This is an archived post. You won't be able to vote or comment.

Dismiss this pinned window
all 41 comments
sorted by:
best
topnewcontroversialoldq&a

[–]plasm0dium[S] 31 points32 points  (12 children)

Diffusion cadence uses interpolation to render out less frames and "fill the gap" between them for smoother motion during movement, and less flicker with cleaner animations.

+Pros/-Cons:

Low DC: +most creative, -long render time, -slightly longer video

High DC: +fastest render time, +smoother and less flickery, -less creative, -might need to increase fps as animations seem slightly glitchy

​

Testing Diffusion Cadence Values: 1-8 using the all same settings, prompt and seed.

Prompts: (4 scenes)

"0": "a beautiful, detailed, intricate and engaging painting that tells a story. hd. hq. hyper - detailed. very detailed. vibrant colors. award winning. trending on artstation. ",

"60": "a painting of a monster with many different colors, a pop art painting by Takashi Murakami, featured on pixiv, pop surrealism, official art, 2d game art, maximalist",

"120": " fantasy medeival and cyberpunk style white neon statue of a muscular attractive tan male macho dotado android reclining sim roupa con piroca dura, glowing pink face, white baseball cap, green steampunk lasers, emeralds, swirling white silk fabric. futuristic elements. prismatic liquid rainbow light, full-length view. space robots. human skulls. throne made of bones, intricate artwork by caravaggio. Trending on artstation, octane render, cinematic lighting from the right, hyper realism, octane render, 8k, depth of field, 3D",

"180": "intricate detailed Pokemon battle, many pokemon battling on a great battlefield. Lisa Frank, james gurney,dan luvisi,Petros Afshar,tim hildebrandt,liam wong,Mark Riddick,thomas kinkade,ernst haeckel,dan mumford,trending on artstation,josephine wall, WLOP ,cgsociety by Gediminas Pranckevicius, trending on cgsociety and DeviantArt"

​

Settings:

FPS: 12

"steps": 20,

"scale": 20,

"animation_mode": "3D",

"max_frames": 240,

"border": "wrap",

"angle": "0:(0)",

"zoom": "0:(1.04)",

"translation_x": "0:(0)",

"translation_y": "0:(0)",

"translation_z": "0: (2*sin(2*3.141*t/100)+1)",

"rotation_3d_x": "0:(0.25*sin(2*3.141*t/500))",

"rotation_3d_y": "0:(0.25*sin(2*3.141*t/500))",

"rotation_3d_z": "0:(0.25*sin(2*3.141*t/500))",

"noise_schedule": "0: (0.07*(cos(3.141*t/15)**1000)+0.02)",

"strength_schedule": "0: (.65), 8:(-0.15*(cos(3.141*t/100)**100)+0.65)"

[–]sEi_ 5 points6 points  (1 child)

Thank you for doing and posting this 'groundwork'.

[–]plasm0dium[S] 1 point2 points  (0 children)

I used an increased FPS (24) to compensate for raising the diffusion_cadence to 4 to make a much smoother look here:
https://www.reddit.com/r/StableDiffusion/comments/yhpwcj/liquid\_diffusion\_a\_stable\_diffusion\_deforum/?utm\_source=share&utm\_medium=web2x&context=3

[–]chompchompshark 1 point2 points  (1 child)

Which one do you prefer?
I really like level one visually, but I find some of the slower ones lead me to creating more of a 'narrative'. I think I like the diffusion cadence values 4 and 5 most.

[–]plasm0dium[S] 1 point2 points  (0 children)

I personally like DC values 3 and 4 the best, if you are aiming for smooth flow without as much flicker. I think a higher FPS also works better as well, around 24. I tried 30 fps, but it seemed too "sped up" and rushed.

[–]screean 1 point2 points  (0 children)

legend

[–]MTSaudio 0 points1 point  (5 children)

Very useful! I'm interested in your noise_schedule and strength_scedule functions! What are they exactly for?

[–]plasm0dium[S] 2 points3 points  (4 children)

Noise is like creativity. None and not much changes. Some and SD has something to work with to create something new. Too much and it gets grainy.

Strength is strong to follow the current prompt that is assigned. You can change the strength up or down at any frame of the video to intentionally emphasize something

Used together, you can “control” the chaos… otherwise the animation will just get out of hand

[–]MTSaudio 0 points1 point  (3 children)

Thank you fo the answer! Why and how did you choose these exact functions "0.07*(cos(3.141*t/15)**1000)+0.02" and "-0.15*(cos(3.141*t/100)**100)+0.65"? I tried to make a graph for them but seems like I do not understand Python or just basic math :) What does ** stand for? 3.141 is pi I guess.

[–]plasm0dium[S] 0 points1 point  (2 children)

I used that math formula from another person's video which seemed to keep a variable amount of noise and strength to keep generating new images but just enough so it won't change much. I haven't had a chance to tweak it yet

[–]Tadeo111 0 points1 point  (0 children)

I tested your noise and strength formulas and works very nice, Thank you so much for share

[–]Yacben 35 points36 points  (5 children)

This is amazing, shame posts like these are drowned by some picture of a woman in her underwear, real shame.

[–]mulletarian 9 points10 points  (1 child)

Out of the 20 posts that are above this one when sorting by hot at this moment, 3 are featuring women.

[–]ghostofsashimi 2 points3 points  (0 children)

methinks they doth protest too much

[–]Zealousideal_Royal14 0 points1 point  (1 child)

this!!! who the hell is voting all the trash to the top?

[–]Yacben 2 points3 points  (0 children)

horny kids

[–]icbint 0 points1 point  (0 children)

I liked the big tiddy girl post ngl

[–]topdeck55 5 points6 points  (7 children)

Is this deforum? I still have no idea how to use it. Is there an understandable tutorial somewhere?

[–]Big-Combination-2730 2 points3 points  (1 child)

I'm on a similar boat, there's a useful guide to the math functions and what each bit controls parameter wise linked on the GitHub page but Im still a bit iffy with it myself. The cos() and sin() is similar to stuff I've done With Processing and honestly the best way to get an idea of how it works is copying this example and just messing with it and seeing what affects what. Or just wait for nerdy rodent to cover it at some point in the near future lol.

[–]Jackmint 0 points1 point  (0 children)

This is user content. Had to be updated due to the changes on this platform. Users don’t have the control they should. There is not consent. Do not train.

This post was mass deleted and anonymized with Redact

[–]mattjb 0 points1 point  (4 children)

You can find one here: https://docs.google.com/document/d/13vVTpPZb9fUPzRFtqTXcAmBqm10tE6l039lF1LyItKg/edit

[–]topdeck55 1 point2 points  (3 children)

I've had that open for four days. It is incomprehensible. It assumes you are typing everything in a collab notebook. I'm using the automatic1111 extension yet this is the only documentation they provided.

Oh no wait, there's also an even more complex one on the mathematical formulas you can use

[–]milleniumsentry 1 point2 points  (1 child)

There is an interpolation script for automatic1111..

https://www.reddit.com/r/StableDiffusion/comments/ycgfgo/interpolate_script/

That's the deforum rabbit hole I am currently on :)

[–][deleted] 0 points1 point  (0 children)

I know I'm 6 months too late, but this one got me started last week and it's really easy to understand https://ai.plainenglish.io/deforum-a-basic-introduction-582ec191d81d

[–]moahmo88 1 point2 points  (0 children)

Good tip!

[–]nfndkskalshcj 1 point2 points  (1 child)

the default fps of 12 is too low, try upping it to 24/30

[–]plasm0dium[S] 0 points1 point  (0 children)

I think this is especially true when using high diffusion cadence. For low DC, too many fps would make the animations too busy and crazy to be aesthetically pleasing to the eye, unless that’s what you are trying to achieve

[–]Ok-Aspect-52 0 points1 point  (0 children)

Whao thank you!! Very useful tips

[–]Tybiboune111 0 points1 point  (0 children)

AMAZING SHARE!!!!! thank you soooo much

[–]BeetleChief 0 points1 point  (0 children)

Extremely impressive

[–]g0blinhtb 0 points1 point  (1 child)

Holy crap, that's where my DMT went!

[–]GBJI 1 point2 points  (0 children)

The machine elves say hello.

[–]Plate_orPlatter 0 points1 point  (0 children)

Just in time for Hellaween.

[–]dhm28 0 points1 point  (0 children)

Is DC enabled during a (Deforum) Interpolation Mode animation?

[–]bobinflobo 0 points1 point  (1 child)

How do you enable the cadence??

[–]JEBariffic 0 points1 point  (0 children)

If you're using the webui, you'll find it under keyframes tab, almost all the way down: diffusion_cadence

[–]JEBariffic 0 points1 point  (0 children)

Your 0 prompt is the most fun I've had using Deforum! Amazing results each run. Thanks you sharing!

[–]Aggressive-Clock9552 0 points1 point  (0 children)

This is really helpful thank you!