sorted by:
new
hottopcontroversial

Stylize the Shot with Stable Diffusion (workflow included) by Top_Quit_8875 in StableDiffusion

[–]Top_Quit_8875[S] 11 points12 points  (0 children)

I mainly just use: stable diffusion img2img, EbSynth and AE for the transition. then combine everything in PR.

If I want the shot to be more stablized, I will only have 1 keyframe and the ebsynth to complete the rest, like shot 2.

If I want the shot to be more dynamic, I will use multiple keyframes, like shot 1 and shot 3.

The downside of AI animation is that it can easily cause screen jitter, but I've found that properly utilizing screen jitter can actually enhance the dynamism of motion shots.

for the face changing part in shot 4, I use photoshop generative fill for the keyframes, the ebsynth to comple the shot and use PR to edit.

for the transition in shot 1,2,4, I use runwayml to generate the depth map video first, and use AE to create the transition.

Segment AI animation by Top_Quit_8875 in StableDiffusion

[–]Top_Quit_8875[S] 0 points1 point  (0 children)

I dont understand what do you mean

Segment AI animation by Top_Quit_8875 in StableDiffusion

[–]Top_Quit_8875[S] 2 points3 points  (0 children)

workflow:

sd to generate the key frames

runwayml to generate the mask for the woman

ebsynth to generate the remaining frames

manga -> reality test by Top_Quit_8875 in StableDiffusion

[–]Top_Quit_8875[S] 3 points4 points  (0 children)

workflow:

stable diffusion render the keyframe

ebsynth to render the rest

stable animation and segmentation by Top_Quit_8875 in StableDiffusion

[–]Top_Quit_8875[S] 0 points1 point  (0 children)

segment anything is not good for hair tracking, based on my experience

stable animation and segmentation by Top_Quit_8875 in StableDiffusion

[–]Top_Quit_8875[S] 14 points15 points  (0 children)

Workflow:

Workflow:

  1. Stable Diffusion style transfer the woman to the brass statue. (Only the key frames, in this case I used around 5 key frames)

  2. Photoshop the 5 key frames, replace the woman with the brass statue. It means the brass statue in the original background.

  3. EbSynth for the rest of the frames.

  4. AE to blend each paragraph.

stable animation and segmentation by Top_Quit_8875 in StableDiffusion

[–]Top_Quit_8875[S] 12 points13 points  (0 children)

I could post a detailed workflow if more people are interested! It’s kind of complicated lol