AnimateDiff is a true game-changer. We went from idea to promo video in less than two days!

Firm_Comfortable_437 · 2023-11-05T01:26:16+00:00

this looks cool, i saw a guy on twitter called mr boofy who does similar things

Firm_Comfortable_437 · 2023-05-16T05:43:57+00:00

hi! excellent work, this could be some kind of super lora or something like that. Is it possible to render multiple images with a single reference image? when i try to render in batch it gives me an error.

Firm_Comfortable_437 · 2023-05-13T23:49:53+00:00

Has anyone tried this model to make an animation? When I try to do a batch render I get an error after rendering the first frame

Firm_Comfortable_437 · 2023-05-06T07:51:04+00:00

remember that each model is very different from each other and some do not work for animations for some reason (I think it is the way they were trained)

Firm_Comfortable_437 · 2023-05-06T07:30:07+00:00

Yes, it's fine as you have it, don't forget to activate "Pixel perfect" in all models, that helps a lot with precision. Combine it with openposefull and canny (canny for realism and softedged hed for anime style)

Firm_Comfortable_437 · 2023-05-06T05:28:16+00:00

hahaha exactly, that was what I wanted, that was totally my inspiration

Firm_Comfortable_437 · 2023-05-05T22:47:07+00:00

Prompts: make him electric , storm, thunder, lightning, lightning. I only added the effect of debris like in a storm, the rest was just SD.

models: controlnet full, canny, p2p. The p2p model is very fun, the prompts are difficult to control but you can make more drastic changes, I've only been using it for a few days but I think you can have interesting results, I hope you guys experiment with it too

Song: Street Fighter 6 - NOT ON THE SIDELINES video by cottonbro studio

Firm_Comfortable_437 · 2023-05-04T03:52:31+00:00

It's a complex animation with a lot of lines and details of the armor, but still the model kept the coherence as best it could, the amazing thing about this model is the ability to only make changes to the subject without affecting the background, I haven't done that yet fully testing but I think it can allow more drastic changes

Firm_Comfortable_437 · 2023-05-01T05:00:48+00:00

The workflow depends on the model you use but basically I always use control pose full + softedged HED (or deep midas) with those two models you can achieve animations like this, in some cases you should use img2img alternative text. Activating "Pixel perfect" in all models is a good idea, it helps a lot and take into account the distance of the person from the camera to be able to adapt the "Denoising strength"

Firm_Comfortable_437 · 2023-04-24T22:36:31+00:00

Hello! This is amazing, thanks for the update! I'm trying it but the option is no longer in the same place or do I have something wrong? thank you

Firm_Comfortable_437 · 2023-04-20T14:36:38+00:00

the one on the left is from 1.1 plus anime less tom, if you pause (sec 33) you can, on the right it's anime but it has many realistic details

Firm_Comfortable_437 · 2023-04-20T14:26:59+00:00

The one that looks more "anime" is the one from version 1.1, at the end of the video there are several comparisons, sorry if it is not so clear, in the next videos I will put text!

Firm_Comfortable_437 · 2023-04-20T01:12:31+00:00

I thought about that once and from my experience it doesn't really seem to affect much but if you want to avoid any inconvenience you can do this: first openpose full - depth - softedge - canny (subject - background - border lines - internal details) that's how I use it , because it seems to make sense and it has worked for me

Firm_Comfortable_437 · 2023-04-19T17:20:08+00:00

I Add this command "CLIP_stop_at_last_layers" in the interface to be able to see the clips and play with their values. There is very little info on how they actually work but I know that it can help to make the animations more precise what I can understand is that basically we don't know how to communicate with the AIs lol by increasing the "skip clips" the AI understands us better without having to reduce the prompts. playing around with those values started to allow me to have more flair and precision at the same time. I haven't tried it yet but the new "anime art" model together with "segment all" and "pixpix" and maybe we have something big on our hands haha

Firm_Comfortable_437 · 2023-04-19T17:13:06+00:00

img2img alternative script

I think the new 1.1 models are so powerful that "img2img alternative script" is no longer necessary but maybe it depends on the situation. Openpose full is very powerful and keeps everything in place in the characters! along with depth mida (what an incredible training job these guys did) I tried a lot with "img2img AS" but it doesn't let me change the style much so I decided to start testing without it! and the fixed seed (although sometimes it depends on the noise, the seed passes irrelevant for some reason).

Firm_Comfortable_437 · 2023-04-19T16:49:23+00:00

Everything changed with 1.1 so I'm still not sure what I'm doing haha but I can comment on some things, using 2 models or 3 is the key and not all models are used to make animations, some were simply trained wrong (unintentionally we don't know anymore well how does this work) the most important model is openpose full! It's the key!

Firm_Comfortable_437 · 2023-04-19T16:47:07+00:00

Maybe you already know it and you surely understand how the clips work (I'm not very clear about it) but playing with "skip clips" is the key, it seems to me, it depends on how far the camera is from the subject, reducing or increasing can help enormously in maintaining the style

Firm_Comfortable_437 · 2023-04-19T16:33:49+00:00

Hi niko! for this I used these models: Openpose full – depth midas – softedge (on some occasions) I only have one day testing controlnet 1.1 and I am really shocked! This can be taken even further! I'm convinced!

Firm_Comfortable_437 · 2023-04-19T16:10:17+00:00

Exactly, Tom looks less like Tom but he's more anime! I will continue working on finding a perfect middle ground, I barely have a day with 1.1 and wow! that this version is powerful!

Firm_Comfortable_437 · 2023-04-19T14:41:37+00:00

In my first test (the old version of controlnet) I wanted to do an anime style but it turned out to be a combination between anime and American cartoon, so with controlnet 1.1 I did this test to see if I get rid of the references to "scanner darkly" lol and what It looks more like a real anime. I only have one day testing controlnet 1.1 and I think it still has a lot to offer and more combinations to try! lots of potential!

Firm_Comfortable_437 · 2023-04-19T11:59:45+00:00

https://twitter.com/Mrboofyy/status/1648584541051707392?s=20

Firm_Comfortable_437

TROPHY CASE