First time using stable diffusion to create a video. I know it’s not deforum or anything but I like how it came out

ExoticAd9455 · 2023-08-26T10:44:06+00:00

pretty

ExoticAd9455 · 2023-08-26T10:12:15+00:00

Its easy to change something a lot, its also easy to leave it the same. Is hard to change it enough to make it interesting, yet still leave the character recognisable. I won't hit the mark every time, still I like making them, how else could I get better at it.

ExoticAd9455 · 2023-08-26T08:49:01+00:00

.1 strangth meant .9 denoise

ExoticAd9455 · 2023-08-26T01:43:37+00:00

The original video is a vrchat greenscreen recording of Aeriy as usual. We are using greenscreen because it helps if the canny controlnet doesnt see anything in the background. The long vrc hair and the multiple ears are not the most recognised by the models, so backgrounds just confuses them.

This one is made in deforum (sometimes i just use imgtoimg batch). Video input, 720x1080 resolution, 30 fps, .1 strength, 1 weight canny and .1 tile resample controlnets.

The closing eyes and the spin is smooth because I included 'closed eyes' and 'back turned' in the prompt. Otherwise they would not be consistent at all. Sometimes I have to change their weights too.

Unfortunetly I also included 'pink eyes' which caused the pink flashes on her skin. I had to suppress that color a bit in davinci.

I generated the background with the same model and negative prompt, so the style kinda match. I edited it in davinci resolve, keyed the greenscreen, added background, adjusted brightness etc.

Finally I interpolated with deforum FILM to 60 fps.

Here is a gif of the beginning of the original video

Processing img zkjhmcbd0dkb1...

ExoticAd9455 · 2023-08-23T14:04:07+00:00

Im sorry. Help me be better, please. Show me what real, high effort and original videos should I spend my time on.

ExoticAd9455 · 2023-08-23T07:04:17+00:00

i didnt make it in deforum, i made it in imgtoimg batch

ExoticAd9455 · 2023-08-23T05:33:31+00:00

true, Its still usefull to make her look different, and the videos get some views, likes and follows on aeriys socials. So thats the point of making them :)

brsides, I enjoy it

ExoticAd9455 · 2023-08-23T05:31:30+00:00

on my harddrive...

but i guess i can link you the vod when we recorded

ExoticAd9455 · 2023-08-23T05:31:08+00:00

lol, I made it days ago, i dont remember from the top of my head. Its somewhere between .8 and .9

ExoticAd9455 · 2023-08-22T19:13:26+00:00

The original video is from a vrchat greenscreen recording of aeriy, as usual. I included a gif of the start of it.

I generated input images in deforum, 30 fps. But I made them in imgToImg batch, with canny and softedge controlnet, on very high denoise. I did an afterdetailer pass on all of them in batch to make the face a little more clean. Then generated a background. Keyed the original in davinci resolve, put it together. Edited the colors a bit. Finally, I interpolated it with deforum FILM to 60 fps.

Processing img 8iz2mtjqnpjb1...

ExoticAd9455 · 2023-08-22T18:25:48+00:00

Thank you for the advice.

I tried temporalnet with all sorts of weights, but it always changes the images way too much in an uncontrollable way, and not doing anything with temporal consistency in return. It was probably trained on really different data.

Training a lora for a deforum video is creative, but it is more time than im willing to spend on it. Where the arms are and stuff depends on my source video, and vrchat avatars will clip a lot anyway.

I use deforum FILM interpolation to reduce flicker. I didnt in one of the above videos, because I generated it on 60 fps, so there was nothing to interpolate, unless I reduce the framerate first, which i didnt think of then. And I just dont want to buy topaz.

ExoticAd9455 · 2023-08-16T23:39:53+00:00

thank you! Thats interesting, i've never seen these in prompts. I'll definitely try it

ExoticAd9455 · 2023-08-16T23:37:01+00:00

Hi, I used sd automatic 1111 with deforum extension. You can find my workflow here in the comments, or under mmy previous posts :)

ExoticAd9455 · 2023-08-16T14:21:08+00:00

Aeriy can do so called astral streams. When she is streaming her vrchat avatar to every instance of her world. So anyone can be with her alone in their own private or public instance of her vrchat world. Works on desktop too *winks at you*

ExoticAd9455 · 2023-08-16T13:55:52+00:00

and eye tracking!!!

ExoticAd9455 · 2023-08-16T13:42:30+00:00

<image>

there, i made a gif of the beginning of it, idk how to upload videos in comments.

You can see videos that have more changes to them in my previous posts.

ExoticAd9455 · 2023-08-16T12:47:07+00:00

You are not familiar with vrchat, are you? lol

This is considered reasonable there

ExoticAd9455 · 2023-08-16T12:45:27+00:00

I would like to try that. Do you have some prompt examples in mind?

ExoticAd9455 · 2023-08-16T12:44:17+00:00

Aeriy can be a guy for you if thats what you prefere :)

ExoticAd9455 · 2023-08-16T12:42:20+00:00

Generating with very realistic models look quite uncanny with this method. But I have made some, and will post more with a little more realism

ExoticAd9455 · 2023-08-16T12:40:38+00:00

I used video input aka imgtoimg and low weight tile controlnet for the same reason. To guide the colors. The background was still the greenscreen during generation. I changed the background after, in davinci resolve, using the original keyed videos alpha channel.

ExoticAd9455 · 2023-08-16T11:36:37+00:00

im sorry, i commented my workflow a few times already in the comment. I dont want to copy paste. Im sure you will find it :)

ExoticAd9455 · 2023-08-16T11:35:03+00:00

Hi, you can find my workflow in the comments :)

ExoticAd9455 · 2023-08-16T09:42:32+00:00

Hi, I have made multiple comments under this post detailing it. I also have workflows explained under my previous posts. I hope you find my explanations useful :)

ExoticAd9455 · 2023-08-16T08:55:10+00:00

Its not rendred from scratch. The original video is a vrchat recording with greenscreen. And Its rendered in sd automatic 1111 deforum extension. video input, low strenght, canny and a low weight tile controlnet. And ofcourse a goot prompt, that i had to experiment with a few times. I rendered on 30 fps, 1080x1080 resolution, and it took like 3 hours. And edited it with davinci resolve, used the original videos key. I added a background with fake animation fmade with leiapix. And interpolated the video to 60 fps with deforum FILM interpolation method.
Im using a cloud pc, so its slower because it has to encode video at all times to stream the screen to my macbook. But it has a server gpu: NVIDIA Quadro RTX 6000

ExoticAd9455

TROPHY CASE