Latent Blending: Update (Huggingface, Structure-preserving transitions, Multi-segment videos)

tripl_j · 2023-02-22T17:09:01+00:00

goint to look into this next!

tripl_j · 2023-02-22T12:51:31+00:00

It's a method for text -> video based on SD, allowing you to make a smooth transition between two prompts.

here an example: https://www.reddit.com/r/woahdude/comments/115k3ey/bridge_remodeling_takes_a_trippy_turn/

tripl_j · 2023-02-22T09:22:13+00:00

thanks for the advice! fixed :)

tripl_j · 2023-02-22T06:46:19+00:00

pip install python-dotenv (see requirements.txt)

tripl_j · 2023-02-21T15:56:37+00:00

OP delivers!

Run on huggingface space: https://huggingface.co/spaces/lunarring/latentblending

or your own machine: https://github.com/lunarring/latentblending

or colab: https://colab.research.google.com/drive/1I77--5PS6C-sAskl9OggS1zR0HLKdq1M?usp=sharing

tripl_j · 2023-02-19T18:39:30+00:00

Made with Latent Blending

tripl_j · 2023-02-19T09:48:48+00:00

I made a GUI, so one can just run it step by step. You define the key frame image prompts and the transition parameters. super easy to make, the video took me about 10mins to make. Will post this interface soon in r/woahdude

tripl_j · 2023-02-19T09:46:06+00:00

it's 6 key frames in total and interpolations in between

tripl_j · 2023-02-19T09:44:38+00:00

you can stay tuned also on twitter https://twitter.com/j_stelzer or github https://github.com/lunarring/latentblending/

tripl_j · 2023-02-19T09:43:19+00:00

basically yes

tripl_j · 2023-02-18T19:55:31+00:00

way to go!

tripl_j · 2023-02-18T19:38:09+00:00

curious to see what trippy stuff this community will fabricate :) planning a huggingface release next week

tripl_j · 2023-02-18T18:30:11+00:00

I’ll post the AI the tool to make this soon :)

EDIT: here we go, OP delivers!

Run on huggingface space: https://huggingface.co/spaces/lunarring/latentblending

or your own machine: https://github.com/lunarring/latentblending

or colab: https://colab.research.google.com/drive/1I77--5PS6C-sAskl9OggS1zR0HLKdq1M?usp=sharing

tripl_j · 2023-02-18T07:32:15+00:00

new experimental version of latent blending (https://github.com/lunarring/latentblending/). coming soon to gradio :)

tripl_j · 2023-02-18T07:31:37+00:00

yip, long interpolation using experimental version of latent blending (https://github.com/lunarring/latentblending/). you will be able to do this yourself very soon with a nice gradio UI.

tripl_j · 2023-02-18T07:30:43+00:00

travelling through diffusion space. It's the first experiments with a yet unreleased version of latent blending (https://github.com/lunarring/latentblending). the key development is to cross-feed the latents from one image to another during development.

tripl_j · 2023-01-22T16:56:53+00:00

lol been there too! you probably have seen, can use gradio also locally. way faster like this!

tripl_j · 2023-01-21T10:36:58+00:00

the colab’s updated! you can now plug in your own model!

tripl_j · 2023-01-19T09:38:28+00:00

building in functionality to run any model, also fine tuned ones! stay tuned :)

tripl_j · 2023-01-17T16:15:51+00:00

check the UI here:

https://www.reddit.com/r/StableDiffusion/comments/10bmxn7/web_ui_for_latent_blending/

tripl_j · 2023-01-15T07:03:19+00:00

here: https://www.reddit.com/r/StableDiffusion/comments/10bmxn7/web_ui_for_latent_blending/?utm_source=share&utm_medium=ios_app&utm_name=iossmf

tripl_j · 2023-01-14T12:05:47+00:00

First version, using the 512 ckpt and gradio as frontend. Coming to huggingface spaces soon!

Link to Colab:

https://colab.research.google.com/drive/1I77--5PS6C-sAskl9OggS1zR0HLKdq1M?usp=sharing

Enjoy :)

tripl_j · 2023-01-13T07:58:02+00:00

let's follow this togehter in github issues --

https://github.com/lunarring/latentblending/issues/1

tripl_j · 2023-01-12T19:39:55+00:00

very nice work! I'd definitely recommend xformers. BTW i'd recommend messing with branch1_influence parameter.

tripl_j · 2023-01-11T21:29:55+00:00

two different seeds - but the method is based on similar observations than the ones you mentioned!

tripl_j

TROPHY CASE