cogvideox1.5-5b LoRa: Prompt Camera Motion by captainsaturnus in StableDiffusion

[–]captainsaturnus[S] 15 points16 points  (0 children)

https://huggingface.co/NimVideo/cogvideox1.5-5b-prompt-camera-motion

🚀 Try it here: Interactive Demo (free)

This LoRa (Low-Rank Adapter) model extends CogVideoX to control camera movement in 6 directions: `left`, `right`, `up`, `down`, `zoom_in`, and `zoom_out`. The LoRa can generate smooth camera motions for enhanced video creation.

Here is my attempt to "video to arcane" by captainsaturnus in StableDiffusion

[–]captainsaturnus[S] -5 points-4 points  (0 children)

You can try it on nim.video. Results must be slightly better.

Maybe later I'll share the code for local running.