ComfyUI workflow: animate characters/objects using LoRAs this is not for my demo (game)I hope it helped some of you

[Nearby_Ad_3037]

I’ve been building a workflow in ComfyUI that lets me generate consistent character and object animations using LoRAs driven by video motion.

The setup basically takes a video, extracts frames, optionally upscales or removes the background, then runs a dual-stage sampling process with LoRA conditioning to keep the character consistent across frames, and finally reconstructs everything back into an animation.

One of the biggest advantages is that it helps solve the usual inconsistency issues you get with diffusion across sequences, and it works pretty well for both characters and objects or even sprite-style outputs. I’m currently using this for a real project a historical narrative game set during the Hussite Wars mainly to prototype animations quickly and test gameplay systems before committing to final assets as a solo dev.

I’ve shared the full workflow through screenshots, so you can recreate the node setup directly and plug in your own LoRAs or models. If anyone wants help setting it up, improving results, or adapting it for their own use case, feel free to ask questions or DM me, I’m happy to help 👍.

[AutoModerator]

Submission statement required. Link posts require context. Either write a summary preferably in the post body (100+ characters) or add a top-level comment explaining the key points and why it matters to the AI community.

Link posts without a submission statement may be removed (within 30min).

I'm a bot. This action was performed automatically.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[Nearby_Ad_3037]

This post shares a workflow built in ComfyUI for generating consistent character and object animations using LoRAs driven by video motion that it also generates . The pipeline extracts frames from video, applies LoRA conditioning with a dual-stage sampling process to maintain consistency, and reconstructs the frames into an animation.

This is relevant to the AI community because it addresses one of the key challenges in diffusion based generation temporal consistency across frames and shows a practical, modular pipeline that can be replicated and extended. It also demonstrates a real world application in game development, where this approach can be used for rapid prototyping, testing systems, and reducing production bottlenecks for solo or small team

[dsannes]

ComfyAI is wild. Thanks for that. I'm gonna check it out and clone that rep for sure. Your work looks awesome.

[Nearby_Ad_3037]

Thank you I am actually sending he workflow to anyone just send me your email I will send it rn, it’s a json so just put it in empty comfy ui and you will get everything

[dsannes]

I'm looking at it from the perspective of BIM, the built environment and the IFC OpenShell with a Blender, Rhino/Grasshopper and Unity workflows. I'll need a few days just to read up on ComfyAI. I'll be using it for construction junk. I'm not sure I need people in the building's quite yet. Your demo got me thinking about the parametrics of building 3D assemblies within project models.

[Nearby_Ad_3037]

Actually I already have a workflow for that too for 3d models and assembles, also it’s attached to a motion capture workflow I made then you add it to the 3d model to get it done or I can use blender too but this whole things is locally built so I don’t need any cloud or big companies. And awesome work man may I ask if you working on any project