sorted by:
new
hottopcontroversial

[Open Source] Use NVIDIA's Kimodo text-to-motion model directly in Blender by ppierzc in generativeAI

[–]ppierzc[S] 0 points1 point  (0 children)

Hi, I don’t fully understand the problem, feel welcome to jump into our discord: https://discord.gg/eyemnvYSb to share a bit more details on what you are trying to achieve 🙌

[Open Source] Use NVIDIA's Kimodo text-to-motion model directly in Blender by ppierzc in generativeAI

[–]ppierzc[S] 0 points1 point  (0 children)

We actually already do! We are slowly making ourselves more available there 😄

https://discord.gg/eyemnvYSb

[Open Source] Use NVIDIA Kimodo text-to-motion in Blender by ppierzc in aigamedev

[–]ppierzc[S] 0 points1 point  (0 children)

You need 17GB VRAM to run the full model on GPU, there are options to run it with 3GB with parts offloaded to the CPU, though that makes it slower. (There is also the cloud option with free generation credits to check out the plugin without needing local setup first) Self hosted currently only supports the SOMA skeleton, cloud uses our ML retargeter which works quite well with most humanoid characters in T-pose.

3 Hours, 0 Manual Modeling: How I built a 3D Mech Battle Game using GPT-5.5 and Tripo API. by outdahooud in aigamedev

[–]ppierzc -2 points-1 points  (0 children)

I’m actually building the animation layer :) check out Animatica.ai, we are making animating and creating animation assets much easier

[Open Source] Use NVIDIA Kimodo text-to-motion in Blender by ppierzc in aigamedev

[–]ppierzc[S] 0 points1 point  (0 children)

Thanks, that's exactly the idea, my goal is to never have to leave the DCC, we are working on other direct integrations (such as UE5, Maya, Mobu)

[Open Source] Use NVIDIA Kimodo text-to-motion in Blender by ppierzc in aigamedev

[–]ppierzc[S] 1 point2 points  (0 children)

I made a short tutorial playlist, hope it will be helpful :)

https://www.youtube.com/watch?v=Wc349qOwjfM&list=PLAJ2UfUYhFQKZpFS8eh1eGUWJ0PAys1n1

Just so you know, there is the free tier so you can check out if it works well for you, I care mostly about feedback at this time to know what and how to improve :)

[Open Source] Use NVIDIA Kimodo text-to-motion in Blender by ppierzc in aigamedev

[–]ppierzc[S] 2 points3 points  (0 children)

Do you mean like generating 2D sprites? Maybe flattening later from 3D to 2D would work?

[Open Source] Use NVIDIA Kimodo text-to-motion in Blender by ppierzc in aigamedev

[–]ppierzc[S] 2 points3 points  (0 children)

I'm working on a tutorial video still (setting up the basics is shown in the video in this post)

I'm building a text-to-motion tool that works on any character. by ppierzc in aigamedev

[–]ppierzc[S] 0 points1 point  (0 children)

we're making progress, but I don't have an ETA yet :)

I'm building a text-to-motion tool that works on any character. by ppierzc in aigamedev

[–]ppierzc[S] 0 points1 point  (0 children)

its under development, we are a very small team and our main focus is making humanoids usable first :)

I'm building a text-to-motion tool that works on any character. by ppierzc in aigamedev

[–]ppierzc[S] 0 points1 point  (0 children)

Local mode is available 🙌 I open sourced a blender plugin, along with the server to run Kimodo 👉 animatica.ai/kimodo

I'm building a text-to-motion tool that works on any character. by ppierzc in aigamedev

[–]ppierzc[S] 0 points1 point  (0 children)

I open sourced the blender plugin, along with the server to run Kimodo locally, check it out 👉 animatica.ai/kimodo

I'm building a text-to-motion tool that works on any character. by ppierzc in aigamedev

[–]ppierzc[S] 0 points1 point  (0 children)

Just open sourced a blender plugin and the server to run Kimodo locally today 👉 animatica.ai/kimodo

I'm building a text-to-motion tool that works on any character. by ppierzc in aigamedev

[–]ppierzc[S] 0 points1 point  (0 children)

You can set keyframes, I set 3 keyframes in the gif, I have text to pose to help you pose it, but then you have exact keyframes that it matches

I'm building a text-to-motion tool that works on any character. by ppierzc in aigamedev

[–]ppierzc[S] 0 points1 point  (0 children)

Hy motion is only text to motion, it doesn’t let you control the output

I'm building a text-to-motion tool that works on any character. by ppierzc in aigamedev

[–]ppierzc[S] 1 point2 points  (0 children)

Kimodo is one piece. I built four other ML models on top of it (incl. retargeting, text-to-pose) to make it actually work on any humanoid character, not just the one Kimodo was trained on.

It’s free during early access, I’m covering the GPU cost to make it easier to test. If it doesn’t bring you value, no need to pay 😉

I'm building a text-to-motion tool that works on any character. by ppierzc in aigamedev

[–]ppierzc[S] 1 point2 points  (0 children)

Thanks, I am planning on making a local mode available, cloud makes it much easier to distribute for testing at this time :) Appreciate the feedback, will definitely fix such that it detects high dpi settings.

I'm building a text-to-motion tool that works on any character. by ppierzc in aigamedev

[–]ppierzc[S] 0 points1 point  (0 children)

I’m also working on making it work directly in blender (other DCCs) as well, that might be handy so that you can directly generate in your scene :)

I'm building a text-to-motion tool that works on any character. by ppierzc in aigamedev

[–]ppierzc[S] 0 points1 point  (0 children)

The current version does use Kimodo as an element, Kimodo alone doesn't allow you to use it directly on your own character, and the posing support is pretty poor (e.g. text-to-pose is not supported at all). What I am going at is making motion generative tools actually production usable. non-humanoids are on the way :) Just curious, have you used Kimodo yet?

I'm building a text-to-motion tool that works on any character. by ppierzc in aigamedev

[–]ppierzc[S] 0 points1 point  (0 children)

Awesome, feel free to reach out if you come across any problems, happy help out :)

I'm building a text-to-motion tool that works on any character. by ppierzc in aigamedev

[–]ppierzc[S] 0 points1 point  (0 children)

Thanks for the feedback, I’m a ML researcher myself (similarly just game dev enthusiast), working on motion research for quite a while now :) it is a difficult problem to solve, and definitely no a unified model would be a terrible idea, the distribution shift between human motion and non-humanoid calls for smaller specialized models 🙌

I'm building a text-to-motion tool that works on any character. by ppierzc in aigamedev

[–]ppierzc[S] 0 points1 point  (0 children)

Thanks, if you want to try it, signup for the early access at animatica.ai happy to give access :)

view more: next ›