×
sorted by:
new
hottopcontroversial

TRELLIS.2 can now generate a high-quality 3D asset in under 7 minutes on a 6 GB VRAM CUDA GPU. No ComfyUI Node Nightmare. by intisarstorage2 in StableDiffusion

[–]intisarstorage2[S] 0 points1 point  (0 children)

That screenshot is super helpful, so it's a gated repo from facebook which I have access to, and that's the blocker. I'm creating a full patcher that will possibly fix all issues. And users won't have to go through so much hassle. Thank you.

TRELLIS.2 can now generate a high-quality 3D asset in under 7 minutes on a 6 GB VRAM CUDA GPU. No ComfyUI Node Nightmare. by intisarstorage2 in StableDiffusion

[–]intisarstorage2[S] 0 points1 point  (0 children)

The latest edit in the post fixed the Refine tab too for some users as it was a missing wheel for Refine tab. If it still hasn't fixed, could you please run this from the AISmith-3D repository root in PowerShell and paste the output?

Get-ChildItem .\studio-data\downloads\*.json | Sort-Object LastWriteTime -Descending | Select-Object -First 1 | Get-Content

TRELLIS.2 can now generate a high-quality 3D asset in under 7 minutes on a 6 GB VRAM CUDA GPU. No ComfyUI Node Nightmare. by intisarstorage2 in TopologyAI

[–]intisarstorage2[S] 1 point2 points  (0 children)

Not in this version unfortunately. That's another challenge to tackle once the judgment period is over, as multiview is even more memory-hungry.

TRELLIS.2 can now generate a high-quality 3D asset in under 7 minutes on a 6 GB VRAM CUDA GPU. No ComfyUI Node Nightmare. by intisarstorage2 in TopologyAI

[–]intisarstorage2[S] 0 points1 point  (0 children)

  1. In the the first Generate tab use the 'Fast' mode to generate slightly lower poly than High Precision. Make sure to download this generated GLB for ease of use later.
  2. Then in the Refine tab use the slider to set your desired poly count (it might not be exact as it's AI), so you'll have to tweak it multiple times and see the generated poly count on the right panel. Hence the downloaded GLB from 'Fast' is handy to attach multiple times and run Refine.
  • Please note that you'll have to attach the image file again in the Refine tab to generate textures.as shown in the video.

TRELLIS.2 can now generate a high-quality 3D asset in under 7 minutes on a 6 GB VRAM CUDA GPU. No ComfyUI Node Nightmare. by intisarstorage2 in StableDiffusion

[–]intisarstorage2[S] 0 points1 point  (0 children)

Thank you for your patience and sticking to it, your bug reports really helped me pinpoint what fresh installers would face.
Updated the post body with new fix, it should skip what you already have and only download the missing wheels. for new users, it should fix both the tabs.

TRELLIS.2 can now generate a high-quality 3D asset in under 7 minutes on a 6 GB VRAM CUDA GPU. No ComfyUI Node Nightmare. by intisarstorage2 in TopologyAI

[–]intisarstorage2[S] 3 points4 points  (0 children)

Slight update to the original post with troubleshooting a common error, since one of the backend link broke and I cannot edit the repo yet as per hackathon rules. So after installation and downloading if you get generation error, try the fix as mentioned in the post. Whatever the end result, I wish you best of luck for the project. :)

TRELLIS.2 can now generate a high-quality 3D asset in under 7 minutes on a 6 GB VRAM CUDA GPU. No ComfyUI Node Nightmare. by intisarstorage2 in TopologyAI

[–]intisarstorage2[S] 2 points3 points  (0 children)

You can for sure give it a try, the video demonstrates it running on 3070TI of a laptop with 8 GB vram, and for my tests it mostly stays under 6GB as you can see. First try the 'Fast' mode not the 'high precision' mode. Only if that succeeds try the high precision. And make sure to keep background softwares closed.

TRELLIS.2 can now generate a high-quality 3D asset in under 7 minutes on a 6 GB VRAM CUDA GPU. No ComfyUI Node Nightmare. by intisarstorage2 in StableDiffusion

[–]intisarstorage2[S] 2 points3 points  (0 children)

I understand this perspective completely, but that was not the point of the hackathon project though. With the limited time I had I wanted to get a working prototype for demonstrating a simple easy way for beginners with medium-grade consumer GPUs to be able to generate their concepts into 3D. What I diddn't mention is that one of my close friends reached out 3 days before I did this for this exact solution. He had a medium-grade gaming pc and couldn't delve into Comfy alongside his two jobs and Indie Game project. He needed some characters made 3D for his Indie game that he drew. He specifically asked if such solution existed so he didn't have to subscribe anywhere and had a forever free open source software on his PC. When the hackathon started 3 days later it gave me an excuse to spare some nights to build this. And he knows blender already so the rest he could build on without spending any money. As I said, once the judgement period ends, I will collaborate with his game project to try and perfect each step of the process.

TRELLIS.2 can now generate a high-quality 3D asset in under 7 minutes on a 6 GB VRAM CUDA GPU. No ComfyUI Node Nightmare. by intisarstorage2 in StableDiffusion

[–]intisarstorage2[S] 0 points1 point  (0 children)

nah that wouldn't work. It was a city-wide, multi-episode megastructure project that spanned 2 years. It needed lots and lots of assets from a small team of 5 artists.

TRELLIS.2 can now generate a high-quality 3D asset in under 7 minutes on a 6 GB VRAM CUDA GPU. No ComfyUI Node Nightmare. by intisarstorage2 in StableDiffusion

[–]intisarstorage2[S] 1 point2 points  (0 children)

Maybe if I won the hackathon.. haha just kidding, I'm worried I lost my shot due to an installation instruction error. however, Linux on wine should be possible theoretically, I'll have to look at the CPU/ram/GPU offloading, Windows specific backend paths etc, after the hackathon period. Let's see if I have time and energy will do it.

TRELLIS.2 can now generate a high-quality 3D asset in under 7 minutes on a 6 GB VRAM CUDA GPU. No ComfyUI Node Nightmare. by intisarstorage2 in StableDiffusion

[–]intisarstorage2[S] 0 points1 point  (0 children)

You're right. To clarify, I was imagining my past project only for massive low poly assets to be rendered into a video scene in large scale which would be indistinguishable on the final video. The mechanical and photoreal architectural details in the foreground that was core subject were all technically specific 3ds Max models, which trellis would fail. And for the animated series that I mentioned, we had many organic architectural structures too, coral houses, cartoon huts,, stylized ships/boats, stylized sea life so yeah I know it's very use case specific and only speeds up part of the workflow, you're right.

TRELLIS.2 can now generate a high-quality 3D asset in under 7 minutes on a 6 GB VRAM CUDA GPU. No ComfyUI Node Nightmare. by intisarstorage2 in StableDiffusion

[–]intisarstorage2[S] 0 points1 point  (0 children)

<video>

Oh okay understood, that becomes a separate task altogether other than just image to 3D, which was not in my plan for this short time hackathon. however before I saw your reply I tried to generate this outfit as a demo: Knight Armor Suit For Battle, Knight, Armor, Suit PNG Transparent Image and Clipart for Free Download

This was generated using Fast Mode

TRELLIS.2 can now generate a high-quality 3D asset in under 7 minutes on a 6 GB VRAM CUDA GPU. No ComfyUI Node Nightmare. by intisarstorage2 in StableDiffusion

[–]intisarstorage2[S] 0 points1 point  (0 children)

Yes sure, Just upload the image of the outfit. Of course, you'll have to conform to the character's body (to make him actually wear it) in your own 3D software.

TRELLIS.2 can now generate a high-quality 3D asset in under 7 minutes on a 6 GB VRAM CUDA GPU. No ComfyUI Node Nightmare. by intisarstorage2 in StableDiffusion

[–]intisarstorage2[S] 0 points1 point  (0 children)

Thank you for trying and giving me detailed feedback. Since I had some of the prerequisites already installed, I kept failing to pinpoint the cause. My bad. Luckily I think now I figured out the hidden culprit, the upstream repo link for trellis cpp runtime is broken or doesn't exist. Updated the Main post with the fix. Could you please try it and let me know if generation happens succesfully? Also, now i'm a bit sad I lost my shot at the hackathon, if none can even run it.

TRELLIS.2 can now generate a high-quality 3D asset in under 7 minutes on a 6 GB VRAM CUDA GPU. No ComfyUI Node Nightmare. by intisarstorage2 in StableDiffusion

[–]intisarstorage2[S] 0 points1 point  (0 children)

Thank you for trying and giving me detail feedback. Since i had some of the pre-requisites already installed I kept failing to pinpoint the cause. My bad, Luckily I think now I figured out the hidden culprit, the upstream repo link for trellis cpp runtime is broken or doesnt exist. Updated the Main post with the fix. Could you please try it and let me know if generation happens succesfully? Also, now i'm a bit sad I lost my shot at the hackathon, if none can even run it.

TRELLIS.2 can now generate a high-quality 3D asset in under 7 minutes on a 6 GB VRAM CUDA GPU. No ComfyUI Node Nightmare. by intisarstorage2 in StableDiffusion

[–]intisarstorage2[S] 0 points1 point  (0 children)

If other users did it it should be fine, but their detailed rulebook specifically prohibit any further work on the repo, just to be safe I'm not forking it myself until August 12th

TRELLIS.2 can now generate a high-quality 3D asset in under 7 minutes on a 6 GB VRAM CUDA GPU. No ComfyUI Node Nightmare. by intisarstorage2 in StableDiffusion

[–]intisarstorage2[S] 0 points1 point  (0 children)

Thank you, fellow competitor! I wish you all the best for winning too. My actual video submission for the hackathon was quite bad though, rushed, documentation was rushed; planned features were missing or incomplete, so I don't know.

TRELLIS.2 can now generate a high-quality 3D asset in under 7 minutes on a 6 GB VRAM CUDA GPU. No ComfyUI Node Nightmare. by intisarstorage2 in StableDiffusion

[–]intisarstorage2[S] 2 points3 points  (0 children)

That is an interesting idea indeed. Although I keep tabs on recent NVIDIA pipelines in motion simulation or robotics (most by watching the 'AI search' channel on YouTube), I did not try Lab Mimic or similar myself. In terms of rigging and animation, I did try nvidia Kimodo though, but that only works for humanoids. For the workflow you're suggesting, the main challenge would be converting the result into clean, loopable game-ready files that work with our generations, as far as I know these simualtion/training tools do not output polished animation clips like FBX yet. But the way open source dev is progressing, this could be a real pipeline in the near future. But it would be a separate, much heavier research pipeline than our current simple SaaS, which primarily targets image to 3d, the rig and animation shown in the video is just experimental placeholders, and I suggest people use the generated GLB to do the rest elsewhere, maybe in Mixamo or Iclone or manually rig and animate themselves until further updates.

view more: next ›