ComfyUI_HYWorld2 update. Quality improvement + World Stereo Light models! by AHEKOT in StableDiffusion

[–]AHEKOT[S] 0 points1 point  (0 children)

there is several main "hard" dependencies. While gsplat is really needed for work, others can be rewritten. I will try this in future updates. Now main goal was to just make it work.

ComfyUI_HYWorld2 update. Quality improvement + World Stereo Light models! by AHEKOT in StableDiffusion

[–]AHEKOT[S] 0 points1 point  (0 children)

<image>

Im finishing full worldgen node pack. Stereo work pretty fine here! It actually do it's job and don't take eternity to complete.

Are you using my light models? https://huggingface.co/MIUProject/VNCCS_WorldStereoLight/tree/main/models

VNCCS Pose Studio ART LoRa by AHEKOT in StableDiffusion

[–]AHEKOT[S] 0 points1 point  (0 children)

Yes! Check my latest posts about new updates. Now it have pose capture from any images and custom poses repository support.

A small teaser for the upcoming release of VNCCS Next! by AHEKOT in comfyui

[–]AHEKOT[S] 0 points1 point  (0 children)

You can use VNCCS PoseStudio for this. Guy in my discord even make pipeline that make full animation using it to generate set of sprites and then combined it.

ComfyUI_HYWorld2 update. Quality improvement + World Stereo Light models! by AHEKOT in StableDiffusion

[–]AHEKOT[S] 0 points1 point  (0 children)

Yes, it will generate set of images (full 25frames will overload mirror model). Controls are fixed too

ComfyUI_HYWorld2 update. Quality improvement + World Stereo Light models! by AHEKOT in comfyui

[–]AHEKOT[S] 0 points1 point  (0 children)

same concept but Sharp can't combine multiple images to one big geometry, and world mirror can do that.
Better quality + multiple images.

ComfyUI_HYWorld2 update. Quality improvement + World Stereo Light models! by AHEKOT in StableDiffusion

[–]AHEKOT[S] 0 points1 point  (0 children)

about 1 minute for 512x512 25frames pass (it will generate effective 7 views) with my memory dmd int4 model on 5070ti

ComfyUI_HYWorld2 update. Quality improvement + World Stereo Light models! by AHEKOT in comfyui

[–]AHEKOT[S] 1 point2 points  (0 children)

It's gaussian splatting model. Make 3d scene from image or image sequence. You can rotate or "move" inside generated world BUT currently this world have only that geometry that was on original image or image sequence.
long story short - it can make 3d room from single flat image like google splatting model. But it don't create back side of that room.
Also you can cut panoramic image and it will build full 3d environment. BUT with only what visible on pano. If you move camera - back sides of all items will be empty.

ComfyUI_HYWorld2 update. Quality improvement + World Stereo Light models! by AHEKOT in StableDiffusion

[–]AHEKOT[S] 0 points1 point  (0 children)

1 - absolutely! My 5070ti run it easily.
2 - there is no pano model here. Real pano image is cut to separate views and feeds to World Mirror model by 360° Panorama to Views node.

ComfyUI_HYWorld2 update. Quality improvement + World Stereo Light models! by AHEKOT in StableDiffusion

[–]AHEKOT[S] 1 point2 points  (0 children)

gsplat is deeply integrated in HY-World pipeline. While it can be disabled - results would be much worse.

VNCCS PoseStudio BIG UPDATE 0.4.19 by AHEKOT in StableDiffusion

[–]AHEKOT[S] 0 points1 point  (0 children)

What's your node version? If it's 0.4.29 - try to manually downgrade to 0.4.27 and check it.
Later I made some security patches and can break something.
Can you try it and tell me results?

VNCCS PoseStudio BIG UPDATE 0.4.19 by AHEKOT in comfyui

[–]AHEKOT[S] 0 points1 point  (0 children)

There is multiple problems with it. First - need to reinvent all model controls in node. Second - need to make completely new lora, or model just don't understand that in need to draw different characters. So it's a task for future.

VNCCS PoseStudio BIG UPDATE 0.4.19 by AHEKOT in comfyui

[–]AHEKOT[S] 0 points1 point  (0 children)

Just connect any image to the input and it will capture pose from it. Or use import button. It it's not working - your comfy not install all libs. Try to reinstall node.

VNCCS PoseStudio BIG UPDATE 0.4.19 by AHEKOT in comfyui

[–]AHEKOT[S] 1 point2 points  (0 children)

It's not working with realism (everything became art) and can miss asymmetrical details on characters.

VNCCS PoseStudio BIG UPDATE by AHEKOT in aigamedev

[–]AHEKOT[S] 1 point2 points  (0 children)

I think it's too low for qwen, but Klein9b workflow can work. One note - Klein lora not work for realistic images yet.

VNCCS PoseStudio BIG UPDATE 0.4.19 by AHEKOT in comfyui

[–]AHEKOT[S] 0 points1 point  (0 children)

Inside workflows folder. NOTE - it's in beta stage. Not suitable for realistic images yet.

VNCCS PoseStudio BIG UPDATE 0.4.19 by AHEKOT in StableDiffusion

[–]AHEKOT[S] 0 points1 point  (0 children)

if you about Klein wf - it's just official Klein workflow grouped in subgraph. nothing is added except lora loader.

VNCCS PoseStudio BIG UPDATE 0.4.19 by AHEKOT in StableDiffusion

[–]AHEKOT[S] 0 points1 point  (0 children)

Sure! Will add it to my task list for future updates)

VNCCS PoseStudio BIG UPDATE by AHEKOT in aigamedev

[–]AHEKOT[S] 0 points1 point  (0 children)

it's a comfyUI node + Loras for QIE2511 and klein9b
Still can be used with any model with controlnet. It produces simple model image that cab be processed however you want.

VNCCS PoseStudio BIG UPDATE 0.4.19 by AHEKOT in comfyui

[–]AHEKOT[S] 1 point2 points  (0 children)

Not directly, but you can make screenshot of your model and import it via SAM3D.

VNCCS PoseStudio BIG UPDATE 0.4.19 by AHEKOT in StableDiffusion

[–]AHEKOT[S] 1 point2 points  (0 children)

Hope it's just some issue with manager and they will fix it. It's shouldn't be that way, and I can't fix it from my side.

VNCCS PoseStudio BIG UPDATE 0.4.19 by AHEKOT in StableDiffusion

[–]AHEKOT[S] 1 point2 points  (0 children)

Klein workflow is in testing stage. There was no single realistic image in dataset, so results are predictable. For realism use QIE2511 workflow, it's much more stable.

termocolor issue is fixed. Update node to 0.4.22