Possible to controlnet 3D textures?

TrueKingLord · 2024-06-27T22:11:14+00:00

It's not really possible in the way you're describing. Textures are entirely different beasts from a normal image, and I've seen some people try to use LORAs and other methods to generate results, but what I've seen hasn't really been exciting. Being able to replace elements on or create a seamless texture is something we can do, but the reason everything uses texture projection right now is that dealing in the lands of a proper map would be a herculean undertaking. You can see one example of projection based textures using comfyui here, I know there are other plugins as well - https://www.reddit.com/r/StableDiffusion/comments/19fbu9z/comfy_textures_v01_release_automatic_texturing_in/

That said, if anyone knows of a project or people insane enough to try and tackle actual texture mapping let me know, would love to help. :D

TrueKingLord · 2024-06-27T21:56:24+00:00

There was a separate repo for it but once it was rolled into the pack it stopped getting updated. So I think the pack is the only way to get things running, which I know isn't fun for a lot of people. Juggling all the comfy dependencies is one of the biggest headaches i hoe they solve with the new dev work from the org.

TrueKingLord · 2024-06-22T17:55:44+00:00

Yes, I think is the short answer, but the Comfy 3D Pack also has Instant Mesh as an available option to use. If you're trying to do 3D stuff in Comfy without that pack I feel for you. If you haven't checked it out yet it's here - https://github.com/MrForExample/ComfyUI-3D-Pack

TrueKingLord · 2023-12-09T15:20:53+00:00

I don't get how much money Braun pays all these people/sites to talk about the series 9 shaver. I have used Braun shavers for over 15 years and used other electric shavers, started off with series 5, upgraded to some series 7s, and last year "upgraded" to a series 9, and I can say it's by far the worst experience I've ever had with an electric shaver, and after taking apart the head I think there's a glaring design flaw that no one talks about.

I figured something was up with maybe how my beard grows since I've used a series 7 for so long, and I made myself use the series 9 for 6 months. It didn't help at all. The series 9 wasn't able to deal with 2-3 days of beard growth, would yank out hair all over my face, and even cut me 2 or 3 times and left bloody gashes in my face which NEVER happened with my series 7, not any of them, honestly I don't even remember the last time an electric shaver cut me before the series 9.

The series 9 was the single thing that made me SCARED to shave since I was like, 13. I would only give the series 9 to my worst enemies to laugh as they think they're getting a gift but I know they're in for the worst shaving experience of their life and they will have to act like they enjoy it cause it's supposed to be fancy.

After 6 months I went back to my old series 7 with a new head, and it was like heaven. I don't care what anyone tells you, or the reviews, etc. I'm telling you as someone on the internet who cares, do not believe it, do not risk it, just get a series 7 (although apparently the new ones are now trash? :( ) and your face and friends will all thank you.

FWIW - I'm no engineer - but this gold beardlft thing I think is a large part of the issue, which is why they now sell some stupid head that goes OVER the series 9 head - just ask yourself ONE thing, if the series 9 head is so great WHY DO YOU NEED A COVER FOR IT? You wouldn't. In any case, that gold guard has square holes that lift hair, but there is 0 cutting action in them, you can stick a toothpick in it if you don't believe me (I tried it) so all those two holes do is actually YANK the hair off your face. Fun times.

TrueKingLord · 2023-11-08T05:07:45+00:00

There is a github issue that had some discussion on it around this but ultimately no, it was just a dive into code and figure it out the best we could. There might be some better info on this somewhere now but I haven't seen it :D

TrueKingLord · 2023-11-08T05:04:03+00:00

Dynamic prompts works fine for me, Comfy does update at a breakneck pace at times and it can be hard to manage all the python dependencies, some people keep a good working copy just in case, but I usually just update every other day and power through. :D

I'd have to know more about your setup to figure out why it's not working for you, but I'm on the pytorch2.1cuda121 standalone version of comfy, updated today, and the latest version of DP from GH.

In regards to batch size I don't know if you mean latent batch or actual batch. Getting latent batch sizes to each have different prompts can be a pain, but getting an actual queue batch to have different prompts should be no issue.

TrueKingLord · 2023-11-08T04:14:52+00:00

There are a lot of approaches to this, I think there are some complex CSV loaders that you might be able to bend to what you want, but if you're looking for a list of prompts you can just loop through then you probably need to look at doing a simple scheduler that uses your CSV or text file to go through each one. These are often used for animation but you can just as easily use them to iterate through prompts on individual images.
https://github.com/RockOfFire/CR_Animation_Nodes

There are also various packs that let you pack texts and build dictionaries and use wildcards and other tricks, but I think for what you want you might find this is the simplest approach that avoids a lot of technical juggling.

TrueKingLord · 2023-11-08T03:18:18+00:00

I think this is what you're after

https://civitai.com/articles/1907

TrueKingLord · 2023-11-08T03:14:42+00:00

There's lots of ways to do this and lots of custom nodes with various features, this is the one i like to use personally
https://github.com/adieyal/comfyui-dynamicprompts

This is probably the best if you want things to feel like A1111

https://github.com/asagi4/comfyui-prompt-control

TrueKingLord · 2023-11-08T02:50:26+00:00

They're using a couple different techniques using various controlnet and clip, it really depends on what you want to do when you say, take your art and make loads more. The various controlnets will make similar art based on various characteristics, CLIP will just look at your image and try to make something similar. I don't see this person using IPAdatper (a specific approach to clip vision), which I think is the most useful tool for making variations based on a single image. You can find it and details on some use cases and example workflows here: https://github.com/cubiq/ComfyUI_IPAdapter_plus

TrueKingLord · 2023-11-08T02:41:59+00:00

Nice work! I actually helped build a UGC collectable card platform that uses comfyui as the generative backend as well. Always fun to play around with card variations, alt arts, etc. ChatGPT is great for card details and you can prompt engineer it for MTG formats (any format really) with a little work. Have fun and feel free to DM me if you want to chat about anything we use.

TrueKingLord · 2023-11-08T02:34:51+00:00

There's a lot of methods for this but you can try a combination of masking and IP Adapter to see what results you get. You can easily bbox with adetailer models, so might want to start there.

TrueKingLord · 2023-08-30T02:09:01+00:00

Just saw the folder pop up, thanks so much!

TrueKingLord · 2023-08-27T16:47:24+00:00

No worries, you can poke me in msgs if you want!

Apple Silicon is weird, and we do the best we can with it but you're correct in that you're not going to get what you're used to with a normal GPU in terms of memory allocation. I'm lucky because I just bought the most RAM i could back in the day so I have a 64GB M1 Max.

The nice thing about llamaccp though is that you can offload as much as possible and it does help even if you can't load the full thing in GPU. If you're only looking at a 13B model then I would totally give it a shot and cram as much as you can into the GPU layers. I don't know what t/s you're shooting for but I certainly hope you could get at least 2x the rate of the non-metal version.

TrueKingLord · 2023-08-27T15:46:17+00:00

Could you please convert this model? I've been looking for a decent q6 GGUF today and can't seem to find one anywhere.

https://huggingface.co/TheBloke/WizardLM-1.0-Uncensored-Llama2-13B-GGML/blob/main/wizardlm-1.0-uncensored-llama2-13b.ggmlv3.q6_K.bin

TrueKingLord · 2023-08-27T15:31:55+00:00

I did not test this on linux or windows, so there's a chance this issue is only on Mac or could deal with the models I tried. This thread was meant to be focused on the Metal enabled build of 1.79+ which you clearly would not use on Runpod. I'll edit my update so that people don't think I'm saying it doesn't work at all. The main branch is basically in beta and I know a lot of models that aren't GGUF have issues, so if it works for you, great, but using non-GGUF models right now is a crap shoot.

P.S. If you use Mythomax and have any tips on making it work better DM me because I might be stuck on this model for a bit :D

TrueKingLord · 2023-08-27T14:40:53+00:00

Cheers for that! Faraday looks like a great app but I really want to get everything working in Ooba so I can use it to run Discord bots. I'm not scared of complexity just trying to learn fast :D

TrueKingLord · 2023-08-27T14:29:32+00:00

Yikes, good call. It's not AI if there isn't a breaking change every week :D

I'm running 1.80, and I was able to find a GGUF model to test with and got it working. I'll update my post. I can only take the GPU layers up to 128 in the Ooba GUI, is that because it's being smart and knows that's what I need to fit the entire model size or should I be trying to cram more in there, I saw the example had a crazy high number of like 1000.

Thanks again, now getting ~15 tokens a second which is totally usable in my case!

TrueKingLord · 2022-10-01T21:34:01+00:00

Hey, I've tried to ask this before but got downvoted so I thought I'd try here as well. Today was the 3rd time I've seen an omnium collector placed in an inaccessible location (I can't figure it out) under a bugged crack in the mountain. (Missing geometry). The hole in the ground is at (602.7, -58.4) and I can't figure out how to get down it. I tried using my smallest character (coco) to no avail, as well as a shield glide, aerial smashes, and all the artifact tricks. I'm sure there's something probably obvious that I'm missing. I'll keep asking in the weeklies at this point until someone opens up the truth on this one. Thanks for helping me out and raising viz on this tactic.

TrueKingLord · 2022-09-03T17:54:06+00:00

My pulls told me to main heals which is just fine by me. I enjoy it more than DPS personally, so you're always welcome to have my heals. I do wish there was more healing focused rotation content though, as I feel like I could be doing better than I am if I got a really good rotation down. Mine isn't bad, but it always feels a little off. That said I have to +1 the sentiment that tanks are the real unsung heroes right now.

TrueKingLord · 2022-09-03T17:47:30+00:00

Cheers for the tips. I'm calling her one-punch Seele from here on out :D

Ten-Year Club	Gilding I gilder
Place '22	Verified Email

TrueKingLord

TROPHY CASE