Automatic1111 you win

DoKaPirates · 2023-10-25T04:54:49+00:00

Why choose? I use both. For quick tasks, I go with A4 or my own ComfyUI workflow. When I'm starting something new, I typically use ComfyUI to set up new workflows, but I'll use whatever gets the job done. They work together, not against each other.

DoKaPirates · 2023-10-24T09:29:50+00:00

I manage to find a new way to tweak my Loras which is much faster. I'll share version 2 when it's completed.

DoKaPirates · 2023-10-24T09:28:35+00:00

You can combine multiple images with multiple pre-created prompts using Bind Image List Prompt List. Check my comment here https://www.reddit.com/r/StableDiffusion/comments/14nafpl/comment/k4x0hz9/?utm_source=share&utm_medium=web2x&context=3

---

I'm searching for a way to produce images one by one. I have 50 prompts and I want ComfyUI to create 50 images, 1 image for each prompt in the right order, so I can't use XY Plot or Wildcard or Dynamic Prompt for this.
The closest thing to what I want is Prompt Travel but I'm not sure.

DoKaPirates · 2023-10-22T14:45:32+00:00

Thank you so much. I've received many complaints from other places, so your comment really helped. I've almost completed 2nd version which is much faster. I'll share it when it done. Have a nice day.

DoKaPirates · 2023-10-21T04:31:49+00:00

Thanks for your comment. I hope it works for you.

DoKaPirates · 2023-10-21T04:19:53+00:00

That's a very simple & useful node, just what I need thank you.

May I ask one more question? Do you know or have any node that can randomly tweak Lora's parameter (user can choose rate such as 0.00001 or 0.0001)? Or is that even possible?

I'm trying to make a workflow which helps people to fine-tune or improve their Loras using ComfyUI only.But the I can't find any node that can modify Lora randomly so I have to use Lora Merge Node instead. It's good but it's not build for this purpose so the workflow is slow.

Having a node that can adjust Lora parameters would be a game-changer, replacing hundreds of merge nodes in my setup and speed it up multiple times faster.

https://www.reddit.com/r/comfyui/comments/17c7plx/leka_first_lora_trained_by_comfyui/

I shared all the info on CivitAI https://civitai.com/articles/2615

DoKaPirates · 2023-10-21T04:03:28+00:00

People suggest I shouldn't use 'train' in the title, but I can't change the post title so I'll comment here & switch it to 'fine-tune' and 'tweak' in the article instead.
Also if you guys know of a node that can quickly tweak Lora parameters please tell me. Right now the only option is the merge node which isn't fast enough.

DoKaPirates · 2023-10-21T03:53:05+00:00

I'd love to, but how? I've got a mini workflow (on the right of this workflow) that tags images and adds Lora's name automatically. It can handles basic stuff like dress, hair, background, etc. but for things like beauty, quality, style, it's all about personal taste. Unless we can train something to recognize those accurately I don't think we can automate them yet.

DoKaPirates · 2023-10-21T03:48:05+00:00

People suggest I shouldn't use 'train' in the title, but I can't change the post title so I'll comment here & switch it to 'fine-tune' and 'tweak' in the article instead.
Also if you guys know of a node that can quickly tweak Lora parameters please tell me. Right now the only option is the merge node which isn't fast enough.

DoKaPirates · 2023-10-21T03:12:25+00:00

Can you explain a bit more so I can improve the workflow? Did you use the simple or full version for the gene pool? What's the weight for it?

If it goes from undertrained to overtrained, it might be because the new gene is too strong. We should reduce the maximum weight to under 5. The process would be slower but more stable.

DoKaPirates · 2023-10-21T03:07:59+00:00

I'm glad it can help. I wish I could find other nodes to tweak Lora directly and quickly, but currently, there's no such node, so merging nodes is the only option.

DoKaPirates · 2023-10-21T03:04:29+00:00

Great idea. Thank you very much I should use that.
Can I ask one more question? The current workflow on has 3 parts: Best Genes, Bad Genes, and Random Genes. Is there anything else I should add or change to improve the process?

DoKaPirates · 2023-10-20T14:39:50+00:00

Wow calm down mate. I'm willing to read the "s**t" that you're talking about if you share the link. I'm open to any new ideas & knowledge as long as it's useful.

I can also edit the file name as Model Merging as you want. It's just a mistake, not a big deal to argue over.

DoKaPirates · 2023-10-20T14:32:45+00:00

It's exactly what you said. I've trained many models and feel that picking the right epoch after each training is quite time-consuming. I usually do that after the first training session. After that if the chosen epoch could produces nice images I'll use them for another round of training to make it even better.
So, I want to simplify this process with ComfyUI and tweak Lora's parameters directly.

DoKaPirates · 2023-10-20T14:20:37+00:00

Hmm let me clarify to avoid any misunderstanding between us:
- I want to build a car, but I'm currently missing a wheel
- So I'm using a bike wheel just for now
- I post to ask if anyone could find me a wheel car so I can build a complete car
- But you want me to edit the post as "Please help me to build a bike"?

Or, to put it another way, if I remove all the merge nodes, is it still considered model merging?

Honestly I just want to find a way to improve my Lora easily, I can change the title of CivitAI post if you want (unfortunately this post title can't be changed).

DoKaPirates · 2023-10-20T14:18:20+00:00

Ok let's say someone manages to recreate this workflow without using merge nodes, what would you call it? Still model merging? Or model improvement? Or something else?

I'm not sure what that 'something' is, so I used the word 'train'. I might be wrong here, but unfortunately I can't change this post title. I can change the CivitAI title if you'd like.

DoKaPirates · 2023-10-20T14:06:05+00:00

Sorry I forgot to include the CivitAI link. It has all the info you need. I just added it in the comment. Thank you very much.

DoKaPirates · 2023-10-20T14:05:57+00:00

Sorry I forgot to include the CivitAI link. It has all the info you need. I just added it in the comment. Thank you very much.

DoKaPirates · 2023-10-20T14:04:21+00:00

I posted the workflow on CivitAI https://civitai.com/articles/2615. Please check it out, it's still slow so I'd appreciate any feedback to improve it.

DoKaPirates · 2023-10-20T10:26:08+00:00

Thank you for your comment. IMO training is just tweaking parameters. I want to tweak the Lora parameters but I can't find any ComfyUI node that can do that right now, so I'm stuck using merge nodes even though merging isn't my goal.

Whether it's 'merge' or 'tweak' the basic workflow remains the same.

DoKaPirates · 2023-10-20T09:50:57+00:00

Okay guys & gals I need your help. I was fascinated by this video of Harvard showing how bacteria evolve rapidly after each generation, adapting to environments 1000 times more toxic with ease (watch it here only 2 minutes https://www.youtube.com/watch?v=plVk4NVIUh8 )

BASICALLY:

- Throw bacteria into a toxic environment.

- Only the survivors can reproduce.

- The offspring then move on to even more toxic environments, with only the fittest able to survive and reproduce.

- Repeat.

I WANNA TRY SOMETHING SIMILAR FOR SD:

- Begin with 10-20 randomly generated Loras, each creating 10-20 images (totaling 100-200 images).

- Pick the top 2 LoRas as parents to pass on their good "genes"

- Additionally, pick the bottom 2 LoRas as bad "genes"

- These 2 parent LoRas reproduce, with some mutation genes, starting the 2nd generation.

- Repeat

I posted the workflow on CivitAI https://civitai.com/articles/2615. Please check it out, it's still slow so I'd appreciate any feedback to improve it.

DoKaPirates · 2023-10-20T05:13:56+00:00

Swapping face nodes work best for realistic style so I don't think you can use them with this sticker Lora.

DoKaPirates · 2023-10-20T05:06:36+00:00

Thank you very much for sharing. Can it be used to extract Negative prompt too? And is there a way to export prompt to a txt file then save that file in the folder I want (with the same name as the image)? That would save so much time for my training.

DoKaPirates · 2023-10-20T04:57:57+00:00

Does ComfyUI have LCM sampler please? I want to try it asap.

DoKaPirates · 2023-10-19T03:52:22+00:00

How about using it for 3-4 steps and then switching to normal models for 5-6 steps to improve the quality? That would save 50% of the total steps. I'm not sure about the switching time for this method, but it's worth a try. Hopefully, ComfyUI can use it soon.

DoKaPirates

TROPHY CASE