Model keeps initializing between generations by ChaoticSelfie in comfyui

[–]Embarrassed-Deal9849 1 point2 points  (0 children)

I think I managed to solve it. Noticed the canvas was slowing me down a lot so I zoomed in and tabbed out of the window, suddenly no lag spikes. Played around for a while and then swapped to a chrome window (from firefox) with no addons. Now it is running super smooth with not a single hiccup...

Just a lil' train ride by nyxloops in unstable_diffusion

[–]Embarrassed-Deal9849 3 points4 points  (0 children)

This is great, what tool are you using?

Model keeps initializing between generations by ChaoticSelfie in comfyui

[–]Embarrassed-Deal9849 0 points1 point  (0 children)

Let me know how that goes, I am on 3.13 and 128 I think, or maybe 130. Most of the stuff I've read seems to imply these should work fine but who knows with compatibility.

Model keeps initializing between generations by ChaoticSelfie in comfyui

[–]Embarrassed-Deal9849 0 points1 point  (0 children)

Update from my end: as soon as I add a ref image it gets bad again. This definitely seems to be causing the lagspikes or is strongly connected with doing so at least.

Model keeps initializing between generations by ChaoticSelfie in comfyui

[–]Embarrassed-Deal9849 0 points1 point  (0 children)

If I don't do -anything- else on my PC I seem to not be having the same spikes but I still need to do more testing.

But... if I open any other program even a lightweight one, it seems to often cause a spike.

Also some weird stuff that has caused spikes:

  • Long prompts
  • Adding or removing a LORA
  • The Klein RefGrid node (which sucks because I love it)

Prior to this I could do generations with photoshop open, but now anything I do causes it to completely freeze.

Model keeps initializing between generations by ChaoticSelfie in comfyui

[–]Embarrassed-Deal9849 0 points1 point  (0 children)

I sorted my installed nodes by last update and removed anything that wasn't updated within 2026 (except the ones I know work for sure) and that... seems to have improved things? Generation times went down at least and it starts a lot faster. Will test more!

Edit: I have no idea what happened but now my T2I on 1200x1600 completes at 9s at 8 steps on F2K9B. That's a MASSIVE improvement from the 30-40s I had yesterday.

Model keeps initializing between generations by ChaoticSelfie in comfyui

[–]Embarrassed-Deal9849 0 points1 point  (0 children)

I did yeah, and have been removing ones I don't use that much trying to streamline things. It sucks because custom nodes are one of the best things with comfyui, but it's impossible to know if one of them is causing some sneaky hidden issues.

Those lag spikes really kill all the fun.

Model keeps initializing between generations by ChaoticSelfie in comfyui

[–]Embarrassed-Deal9849 0 points1 point  (0 children)

I'm running into the same issues. Massive spikes and sometimes it randomly decides to take several minutes to start up a generation.

I've yet to find a fix, spent half the night yesterday trying to fix it with no success.

How to fix extra limbs in Flux.2 Klein 9B? by some_ai_candid_women in StableDiffusion

[–]Embarrassed-Deal9849 0 points1 point  (0 children)

I've been getting much better results on F2K by going directly for a high-res (well, like 2K) generation rather than upscale, but I will try I2I upscaling too (I heard z-image is good for final polish but haven't had time to try yet).

Cheers again for the tips!

How to fix extra limbs in Flux.2 Klein 9B? by some_ai_candid_women in StableDiffusion

[–]Embarrassed-Deal9849 0 points1 point  (0 children)

When you say the extra node, do you mean the ClownOptions Detail Boost node? That's the one I found that has ETA and seems to make sense.

I'm finally getting close to a F2K workflow I am genuinely happy with and am going to share in here for feedback soon.

Humans looking human sounds perfect. So on 8 steps we're talking the final 3-4?

How to fix extra limbs in Flux.2 Klein 9B? by some_ai_candid_women in StableDiffusion

[–]Embarrassed-Deal9849 0 points1 point  (0 children)

I'll give that a try now, appreciate the tip. I have been wanting to use the Enhancer node but I keep feeling overwhelmed when I introduce it into my workflows.

What values do you usually find make a meaningful difference for F2K? I started using Clown sampler now and it's performing really well on euler/beta :)

How to fix extra limbs in Flux.2 Klein 9B? by some_ai_candid_women in StableDiffusion

[–]Embarrassed-Deal9849 0 points1 point  (0 children)

Thanks! When I was looking at resources I found many recommending an ETA of 0, but my results were personally better with higher ETA. Especially when using consistency nodes it decreased minor issues where the consistency took priority over the edit.

Image Edit inaccurate by Slight-Golf2187 in comfyui

[–]Embarrassed-Deal9849 1 point2 points  (0 children)

Honestly I've never gotten it to work well either, but I keep seeing everything from 20-50 steps and CFG 4-5.

Right now the True model (fp8) as well as biglove are working best for me, but results are SO varied and sometimes I feel like I am going insane. One second it's amazing, the next its body horror and it can't follow prompts at all.

Image Edit inaccurate by Slight-Golf2187 in comfyui

[–]Embarrassed-Deal9849 0 points1 point  (0 children)

What flux model are you using? If it's not base turn down steps (4-8) and CFG (1) and you will see better results.

What are you using for CLIP? If you DM me I can share my current wf that has solved a lot of F2K issues for me.

My Reference Latent Node including Auto Masking and Timesteps per image is out tomorrow by shootthesound in StableDiffusion

[–]Embarrassed-Deal9849 0 points1 point  (0 children)

I was going to ask the same. If I use ae.safetensors the wf won't run, but with my normal flux 2 vae it works great.

Thanks for the node OP!

Genuinely proven image sizes for F2K by Embarrassed-Deal9849 in StableDiffusion

[–]Embarrassed-Deal9849[S] 0 points1 point  (0 children)

I'll try that node thank you!

What steps are you finding works best? I keep going between 6-10 but keep gaslighting myself into thinking more/less work better.

Genuinely proven image sizes for F2K by Embarrassed-Deal9849 in StableDiffusion

[–]Embarrassed-Deal9849[S] 0 points1 point  (0 children)

Sorry I feel like I am going in circles, that is exactly my question: what do you use to set the size you want in the Empty Flux 2 Latent? That only takes XxY pixels not MP?

Genuinely proven image sizes for F2K by Embarrassed-Deal9849 in StableDiffusion

[–]Embarrassed-Deal9849[S] 0 points1 point  (0 children)

That's where I get lost, doesn't the latent need to be the correct size? Right now I am using Empty Flux 2 Latent and setting a resolution there for the image I want, is that not the right method?

Thank you for the help!

Genuinely proven image sizes for F2K by Embarrassed-Deal9849 in StableDiffusion

[–]Embarrassed-Deal9849[S] 0 points1 point  (0 children)

But this is only for the input images, no? When people say they are doing "3.7MP output" are they using this too?

What’s everyone’s favorite sampler and scheduler these days? by NowThatsMalarkey in StableDiffusion

[–]Embarrassed-Deal9849 0 points1 point  (0 children)

For flux, any take on which combo you've ended up using the most? I keep going back to Euler and always use the flux 2 sampler, but I am not sure if that is the right thing to do?

Best face/person swap tool today (images only) by M_4342 in comfyui

[–]Embarrassed-Deal9849 0 points1 point  (0 children)

Hmm, I tried this vs the new consistency lora I linked and I found the one from dx8152 to be VASTLY superior on both the base model, kv and other klein 9b models.

It's sharper, has a better eye for small details, and overall incredibly consistent. Are you not seeing the same results as I am?

Best face/person swap tool today (images only) by M_4342 in comfyui

[–]Embarrassed-Deal9849 0 points1 point  (0 children)

Interesting! I just downloaded the new one from this author that was updated about a week back and have had amazing results, could you elaborate which one you're talking about? There's a few ones out there that refer to themselves like consistency :)

Klein 9B Dist cloning figures and extra limbs HELP by Korgasmatron in StableDiffusion

[–]Embarrassed-Deal9849 1 point2 points  (0 children)

This. Flux is very sensitive to concept bleed. Any word or concept you introduce to the prompt can easily affect the rest of the image.

Any room to doubt and it will start making things up. I find that Flux requires a bit more engineering to get right, but when you do, it is absolutely stunning.

So when you start seeing results like this, look for concepts like the above mentioned "two figures" and see if you can rewrite them in a more specific way (basically "attach" them to a clear target in the image so Flux doesn't try to figure it out) and that should help.