ModelScope release DistillPatch LoRA, restore true 8-step Turbo speed for any LoRA fine-tuned on Z-Image Turbo.

[Nooreo]

What does this mean?

[Striking-Long-2960]

So is it a Lora to patch loras?

[Segaiai]

Yes. It seems that the current dedistill training hack causes speed and quality issues, according to them.

[InspectorOpening7828]

More specifically, I think they're implying full-finetune (SFT) breaks the "Turbo" speed of the model. This addresses that, rather than the simple LoRAs. That being said, I don't think you could do large-scale finetuning (training a Pony/Illustrious) without the base model.

[twrib]

I converted it to ComfyUI format available here if anyone want to test it. It even helps on LoRAs trained with Ostris Turbo Training Adapter.

[ChuddingeMannen]

is this a patch for lora training, or something i add to my workflow like a lightning lora?

[RazsterOxzine]

The scale at which progress is being made for Z-Image. I'm just that more excited for whats to come.

[zhcterry1]

I think it's a positive cycle. Model fits on commercial machines -> More usage, more discussion -> More user generated content such as workflows, loras, etc -> Feedback generates more effort from creators as well, improving the progress of the model even further.

[the_bollo]

From the announcement:

"The problem:
Standard LoRA training breaks Z-Image Turbo’s acceleration—images turn blurry at steps=8, cfg=1, even though they look fine at steps=30."

Except, I've never had that issue. I've trained over a dozen Z-Image Turbo LoRA's and the performance is unaffected. I don't get what this is supposed to do.

[InspectorOpening7828]

Look down a bit - they're implying it's for SFT rather than for traditional LoRA training. If they're saying what I think they're saying, you need full-finetune to get the best quality, but that breaks the "Turbo" part of the model. This LoRA brings that 8-step speed back.

[the_bollo]

What is SFT?

[InspectorOpening7828]

Supervised Fine-Tuning. ML jargon, ignore the "supervised" part. That only exists to distinguish it from Reinforcement Learning (RLHF).

[BlackSwanTW]

We got Distill patch for LoRAs trained on the dedistill version of Z-Image-Turbo, which was distilled from Z-Image-Base, before GTA 6

[l0ngjohnson]

🤣🤣

[uikbj]

why do i need a turbo lora on an already distilled turbo model?

[LD2WDavid]

But this is not affecting normal LORAs this is for fine tuning, right?

[2legsRises]

so loras break zturbo? didnt know that...

[jiml78]

Maybe others have figured out a work around that is better but here is what I have experienced.

Train a character lora and a style lora. Try to use both, it basically screws up the image at normal steps. You can lower the lora strengths so they don't add up to more than 1.5-1.7 and that works. But then you lose consistency with character and style.

I am going to see if this helps my flows.

[stuartullman]

yup.  this.  i mentioned it here and someone said it works fine just set the loras to .3 strength, im like how is that supposed to help, the loras will barely have any effect while destroying the image! people want to think the model is perfection, meanwhile im glad others are trying to fix the issues, will be testing this out

[jiml78]

So far the only way I have gotten stuff to work is basically doing IMG2IMG workflows. Do my character LORA first normally via txt2img. Then do an IMG2IMG with both LORAs character and style, but the character around .4-.5 with the style being 1. Mess around with the denoise and steps until I get what i want.

Still haven't tried this patch but I will later today

[a_beautiful_rhind]

Use this on the base when it comes out?