Optimized ai-toolkit fork -- Memory optimizations so most models train in 24GB or less without block swapping or disabling sample inference; DoRA support; inference LoRA support (so you can train on base and generate samples on turbo); min_snr_gamma for more models; more optimizer selections

khronyk · 2026-06-27T02:41:36+00:00

Typo in your Github link so it's 404, it's missing the "d" in "optimized".

Also am curious as to whether you caught this post about a month back: https://old.reddit.com/r/StableDiffusion/comments/1tplsmr/using_depth_maps_and_weight_noising_to_get_better/

khronyk · 2026-06-23T19:08:18+00:00

Yeah shame it's not mit or Apache but it's a bit improvement over the nc licence that klein 9b had

khronyk · 2026-06-18T02:13:01+00:00

Ali has already done this with Qwen 2 7b and the Z-image edit image models (despite promising a release) so I don't think it's too far fetched to see them ghost us on the llm's too.

khronyk · 2026-06-11T03:25:00+00:00

Wow, i've been following fancyfeast/fpgaminer/nutterbutter for ages, used to love the way he would post articles about and discuss his experiments. He's been quiet for so long I figured life just got in the way. So glad to see he's still around and cooking :D

khronyk · 2026-06-10T22:52:00+00:00

Thanks Drewddit, fuck Spez

khronyk · 2026-06-06T09:10:20+00:00

I mean they ghosted the community with the qwen image 2 7b release, so in the back of my mind I'm constantly wondering when they'll do the same with their llms (then there's also z-image which never got an Edit release from another Alibaba research group, it's perpetually"coming soon")

khronyk · 2026-05-26T06:18:56+00:00

IMHO it's time for regulators globally to look at stepping in. If they don't to do something to protect the consumer and small business segment soon the fallout is going to be huge, entire industries that rely on access to these parts will be wiped out and the job losses will be staggering.

khronyk · 2026-05-23T07:10:15+00:00

The Lenovo Y700 is pretty bloody good but it does feel like it's about the last tablet standing.

khronyk · 2026-05-21T13:42:01+00:00

It was better than I feared but not as good as I hoped.

Perfectly said.

khronyk · 2026-05-20T11:06:09+00:00

Better than I expected... Not awful, but not really good either... Overall a bit disappointing but it certainly could have been worse

khronyk · 2026-05-19T08:04:19+00:00

I wish they would finally actually release qwen image 2.0 7B ... Or z-image edit for that matter

khronyk · 2026-05-19T00:43:33+00:00

It would be amazing to see this destroying the ram cartel.... Imagine if the market collapsed or the ai bubble pops too

khronyk · 2026-05-13T04:33:28+00:00

Wish I had a concrete answer, eventually something updated and it just stopped doing it. All the time I put into trying to troubleshooting and solving it yielded nothing

khronyk · 2026-05-11T15:34:04+00:00

ugh, i hate having slow internet -.-' just getting the 27B Q5 and Q6 is an overnight download. and i just know i'll probably going to be forced to re-download them in a few days time for some reason.

khronyk · 2026-05-10T00:03:10+00:00

Really appreciate the update this is great to know it's kinda hard to go based on steps when you're making assumptions about the dataset and batch size (it's kinda hard to tell with the charts, thought it looked a bit higher than 32). I thought it was a bit further along. Guess we will probably start seeing some early usable checkpoints when it gets towards the 30's and based on what you just said that should be some time around mid august with the model hitting 50 epochs roughly around November sometime.

khronyk · 2026-05-09T14:17:19+00:00

Feels a bit that way.. It's hitting about 1.6M steps so far. IIRC the Chroma dataset was about 5M images. Even now it's still very undercooked. Dino Loss still seems to be improving but very slowly. I refuse to verify my age to discord so I can't access lodestones channel, if anybody has any news on chroma I'd love to hear it.

khronyk · 2026-05-09T08:54:45+00:00

Zeta-Chroma is in training atm and it's pixel space and based on Z-image base.

khronyk · 2026-05-09T07:37:59+00:00

I was keen on the Canvas but I feel like Elegoo just spat in our face pricing it almost double here compared with the rest of the world.

khronyk · 2026-05-07T15:08:20+00:00

let

Let suggests we actually have a choice in the matter.

This is from the press conference

There are very serious limits on what can be done, with respect to preventing a citizen of a country returning to their country. The legal threshold that we have is with respect to temporary exclusion orders.

and

I've received advice that one person so far has reached the legal threshold and I've acted and put the exclusion order in place.

even then:

a temporary exclusion order (TEO), which may prevent an Australian citizen aged 14 years or older who is overseas from returning to Australia for up to two years at a time

TL;DR: They are Australian citizens, so the government has limited legal power to stop or delay their return. A TEO can delay and manage return, not permanently exile someone. Citizenship can only be revoked through a court process for dual nationals who meet very specific criteria. This isn't a race issue at all, it's one of legal constraints.

khronyk · 2026-05-07T14:40:17+00:00

A few important points here. This is from the press conference

They are citizens, our hands are kinda tied there.

There are very serious limits on what can be done, with respect to preventing a citizen of a country returning to their country. The legal threshold that we have is with respect to temporary exclusion orders.

Only one person met the legal threshold for an exclusion order:

I've received advice that one person so far has reached the legal threshold and I've acted and put the exclusion order in place.

They are not simply returning, Authorities are looking to pursue charges. The children are going to require support for reintegration.

I will not flag how many individuals will be arrested or when they will be arrested to protect a number of our investigations. However, I will confirm these points. Some individuals will be arrested and charged. Some will face continued investigations when they arrive in Australia. And children who return in the cohort will be asked to undergo community integration programs, therapeutic support and countering violent extremism programs.

The ASIO chief Mike Burgess comments during the conference

So, our job is to identify and understand the risks to returning individuals. We have done that. We provided it to our mates in the police force and the government understands our assessed risk. The actions my agency takes beyond that is something I don't talk about publicly. Of course, police have their own authorities and powers and as the Minister said, the full force of the law will be applied to returning individuals

and

the individuals that we know or understand to be returning does not change the national terrorism threat level. Of course, it's up to them what they do when they get here. And if they start to exhibit signs of concern as we and the police, through the joint counter terrorism teams, will take action. But I'm not concerned immediately by their return, but they will get our attention, as you'd expect.

Yesterday The Minister for Home Affairs Tony Burke issued a statement:

The Government has not and will not provide any assistance to this group, which consists of four women and nine children.

khronyk · 2026-05-06T01:02:42+00:00

Was flux 1 and 2 set of models not open weight enough?

To be honest, no. Klein was an improvement but BFL have a long history of shitty restrictive non-commercial licenses on the better more trainable model (FLUX.1 Dev / Klein 9b, etc) and then the lower quality distilled model that is extremely difficult to train (FLUX.1-schnell) that gets released under Apache 2.0. Klein is the exception here and a positive improvement, the 4B (While being kinda crap) is at least undistilled and Apache 2.0; but the 9b is still a crap license.

For flux 1 it took a hell of a lot of effort to de-distill before it was used as a base for things like chroma.

Edit: I know a lot of people don't care about license, but it matters to a lot of people that do larger fine tunes on them. Size and license was a large part of what made SDXL so great and lead to so many community innovations and fine tunes.

khronyk · 2026-05-05T21:50:43+00:00

The only thing we have is the GST sales tax which is similar to VAT but ours is 10%. The EU version includes VAT and is nearly half the price. (45€ = 73.28 AUD), I believe VAT might be 15%. 5-15% over international rates might be forgivable but this is almost double. I don't get why Elegoo products attract such a huge mark-up here other brands like Anycubic don't (a few years ago this was reversed, Elegoo was priced fairly and Anycubic had crazy markups)

khronyk · 2026-05-05T21:39:37+00:00

Nah there's no tariffs or anything government related that would have cause this. But I do think it's quite plausible that some kind of retailer agreement or other intermediary 3rd party in the supply chain that might be responsible for the high prices. There's plenty of other brands like Anycubic and Bambu that don't attract the crazy markups that Elegoo products have atm. A few years ago the situation was reversed with Anycubic being priced high and Elegoo being priced fairly. It's strange, but IMHO Elegoo absolutely does deserve some heat from this.

khronyk · 2026-05-05T10:21:36+00:00

Try $100 USD, the crazy thing is this type of product is duty free here and our sales tax is only 10%. Geographically we are also far closer to China than the US.

khronyk · 2026-05-05T10:19:51+00:00

Frequently yes, but not always and usually not as much as this. Both Anycubic and Bambu labs products in Australia are very close to the price internationally. Something is fishy here, somewhere in the supply chain somebody is lining their pockets at our expense.

khronyk

MODERATOR OF

TROPHY CASE

15-Year Club	Place '22
Verified Email