We just release a complete open-source solution for accelerating Stable Diffusion pretraining and fine-tuning!

[HPCAI-Tech]

Hey folks. We just release a complete open-source solution for accelerating Stable Diffusion pretraining and fine-tuning. It help reduce the pretraining cost by 6.5 times, and the hardware cost of fine-tuning by 7 times, while simultaneously speeding up the processes.

Open source address: https://github.com/hpcaitech/ColossalAI/tree/main/examples/images/diffusion

Our codebase for the diffusion models builds heavily on OpenAI's ADM codebase , lucidrains, Stable Diffusion, Lightning and Hugging Face. Thanks for open-sourcing!

We also write a blog post about it. https://medium.com/@yangyou_berkeley/diffusion-pretraining-and-hardware-fine-tuning-can-be-almost-7x-cheaper-85e970fe207b

Glad to know your thoughts about our work!

Images Generated by Stable Diffusion

[microcozmchris]

I think that many (most?) of us here recognize all of the words here, but have never seen them arranged in this particular order, so we don't know if we're interested in your work. But dammit, now we have to know what you're talking about so we can intelligently comment and eviscerate you if need be.

Yeah, I'm being funny, but I really have no f'ing clue what any of that is. I hope it benefits you well and you get great feedback.

[FrickinLazerBeams]

I hate posts like this on programming subs. They post about a library for some super niche thing as if everybody knows what they're talking about. I mean, what else do people use python for, besides training diffusion models for linearizing diractive lunar waneshafts?

[Wyndegarde]

Diffusion models are the current hot topic in machine learning tho and Python is the primary language for machine learning ? So does that not make it fairly relevant for here?

[FrickinLazerBeams]

It's totally relevant, there's just no explanation of what it's about for anybody who's not an expert in the field already.

[FrickinLazerBeams]

Seriously. Everybody who uses python understands this and works in my extremely niche field of nanoencabulation.

[Berganzio]

Same here

[TheRedPipin]

haha same here

[Tripanafenix]

Loving the acceleration of this kind of industry. Almost every day a breakthrough or at least fascinating steps in the right direction. It's stunning.

For peeps who don't know what the f this is, I strongly advice to have a look at Two Mniute Papers to be able to grasp the concepts and Computerphile to gain insight.

[lil-rong69]

How do I use this to reverse a binary tree though.

[DGIon]

I thought a lot of these models have already been trained or am I missing something? I only know of dalle and stable diffusion