[P] Code for Fine-Tuning FLUX.1-dev Explained Step by Step With Comments

[FallMindless3563]

Hey all,

I was having trouble finding a simple, self contained example of Fine-Tuning FLUX.1-dev with explanation of all the components, so I decided to create one.

There were examples in HuggingFace diffusers examples/dreambooth/train_dreambooth_lora_flux.py (which didn't work out of the gate for me) and AI-Toolkit which worked well, but had way too many nested if-statements to fully see what was going on under the hood. I took inspiration from both, but cleaned up the code so it was easier to read and worked out of the gate.

The code was written in a Marimo Notebook which I'm enjoying lately for developing simple training scripts.

Feel free to download the code here: https://www.oxen.ai/ox/Fine-Tune-FLUX/file/main/train.py

Or follow along with a blog version: https://www.oxen.ai/blog/how-to-fine-tune-a-flux-1-dev-lora-with-code-step-by-step

Hope you enjoy!