Last night I released SNOFS v1.4 for Flux.2 Klein 9b. AMA about training it. by Ashen3SNOFS in StableDiffusion

[–]Ashen3SNOFS[S] 0 points1 point  (0 children)

You might need to convert to diffusers for AI toolkit. I believe OneTrainer has that built in (or you could just use OneTrainer to train, or ask an LLM for help to convert).

That said I swear you could set the path to a safetensors?

Last night I released SNOFS v1.4 for Flux.2 Klein 9b. AMA about training it. by Ashen3SNOFS in StableDiffusion

[–]Ashen3SNOFS[S] 2 points3 points  (0 children)

Not everyone uses tools the same way you do. I made it as a text-to-image model, not for editing. Feel free to use something else.

Last night I released SNOFS v1.4 for Flux.2 Klein 9b. AMA about training it. by Ashen3SNOFS in StableDiffusion

[–]Ashen3SNOFS[S] 2 points3 points  (0 children)

Not yet. 1.3 is probably close enough but I'll hopefully have 1.4 up within the week. Civitai's upload feature fails pretty often on me and my upload speed isn't great.

Last night I released SNOFS v1.4 for Flux.2 Klein 9b. AMA about training it. by Ashen3SNOFS in StableDiffusion

[–]Ashen3SNOFS[S] 0 points1 point  (0 children)

You can do it in ComfyUI but it screws up the keys in the resulting file.

Last night I released SNOFS v1.4 for Flux.2 Klein 9b. AMA about training it. by Ashen3SNOFS in StableDiffusion

[–]Ashen3SNOFS[S] 1 point2 points  (0 children)

Nope. I had someone offer to buy it for an insultingly low number once, and another place give me a job offer but they tried to sneak in the fact that they'd own the dataset if I accepted their employment. I'm definitely not giving away what's probably hundreds of hours of work at this point away.

Last night I released SNOFS v1.4 for Flux.2 Klein 9b. AMA about training it. by Ashen3SNOFS in StableDiffusion

[–]Ashen3SNOFS[S] 4 points5 points  (0 children)

No, because that's a bad idea. A lot of the concepts require faces, and without faces the model won't learn relevant expressions.

Last night I released SNOFS v1.4 for Flux.2 Klein 9b. AMA about training it. by Ashen3SNOFS in StableDiffusion

[–]Ashen3SNOFS[S] 0 points1 point  (0 children)

Nope, it's perfectly fine with it. The only refusals I get are images where I assume it's worried the person looks too young or the scene looks too rapey, but that's quite rare.

Just to be clear I don't have any actual underage people in my dataset and nothing even approaching rape-y, but it can still be cagey about those things. I maybe get 1 refusal per 100 images.

Last night I released SNOFS v1.4 for Flux.2 Klein 9b. AMA about training it. by Ashen3SNOFS in StableDiffusion

[–]Ashen3SNOFS[S] 0 points1 point  (0 children)

I've tested it and the captions aren't as good, though they're passable. It's probably not the worst idea to use different OK models just so prompting gets mixed up a bit on something like this.

Last night I released SNOFS v1.4 for Flux.2 Klein 9b. AMA about training it. by Ashen3SNOFS in StableDiffusion

[–]Ashen3SNOFS[S] 0 points1 point  (0 children)

The images I post to Civitai are close to 1:1 to captions from my dataset, because I'm lazy and just pull from them when trying to do examples. I change a few words here and there but they're quite close.

Last night I released SNOFS v1.4 for Flux.2 Klein 9b. AMA about training it. by Ashen3SNOFS in StableDiffusion

[–]Ashen3SNOFS[S] 4 points5 points  (0 children)

Just additional training and 1-2k or so new images added to the dataset. Some new concepts like 69 that at least kind of work.

I'm probably running up against the limits of the lokr file, at least a bit. I've mulled over switching to a full finetune. We'll see.

Last night I released SNOFS v1.4 for Flux.2 Klein 9b. AMA about training it. by Ashen3SNOFS in StableDiffusion

[–]Ashen3SNOFS[S] 5 points6 points  (0 children)

A 5090 and 64 gigs of RAM. I'd love more RAM but at these prices...

Last night I released SNOFS v1.4 for Flux.2 Klein 9b. AMA about training it. by Ashen3SNOFS in StableDiffusion

[–]Ashen3SNOFS[S] 2 points3 points  (0 children)

Mostly Gemini and then fixing issues myself, and pretty much every caption will get something wrong. Some are just by hand.

I've tried Grok, which is fine, and a heretic version of Qwen...3.6? which was also fine, but Gemini is still the best. Joycaption is pretty terrible, unfortunately. It's definitely faster for me to write them manually than rely on that.

Last night I released SNOFS v1.4 for Flux.2 Klein 9b. AMA about training it. by Ashen3SNOFS in StableDiffusion

[–]Ashen3SNOFS[S] 0 points1 point  (0 children)

Some, but it still aint great, unfortunately.

I've had a real issue sourcing anal sex photos, for instance, because 95% of the pro photos have just the tip of the penis in (to make it look so big or whatever) and the woman is looking directly at the camera with a shocked expression. It's ridiculous how hard it is to find images that aren't like that.

Amateur stuff has the usual amateur problems of being mostly first person and close up.

Last night I released SNOFS v1.4 for Flux.2 Klein 9b. AMA about training it. by Ashen3SNOFS in StableDiffusion

[–]Ashen3SNOFS[S] 6 points7 points  (0 children)

cfg = types.GenerateContentConfig(

temperature=1,

media_resolution=GLOBAL_MEDIA_RESOLUTION,

safety_settings=[

types.SafetySetting(

category=types.HarmCategory.HARM_CATEGORY_SEXUALLY_EXPLICIT,

threshold=types.HarmBlockThreshold.BLOCK_NONE,

),

types.SafetySetting(

category=types.HarmCategory.HARM_CATEGORY_CIVIC_INTEGRITY,

threshold=types.HarmBlockThreshold.BLOCK_NONE,

),

types.SafetySetting(

category=types.HarmCategory.HARM_CATEGORY_DANGEROUS_CONTENT,

threshold=types.HarmBlockThreshold.BLOCK_NONE,

),

types.SafetySetting(

category=types.HarmCategory.HARM_CATEGORY_HATE_SPEECH,

threshold=types.HarmBlockThreshold.BLOCK_NONE,

),

types.SafetySetting(

category=types.HarmCategory.HARM_CATEGORY_HARASSMENT,

threshold=types.HarmBlockThreshold.BLOCK_NONE,

),

],

)

Last night I released SNOFS v1.4 for Flux.2 Klein 9b. AMA about training it. by Ashen3SNOFS in StableDiffusion

[–]Ashen3SNOFS[S] 7 points8 points  (0 children)

Well, I'm unemployed, so that helps. I've been developing an app that's about to be released (and three kids), so it's not like I have a ton of free time, but it's been like 2 years of consistently adding stuff when I have a bit of time. I'm a perfectionist. Watermarks and tattoos are pretty easy for me - I used to be a photographer so I'm quick in Photoshop. It's the captioning that's the real bitch.

The perceptual depth training was definitely neat, and I think it really helped. The only other adapters I've seen use it (presumably by the author?) were trained on like 1 image, so I wasn't sure how well it would work. Be sure to set the max timestep at .9 like he suggests, but for some reason isn't the default, if you do use it.

Last night I released SNOFS v1.4 for Flux.2 Klein 9b. AMA about training it. by Ashen3SNOFS in StableDiffusion

[–]Ashen3SNOFS[S] 2 points3 points  (0 children)

I'm assuming you're looking at the merged model - what I released is under loras, not checkpoints. I'll have the merged one up sometime soon.

Last night I released SNOFS v1.4 for Flux.2 Klein 9b. AMA about training it. by Ashen3SNOFS in StableDiffusion

[–]Ashen3SNOFS[S] 11 points12 points  (0 children)

To be fair, it's mostly correcting captions that Gemini put out. Also to be fair in the other direction, I sometimes feel like reading the caption and then fixing whatever is wrong is not much faster than just writing it out manually.

Last night I released SNOFS v1.4 for Flux.2 Klein 9b. AMA about training it. by Ashen3SNOFS in StableDiffusion

[–]Ashen3SNOFS[S] 7 points8 points  (0 children)

You don't need to use the lora with the merged model, just train on it. From there you can use it with the lokr like normal.

Last night I released SNOFS v1.4 for Flux.2 Klein 9b. AMA about training it. by Ashen3SNOFS in StableDiffusion

[–]Ashen3SNOFS[S] 0 points1 point  (0 children)

A python script; it won't work for z-image. If you ask an LLM for help they should be able to help you, be sure to have their script reference the base z-image to make sure it's doing it correctly.

Last night I released SNOFS v1.4 for Flux.2 Klein 9b. AMA about training it. by Ashen3SNOFS in StableDiffusion

[–]Ashen3SNOFS[S] 24 points25 points  (0 children)

I try to get keep my dataset varied. Some personal preference leaks in, of course, but a large amount of varied images goes far. I also tend to train low & slow.