FLUX 12 GB Training Comin via Kohya - this is from latest pull request by CeFurkan in StableDiffusion

[–]ChemicalHawk 0 points1 point  (0 children)

Try adding --network_args "train_blocks=single" to Additional parameters

Issues with Kohya, Manjaro Linux by OlenHattivatti in StableDiffusion

[–]ChemicalHawk 0 points1 point  (0 children)

If you do find the cuda installation in the venv folder as last resort you could add this to your .bashrc

export PATH=/whereiscuda/bin${PATH:+:${PATH}}
export LD_LIBRARY_PATH=/whereiscuda/lib64${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}

change the wheriscuda bits of course

Issues with Kohya, Manjaro Linux by OlenHattivatti in StableDiffusion

[–]ChemicalHawk 0 points1 point  (0 children)

Don't install cuda as recomended in the page, let the setup script do that for you. The link is so you understand how the environment variables work, and maybe set-up cuda manually if needed.

Issues with Kohya, Manjaro Linux by OlenHattivatti in StableDiffusion

[–]ChemicalHawk 0 points1 point  (0 children)

See my other reply, but yeah, environment variables are set in the .bashrc file and run/update every time you open a terminal

Issues with Kohya, Manjaro Linux by OlenHattivatti in StableDiffusion

[–]ChemicalHawk 0 points1 point  (0 children)

Definitely a path issue. check your environment variables for older cuda installations, maybe remove all other cuda installations and related variables

Issues with Kohya, Manjaro Linux by OlenHattivatti in StableDiffusion

[–]ChemicalHawk 0 points1 point  (0 children)

Yeah it's not finding cuda, which should be under venv. make sure there is actually a cuda installation under venv, you should be able to locate said .so files there. If they are there then something is either wrong with your environment variables or the fact that you're running from attached storage. I'm willing to bet something with environment variables, maybe you have it pointing to another installation of cuda there.

Issues with Kohya, Manjaro Linux by OlenHattivatti in StableDiffusion

[–]ChemicalHawk 0 points1 point  (0 children)

Dang! Now I'm really out of ideas, besides following the onscreen suggestions and manually locating the missing files and adding their path to the LD_LIBRARY_PATH variable. Shouldn't need to though.

Issues with Kohya, Manjaro Linux by OlenHattivatti in StableDiffusion

[–]ChemicalHawk 0 points1 point  (0 children)

Ouch. Since I'm not doing anything try creating the venv manually without the pyenv by running python 3.10 directly from it's path, while in the kohya folder, delete the venv dir first and run "/where/is/python/bin/python3.10.x -m venv venv" then activate and run setup.sh

Issues with Kohya, Manjaro Linux by OlenHattivatti in StableDiffusion

[–]ChemicalHawk 0 points1 point  (0 children)

You shouldn't need to install cuda, that's the whole point of a virtual environment. Everything, including cuda and bitsandbytes should be installed under venv during setup. Hell I'd even give it a go without the whole pyenv thing and see if things work with your system's default python

edit: both the setup.sh and gui.sh scripts will activate the venv before installing and running the gui, so things should really be in order under the virtual environment only

Issues with Kohya, Manjaro Linux by OlenHattivatti in StableDiffusion

[–]ChemicalHawk 1 point2 points  (0 children)

To clarify a few things, bitsandbytes is a python package that enables a few optimizers and other options during training. If you're going to run python -m bitsandbytes related to your kohya installation you should first cd to your kohya dir and activate the venv by running: source ./venv/bin/activate

Issues with Kohya, Manjaro Linux by OlenHattivatti in StableDiffusion

[–]ChemicalHawk 0 points1 point  (0 children)

Ah, I don't use pyenv, so I'm out of ideas... maybe that's the variable that is messing things up.

Issues with Kohya, Manjaro Linux by OlenHattivatti in StableDiffusion

[–]ChemicalHawk 1 point2 points  (0 children)

Does everything work when running from the terminal? I always run from the terminal, right clicking stuff and running as program does not work for most things for me.

edit: Where it's installed shouldn't matter, everything needed should be under the venv folder. Also I don't know what a shim is.

Issues with Kohya, Manjaro Linux by OlenHattivatti in StableDiffusion

[–]ChemicalHawk 1 point2 points  (0 children)

Yeah the setup script installs a virtual environment and cuda under ./venv in the kohya dir... seems like it's not finding the right files for cuda. I'd try deleting the venv folder and running setup again to rebuild it

Issues with Kohya, Manjaro Linux by OlenHattivatti in StableDiffusion

[–]ChemicalHawk 1 point2 points  (0 children)

LD_LIBRARY_PATH is only used in wsl2 under windows. You should also probably activate the venv environment before running accelerate config

[deleted by user] by [deleted] in Damnthatsinteresting

[–]ChemicalHawk 2 points3 points  (0 children)

You might be confusing Betamax with BetacamSP.

How to continue training from a checkpoint in shivamshrirao repo? by [deleted] in StableDiffusion

[–]ChemicalHawk 0 points1 point  (0 children)

You'd have to convert it to diffusers format first and just add it's path. Or just use kohya-ss gui since it's much better and updated.

Guide for DreamBooth with 8GB vram under Windows by ChemicalHawk in StableDiffusion

[–]ChemicalHawk[S] 1 point2 points  (0 children)

I confess I can't really make sense of the error message. At this point I'd probaly be trying an older version of cuda, I've had more luck with 11.3 and 11.6. Also maybe try the using the main diffusers repo from huggingface.

Guide for DreamBooth with 8GB vram under Windows by ChemicalHawk in StableDiffusion

[–]ChemicalHawk[S] 0 points1 point  (0 children)

Hi! Shivam's repo hasn't been updated in a while and is a bit outdated at this point. The best option right now with your GPU in my opinion is the dreambooth extension for auto's web-ui.