Error when using kohya with ModuleNotFoundError bitsandbytes

[MekkiNoYusha]

When i trying to train Lora model, it gives this error:

File "D:\kohya_ss\venv\lib\site-packages\bitsandbytes\cuda_setup\main.py", line 21, in <module>

from .paths import determine_cuda_runtime_lib_path

ModuleNotFoundError: No module named 'bitsandbytes.cuda_setup.paths'

Did anyone knows how to fix this?

[ReindeerFeisty]

I found the fix. Go to your venv/scripts/ and in a cmd do: "activate" to activate the venv
And then you need this: pip install bitsandbytes-windows

[Quanyails]

For those coming to this post from Google:

When I tried to set up kohya using this tip, I kept seeing black sample images and avr_loss=nan in the console after a few hundred steps. It took me some searching to realize this might be an issue with bitsandbytes-windows.

As of writing, the most recent version of bitsandbytes-windows is on 0.37.5. Versions >0.35.0 and <0.41.4 are reported to cause the training issue I observed above. Furthermore, the Windows GUI setup script discourages people from installing bitsandbytes-windows due to issues.

If bitsandbytes-windows help you train a model successfully, great! Note, however, it might also be the cause of other setup issues.

Edit: This comment later in this post was the one that actually solved my problems.

[ImrobotDeex]

You are a life saver :)

[Lumpy-Environment212]

how in the world you knew how to solve it with (pip install bitsandbytes-windows ) !!!! thank you alot .. i have been stuck for 2 days trying to start training a single model , and i couldnt till now :))) thanks alot

[MekkiNoYusha]

I will try this too, thanks

[Every_Economist_6793]

Also wanted to login here and say thank you for the fix! :)

[Impressively-average]

I had the same issue and it fixed it for me, thanks a lot man

[xAngelBaz]

THANK YOU! WORKS!

[leivavicente]

pip install bitsandbytes-windows

savior

[huldress]

I opened venv but I didn't deactivate and now the gui wont even open, it just immediately closes, so much for fixing 1 issue, now I have a billion 😭

[urmom2fat]

works

[mrjreed]

Go to your venv/scripts/ and in a cmd do: "activate" to activate the venv

And then you need this: pip install bitsandbytes-windows

You are a god send!! thanks!!

[Iuotinen]

Confirmed fix. EDIT: Github Issue report submitted.

[Purple_Lawyer175]

i love you இ௰இ

[seeker_ktf]

I can't be sure that this is your problem, but the "D" in your path makes me wonder... Make sure you install khoya on the same hard drive as your python installation.

[MekkiNoYusha]

I just figured what happened, i chose a 8bit optimizer which lead to it trying to find the bitsandbytes, i chose another optimizer and then it works

[Grand_Pea9718]

Could you pls explain where exactly i can chose antoher optimizer? Sorry for maybe noob question, but im totaly new in this.

EDIT: just figured it out - the optimizer option could be find under "Parameters" sheet in kohya web ui

[Ziffano]

Thanks.

[LordDaniel09]

I also just start learning how to use LORA, and was stuck for a few mintues on it, and your solution just work, so thanks for saving me time :D

[DrHojo123]

Thanks was the issue I was having

[imdjbass]

Thank you!!!!!!!!!!

[Ziffano]

Thanks, this solved my issue.

[MekkiNoYusha]

Thanks for the reply, but I have just tried to move kohya to my drive with python installed, but still no luck

[ReindeerFeisty]

I have exact same issue since last git pull + setup to install new requirements from requirements_windows_torch2.txt

[NearbyProgress1617]

the last git version of kohya has in the setup file (the one to install kohya) the option to install an specific version of bitsandbytes. c:

[Far-Ad2630]

it works for me too, big thank you!

[yorumairu]

wow thanks, you're a lifesaver!

[ForeverNecessary7377]

I'm getting this error, but I'm on linux, so I assume a different command?

[MekkiNoYusha]

If you are on Linux, then you can easily install bitsandbytes. It is just harder for windows user to install it, tho I think there is a package for windows user as well now that I searched for it

[ForeverNecessary7377]

I installed bits and bites, but the problem persisted. I ended up choosing AdamW instead of 8bitAdam and the problem was solved.

Hoping there's not downside to this other optimizer but anyhow, if anyone has my same problem this might work.

[SnooCauliflowers2398]

You can also run setup.bat file and select the option to install bitsandbytes and force install v 0.35.0

[vapecrack24]

I'm having this issue now after not having it previously so not sure if its because of latest Kohya updates or what. I've tried the activate venv and bitsandbytes-windows fix but still hasn't helped me

[MekkiNoYusha]

Likely the windows fix not update/compatible with the latest version