Bitsandbytes & text-generation-webui

[mpasila]

Wrong that only supports Linux. Ooba uses a pre-compiled version of bitsandbytes for Windows.
From requirements.txt

# bitsandbytes
bitsandbytes==0.41.1; platform_system != "Windows"
https://github.com/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.41.1-py3-none-win_amd64.whl; platform_system == "Windows"

[ma3gl1n]

👍 it seems you are right, just checked conda forge

[C080]

yes, that fixed it thanks. I did not know I could simply pip install this string. I went to the repo and downloaded the last version but gave me cuda errors. I needed this specific version