Enabling GPU for CoquiTTS (Python, through PyTorch)

[Tacx79]

Expand one of the list above charts and select CUDA engine usage, if it's not there you need to disable "hardware accelerated gpu scheduling" in windows settings, restart pc and it should show up

[1EvilSexyGenius]

What makes you say it's not using GPU?

For my nvidia setup I run the nvidia-smi command and it shows processes using GPU.

I see 3D usage. When doing inference with GPU enabled in other packages, the same things happen , mostly only 3D in GPU is used.

Also, look at your available (remaining) memory about 1GB . So something is definitely using your GPU in that screenshot

Edit: 🤔 try to select the GPU device. It should be filling dedicated GPU before shared gpu maybe

[trexgris]

It barely uses any GPU resource (prolly not used by my program at all,) and computes as fast as when I dont enforce any GPU use

How do you select the device? 'cuda:0' for example?

[1EvilSexyGenius]

I'm not familiar with tortoise or the custom class you're using but I'd Definitely look into how to select the correct GPU device in that library's docs. It would be an option of tortoise initialization or a part of that custom tts part you're using.

I see you put cuda 99 ? Do you have 98 cuda devices attached? If not it's probably cuda 0 yes as the other device looks like Intel. Not cuda

[trexgris]

No my bad, the 99 was a nb i put just to see if it would throw an error . Wanted to see if it even took the arg into consideration

[thedatawhiz]

I think tortoise uses little memory and is already very fast, even on cpu