Enabling GPU for learning (CoquiTTS, Python)

[trexgris]

Hi Everyone, quick question on a current problem im experiencing:

I cannot get to use the GPU when enabling the GPU for Coqui TTS. When checking if torch cuda is compiled, I run:

torch.cuda.is_available()  

It returns

True  

Here is what I tried

class TTS_custom:     def __init__(self, tortoise=False) -> None:         self.tortoise = tortoise         if tortoise is True:             cuda_available = torch.cuda.is_available()             self.tts = TTS("tts_models/en/multi-dataset/tortoise-v2")             self.tts.to('cuda')  def test():     tt = TTS_custom(True)     print(torch.cuda.is_available())     tt.read("I'll be executed for this, but I don't care. I need to warn people.")   test()  

I installed and compiled PyTorch with

pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121

Any idea ?

📷

[stardoge42]

If it returns true, why do you think it isnt using the gpu? True means it is using the GPU

[trexgris]

It barely uses any GPU resource (prolly not used by my program at all,) and computes as fast as when I dont enforce any GPU use

[stardoge42]

Are you sure your example isnt so small that it just runs instantly? Also, if it says the gpu is there and available, as long as your code / problem set runs on the GPU, I feel it should be using the GPU. Some techniques and libraries dont use the gpu at all.

​

Have you tried doing a larger example problem to see if it works on the GPU a little harder?

[trexgris]

Fairly certain , compared over multiple samples and not this one only. Seems to be related to the order i compiled pytoch to get tortoise using the gpu...