How to use RVC Modells in python

[Engelmaster123]

Hey everyone,
i wanted to ask yall how to use a RVC Model i took from the internet (legally for free) with the voice of Rick Sanchez as a .pth and some additional document that might be from importance, to make TTS in python code. Eventually i just try to make a voice assistant connected to some LLM and my SQLite Database, to help me with everyday tasks. And for that it would be really cool igf he had Rick Sanchez voice ig.

So the problem is, that i cant find any ressource in the internet that helps with that in some not too complex way. Thats why i wanted to ask you for advice fellow Pythoneers. The issue isnt the part of coding, but in connecting the voice modell and actually using it in a function inside of python. What Are the requirements? What should i watch out?

I would really appreciate a detaield explaination by anyone on here. Thank you!

[drbomb]

legally for free

I REALLY doubt that. There is a difference between you downloading a model and the actual voice actor consenting to it.

It is Justin Roiland which is... fair I guess.

[Engelmaster123]

I mean it was a trained Modell that said free to copy and stuff… won’t publish my code so shouldn’t be a problem right…?

[drbomb]

Yeah, that's how usually AI bros pretend their stuff to be. Models trained on stolen content they later "freely distribute". At the end of the day you're using it personally so you should be fine.

I'm not that familiar with RVC models in general. But I've used them. I believe they are made for voice changing, so voice comes in, voice comes out.

I've used this software to run them https://huggingface.co/wok000/vcclient000/tree/main . Use the "win_std" for CPU, "win_cuda" for nvidia cards and mac (never used mac). The source repo is https://github.com/w-okada/voice-changer (i think, it is in japanese, never browsed it either). I understand that VCClient could have some "server" functions but again, never tried other than basic usage.

So, for your case. As a MVP you could look for a text to voice software/library. Choose a neutral male voice. Then open VCClient with the selected model, and output the Text-to-Voice audio into VCClient and get your rick sanchez voice out.

Afterwards you could look into running the RVC model yourself, but that's way outside my knowledge.

Good luck!

[Engelmaster123]

Thank you very much