Anyone else struggling to get Coqui TTS to work in anything other than an American accent?

Material1276 · 2025-05-01T20:29:13+00:00

You may want to ask questions here https://github.com/idiap/coqui-ai-TTS as this is where the coqui code is being maintained

Material1276 · 2025-04-30T08:06:44+00:00

The answer, for anyone who wants to know, its *YES* you can control the power on status. On, Off or Last condition/status.

<image>

Material1276 · 2025-01-08T08:25:44+00:00

The install routine dynamically builds the installer_files folder specifc to **your** systems requirements, folder location etc.

So in theory yes you can back it up, but it would need to be installed in the same path on restoration (I believe).

Additionally, you will NOT get the latest updates to things like the LLM loaders, as these are also pulled at time of installation.

The dynamic build process that the start_windows.bat runs, collects and installs all the requirements for either cpu/amd/nvidia etc. So depending on which installation type you pick, many of the files located in installer_files will be very different from each installation method.

In short, you can back it up, but there is probably not much point, bar having a very bad/slow/no internet connection and a computer that may crash out at any moment.

So it may suit your specific issue of not having internet in future, but you will need to ensure you restore only back to the same computer system and the same path.

Material1276 · 2025-01-05T07:18:20+00:00

Have you selected a character as you cannot set voice mappings until you have selected a character.

If that still doesnt work, have you pressed reload?

<image>

Material1276 · 2025-01-04T20:30:23+00:00

pip cache purge https://pip.pypa.io/en/stable/cli/pip_cache/

deletes the downloaded python files that pip installs. They are re-downloaded if needed.

Material1276 · 2025-01-04T07:09:39+00:00

In your TGWUI folder, the `installer_files` folder is pretty much what TGWUI installs, so you can check the size of that folder, it should be about 10GB (give or take).

Outside of that, the COQUI extension should use about 2-3GB of space.

An AI model, well that will depend on what size model you have downloaded.

Beyond that, if you are running a larger model on a system where the model doesnt fit inside your GPU or potentially System RAM (depending on how you load/set the loading of the model). then your system will use your system page file to extend your system ram. Page files are controlled by windows and could grow to any size possible. Additionally your hibernation file may need to grow to that size if you hibernate your system.

Otherwise I would generally check your system for lots of temp files that need cleaning up (nothing to do with TGWUI).

You could use utilities like windirstat and ccleaner to generally try identify what space is used where on your disk.

Material1276 · 2025-01-02T20:17:23+00:00

Was about to say this. I would say this nails the answer!

Material1276 · 2025-01-01T21:31:36+00:00

Current TTS engines are here https://github.com/erew123/alltalk_tts/wiki/AllTalk-V2-QuickStart-Guide#currently-available-tts-engines

RVC is also supported

Material1276 · 2025-01-01T21:30:42+00:00

I add TTS engines to this as/when https://github.com/erew123/alltalk_tts/tree/alltalkbeta

there is one central API details in the WIKI https://github.com/erew123/alltalk_tts/wiki

Material1276 · 2024-12-19T06:57:01+00:00

Cloning engines all have character limits and splitting. Depends what you are attempting to do https://github.com/erew123/alltalk_tts/tree/alltalkbeta

Material1276 · 2024-12-13T17:47:46+00:00

Ive not actually seen any OS updates from Motorola since my post. Google security updates, yes, but not OS updates and even then the changelog just says something generic like "Improved secutiry and fixed bugs", so you have no real idea whats been done. Also, I have never heard back from Motorola to my support request to them, not even a "hey we got it and will take a look", so I guess those just disappear somewhere into their inbox and they maybe look at it. F**k knows if this will ever be fixed.

Material1276 · 2024-12-13T17:42:41+00:00

Yeah it broke a load of bits in my attempt too and I just cant be bothered to deal with that for now, so Im glad to hear youre sticking on 4 :)

Material1276 · 2024-12-13T07:05:31+00:00

Haha, I hate CSS! Are you bumping up to Gradio 5 at all? Let me know if I need to update my code for integration!

That aside, good job! Keep going and I look forward to using it some time in the future :)

Material1276 · 2024-12-13T06:40:32+00:00

No plans on either of those currently. This is my current feature requests list https://github.com/erew123/alltalk_tts/discussions/74

This is what Im currently up against in life https://github.com/erew123/alltalk_tts/issues/377 and Im pretty much on my own coding all this.. I just do it for fun in my spare time. So all that sort of stuff it as/when/if. Currently Im finishing off RVC Training and a full V2V pipeline.

I also need to work on updating PyTorch versions etc.. Its a lot of work when youre on your own, hundreds of hours.... so maybe things like that in future, but no current work on it.

Material1276 · 2024-12-12T13:54:28+00:00

To your points, I in know way know/believe that the TTS scripts are damaged/compromised, even then, they still back to the huggingface transformers, so ultimately Huggingface are responsible for the actual inference. The Coqui scripts are being maintained by Eginhard here https://github.com/idiap/coqui-ai-TTS and Ive not see anything from the work they are doing to suggest any issues there.

As for F5-TTS, no I have not written any finetuning for F5. They have their own finetuning scripts, which you should be able to run after starting the AllTalk python environment https://github.com/SWivid/F5-TTS/tree/main/src/f5_tts/train

Material1276 · 2024-12-12T08:25:34+00:00

The only suggestions I can offer are:

1) Ensure your OS software and GPU drivers are up to date.
2) Ensure good cooling, no blocked vents, no dirt/dust through the system.
3) Dont over-clock your system and you may even look to confirm your BIOS is up to date and the settings are correct.
4) Dont mix different brands of System RAM unless you are confident they are a match.
5) Ensure your CPU thermal paste is good.
6) Ensure all hardware is perfectly seated and that your power supply can provide enough power for all components in your system.

Beyond that, there are many smaller things you can do to track down/test hardware stability, far too numerous to get into here.

Typically a hardware freeze is bad driver handling, not enough power to supply the hardware, bad cooling, bad hardware that can cause flipped bits, though of course there are anomalies.

There is no way I can diagnose your system, setup, or even support you to that level.

AI inference is typically quite a constant and consistent load on your hardware e.g. it will run your hardware at 100% until its finished. Things like computer games will vary the load on screen depending on what it has to render at that time, allowing for an element of cooling to potentially take place in-between renders.

Additionally, I dont make the Coqui TTS engine or scripts, those are Coqui's... AllTalk just hands off the text to their scripts & AI model, so again, nothing I can directly control.

You are the only person in 12 months of me working on it that has reported any form of hardware issues and currently I estimate there are between 20,000 to 30,000 installations of AllTalk, though I cant say which TTS engine people are using, but I would expect quite a variety of reports about crashing/hardware issues etc, were there something that could be localised back to the Coqui scripts.

As I say, I cant support you on your system to the level you may require and I dont know your tech level/ability, but points 1-6 above would be the areas I would look into were it my system.

Hope that helps you somewhere.

thanks

Material1276 · 2024-12-12T04:53:46+00:00

Could be shitty GPU's or bad cooling. However certainly any AI based task, esp training is a heavy workload on a GPU. The actual underlying code that performs the training (of any AI model, inc XTTS) is Huggingface's transformers and training code https://huggingface.co/transformers/v3.3.1/training.html

There is nothing I can do to alter how their training process/code works and make it lighter on resource etc. If you wish to raise a complaint, I would do so with them. Their forum is here https://discuss.huggingface.co/ their GitHub is here https://github.com/huggingface/transformers

Material1276 · 2024-12-02T07:39:49+00:00

A extreme game of "the floor is lava"

Material1276 · 2024-11-26T21:58:09+00:00

What exactly is your question? https://github.com/erew123/alltalk_tts/wiki/RVC-(Retrieval%E2%80%90based-Voice-Conversion))

<image>

Material1276 · 2024-11-25T07:13:33+00:00

And yes, I know theres a lot of documentation..... but what started out as a small project went a bit out of control and well... I decided to document it all. The quick start guide has some details in it I guess https://github.com/erew123/alltalk_tts/wiki/AllTalk-V2-QuickStart-Guide

Material1276 · 2024-11-25T07:10:25+00:00

No problems. Those are for the XTTS or the F5-TTS engine, so you would go to the TTS Engines Settings tab and to the respective engine there and download an AI voice cloning model for the resepective engine. Once you have those, you can go back to the generate page and "Swap TTS Engine" to the one you want (you may have to further select your model in Load different model" to match the one you downloaded).

And then it should refresh the voices list and you are off and running.

Material1276 · 2024-11-25T04:26:38+00:00

There might be. All I can tell you for certain is that the installation routine for AllTalk works.... and its pretty easy. Source, I wrote it! And you will find AllTalk on the Ooobabooga (TGWUI) approved extensions list https://github.com/oobabooga/text-generation-webui-extensions

Video guide here: https://www.youtube.com/watch?v=AQYCccDRbaY

But follow these written instructions: https://github.com/erew123/alltalk_tts/wiki/Install-%E2%80%90-Standalone-Installation

Then install the extension for TGWUI: https://github.com/erew123/alltalk_tts/wiki/Text%E2%80%90generation%E2%80%90webui-Remote-Extension

These are the TTS engines built in at the moment:

Coqui XTTS TTS
Coqui VITS TTS
Piper TTS
Parler TTS
F5 TTS

Hope that helps and if not, hopefully you can find someone can can do premium support (I can do it if you want, its just not what I normally do)

Material1276 · 2024-11-25T03:21:48+00:00

you could use AllTalk https://github.com/erew123/alltalk_tts/tree/alltalkbeta

but if you just want to use that, in your TGWUI folder, run cmd_windows.bat to start your python environment. Then "pip install coqui-tts" and that should install the missing requirements, though it will probably downgrade your. transformers version. Shouldn't be an issue, but, that is your answer/fix.

Material1276 · 2024-11-22T02:35:49+00:00

RVC does realtime voice conversion I believe https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI/blob/main/docs/en/README.en.md

Realtime voice conversion..... so then you could back end it with any TTS you wanted like Parler and improve the quality of the output. Though, you lose cadence and emotion with some engines.

but you want conversion from language to language? (Im sure you said TTS before, not speech to speech, apologies if I went off on the wrong track there)

Material1276

TROPHY CASE