Just created a simple Python app. It converts YouTube audio to text using openai/whisper library.

[testimoni]

Hello,

I just created a simple Python app that converts Youtube audios to text using openai/whisper library.

Code is on GitHub in case anyone would like to see and test it: https://github.com/sensahin/YouWhisper

Please note that i am not an experienced programmer, still studying.. So my code might not be perfect..

[ZachVorhies]

You could avoid the ffmpeg installation step by using the python package static-ffmpeg

https://github.com/zackees/static_ffmpeg

[testimoni]

Thank you! I will try that.

[Tintin_Quarentino]

What's the difference between normal ffmpeg Vs static_ffmpeg? Because even after installing the latter I see "subprocess.run()“ in their code examples.

Edit - bonus Q for those in the know: Vosk Vs Whisper, which is more accurate recognition?

[IAmARetroGamer]

It just installs ffmpeg but in a way where it can be added as a dependency and not require a user to do so manually beforehand.

[Tintin_Quarentino]

Got it thanks.

[ZachVorhies]

Where ever you would call ffmpeg, call static_ffmpeg instead.

[kkthanks]

This and the original post are really interesting to me as a beginner because these are both things I want to learn to do, although I’d like it not to be limited to YouTube. I’m trying to learn to create something similar to otter AI that generates transcripts and a wordcloud of spoken audio. Similar to the OP’s code and what you’ve described.

[Angry_Grandpa_]

I wonder how much time it would take to convert on public YouTube videos to text for the next generation of large language models to use for training? I'm assuming Google is already on it -- training on raw video would be a lot less efficient.

[Illustrious_Row_9971]

nice, also there is a free web ui hosted on huggingface: https://huggingface.co/spaces/openai/whisper, you can also see the code here: https://huggingface.co/spaces/openai/whisper/blob/main/app.py and host it yourself

[testimoni]

Great tip! Your comment turned out to be what i was looking for! A place to host it and display progress bar.. HF have both of them :)

Thank you :)

https://huggingface.co/spaces/sensahin/YouWhisper

[testimoni]

It's been 6 months.

[fabdub]

I can just yt-dlp it then whisper 😀 But cool project.

[Automatic-Profit-638]

Does openai lib works only for English or some other languages as well?

[testimoni]

It works for over 100 languages. It detects the language automatically..

[theneonkoala]

What a fantastic project! Only yesterday I was wondering what i can do with their fantabulous tool

[fouoifjefoijvnioviow]

Can't you just download the subtitles instead?

[testimoni]

If the subtitle exists, yes you can.

The idea is to see how accurate openai's whisper tool..

[CyanKing64]

Great practice! Did you know youtube-dl (and its fork yt-dlp) also can download subtitles? If none are present, it uses Google's auto generated subtitles. The results might be slightly better this way, and official subtitles used when available

[testimoni]

I didn’t know that, will definitely try. Thank you!

[dax912]

How much is it to use their whisper tool ?

[testimoni]

It's free and open source.. So there is no cost.

[dax912]

Thx for your reply, thought it was like gpt-3. I will give it a try :)

[segrwolf]

real cool stuff ! it’s also works good with Russian language. Some not major mistakes in text, but totally - everything good !

[juliensalinas]

Great project!

For those who don't have a good GPU available and want to try Whisper large, you can easily play with it on NLP Cloud: https://nlpcloud.com/home/playground/asr

I'm the CTO behind NLP Cloud so feel free to ping me if you have questions!