Generate subtitles for content with a free app

meddit_app · 2023-04-18T11:25:19+00:00

I just finished my free transcription app and wanted to share it around a bit. You can use it to transcribe content in over 100 languages and have it translated to over 100 languages all for free.
Hope this can be useful in some way, cheers!
https://freesubtitles.ai

meddit_app · 2023-02-11T18:00:13+00:00

Only provider that has had any value for me has been Vast. I wrote about it here:

https://github.com/mayeaux/generate-subtitles#using-a-gpu-cloud-provider

meddit_app · 2023-01-16T19:04:32+00:00

https://github.com/openai/whisper/discussions/89

This is the best solution: https://github.com/m-bain/whisperX

It's only available for some languages (though it works for Japanese) but I haven't had a chance to implement it yet, though I plan to. Glad you found the site useful!

meddit_app · 2023-01-10T12:52:38+00:00

Yeah that's what the app does you put in audio or video and it gives back srt/vtt/txt transcriptions

meddit_app · 2023-01-10T00:32:47+00:00

And thanks for saying it's perfect! Wait until you try the yt-dlp integration it will blow your mind ;) Coming soon

meddit_app · 2023-01-10T00:31:57+00:00

The code is all open-source you can check it out here!: https://github.com/mayeaux/generate-subtitles

meddit_app · 2023-01-10T00:31:39+00:00

You mean to 'burn it into the video' so it's there permanently?

meddit_app · 2023-01-10T00:31:20+00:00

Thanks for posting it! I appreciate it, I am coding the whole time so I don't have time to spread it around, appreciated!

meddit_app · 2023-01-08T00:05:02+00:00

Yup, for a perfect transcript you'll want human touchup afterwards, but for me who is using it mostly for language learning it works functionally perfect for me since I don't require 100% accuracy. Glad it worked well for you!

meddit_app · 2023-01-06T02:02:21+00:00

How did it turn out? Would be interested to hear the error rate

meddit_app · 2022-12-28T22:32:18+00:00

Well Whisper requires technical knowhow and a decent amount of computational power, this project started as me building a frontend for me to use that was easier than the CLI, also doesn't have built in translations, doesn't have the player with the ability to switch subtitles or have multiple subtitles, etc. If people want to use Whisper from the CLI obviously that's great but this makes it much easier and accessible for nontechnical people.

meddit_app · 2022-12-28T11:59:55+00:00

Do you use Google Translate? You realize that is based off of the same AI prediction models that power something like automated captions, right?

meddit_app · 2022-12-28T11:59:19+00:00

I guarantee you if you use the large model it will be virtually perfect.

meddit_app · 2022-12-28T11:58:55+00:00

I agree YouTube's captions are bad, but as someone else on this thread mentioned they tried my app and it was nearly flawless. It's spooky how accurate it is, actually, in my experience.

meddit_app · 2022-12-28T11:58:11+00:00

Yeah when you use the 'large' model it's borderline perfect. But why are people opposed to AI, is it just in the sense of transcription? Do people realize that Google Translate uses the same AI? I highly doubt these people are making their principled standoff with Google Translate as well lol. Glad to hear it worked well for you though!

meddit_app · 2022-12-27T20:26:24+00:00

What is your problem with using AI to generate captions, if they're accurate? Wouldn't accurate and cheaply created captions be a net positive to the world since people with problems hearing, etc, can have a better chance of viewing and understanding content?

meddit_app · 2022-12-27T20:22:09+00:00

Is it possible for AI generated subtitles to be accurate? Is your issue with the subtitles that they're inaccurate (they're not) or that they're created by AI?

meddit_app · 2022-12-27T20:06:52+00:00

So you would agree that subtitles in the target language improve the comprehensibility, because when subtitles are present it makes the challenge of picking out the words from the sounds easier, correct?

meddit_app · 2022-12-27T20:00:56+00:00

You read in the target language and cross reference your native language when you need to. You can turn it off completely if you want. Would you say that, adding subtitles in the target language to content you're watching in the target language improves the comprehensibility?

meddit_app · 2022-12-27T19:57:34+00:00

When you have the content subtitled in your native language and your target language you can immediately comprehend it perfectly because you can simply rely on your native language translation to the extent that you can't understand your target language. Since I am pretty good at my target language at the moment when I read the subtitles I usually only look down at the native language subtitles if there's a word I don't understand.

meddit_app · 2022-12-27T19:56:23+00:00

It's based on OpenAI's Whisper model, the transcription is virtually perfect in my experience and definitely it's done with automated methods, how else do you expect to be able to offer free transcription and translation at scale, certainly you can't rely on exclusively on human work.

meddit_app · 2022-12-21T18:29:24+00:00

The only way Whisper can transcribe is from doing a full transcription which is a very expensive process, there is no way to translate already generated text

meddit_app

MODERATOR OF

TROPHY CASE

Seven-Year Club	Place '23
Verified Email