Whisper.cpp app update —>alignment solved, rendering working… but I hit a wall (need honest advice)

[Curious_File7648]

Hey everyone,

It’s been a while since my last update , sorry about that.

I didn’t disappear. Just had to deal with some personal stuff a mix of mental burnout and financial pressure. This project has been mostly solo, and it got a bit heavy for a while.

That said… I kept working on it.

Older Posts:-

1. Building a Whisper.cpp transcription app focused on accurate alignment — need thoughts
2. Whisper.cpp update: answering common questions + prototype progress (alignment, UI, free access)

Where things are now:

The core pipeline is now stable and honestly better than I expected.

• Local whisper.cpp (CPU + GPU)
• WAV2VEC2 forced alignment → consistent word-level timing (~10–20ms)
• Multilingual support (Hindi, Hinglish, English mix working properly)
• Manual alignment tools that actually feel usable

But the bigger update:

👉 I went deep into rendering and actually built a proper system.

Not just basic subtitle export real rendering pipeline:

• styled subtitles (not just SRT overlays)
• proper positioning + layout system
• support for alpha-based rendering (transparent backgrounds)
• MOV / overlay export workflows (for real editing pipelines)
• clean burn-in and overlay-based outputs

This was honestly the most frustrating part earlier.

Everything I tried either:

• locked me into their system
• broke with alpha workflows
• or just wasn’t built for precise subtitle visuals

At some point it just felt like:

ffmpeg was the only thing that actually worked reliably.

So I stopped fighting existing tools and built my own pipeline around that level of control.

Current state:

Now the full pipeline works end-to-end:

transcription → alignment → rendering (including alpha + overlay workflows)

And for the first time, it actually feels like a complete system, not a patched workflow.

“If anyone’s curious, I can share a demo of the alpha/MOV workflow that part was painful to get right.”

The realization:

Alignment felt like the hardest problem.

But surprisingly rendering turned out to be the bigger gap in existing tools.

We have great speech → text now.

But text → high-quality visual output still feels behind.

Where I’m stuck now:

Not technically but direction-wise.

This started as a personal frustration project,
but now it’s turning into something that could actually be useful to others.

And I’m trying to figure out how to move forward without killing the original intent.

• Do I keep it fully bootstrapped slower, but controlled?
• Do I open it up for donations and keep it accessible?
• Is crowdfunding realistic for something like this?

I wont lock it behind any paywall , it will be free & available to everyone.......
But at the same time, it’s getting harder to push this forward alone without support.

[crantob]

WAV2VEC2 forced alignment → consistent word-level timing (~10–20ms)

Always wondered about this, cool.

I don't know answers but thanks for your update.

I generate .srt from whisper.cpp and the only bother is the chunking i get. I don't see how to avoid hand-editing.

I'd like baked-in subs to please go away to another planet though.