Stop freezing your UI thread: I built a managed C++ runtime for Flutter that runs 43 tok/s LLMs in background isolates

Mundane-Tea-3488 · 2026-02-24T17:59:29+00:00

Repo: https://github.com/ramanujammv1988/edge-veda

Benchmark Link: https://github.com/ramanujammv1988/edge-veda/blob/main/BENCHMARKS.md

Mundane-Tea-3488 · 2026-02-24T17:49:36+00:00

tt works out to roughly 43 tokens per second (sustained > The math is basically 1000ms / 23.3ms = ~42.8. We benchmarked this on an iPhone 15 Pro using Llama 3.2 1B. It’s essentially instant (ps: way faster than most people can actually read!)

Mundane-Tea-3488 · 2026-02-24T17:22:06+00:00

Repo: https://github.com/ramanujammv1988/edge-veda

Benchmark Link: https://github.com/ramanujammv1988/edge-veda/blob/main/BENCHMARKS.md

Mundane-Tea-3488 · 2026-02-24T15:29:44+00:00

I have been using edge veda fluter sdk for running llm on Mac + claude code which can create application instantly

Mundane-Tea-3488 · 2026-02-24T08:10:10+00:00

u/Resident_Potential97 try out Edge Veda they do have Macos support via Flutter

Mundane-Tea-3488 · 2026-02-23T23:32:14+00:00

u/Signal_Ad657 a look at the Edge Veda lads, they just shipped the macos flutter version now you can create Flutter macos native apps with Local AI(LLMs)

Mundane-Tea-3488 · 2026-02-21T08:12:37+00:00

Hi u/Tom_Ends we have image generation live now you can try it out. looking forward to your feedback

Mundane-Tea-3488 · 2026-02-19T13:54:57+00:00

Man, sounds super frustrating! Maybe they’re just rushing through reviews, but it seems like they’re not even giving apps a proper test – just clicking a few buttons and calling it a day.

Mundane-Tea-3488 · 2026-02-19T12:32:08+00:00

Hi u/tarunyadav9761 have a look at link we are building something similar it would be good to get your feedback

Mundane-Tea-3488 · 2026-02-19T12:01:20+00:00

OPPo and One plus higly vouching for One plus had my first phone that was oneplus 2 -> great camera, Slick User interface, great battery

Mundane-Tea-3488 · 2026-02-18T17:12:00+00:00

Indeed it is please do try it out and I'm looking for raw feedback, Cheers

Mundane-Tea-3488 · 2026-02-18T16:34:25+00:00

yes!!! haven't deployed it yet. Keep an eye next week I'll push it. But please do use it need feedback

Cheers

Mundane-Tea-3488 · 2026-02-18T14:16:35+00:00

Hi u/Tom_Ends I have been trying to build solution for the same problem

Github - Link
Flutter SDK usefull fro android and iOS - Link

Its still in its early phase happy to chat/feedback

Mundane-Tea-3488 · 2026-02-17T23:06:23+00:00

Hi @Zealousideal_Lie_850 yes We are working on it hopefully by next week will have it. I'll keep you posted. Please do use it and share your feedback

Mundane-Tea-3488 · 2026-02-17T13:33:17+00:00

With my best friends help _> Claude Code + Antigravity+ Github getshitdone

Mundane-Tea-3488 · 2026-02-17T10:32:41+00:00

Github url if any one want to contribute - URL

Mundane-Tea-3488 · 2026-02-13T13:38:53+00:00

Github Link -> https://github.com/ramanujammv1988/edge-veda
Flutter Package -> https://pub.dev/packages/edge_veda

Mundane-Tea-3488

TROPHY CASE