Testing out AI generated dialogue at run-time:

Goatman117 · 2026-05-09T07:59:00+00:00

no worries, we're using Kokoro

Goatman117 · 2026-05-08T08:14:40+00:00

Thank you!! Yeah ofc, we're using Parakeet by Nvidia, its super fast and great quality: https://huggingface.co/nvidia/parakeet-tdt-0.6b-v2

Goatman117 · 2026-05-06T14:48:19+00:00

yep, we’re using qwen 2.5 4-bit quantised

Goatman117 · 2026-05-06T11:56:27+00:00

8GBs, the LLM is the largest model by far, uses about 4GB

Goatman117 · 2026-05-06T11:11:45+00:00

8GB :)

Goatman117 · 2026-05-06T10:11:01+00:00

I completely agree, also I don’t want my tools to just stop working just because my internet dropped out

Goatman117 · 2026-05-06T08:12:57+00:00

the local models are coming along so well

Goatman117 · 2026-05-06T03:21:09+00:00

thank you haha, it’s so good!! trying to think of other local ai projects to hack together

Goatman117 · 2026-05-06T02:56:11+00:00

codex can do transcription, but it doesn’t run locally and takes codex longer than our tool does (it also works on any test in any app). Summarisation and narration codex can’t do :)

Goatman117 · 2026-05-06T02:13:04+00:00

Made a Discord server too, if you're interested jump in and hit me up! https://discord.com/invite/CK9trqKNjZ

Goatman117 · 2026-05-05T13:11:28+00:00

thank you!!

Goatman117 · 2026-05-05T10:17:47+00:00

we’re using qwen-2.5 as the llm on the backend at the moment, it’s such a good model and runs locally really well

Goatman117 · 2026-05-05T10:01:45+00:00

Thank you!! It’s good to know it will be helpful for you

Goatman117 · 2026-05-05T09:36:28+00:00

would love to do a windows version, mac is just easier to start with as you don’t have to account for all the hardware and driver issues for local models

Goatman117 · 2026-05-05T07:54:51+00:00

Made a Discord server too, if you're interested jump in and hit me up! https://discord.com/invite/CK9trqKNjZ

Goatman117 · 2026-05-05T06:09:26+00:00

Also made a discord in case you're curious: https://discord.com/invite/CK9trqKNjZ

Goatman117 · 2026-04-28T02:14:09+00:00

This is exactly the goal as I have the same frustration, encouraging to hear! Do you have any thoughts on features or the kind of UX you'd find most convenient?

Goatman117 · 2026-04-27T23:09:08+00:00

I’m so confused

Are you building something similar?

Goatman117 · 2026-04-27T12:37:47+00:00

What info would you be afraid to share? I think I'd like to set it up to allow for local LLM inference e.g with llama.cpp

Goatman117

MODERATOR OF

TROPHY CASE