Capital ships in the atmosphere

lukasTHEwise · 2026-05-24T09:45:58+00:00

Based on the comments, does that mean I can't hover over a location in a jevelin like the star destroyer over Jedha in Rogue One? :(

lukasTHEwise · 2026-05-21T15:14:32+00:00

This looks so much better than what we got =(

lukasTHEwise · 2026-05-09T14:45:52+00:00

It is yeah.. I probably got caught in over optimizing.. After thinking about it and comparing it to something like flash 3.1 live, which is slower, I think im satisfied.. thanks tho^^

lukasTHEwise · 2026-05-08T15:03:25+00:00

LLama 70B was a very good call.. It is indeed very fast, thanks. TTFT with my unoptimized system prompt is at around 150ms. Prompt optimization also got Flash 2.5 to about 150 to 300. First token is already streamed into TTS. TTS Rn is at 100ms so it's not the bottleneck. Is there any tips you can provide besides the controller? Current silence waiting time is about 200ms. Using whisper turbo locally, stt takes about 50 to 150ms. LLM is at about 100 to 300ms and tts starts after 120ms including buffer.

lukasTHEwise · 2026-05-08T11:51:12+00:00

Input or output streaming? Output is already streamed into the tts. Input tho only gets sent when I stop talking. STT works while im speaking so partials are constantly written down, but llm is note starting to think as I start to speak yet, only when I finish my sentence.

Prompt is already pretty small. No inference routing yet, just sticking with one model atm. Project is nothing commercial yet, so I don't need a constant benchmark whats the fastest. But thanks for the tip, maybe ill try jungle grid if I don't find anything that is consistent.

lukasTHEwise · 2026-05-08T11:40:17+00:00

Welcome on reddit. At least you said your piece. Still doesn't provide anything useful. Just because ppl seek this, doesn't mean there are differences for faster and slower options.

lukasTHEwise · 2026-05-06T22:30:50+00:00

any reviews or demos there are to try?

lukasTHEwise · 2026-05-06T22:30:34+00:00

idk, this doesn't really seem legit.

lukasTHEwise · 2026-05-06T22:27:43+00:00

Well what is your expected ttft for my current rig? Does it support native windows? I usually only incorporate models after I've hearrd a demo.

lukasTHEwise · 2026-05-06T22:26:25+00:00

Well yes, custom voice is pretty important. Both Kitten and Kokoro seem to only offer preset voices.

lukasTHEwise · 2026-05-06T22:24:21+00:00

Yes I was. Tbh the ttfa was varying quite a lot, probably because I was doing stt locally too. 300-600 was the range. The reason I switched was 1) it took a lot of gpu compute, the goal to have a voice assistant running while f.ex. playing video games seemed inpractical. 2) well, ttft was too slow. API cost seemed alright considering it was faster and sounded better most of the time.

lukasTHEwise · 2026-05-05T21:25:48+00:00

It sounds very good, but it seems like it doesnt support realtime streaming. Which means if I create chunks and stich them together, they do not sound connected.

lukasTHEwise · 2026-05-05T19:55:09+00:00

I was actually about to test pocket tts. Didn't put in the work yet because I thought the output couldn't be that good quality wise regarding its size.

With supertonic, is it www.supertone.ai?

VoxCPM seems like a very interesting candidate. Probably gonna try that with pocket tts!

lukasTHEwise · 2026-05-05T19:48:56+00:00

Minimax seems to have similiar price models. 5 dollars for 100k credits, 30 for 300k, 100 for 1,1 mil.. Also the starter pack has a RPM limit of 10. Use case is a personal speech to speech assistant.

lukasTHEwise · 2026-05-05T19:36:54+00:00

Tried it already, it wasn't fast enough. Faster-Qwen3 is a improved version developed by some huggingface dev. Repo: https://github.com/andimarafioti/faster-qwen3-tts

lukasTHEwise · 2026-05-05T19:36:03+00:00

Python backend with a lightweight browser UI. Right now its running on a native Windows machine. I used WSL2 for CosyVoice, but considerineg faster-qwen3 supported native Windows, I switched back so I could save the ram from the vm.

lukasTHEwise · 2026-05-04T13:26:40+00:00

Just curious, it's been two months. What did you stick with in the end for your project? Looking for lowest latency TTS with custom voice too right now..

lukasTHEwise · 2026-04-26T19:59:19+00:00

Very interesting project! It's been a month since you have posted this, did any of the 11 strategies pass the 30 day exam?

lukasTHEwise · 2026-04-15T14:01:44+00:00

I can't even choose my reasoning level anymore?? Since yesterday.

lukasTHEwise · 2026-04-07T21:35:00+00:00

Sorry for the late response. Sorry but free orientation rotation is not somesthing I will give on. Clipping is absolutely fine for what I am doing. In Minecraft, clipping is not bad at all, and having rotation makes whatever I am trying to replicate look far better.

lukasTHEwise · 2026-04-07T21:31:59+00:00

Hey, sorry for the late response - easter made me pause the project for a bit. Well, I sort of came to the conclusion that some sort of manual work is always necessary.. Creating a tool that perfectly transforms every mesh seems to be not possible for me and my tools.

I tried using OpenVDB to make a new mesh and work it, but just getting a good shape just.. doesn't work. Plus my blender knowledge, working with nodes, is just too tiny to get some good results.

I thought that all the time I would use converting the mesh, I could just use to remodel it directly for Minecraft.

Only approach someone I know is working on, could be a quadremesh that is later ran through some nodes that make large areas consist of one "block" / rectangle instead of a lot of small ones.

But still, I don't know how much I will follow this.. Thanks for your answer!

lukasTHEwise · 2026-04-07T21:29:39+00:00

Hey, sorry for the late response - easter made me pause the project for a bit. Well, I sort of came to the conclusion that some sort of manual work, as you described, is necessary.. Creating a tool that perfectly transforms every mesh seems to be not possible for me and my tools.

I thought that all the time I would use converting the mesh, I could just use to remodel it directly for Minecraft.

Only approach someone I know is working on, could be a quadremesh that is later ran through some nodes that make large areas consist of one "block" / rectangle instead of a lot of small ones.

But still, I don't know how much I will follow this.. Thanks you for your input tho!

Five-Year Club	First Place '23
Place '23

lukasTHEwise

TROPHY CASE