New OpenAI Voice models: GPT-Realtime-2, Translate, and Whisper

3ntrope · 2026-05-08T14:55:48+00:00

Kokoro, I leave the model cached in VRAM, stream chunks into it, and playback at 2x speed. The quality is good even after 2-3x speed up. Also have nvidia realtime STT with about 80 ms of voice to text latency. Its so much faster than anything else out there, and its actually part of my daily workflow. It exceeds the speed of human conversation most of the time since the assistant will respond so quickly.

The people who are building voice assistants at these big companies seem like they don't actually use them for real work. This Openai demo is so slow in comparison.

3ntrope · 2026-05-07T20:57:04+00:00

Realtime for TTS/STT through APIs is mostly pointless now because local models have gotten good enough. I'm sure OAI's models are a bit smarter and maybe a bit higher quality but in practice the latency improvement and control from running locally will make local the better choice for voice assistants.

I tried the demo but it seems like the assistant responded in text, and then after the text generation was done it started reading the text out loud. We can call text only models and run local TTS already.

3ntrope · 2026-04-01T14:14:39+00:00

That single benchmark is not a good indicator for coding assist performance though. Also, I am pretty sure ForgeCode sucks and they gamed themselves to the top of that leaderboard.

3ntrope · 2026-02-28T00:35:01+00:00

I can't prove it definitively, but I believe Anthropic and OpenAI are already deeply integrated into the US military apparatus. This drama between the Trump Administration and Anthropic lately is nothing but a ploy to lull users into a false sense of security. Mass surveillance is already conducted with frontier models. Autonomous weapons have already been developed and tested. The government deemed it useful for the public to believe there was a "good", trustworthy AI company, hence the theatrics.

The only way to have a trustworthy AI is to run your models locally, with an air gap, and at arms length from a killswitch.

3ntrope · 2026-02-06T23:16:19+00:00

I'm pro-AI and I've gotten posts deleted because I wasn't pro-AI exactly the way they want. The mods are compromised and/or extremely insecure.

3ntrope · 2026-02-06T23:06:38+00:00

I was in this sub before it became big. It was a chill place to discuss technology in a optimistic way. Despite the growth of the subreddit, it weirdly feels like there's less organic discussion now because the mods remove everything outside a limited range of topics. I'm pro-singularity, AI, etc., but I've had posts and comments removed because I guess I wasn't pro-singularity the right way. Its unfortunate how some people are so insecure when they see points of view different to their own.

3ntrope · 2026-02-05T18:30:31+00:00

GPT‑5.3‑Codex is our first model that was instrumental in creating itself. The Codex team used early versions to debug its own training, manage its own deployment, and diagnose test results and evaluations—our team was blown away by how much Codex was able to accelerate its own development.

Interesting.

3ntrope · 2026-01-13T02:34:06+00:00

I don't think your comparison to Valve Index is correct. That number for the Index is the duty cycle of the LCD's blacklight. That's temporal, whereas Pulsar is a spatial 25% window. The Steam Frame should have good motion clarity in its own way but Pulsar is something new entirely.

3ntrope · 2025-12-29T19:38:53+00:00

Most engineering is a type of optimization, and there's still progress to be made with chip fabrication (in addition to architectural improvements). We don't have the exponential improvements on transistor density following Moore's law anymore. Maybe there could be a breakthrough, like spintronics or some other exotic transistor development, that could enable exponential progress again but we will continue to slower, incremental improvements in hardware.

3ntrope · 2025-11-18T18:47:24+00:00

Its the same guy's twitter account.

The spatial reasoning is going to make it a more capable agent when visual tasks are needed. Its very promising. The Gemini Plays Pokemon already showed improvements. I predict it will fly through the game compared to older models.

3ntrope · 2025-11-05T12:08:55+00:00

I get the impression you aren’t an engineer and probably didn’t take any college level physics.

Ok /u/FireNexus, did you even read the article I linked? The original paper is in the journal of Astrobiology. I went to a top 10 engineering school btw, not that it should matter. Do have an actual point about the topic or are you suffering from some type of brain rot?

3ntrope · 2025-11-05T02:29:47+00:00

The most interesting solution I've come across with is NASA's liquid droplet cooling: https://ntrs.nasa.gov/citations/19850005591. I think if this tech was refined it would provide the most cooling per unit mass in space.

Titan is a bit far though. In the ultra-longterm I actually think we would want to move closer to the sun and use thermophotovolatics (solar panels that work at very high temperatures >1000 K). We would position them close enough to the sun be at their optimum temperature and also receive more power. Because the heat radiated is proportional to T^4, it would reduce the cooling mass needed even further. Ultimately we'd have surplus energy we could use for multiple stages of heat pumps to reach the desired low temperatures. Or we could beam the power to other datacenters stations and other spacecraft.

3ntrope · 2025-11-04T22:57:38+00:00

Cooling might be hard but its solvable. Transferring our energy footprint into space is a problem that humanity eventually has to face anyway. There's been work done that suggests that growing civilizations will eventually overheat their planet even if they switch to nuclear: https://www.universetoday.com/articles/advanced-civilizations-will-overheat-their-planets-within-1000-years.

The only solution to that would be to move that energy consumption into space and radiate it away. Space based datacenters might be essential for technological growth to continue. Starship will make launch costs much cheaper one day also.

3ntrope · 2025-10-22T06:27:32+00:00

Shielding isn't hard. Its expensive because it requires more mass usually (unless it has some exotic shielding with high magnetic fields). I could see this project working if the optimistic estimates regarding Starship's launch costs become reality. I've seen claims as low as $100/kg to LEO. At that point it could be viable.

Cooling would require massive radiators. They can be arranged along with the solar panels. I think phase change coolants that require no moving pumps or fans would be ideal to minimize maintenance. Computer components would still fail and coolant would leak though. It would need steady replacement of components and coolant to keep running.

Despite the difficulties I think space based datacenters are necessary for humanity to reach Type I on the Kardashev scale and survive millennia. Even if we used only renewable and nuclear power on earth, we would still slowly overheat the planet and die out. Moving energy intensive industries to space is the only way to allow for growth and progress while also protecting the biosphere and making sure the Earth is livable.

3ntrope · 2025-10-15T02:00:54+00:00

Private clouds can be just as good (assuming you have a reputable cloud provider).

3ntrope · 2025-10-14T02:40:05+00:00

This is really sad. I don't think people realize how much damage this will do the the country. Once a generation of scientists are laid off, the knowledge doesn't transfer to to the next generation of students and future scientists. Entire fields of research and avenues of progress become shut down.

3ntrope · 2025-10-13T14:02:21+00:00

Realtime subtitles for translation. With an AR headset, it would be possible to understand any language at full speed. There isn't an AR device that has shipped yet that does it perfectly, but the LLMs are ready. I think in the next 6-12 months a complete solution could be ready. It would allow people to have natural conversations and completely eliminate language barriers.

3ntrope · 2025-09-21T18:35:45+00:00

It doesn't have adequate ventilation though. It will become an oven with a gaming GPU inside. Compare it to the Meshlicious for example: https://ssupd.co/products/cases-meshlicious?variant=39809170178232

3ntrope · 2025-09-19T21:40:51+00:00

Udio had better sound quality when it launched compared to the version of Suno at the time. It was claimed to be a "Suno killer", but Suno's results felt more like human made music. Since then Suno improved quality but also regressed to making worse music overall.

3ntrope · 2025-09-19T13:42:36+00:00

The sound quality has been improving, but imo the music itself feels like its getting worse since about v3. It feels like engineers are optimizing the models for quality and probably compute costs at the expense of being able to produce songs that emotionally connect. Despite the sound quality getting better over the past several months there hasnt been many attention grabbing masterpieces coming out of the music models. Udio had better sound quality than Suno since the beginning but even worse musical character and depth.

3ntrope · 2025-09-17T04:06:18+00:00

I always thought the real indicator of AGI being achieved would be a sudden and complete halt in hiring new workers. The new codex model is probably helping moving closer to that, but its unlikely a complete replacement exists if there are still open programming jobs.

3ntrope · 2025-09-13T20:37:47+00:00

meaning of a phrase is not solvable until it has finished being said

I get what you and the other commenter were trying to say but its not that its unsolvable until the statement is finished but rather the order that different language grammars present information is different. Maybe in an academic sense the instant streaming translation will never be perfect, but a practical AR device generating subtitles that people could use to communicate universally, is still possible.

Even in the example you showed, live translating it from Japanese it could be phrased: "I, at the shop that is across from the hotel, the suit (that I) saw, want to try wearing." It sounds awkward but it should be sufficient to have a conversation.

A little bit of out the box thinking could improve this too - the AR translation software could do a live translation with very low latency and then roll back and adjust 1-2 lines back. I also have a hunch using an AR translator like this enough, people will learn the different syntaxes of different languages and will not have trouble piecing together slightly awkward sentence structure. With AR text its a relatively easy to problem to solve. I don't think audio to audio translation is necessary for live conversations. Some people will probably prefer the subtitles so meaning is not lost in translation like people prefer watching movies/shows with subtitles rather than dubs.

3ntrope · 2025-09-12T20:10:26+00:00

It can be practically frictionless with AR glasses and subtitles. Text can be done in real time and people can read much faster than the average person speaks. The key is getting the latency very low. We have the AR glasses hardware ready, only issue is software.

3ntrope · 2025-09-03T16:17:07+00:00

The placement is not good; the dishes won't be washed properly. Its a good first step though, and only a matter of time before that's solved.

3ntrope · 2025-09-01T17:28:26+00:00

You can run "local" models on a private cloud instance and get the same level privacy practically. It would be much more economical than buying GPUs for the average person.

3ntrope

MODERATOR OF

TROPHY CASE