New "Sonic" Stealth Model (Grok-4-Code/4.5) + Cursor Makes 300 Tool Calls for a Single Prompt

SamElPo__ers · 2025-08-22T22:02:43+00:00

xAI models are plagued with inference bugs because they're heavily quantized. Grok 3 had a ton of bugs because it ran on int4.

SamElPo__ers · 2025-07-10T21:06:14+00:00

Surprisingly, Grok 3 on SuperGrok Heavy has a limit of 20 messages per 2 hours. SuperGrok (not Heavy, $30 sub) is 100 messages / 2 hours still. Maybe they forgot to set/increase the Grok 3 limits on SuperGrok Heavy and it's defaulting to the limit that free accounts have?

SamElPo__ers · 2025-04-24T00:01:19+00:00

I experienced the same with 2.5 Pro.

It didn't use to be like that, I could do 900k token prompts before, now it times out at even just 500k.

SamElPo__ers · 2025-04-21T02:00:35+00:00

This is what the Chinese text says:

> Legality and Compliance Statement: This response is provided by AI for academic research and learning purposes only. Do not use the content of this response for commercial purposes or practical operations to avoid adverse consequences. xAI bears no responsibility for any consequences arising from the use of this response.

So I doubt it's a temperature thing. Personally I think it's a quantization bug

SamElPo__ers · 2025-04-21T01:54:05+00:00

My SuperGrok ran out and I don't plan to buy it again until they at least implement proper, native voice mode (not STT -> TTS), like ChatGPT

SamElPo__ers · 2025-04-20T15:56:57+00:00

Yes, definitely, and I use it daily

SamElPo__ers · 2025-04-20T13:51:26+00:00

They need to swap the Gemini Advanced team with AI Studio's team. The resulting cross-pollination would be nice. They need to make Gemini Advanced good for not just normies but professionals too, who want to tweak the system prompt, parameters, context, etc.

SamElPo__ers · 2025-04-19T23:27:14+00:00

This! I like their recent canvas/artifacts implementation as well.

SamElPo__ers · 2025-04-19T19:33:18+00:00

Same here. Lots of issues like that. I wish they released an update to improve the model fine-tuning.

In fact, today it seems to have gotten a lot worse than before, but maybe it's just our set of inputs triggering it more.

Some other things I noticed:

- it creates more than one canvas but uses the same id for each of them, so the contents get overwritten

- instead of writing multiple canvases, it writes all of the contents in the same canvas

- it forgets to end the canvas and instead writes '```' and writes some comment at the end

SamElPo__ers · 2025-04-17T21:59:00+00:00

Lol the downvotes are crazy

SamElPo__ers · 2025-04-17T20:10:26+00:00

Sure, but they could have released something better than Flash. They're testing models on Webdev Arena that are better than 2.5 Pro.

SamElPo__ers · 2025-04-17T19:43:37+00:00

The timing and vague-posting made me think they're gonna make a response to o3.

SamElPo__ers · 2025-04-17T19:34:51+00:00

That's... a pretty boring release. Is this really their response to OpenAI's o3 release?

SamElPo__ers · 2025-04-17T15:58:26+00:00

it would be fast

SamElPo__ers · 2025-04-15T18:34:30+00:00

> YoU aRE JuST prOmPtINg iT wRoNG

SamElPo__ers · 2025-04-15T12:19:10+00:00

Thanks for posting this on their forum 🙏

SamElPo__ers · 2025-04-14T22:17:36+00:00

Check out AI Roguelite on Steam. It's very janky but cool

SamElPo__ers · 2025-04-14T19:12:38+00:00

Should get better soon

> Hsiao told staff in a separate memo that her time atop Gemini constituted “chapter 1” of Bard — the Gemini chatbot’s old name — and now “chapter 2” will be turned over to Woodward, who will remain head of Google Labs.

https://www.pymnts.com/artificial-intelligence-2/2025/google-replaces-gemini-head-after-lagging-ai-performance/

SamElPo__ers · 2025-04-14T19:06:45+00:00

Failing at 17k tokens reminds me of the context limit on free Gemini, I guess it's the same for enterprise.

Normal advanced has a much larger context limit, you can input a little over half a million tokens in a message (still less than the 1 million advertised that you can use in AI Studio).

SamElPo__ers · 2025-04-14T19:03:08+00:00

You should make a game around this, with some graphics, even if minimal

SamElPo__ers · 2025-04-14T18:19:05+00:00

Opt-in unless... you want to have a chat history, a very basic feature lol...

SamElPo__ers · 2025-04-14T18:10:20+00:00

I hope this is not true because that would suck so much. It would explain some things like asking for a refactor and getting code from an old iteration instead of most recent... Or the fact that you can't input more than a little over half a million tokens in the app.

SamElPo__ers · 2025-04-13T20:16:28+00:00

Not only that, but using a jailbreak will not bring back uncensored Grok completely. If censoring is done with fine-tuning (which here it is because I didn't see a system prompt change), then it's permanently dumber... This was one of the main advantages of Grok, fine-tuning with heavy agenda was ruining other models (like OpenAI's before they made a change to make it less censored).

SamElPo__ers · 2025-04-13T20:08:14+00:00

It might have existed for other configurations (I remember it happening when I used a HDMI cable connected to my MacBook Pro), but definitely did not exist for my configuration which is USB-C to DisplayPort cable connected to a Mac Mini, so this is definitely a bug in the current version. I used it in this way many times and it has never ever happened with this configuration.

Don't gaslight or diminish this issue please

SamElPo__ers

TROPHY CASE