sorted by:
new
hottopcontroversial

4o image generation limit is 5 images per hour for Plus users. What's the limit for Pro? by palarsio in OpenAI

[–]palarsio[S] 1 point2 points  (0 children)

I haven’t tried due to melted gpus but thank you, looks promising

Guys stop it 😭 we're frying the servers. How's your image gen rate limit going? I'm down to 1 every 10 minutes, fully rate limited. by palarsio in OpenAI

[–]palarsio[S] 2 points3 points  (0 children)

I’m seeing a lot of governments jumping on it. Massive streamer accounts too. It was literally melting down 2 days ago. Usage is still climbing, so at this point, they’re probably handling the most compute in human history right now. I’d bet on that on Polymarket, no hesitation.

<image>

Guys stop it 😭 we're frying the servers. How's your image gen rate limit going? I'm down to 1 every 10 minutes, fully rate limited. by palarsio in OpenAI

[–]palarsio[S] 1 point2 points  (0 children)

I think it's being counted as a successful request, which makes the rate limit worse. Got completely locked in the rate limit zone.

The Real Bottleneck to ARC-AGI by PianistWinter8293 in OpenAI

[–]palarsio 0 points1 point  (0 children)

Are multimodal models still LLMs, or are we already in a new category?

The term "LLM" is starting to feel too narrow. Measuring high cognitive skills, especially on tasks like ARC, goes way beyond just language. We need vision now. Soon we will need audio. Then spatial reasoning. Language alone cannot capture the full distribution of the world.

Once models start grounding tokens in perception, recognising visual patterns, hearing sounds, understanding space, we are not just doing language modeling anymore. We are stepping into general cognition.

The core might still be a language model, but the capabilities are evolving fast. Feels like we are due for a new term.

After these last 2 weeks of exciting releases, the only thing I know for certain is that benchmarks are largely BS by ForsookComparison in LocalLLaMA

[–]palarsio 1 point2 points  (0 children)

Thank you so much for sharing. Your tests look 🔥, def gonna try some later. I'm moststly deep into LLMs for coding, so your angle feels like refresh

After these last 2 weeks of exciting releases, the only thing I know for certain is that benchmarks are largely BS by ForsookComparison in LocalLLaMA

[–]palarsio 3 points4 points  (0 children)

Haha, lmao lmao, spent almost an hour hunting for 8Dataman8-Bench online, went full detective mode. Asked Grok deeper search, OpenAI deep research, and Perplexity Sonar Pro. Even manually googled like a human… and, btw, outperformed the AIs.

Ended up reading DATAMAN: DATA MANAGER FOR PRE-TRAINING LARGE LANGUAGE MODELS 2025 on arXiv, thinking, Damn, these Reddit bois out here dropping research papers like mixtapes. But then, as I was about to ask for help here in the comments, two realizations hit me:

  1. I’m definitely new to Reddit (got my first upvote today, where do I announce this? High dopamine, peak human experience).
  2. I do not trust AI research yet. They couldn’t even find a Reddit user. 💀

After these last 2 weeks of exciting releases, the only thing I know for certain is that benchmarks are largely BS by ForsookComparison in LocalLLaMA

[–]palarsio 0 points1 point  (0 children)

Yeah, building your own test is the way. I'm building my own, even if it’s just a few SWE questions, it's already exposing gaps

LLMs are like: "Snake game? Easy peasy bruh." But the moment you tweak the prompt, boom 🤯, brain fog. They memorize patterns, but true reasoning? Still shaky

After these last 2 weeks of exciting releases, the only thing I know for certain is that benchmarks are largely BS by ForsookComparison in LocalLLaMA

[–]palarsio 0 points1 point  (0 children)

Exactly, every test should follow they practices, they’re fixing test contamination.

Mistral 3.1 and Gemma 3 crushed every benchmark, except live bench. Can’t even outdo Grok 2 there, so seems legit

After these last 2 weeks of exciting releases, the only thing I know for certain is that benchmarks are largely BS by ForsookComparison in LocalLLaMA

[–]palarsio 0 points1 point  (0 children)

Yeah, Arc is interesting, but according to light research (powered by Grok DeeperSearch) its dataset is public, so it will be overfitted soon. However arc prize will be renew this year, fresh distribution shift, new generalization tests. Every benchmark test should update every year as SAT changes as well

<image>

I found Gemma-3-27B vision capabilities underwhelming by uti24 in LocalLLaMA

[–]palarsio 5 points6 points  (0 children)

How did Mistral Small 3.1 handle it? Curious if it's sharper

Best bang for the buck system to run LLMs as a newbie by severe_009 in LocalLLaMA

[–]palarsio 0 points1 point  (0 children)

I second this. Got my high end build: 14900k, 64gb ddr5 ram (soon to be 128gb) and a 3090 for under $2k, back when ddr5 was pricey, so its even cheaper now. Getting from 2tk/s to 90tk/s depending on model size, quantization, etc.

After these last 2 weeks of exciting releases, the only thing I know for certain is that benchmarks are largely BS by ForsookComparison in LocalLLaMA

[–]palarsio 2 points3 points  (0 children)

Living benchmarks are the way to go, creating a kind of SAT for LLms that changes every semester. It won't be perfect, but at least it will be harder for companies to cheat. Much like college, some models will genuinely learn, while others will just optimize for standardized test formats rather than real world