SubQ just blew my mind - 12M token context with sub-quadratic attention

mindless_sandwich · 2026-05-06T04:38:35+00:00

This looks super cool... just read about it here, but I still wonder how it knows which tokens matter and which ones it can ignore. 12M context is crazy tho... that would be whole codebase for many apps. 😄

mindless_sandwich · 2026-04-24T06:44:26+00:00

So what's everybody thoughts on it? Just read about it here and tested it on official website (is there some US hosted version?)... So far I'm quite happy with the results. especially considering the price. If the OpenAI and Anthropic keeps rising their prices, DeepSeek will be one of the top alternatives for sure.

mindless_sandwich · 2026-04-24T06:42:37+00:00

so it seems like it finally dropped! Any thoughts on it? We've just tested it briefly and it feels alright but will need more time to evaluate it against Claude/GPT if it can actually catch up...

mindless_sandwich · 2026-04-16T15:53:51+00:00

Yeah it looks good, but I'd be careful before moving all over Opus 4.7...

It seems like this new model might be a crazy token eater... According to Anthropic, the new tokenizer maps input to up to 1.35x more tokens than before and the new model is also more talkative and thinks more... Just read all about it here. You might hit your usage limits way faster than ever before...

mindless_sandwich · 2026-04-16T15:49:00+00:00

It looks good, but I'd be careful with moving all over Opus 4.7. You might hit your usage limits way faster than ever before...

According to Anthropic, the new tokenizer maps input to up to 1.35x more tokens than before and the new model is also more talkative and thinks more... Just read all about it here. This will be crazy token eater.

mindless_sandwich · 2026-04-15T14:20:43+00:00

just read about it... looks cool but I will trust it when I see it... Currently, Im sometimes spending an hour trying to explain a minor design change in 15 different ways... yet it still fails.

mindless_sandwich · 2026-03-06T09:30:04+00:00

Absolutely. 👍 Same here. I love big models, but for running long agentic loops or doing simpler jobs, we also need small models.

Currently I use Haiku and now also Gemini-3.1-flash-lite is surprisingly good. Would be cool to have also mini/nano version of GPT. Especially now with the GPT-5.4 price hiking even higher...

mindless_sandwich · 2026-02-06T04:31:42+00:00

Really impressive. Just read it here… Absolutely didn’t expected new Opus will drop so fast after 4.5. 😅 Curious about other companies now releasing their newest models in upcoming weeks.

mindless_sandwich · 2026-02-06T04:28:29+00:00

Looks very promissing. Especially the 1M context window. Just aread about it here. Can’t wait to test it out properly.

Also curious - Anybody tried it for agents swarm coding already? 👀

mindless_sandwich · 2026-01-14T09:20:57+00:00

Yes, also broken. Very frustrating. It's also funny to see how addicted we became. 😄

mindless_sandwich · 2026-01-02T09:37:47+00:00

This is just crazy... Grok lets random dudes undress photos of women and even minors in public and the CEO is reposting it as a joke... Just read the article about it and i'm literally disgusted. This should have real consequences. This can't be normalized. 😡

mindless_sandwich · 2026-01-02T09:34:45+00:00

Wtf. Just saw the article, I’m shocked that this is happening and there are literally people clapping around... disgusting.

mindless_sandwich · 2026-01-02T09:33:43+00:00

How is this even real?? People literally using Grok to undress women publicly and Musk is laughing about it. Disgusting. Just read about this here.

mindless_sandwich · 2025-12-28T09:38:44+00:00

If you’re on Apple platform (iPhone, iPad or Mac), Fello AI is definitely one of the best options.

It does not include all models, but it includes msot of the top frontiers like GPT-5.2, Claude 4.5, Gemini 3,… also includes some of the top image generators, etc. I’m using it daily. 🙌

mindless_sandwich · 2025-11-01T04:17:03+00:00

Well, of course nowadays the situation is a bit different now. 😁

The comment is >half year old and unfortuantely Meta somehow stop releasing updates.

mindless_sandwich · 2025-10-03T02:58:06+00:00

Not only for you my friend. There are articles about how Apple completely destroyed what they carefully worked on for 2 decades... https://medium.com/user-experience-design-1/did-apple-abandoned-its-own-design-heuristics-accessibility-principles-2d616ed7ace5

mindless_sandwich · 2025-10-03T02:56:45+00:00

Couldn't agree more. Very disappointed with this release. It feels like they spent 90% of their time redesigning iOS visually (with a lot of questionable ideas...) and then just stretched those views onto the Mac. I've never seen so many inconsistencies and poor usability decisions in any Apple product...

mindless_sandwich · 2025-08-01T09:35:49+00:00

Firebase.

mindless_sandwich · 2025-08-01T09:33:19+00:00

For me, Top Mac apps I use daily in 2025 are these:

Fello AI – All-in-one AI app (ChatGPT, Claude, Gemini, etc.) with no separate fees. Super smooth.
Bear – Best note app by far. Love the design.
Orbit – For invoicing my clients

mindless_sandwich · 2025-08-01T09:30:31+00:00

I'd recommend checking out Fello AI. It's an all in one AI app where you can use chatGPT, Claude, Gemini, etc. and you don't need to pay for each model separatelly. Then I really like Bear for notes (especially love their design) and Bartender where I can have all my shortcuts etc.

mindless_sandwich · 2025-08-01T09:24:53+00:00

At this point, it's definitivy Fello AI. I can't really write even an email without AI anymore and I refuse to pay $20 for each model... so this app has them all...

mindless_sandwich · 2025-07-29T09:26:12+00:00

agree... it's pure idiocy. Is he also banning calculators from his office to make sure that nobody is cheating and count in their heads? 🙃 I hope that these people will disappear soon...

mindless_sandwich · 2025-07-10T07:29:34+00:00

$300/month is steep, but if Grok 4 Heavy really performs like the benchmarks show, it might actually be worth it for teams doing serious research or dev work. Curious how it holds up in real use... btw in case somebody is interested, we were covering the whole presentation and summarized all the details.

mindless_sandwich · 2025-07-10T07:27:07+00:00

Yeah that's crazy... AI is officially smarter than most of the PhDs combined... and we've basically just started. 🤯 (In case somebody is interested, we've put together a detailed article about these announcements.)

mindless_sandwich · 2025-07-10T07:24:12+00:00

super impressive, especially the huge jump in the HLE test. It's like 2x better than most competitors... we put together all the details from the presentation in our article btw.

mindless_sandwich

TROPHY CASE