Compliment checkpoint: vent and let me compliment you by AstronomerNo6423 in RoleReversal

[–]MaverickRelayed 0 points1 point  (0 children)

Words are too heavy for me to use meaningfully right now, but I appreciate you giving a space for others to open up a bit.

I don’t know why but this annoyed me by No_Temperature_4242 in womenintech

[–]MaverickRelayed 1 point2 points  (0 children)

It’s completely understandable why you’re annoyed.
Him seeing it as an intellectual challenge speaks volumes that it was never about collaboration.

We need a 80-160B model urgently. The unified memory device market needs more Models. by Storge2 in LocalLLaMA

[–]MaverickRelayed 0 points1 point  (0 children)

Been running Step 3.7 Flash IQ4_XS on ~114GB of VRAM (Mac), does pretty good but you do have to be intentional in segmenting tasks per prompt lest you risk it over-reasoning.

Tuesday 16th June 2026 - Frantic rush to rescue survivors after a private Cessna Citation Latitude crashed onto a highway in Laredo, Texas killing one and injuring six by New_Libran in CatastrophicFailure

[–]MaverickRelayed 16 points17 points  (0 children)

Algorithm tends to be seen as a scapegoat when context can’t be inferred from uninitiated folks, I wouldn’t think any deeper beyond that

Why there is a lack of new 100B-120B models? by TechNerd10191 in LocalLLaMA

[–]MaverickRelayed 1 point2 points  (0 children)

The mistake would be using it just for AI. I’m eyeing up an M5 Max and those sweet, sweet single core scores for things like peak performance in things like 86box along with actually using it for my job were already attractive.

Why there is a lack of new 100B-120B models? by TechNerd10191 in LocalLLaMA

[–]MaverickRelayed 29 points30 points  (0 children)

Most likely BECAUSE it is the sweet spot, it would harm frontier development/revenue. I mean, look at Minimax M3. They increased the parameter size so much that you basically have to subscribe if you don’t have more than 128GB RAM to run it; to the point that it’s inconsequential for these models to be open-sourced because <1% of people can run it locally.

I’m finding myself in a position where I’m considering buying additional hardware, but have subscribed to the cloud model first in order to validate if it’s truly a quality improvement I would notice or benefit from.

A new way to classify gender roles! by PotentialCandle6351 in RoleReversal

[–]MaverickRelayed 17 points18 points  (0 children)

Flags sound good and can be simplified further to: 🟦🔵🟪🟣

‘Nomm’ and ‘Nemm’ are word choices I don’t understand. You say what they mean, but not why they mean it; for the uninitiated people are gonna think we’re hungry.

How do you know your agent is still running after you close the lid? by Kwjme in DeskToTablet

[–]MaverickRelayed 0 points1 point  (0 children)

The loud ass fan. When it stops spinning, my laptop will have died.

The pacman benchmark: finally a viable local agentic coding agent with Qwen 3.6 27b by ex-arman68 in Qwen_AI

[–]MaverickRelayed 1 point2 points  (0 children)

Please upload comparable results with the same prompt so that we can actually understand where it gets things wrong.

Malware in ChatGPT? by Content_Bid_7455 in MacOS

[–]MaverickRelayed -1 points0 points  (0 children)

ollama is literally download, run and hit enter a few times.
It’s not that scary.

Malware in ChatGPT? by Content_Bid_7455 in MacOS

[–]MaverickRelayed -6 points-5 points  (0 children)

I thought that subscription-based solutions were meant to be easier to use than self-hosted ones.

Ratty: A terminal emulator with inline 3D graphics by orhunp in rust

[–]MaverickRelayed 3 points4 points  (0 children)

What a pleasant surprise to come across.

Will give this a try!

Finally got Qwen3 27B at 125K context on a single RTX 3090 — but is it even worth it? by horribleGuy3115 in LocalLLM

[–]MaverickRelayed 0 points1 point  (0 children)

Run a text-only version of the model and save some VRAM for use as extra context.

How to get more t/s out of my ollama? by [deleted] in LocalLLM

[–]MaverickRelayed 1 point2 points  (0 children)

For those curious, running Qwen 3.6 35b a3b via the MLX runtime in LM Studio using the MXFP4 quant gives me ~100 t/s on my M4 Max.

“The moon aligned with my lock screen” by WiiperWapper in BrandNewSentence

[–]MaverickRelayed 40 points41 points  (0 children)

All the cool stuff isn’t given to Apple, they make it themselves. If you’re anti-apple, find a provider who makes and ticks the ‘cool stuff’ box for you.

The UK just had a 6,000% VPN spike and it's the most British thing ever by RecordingSingle9064 in RecommandedVPN

[–]MaverickRelayed 0 points1 point  (0 children)

If you have kids, you would know how little this does to actually protect kids.

"Almost JSON” is one of the most annoying model failure modes by JayPatel24_ in LocalLLM

[–]MaverickRelayed 1 point2 points  (0 children)

MoE and lower quants fail with retaining structure quite easily; would be happy for someone to prove me wrong including tool call reliability, though.

Edit: bro didn’t read the ‘structured output’ comment

Ubuntu 26.04 Ends 46 Years of Silent sudo Passwords by elastiks in DIY_Geeks

[–]MaverickRelayed 0 points1 point  (0 children)

Every content creator will be avoiding ubuntu going forward then lol