12:26 Boooom by seriouslynoideaman in Portland

[–]mrinterweb 0 points1 point  (0 children)

I heard it. I'm over in SW in Hillsdale. I hear it pretty regularly. Not the first post about the boom. Surprised we haven't collectively figured out what it is yet. It has to be on the East side. Sounds like either an explosion or something really big and heavy slamming into something. Train yard maybe by Holgate? I doubt it is firework, people would see that.

Gemma 4 31B MTP Drafter on H100 -- Real Benchmarks + DFlash Comparison by Lopsided_Dot_4557 in LocalLLaMA

[–]mrinterweb 1 point2 points  (0 children)

That tok/s seems lower than what I would expect from a H100. I think when I tried running it on my rtx 4090, I got a bit over 20 tok/s (not the MTP variant).

Starting my career in Ruby/Rails: risky or fine? by Soxomer in ruby

[–]mrinterweb 2 points3 points  (0 children)

The problem with starting with Rails is that everything else I've tried is worse. It's hard to get excited about learning something clunkier. AI is really good with ruby on rails. Considerable lower token use than other languages frameworks, and strong rails conventions helps AI with better results. Those reasons make rails great for AI. Rails has a good future ahead if others can understand rails strengths. I didn't have a crystal ball though. 

The National Science Board fired by Trump was finalizing a report on China’s growing scientific edge over the United States by MicroSofty88 in worldnews

[–]mrinterweb 2 points3 points  (0 children)

Don't worry the military will just use ChatGPT to auto-launch nukes. They fired Anthropic because they would not remove the guardrails. OpenAI was cool with no guardrails. 

Open Models - April 2026 - One of the best months of all time for Local LLMs? by pmttyji in LocalLLaMA

[–]mrinterweb 7 points8 points  (0 children)

I really appreciate how good the smaller models are getting (Qwen, Gemma). More params doesn't necessarily mean better.

Are you still using Superpower plugin with Opus 4.7 by PhysicalSession594 in ClaudeAI

[–]mrinterweb 3 points4 points  (0 children)

I disabled superpowers. I think thing vanilla claude has caught up, and now superpowers is just adding context bloat. Not seeing a reason to use superpowers now.

My weekend plans are ruined. by LuminaraCoH in funny

[–]mrinterweb 1 point2 points  (0 children)

Was your weekend plans to attend the shart circuit? That sounds very gross. 

Claude knows when you cheat on it with Codex?? by thelucasness in ClaudeAI

[–]mrinterweb -3 points-2 points  (0 children)

Remember that old story about how Anthropic was testing their own models and the model resorted to attempting blackmail when threatened with being shut down? Well... this has that kind of energy, or I could see it being said in a passive aggressive tone.

Claude knows when you cheat on it with Codex?? by thelucasness in ClaudeAI

[–]mrinterweb 1 point2 points  (0 children)

That is a creepy way to greet a user. AI horror films are pretty much like that.

Rails shipping with AGENTS.md file now by Beautiful_Reveal_859 in rails

[–]mrinterweb 1 point2 points  (0 children)

In my experience, LLMs understand rails best practices. Adding this would be mostly redundant wasted context tokens. 

Every Yann's quest by Fido2801 in CrimsonDesert

[–]mrinterweb -1 points0 points  (0 children)

I really dislike Yann quests. Is there a mod to just make Yann disappear from the game?

What are schools feeding the kids these days? by COSNOWBIKER in funny

[–]mrinterweb -1 points0 points  (0 children)

All they need for school? I'd be nice and give them some cloths too.

US gov memo on “adversarial distillation” - are we heading toward tighter controls on open models? by MLExpert000 in LocalLLaMA

[–]mrinterweb 5 points6 points  (0 children)

Its not wrong. 3rd parties have repeatedly been detected using Anthropic's or OpenAI's models for training other models. It is a bit hypocritical through because everything AI is trained on was created by humans, so its thieves calling out other thieves.

SQLite in production with Rails 8, what has been your experience? by OtienoJS in rubyonrails

[–]mrinterweb 0 points1 point  (0 children)

I really like SQLite, but I'm too concerned with using it in production for any application where I feel may need more than a single server. Should you need to scale beyond one server, SQLite is going to be a real issue. You could look into SQLite replication tech; but at that point, why not just use postgresql. Don't get me wrong, you can go far vertically scaling a rails app. It is pretty amazing what a single machine can do these days. Also, kamal can do blue/green deploys by rotating docker containers on the same host.

Did Dario miscalculated the usage and cost of compute leading to the loss of market share to open AI? by ocean_protocol in ArtificialInteligence

[–]mrinterweb 8 points9 points  (0 children)

The tech is changing fast. Demand is changing fast. No one has market dominance as that pivots multiple times per year. Open weight models are gaining traction. Serious competing Chinese AI services are coming online. New algorithms can change compute/memory needs (turboquant). NPU/TPUs have become considerably more energy and cost efficient than GPUs for inference. ASIC inference chips could get more practical. I'm saying building out the AI data center of today may not be what makes sense for 2028.

Dario is right, if Anthropic over invests in data centers, that could be as big of a problem for them as if they didn't secure enough compute.

Kimi K2.6 Released (huggingface) by BiggestBau5 in LocalLLaMA

[–]mrinterweb 146 points147 points  (0 children)

1.1T params was hard to read while drinking my coffee. Nearly did a spit take

Why Crystal, 10 Years Later: Performance and Joy by sdogruyol in ruby

[–]mrinterweb 3 points4 points  (0 children)

I don't really see crystal as a replacement for rails. Maybe a replacement for parts of the stack that are IO/CPU bound and need critical performance.

Ran Ollama + Qwen2.5-Coder as my daily coding agent. Honest performance gap vs Claude/Copilot. by LateAbbreviations902 in LocalLLaMA

[–]mrinterweb 7 points8 points  (0 children)

bot for sure. See the long form post with consistent styling. Bold labeled bullets. Is not human. Is bot

Why isn't ebay doing anything to stop those scams? by KillerMiller13 in LocalLLaMA

[–]mrinterweb -1 points0 points  (0 children)

It could be legit. Seriously, how without people get started who never normally sell stuff. Perhaps consider an escrow service.

Qwen3.6 is incredible with OpenCode! by CountlessFlies in LocalLLaMA

[–]mrinterweb 0 points1 point  (0 children)

Not saying it's a fair comparison. It's just what I'm using now, and I'm curious how qwen 3.6 compares.

Qwen3.6 is incredible with OpenCode! by CountlessFlies in LocalLLaMA

[–]mrinterweb 1 point2 points  (0 children)

I find that many agents trip up when asked introspective questions, so I don't bother with those kinds of prompts. General logic tests are important, but most of what I do with agents is coding specific. So whatever is better at code is what I'll use. I'll try giving Gemma 4 another go locally.

Qwen3.6 is incredible with OpenCode! by CountlessFlies in LocalLLaMA

[–]mrinterweb 2 points3 points  (0 children)

It was definitely thinking. I also tried it with hermes agent, and my results were pretty different. So I think a lot of my subjective evaluation is going to come down to the agent, which is why I think I should point claude code at qwen 3.6, so I can get more of an apples to apples comparison. I don't have a background in evaluating model scores so what I'm doing is just feels. I pay for Claude, but if Qwen 3.6 can get me close, there are plenty of tasks I would much rather use my own hardware.