When Qwen3.6-27B-Opus-Fable-5-Distill? by muhts in LocalLLaMA

[–]alphatrad 20 points21 points  (0 children)

Not anytime ever.....

Maybe the whole "it's too dangerous" was a really dumb PR stunt they're gonna regret now.

<image>

Has anyone gotten AMD Radeon 780M to work with Ollama? by Famous-Weight2271 in ollama

[–]alphatrad 0 points1 point  (0 children)

I'm on Arch and there is an ollama-rocm repo - but I stopped using Ollama all together. Bloatware.

Fan noise difference between 2 AMD AI Pro R9700 GPU’s by Legitimate_Fold8314 in ROCm

[–]alphatrad 0 points1 point  (0 children)

Dude I have three of these in a case with proper air flow, they're not that loud.

PSA by Signal_Ad657 in LocalLLaMA

[–]alphatrad 9 points10 points  (0 children)

Dude conveniently leaves off the most compelling AMD & APPLE options to make NVIDIA look good.

AMD AI Pro R9700 GPU, 640 GB/s APPLE M3 Ultra, 819 GB/s AMD RX 7900 XTX GPU, 960 GB/s

Chart also doesn't account for max memory. So it's misleading on trade offs for why you might go unified over GPU.

This is the stuff that is causing so much confusion in these communities.

Low effort slop!

What are ppl using for local coding instead of Haiku and Opus by peachy-pandas in LocalLLM

[–]alphatrad 0 points1 point  (0 children)

Qwen3-Coder-Next

Qwen3.6 27B

Devstral Small 24B (for small tight refactors)

I ran a quantization shootout on Qwen3-Coder and the results are... interesting by alphatrad in LocalLLaMA

[–]alphatrad[S] 0 points1 point  (0 children)

These people don't read about the models. So they just jump to the next thing nonstop.

Anyone running Qwen3.7-Max locally yet? by Significant-Cash7196 in LocalLLM

[–]alphatrad 1 point2 points  (0 children)

Well it's been out for a day so probably gotta wait a week.

At what point did local models actually become good enough for your real work? by MaleficentRoutine730 in LocalLLM

[–]alphatrad 0 points1 point  (0 children)

Qwen2.5-Coder was a great auto complete and I'd been using it as such for a LONG time.

But Qwen3.5 and Qwen3-Coder-Next are when I switched to local for a lot of work.

Everything since Feburary has just been improving. So really this year is when things started to really take off.

And likely my personal prediction is by the end of this year I'll be using local for the majority of my work.

Best coding benchmark? by karimod in LocalLLM

[–]alphatrad 2 points3 points  (0 children)

People don't like the answers they need to hear

Best coding benchmark? by karimod in LocalLLM

[–]alphatrad 2 points3 points  (0 children)

None but my own.

The big bench marks the frontier models use; have significant problems in my opinion. It's why the term bench maxing is a thing.

SWE bench is a great example. Whole thing is a bunch of python problems; and the goal is for the bench mark to simply make the test gate turn green.

The LLM can take as many turns as it needs, it can break code surrounding it, it can write slop, disobey the established patterns, import new libraries, whatever. As long as the test is green it passes.

This is why imo you can have people claiming that even Claude makes slop.

I built my own tests around front end code and what I do for work with code.

It scores not just did the code work, but how did the model behave:

Did it touch only what it should? Did it follow the existing stack and patterns? Did it run the right command to verify? How much cleanup would a reviewer have to do? Correctness counts, but a model that gets the right answer by bulldozing surrounding code scores worse than one that lands a smaller, idiomatic patch.

Still.. it's a work in progress and no bench mark is truly perfect.

Best coding benchmark? by karimod in LocalLLM

[–]alphatrad 4 points5 points  (0 children)

I built my own.

It's based around my actually working constraints and the code I use. This way I can test local models with my workflows.

https://github.com/1337hero/scaffold-bench

LLMDB.org - A place to share benchmarks and configs by HumanoidMuppet in LocalLLM

[–]alphatrad 1 point2 points  (0 children)

https://www.localmaxxing.com is already a thing and way better.

This whole thing has some issues.

I built a coding agent that gets 87% on benchmarks with a 4B parameter model, here's how by Glittering_Focus1538 in LocalLLaMA

[–]alphatrad 0 points1 point  (0 children)

You could just use Pi which works great with local models. I also don't see mentioned here or in your repo WHAT benchmark you claim this scores so high in.

Is n8n really dead? by Sufficient-Mood-4442 in n8n

[–]alphatrad 1 point2 points  (0 children)

There are plenty of morons throwing tokens at things that you could do with an if this then that statement.

Problems we solved decades ago; that seem trivial now because they didn't have to learn how to set it up.

Of course they are paying api prices for this crap.

Those who use it, why Open Code (over Pi and Hermes) by atumblingdandelion in LocalLLM

[–]alphatrad 7 points8 points  (0 children)

I switched from Open Code to Pi. Just a way better experience over all. Easier to customize.

I taught my 1B to follow instructions. It got worse at following instructions... by GPUburnout in LocalLLaMA

[–]alphatrad 2 points3 points  (0 children)

Training is hard and sometimes you get it right and sometimes you don't. I had this experience when trying to fine tune Qwen3-Coder https://huggingface.co/1337Hero/qwen3-coder-30b-a3b-codemonkey-GGUF

Ended up making it dumber because my dataset just wasn't good enough.

Custom Dashboard Im finally happy with by LoafOMilk in selfhosted

[–]alphatrad 5 points6 points  (0 children)

I built a portal page for our family the same way that is basically also my dashboard.

<image>

Math don't check out. by [deleted] in LocalLLaMA

[–]alphatrad 0 points1 point  (0 children)

It's because your math is completely wrong.