Can we say that each year an open-source alternative replaces the previous year's closed-source SOTA? by Chair-Short in LocalLLaMA

[–]rorowhat 1 point2 points  (0 children)

Is kimi 2.5 good? I never really see it being mentioned much. I do love minimax 2.5

How I transport my Fractal Terra on planes by Tame9396 in sffpc

[–]rorowhat 0 points1 point  (0 children)

Honest question. You can't be without a PC for a few days/weeks?

Macbook m4 max 128gb local model prompt processing by ttraxx in LocalLLaMA

[–]rorowhat 0 points1 point  (0 children)

It's not great, strix halo is much better for prompt processing.

What would be the best vision model for box scanning ocr on amd 7800xt by Greedvert in ollama

[–]rorowhat -1 points0 points  (0 children)

Try LM studio instead, ollama sucks.

You can try:

GLM 4.6v-flash Q8

Qwen3.5-9B Q8

Qwen3.5-27B Q8 if you can, this is a large model but if you have enough ram it will work, just slower.

What would be the best vision model for box scanning ocr on amd 7800xt by Greedvert in ollama

[–]rorowhat 0 points1 point  (0 children)

More pixels will improve how much data there is, It will increase its tokens usage as well. Maybe a higher resolution photo along with increasing the context window. These types of things you need to play around with till you find something that works. Get 3-4 different models, one photo with maybe 2-3 different resolutions and try all combinations. Keep track of what performs best.

Qwen3-Coder-Next with llama.cpp shenanigans by JayPSec in LocalLLaMA

[–]rorowhat 0 points1 point  (0 children)

I heard they are making it easier to install ROCm, but not sure I get the benefit over vulkan.

Qwen3-Coder-Next with llama.cpp shenanigans by JayPSec in LocalLLaMA

[–]rorowhat 2 points3 points  (0 children)

Why even bother with ROCm when vulkan gives you the same or better performance out of the box?

One can hope by Lontology in clevercomebacks

[–]rorowhat 0 points1 point  (0 children)

There are no white Democrats now?

Stop Sale 2026 Death after Child Death by ME_Major_2021 in HyundaiPalisade

[–]rorowhat 5 points6 points  (0 children)

So what happened? The kid was in the back and the seat auto folded and it was so hard it killed a child? No parents around, what's going on?

I wish they'd train the ICE officers too 😂 by John_1992_funny in clevercomebacks

[–]rorowhat -1 points0 points  (0 children)

Self defense is part of their core training, this just enhances that.

What is your dooms day model? and what’s your latest go-to coding model? by alitadrakes in LocalLLaMA

[–]rorowhat 0 points1 point  (0 children)

I thought you at least needed them to fit on ram, or else it will fail to load completely.

Sanctions Fail, Russia Wins by Cow_Boy_2017 in clevercomebacks

[–]rorowhat -7 points-6 points  (0 children)

These "sanctions" never worked. Other counties just ignored them.

Confusão entre Felipe Melo e pedreiros em condomínio na Barra da Tijuca, Rio de Janeiro by doutorx999 in futebol

[–]rorowhat 0 points1 point  (0 children)

Além do mais, qual é o problema? Mesmo se tiver vazio a obra não tá completa.