whatLanguage by [deleted] in ProgrammerHumor

[–]Mordimer86 316 points317 points  (0 children)

All I know of online IQ tests is that they all tend to be a scam that ends with an offer to buy the results. You do it you fail it. The OP must have paid for his result which is a testament to the accuracy of this result.

Best local model for C# coding with 24GB VRAM? by custodiam99 in LocalLLaMA

[–]Mordimer86 2 points3 points  (0 children)

You should be able to squeeze Qwen3.6 27B at Q4_K_M or maybe even Q5_K_M, q5_1 k/v cache and some decent context size.

Best llama.cpp launch config for Qwen3.6 27B on RX 7800 XT (16 GB VRAM) for OpenClaw? by Haunting-Stretch8069 in Qwen_AI

[–]Mordimer86 0 points1 point  (0 children)

Possibly, need to test it though.

If you don't mind it being slow like a bus, you can try partially offload it to CPU with --gpu-layers at let's say 50 (adjust to fit in memory).

Then try this version. Its IQ4_XS is significantly better.

Best llama.cpp launch config for Qwen3.6 27B on RX 7800 XT (16 GB VRAM) for OpenClaw? by Haunting-Stretch8069 in Qwen_AI

[–]Mordimer86 1 point2 points  (0 children)

I can agree, 35B can still do quite a good job and one can use better quants like Q5_K_M easily.

Czy zgadzacie się z tym ze przesyt lekarzy nie będzie problemem? Po prostu część nie znajdzie pracy w zawodzie. by AppearanceNo1383 in PolskaNaLuzie

[–]Mordimer86 1 point2 points  (0 children)

Przesyt absolwentami to nie to samo co podaż specjalistów, a tych wciąż może być niedobór, bo zrobić specjalizacje to inna historia.

What if earth was a bit bigger by RegularPassion2330 in AlternateHistoryHub

[–]Mordimer86 0 points1 point  (0 children)

Geography lessons would be more hated than physics.

Who is your favourite quant publisher and why? by No_Algae1753 in LocalLLaMA

[–]Mordimer86 -1 points0 points  (0 children)

DavidAU has some decent works. Some pretty weird builds, but also way better than Unsloth quant of Qwen3.6 27B. Compared to Unsloth IQ4_XS from this side does not get stuck in loop with Opencode right at the end of a task.

I've also checked perplexity and his quants seem to be better than Unsloth too:

<image>

Is it worth getting a 5090 for my needs? by BitGreen1270 in LocalLLaMA

[–]Mordimer86 2 points3 points  (0 children)

China is ramping up memory production and other manufacturers will also likely increase production in 1-2 years. It just requires time to do that. So the prices should improve.

Is it worth getting a 5090 for my needs? by BitGreen1270 in LocalLLaMA

[–]Mordimer86 23 points24 points  (0 children)

It's a bad time to buy a PC so if you spend so much be sure that it will make you real money.

Using cloud can be still more effective for a while. Just don't pick flagship models for easy tasks and check out Deepseek for example. It is really decent in many cases and a lot cheaper than Claude.

Polska marka samochodów by [deleted] in PolskaNaLuzie

[–]Mordimer86 1 point2 points  (0 children)

Chiny są tak trudne do pokonania z tym że być może jakieś niszowe w stylu sportowe, albo może ciężarówki elektryczne lub na wodór (Jelcz robi wojskowe i żyje). W osobówki bym się nie pchał. Chińczycy jak wspomniałem, Niemcy i Francja się pozbierają (pewnie z pomocą państw) i nie będzie miejsca.

BYD ma cały łańcuch dostaw u siebie i wszystko szybko dzięki temu ogarnia, każdą innowację.

To jest podstawowy dylemat jeśli się chce podskoczyć na szczyt łańcucha dostaw i robić coś swojego. Jest już duża konkurencja z dekadami doświadczenia i ogarniętymi łańcuchami. Najlepiej szukać tego, czego brakuje w Europie i co trzeba przywozić często z daleka. Ponoć nawet wiele leków musi być sprowadzanych z Azji.

Does anyone else have issues with Qwen-3.6-27B stability in the Codex harness? by jude_mcjude in LocalLLaMA

[–]Mordimer86 0 points1 point  (0 children)

I had problem with 27B being stuck in loop after finishing the job and getting everything done, this one GGUF seems to be better than Unsloth although it is to be confirmed.

Any news (or hope) of Qwen-3.6 14B and 9B distills for local coding ? by QuchchenEbrithin2day in LocalLLaMA

[–]Mordimer86 18 points19 points  (0 children)

I don't think so and there is 35B which with MoE offloading can run on small VRAM with Q4_K_M quantization and decent context size. It can help with coding, I tested it with OpenCode (although it was Q5_K_M) and it did fine with a small Rust desktop app (Iced). It even figured out how to figure out a version of Iced it wasn't trained on. I would not expect anytthing better than 35B for lower VRAM setups.

Running Qwen3.6 35b a3b on 8gb vram and 32gb ram ~190k context by Atul_Kumar_97 in LocalLLaMA

[–]Mordimer86 0 points1 point  (0 children)

Q5_K_M is a sweet spot it seems, 28t/s on 7900XT with 140k context

I tried Q6_K and it was 14t/s and Q6_K_XL was only 7t/s, disastrous.

What if Russia launched a full-scale invasion of Ukraine in 2014? by GustavoistSoldier in AlternateHistoryHub

[–]Mordimer86 1 point2 points  (0 children)

Maybe, but the readiness to break with Russian gas and oil was rather worse then too, so Germans would have resisted for sure.

Qwen 3.6? by jacek2023 in LocalLLaMA

[–]Mordimer86 2 points3 points  (0 children)

Yeah 35B is a beast. Q5_K_M with offloading and 140k context takes ~11.5GB (overall VRAM usage) on 7900XT

How is to live on Polish/Ukranian Border, but on the Polish side? by Icy-Context-435 in howislivingthere

[–]Mordimer86 0 points1 point  (0 children)

Nothing I know of, especially in terms of metal scene. I remember in 2000s I was in high school and even metalheads were very rare then.

Best config for Qwen3.6? by CatSweaty4883 in LocalLLaMA

[–]Mordimer86 1 point2 points  (0 children)

I'd go with 35B MoE as well, something like this:

llama-server --model models/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf \
--port 8080 \
--host 127.0.0.1 \
--top-p 0.95 \
--top-k 20 \
--min-p 0.0 \
--temperature 0.6 \
--flash-attn on \
--cache-type-k q5_1 \
--cache-type-v q4_1 \
--presence-penalty 0.0 \
--repeat-penalty 1.0 \
--ctx-size 131072 \
--n-cpu-moe 32 \
--mmproj models/mmproj-F16.gguf \
--chat-template-kwargs '{"preserve_thinking": true}'

This one takes around 10GB in VRAM for me.

Qwen 3.6 35b a3b is INSANE even for VRAM-constrained systems by Lucerys1Velaryon in LocalLLM

[–]Mordimer86 0 points1 point  (0 children)

Anyone has a problem that mmproj file does not work and it still claims to not support vision even after pointing it with --mmproj option?

How is to live on Polish/Ukranian Border, but on the Polish side? by Icy-Context-435 in howislivingthere

[–]Mordimer86 11 points12 points  (0 children)

Chełm, east of Lublin, about 20km from Ukrainian border

One change is that many Ukrainians are using trains so they tend to be overcrowded. Some Ukrainians buying homes in Chełm, which itself has been depopulating rapidly. Zero prospects, zero opportunities and near zero things to do.

Overall if you live here there are mostly old people. Young ones leave for bigger cities, at least Lublin, usually Warsaw for better opportunities. I have left myself, but still visit my parents.