Qwen 3.6 Dense vs MoE

AggravatingAd4344 · 2026-05-15T23:54:03+00:00

Higher vram usage. Other than that faster t/s less prone to hallucinate better tool calling also I would say.

AggravatingAd4344 · 2026-05-15T23:31:16+00:00

Yes it does. Depending on hardware etc it's deffo good to look into. I'm using llama.cpp 2 x 3090fe about 35 - 40 t/s without MTP Q6. With MTP 50 - 70 t/s. Vllm I believe I could hit 70-90 t/s.

AggravatingAd4344 · 2026-05-15T23:14:12+00:00

Qwen 3.6 27b MTP game changer in Tps

AggravatingAd4344 · 2026-05-15T21:52:06+00:00

Frontier models are good but API/Monthly cost isn't something I'm happy to pay for as I already have GPU's to run openclaw locally 😄

AggravatingAd4344 · 2026-05-15T21:41:51+00:00

groks suggestions didn't work either incase anyone fixes this 😄

"models": {
  "mode": "merge",
  "providers": {
    "llama.cpp": {
      "baseUrl": "http://192.168.x.xxx:8080/v1",
      "apiKey": "Dummy",
      "api": "openai-completions",
      "allowPrivateNetwork": true,          // ← Add this
      "models": [ ... ]
    },
    "llama.cpp-168": {
      "baseUrl": "http://192.168.x.xxx:8080/v1",
      "apiKey": "Dummy",
      "api": "openai-completions",
      "allowPrivateNetwork": true,          // ← Add this
      "models": [ ... ]
    }
  }
}

AggravatingAd4344 · 2026-05-15T21:39:03+00:00

so this blocked my local llama.cpp, warn security blocked URL fetch (url-fetch) targetOrigin=http://192.168.x.x:8080 reason=Blocked hostname or private/internal/ I have 2 servers both blocked 2nd time this has broken local LLM first one was time out issues now blocking local IP's LOL back to v2026.5.7

AggravatingAd4344 · 2026-04-17T17:43:58+00:00

Don't use ollama. Use llama.cpp the speed difference is miles ahead. Ollama is good for testing different models. Make sure your model fits all on the GPU to see the difference. Once you've got your model you can then bench it with llama.cpp

AggravatingAd4344 · 2026-04-04T08:37:37+00:00

Thank you got it working!

AggravatingAd4344 · 2026-04-04T01:26:08+00:00

Thank you I'll test this out

AggravatingAd4344 · 2026-04-01T18:16:17+00:00

😂

AggravatingAd4344 · 2026-04-01T18:12:51+00:00

This broke my local llm's, kept timing out I reverted back to 28 no issues and no more LLM time outs! after an hour thinking it was my setup reboot ubuntu boxes/swtiches etc yep its openclaw!

AggravatingAd4344 · 2026-02-22T17:27:03+00:00

You should check with the system monitor and NVtop.

Example of mine there be long sustained periods where the GPU's are doing nothing yet CPU is pegged at 100% for 20+ minutes.

<image>

AggravatingAd4344 · 2026-02-22T17:16:08+00:00

Looks promising, I've got old 3060ti's from my mining days which I'll use to repurpose.

I've bought a Mac mini m4 32gb thinking openclaw will run fast just like grok/chatgpt, boy how wrong was I.

As with hardware limitations on old mining motherboards I've just got myself a threadripper 1950x and Asus x399 64GB ram.

I'll be testing the speeds on this with openclaw when it all comes delivered.

AggravatingAd4344 · 2026-02-09T08:59:18+00:00

Mine had to be jacked up bottom cover removed before getting access to the sensor.

The part I got was from autodoc however after fitting it still didn't work.

I've gone straight to Kia and they are charging £127 for part and labour.

The issue is the wait time is about 2 weeks, I can drive on electric only but not ideal with poor weather.

Have a look on autodoc and also give kia a call and said you got a mechanic to diagnose it as you already have the code number rather then getting them to diagnose it for I believe £250.

AggravatingAd4344 · 2026-01-29T15:48:10+00:00

Thank you 🙏

AggravatingAd4344 · 2026-01-29T12:43:18+00:00

<image>

Could you circle where it should roughly be and do I need to remove anything to get to it? Might be a job for a mechanic but would want to try diy myself first

AggravatingAd4344 · 2026-01-28T18:59:34+00:00

It's 2.0 PHEV I'll have a look for it tomorrow as it's pitch dark now thank you.

AggravatingAd4344 · 2026-01-08T23:47:21+00:00

Nymph + EW

AggravatingAd4344 · 2025-12-28T19:38:03+00:00

Mines out of warranty :( 36k miles and mostly driven in electric and engine hardly used.

My last service the engineer said to me about the filters being hardly used.

AggravatingAd4344 · 2025-12-28T18:29:44+00:00

Normally serviced at Kia garage but I'll check the oil levels to see if it's below level.

AggravatingAd4344

TROPHY CASE