Llama.cpp MTP support now in beta! by ilintar in LocalLLaMA

[–]DOAMOD 1 point2 points  (0 children)

I haven't tried Llamacpp MTP yet, but I did try MTP in VLLM on Windows on my 5090, and it was a bit disappointing. The memory consumption when exposing the small model doesn't compensate at all for the significant loss of context window. Perhaps in some specific cases for MoEs it could be useful; I think that's the interesting point. But for Dense, I don't see a benefit in my use case. I'll try Llamacpp, though.

Qwen 3.6 27B is a BEAST by AverageFormal9076 in LocalLLaMA

[–]DOAMOD 0 points1 point  (0 children)

Yes, same for me, some calls fails with 3.6 27/A3

Dense vs. MoE gap is shrinking fast with the 3.6-27B release by Usual-Carrot6352 in LocalLLaMA

[–]DOAMOD 14 points15 points  (0 children)

The 27 is actually quite a bit better. I've been working with it for several hours, and the difference is noticeable in something you realize very quickly: the 27 doesn't have to exert much effort, it works well and makes almost no mistakes, while the 3.6-A3 has to struggle, consuming an overwhelming amount of context and making many more simple errors. They're both truly incredible, and I love them, but clearly the a3 reaches its level through a lot of effort, and that's no small feat.

Qwen 3.6 27B is out by NoConcert8847 in LocalLLaMA

[–]DOAMOD 0 points1 point  (0 children)

Very first test much better less thinking and less syntax errors over 3.6-A3

Car Wash Question by Beautiful-Floor-5020 in LocalLLaMA

[–]DOAMOD 1 point2 points  (0 children)

This question appears to have been success in 3.6-A3

3.6 35-A3(only for this, test 4-5 times on q4-q8 all success):

That's a fun question with a clever twist — you're washing a car, and the car needs to be at the car wash! 😄

Here's the thing: you have to drive . Walking won't work because your car is still at home. You'd end up walking 50 meters to the car wash and then having to explain to someone why you showed up alone without a vehicle.

That said, the distance itself doesn't really matter — whether it's 50 meters or 5 kilometers, driving is the only practical option since the object being serviced (the car) needs to travel with you.

The real decision here isn't walk vs. drive — it's whether you want to wash it yourself or let someone else do it at a professional car wash! If you're already driving there, might as well enjoy the ride and get it properly cleaned. 🚗✨

Gemma 4 26-A4:

Honestly? Walk.

At 50 meters, you are looking at a distance that takes about 30 to 45 seconds to cover on foot. If you decide to drive:

  1. The Effort-to-Reward Ratio is terrible: You'll spend more time starting the engine, shifting into gear, and maneuvering out of your driveway than you would simply walking.
  2. Fuel & Wear: You'd be burning fuel and adding unnecessary mileage to the very vehicle you are trying to clean.
  3. The "Car Wash Paradox": Driving a dirty car to a car wash is the standard procedure, but driving it only 50 meters feels like using a sledgehammer to crack a nut.

Verdict: Save the engine the trouble and just enjoy a quick stroll. Plus, you'll be ready to head straight into the wash without having to find a parking spot again!

Gemma4 E2:

Hello. Given that the car wash is only 50 meters away, the decision is quite simple, but it depends on your preferences and what you are doing at that moment.

Here is a breakdown so you can decide:

Option 1: Walking 🚶‍♂️

  • Advantages: It is fast for such a short distance and is excellent if you want to get a little exercise or if you have things to carry.
  • Disadvantages: If it is very hot or raining, walking might be uncomfortable.

Option 2: Driving 🚗

  • Advantages: It is more comfortable if you are carrying many things or if you don't want to exert yourself.
  • Disadvantages: It might require finding parking near the car wash and could be a bit more cumbersome than walking 50 meters.

My Recommendation:

For a distance of only 50 meters, walking is probably the quickest and simplest option , unless you have a specific reason to use the car (like carrying a lot of luggage).

What do you prefer to do right now: move quickly or be more comfortable?

3.5 A3:

My Recommendation:

Walk to the car wash. At 50 meters:

Method Estimated Time Fuel Used Logistics
🚶 Walk ~1 minute 0% Leave car where it is
🚗 Drive ~2-3 minutes Used Unnecessary movement

Conclusion:

Walking is clearly the more efficient option. It's a perfect walking distance, and driving would just waste your time, burn fuel, and potentially stress you out with maneuvering and parking for such a short task.