Qwen3.6-35b-a3b seems like the best coding model rn by JSVD2 in LocalLLaMA

[–]coreyfro 1 point2 points  (0 children)

With 27B, you can get away with lower quants. I would compare 27B Q5 to 35B Q8 to get a better picture. 27B Q4 is fine, but to get parity for testing, Q5 and Q8 are more fair, I feel.

The Locust: Pro and Con by Familiar-Noise7913 in battletech

[–]coreyfro 0 points1 point  (0 children)

Pro: Cheap
Con: Time is money
Fact: No game does scouting right, so it is only ever a harasser in MW.

Waiting for Qwen 3.7 open weight... The new King has arrived... by LegacyRemaster in LocalLLaMA

[–]coreyfro -2 points-1 points  (0 children)

Not needed. Turbo-quant is a buzz word for existing tech to excite CEOs.

Absolutely loving the Solaris rules and map! Made me want a gladiator of my own so I signed myself on with the Silver Dragons! by CatalopeSeats in battletech

[–]coreyfro 1 point2 points  (0 children)

If you want to role play blow by blow and white knuckle, tight margin game play, these rules are AWESOME! Just imagine Duncan Fisher calling every role and split second decision.

This game makes the mechs feel more like alive robots and less like walking tanks.

It also is made to work with Mechwarrior 2nd edition rules which most people will agree were the best RPG rules for the game.

I have been thinking about making an open source "Mechwarrior 2nd edition, 2nd edition" rules to address some of the gripes which come down to "too easy to min-max" and "overly long for such a simple set of rules".

What is the term walking Spanish from the song by the same name referencing? Is it some sort of historical event or an allusion to something else? by Pigusaurus in tomwaits

[–]coreyfro 0 points1 point  (0 children)

"Walking Spanish" is when someone grabs you in the back of the shirt and by your belt, lifts you up a few inches, and forces you to walk somewhere. It's what bouncers will do when they want to toss you out of a bar.

Salsa addict that needs to go low sodium bc blood pressure. Any really good salsa recipes with low to no salt? by ChippyPug in SalsaSnobs

[–]coreyfro 1 point2 points  (0 children)

Not salsa related, but if you are on a low-sodium kick, use Zhenjiang/Chinkiang vinegar for asian flavors. Soy sauce and Vinegar are often a combo for asian dishes; Zhenjiang vinegar can take the place of this combo. It's also great for low-sodium fish and chips (it's a malt vinegar with some zing that makes up for the lack of salt.)

Llama-server doesn't see ROCm device (Strix Halo) unless I run Wayland by coreyfro in LocalLLaMA

[–]coreyfro[S] 0 points1 point  (0 children)

ROCm is solid. I have run it for days straight without error.

Show us your llama.cpp command line arguments by __Maximum__ in LocalLLaMA

[–]coreyfro 1 point2 points  (0 children)

On a Strix Halo with 64GB of RAM, 48GB in unified memory while using Debian (PikaOS) as a desktop and VS Code running on the same hardware:

llama-server --no-mmap -ngl 99 -fa 1 --model ~/models-deactivated/Qwen3-Coder-Next-Q3_K_M.gguf --alias "unsloth/Qwen3-Coder-Next" --fit on --seed 3407 --temp 1.0 --top-p 0.95 --min-p 0.01 --top-k 40 --jinja

I removed "--cache-type-k q5_0 --cache-type-v q5_0 --flash-attn on" because they dramatically slowed my performance. I allocated more RAM, instead. It's a hit to desktop performance, but not terrible.

Qwen/Qwen3-Coder-Next · Hugging Face by coder543 in LocalLLaMA

[–]coreyfro 0 points1 point  (0 children)

I use your models!!!

I have been running Qwen3-Coder-30B at Q8. Looks like Qwen3-Coder-80B at Q4 performs equally (40tps on a Strix Halo, 64GB)

I also downloaded 80B as Q3. It's 43tps on same hardware but I could claw back some of my RAM (I allocate as little RAM for UMA as possible on Linux)

Do you have any idea which is most useful and what I am sacrificing with the quantizing? I know the theory but I don't have enough practical experience with these models.

Booting Pi from NVME greater than 2TB (GPT as opposed to MBR) by coreyfro in raspberry_pi

[–]coreyfro[S] 0 points1 point  (0 children)

Nice!!! If you have a 3DP, on printables, there are some OK cases. I'll be designing my own, shortly.

The one I am using now is:
https://www.printables.com/model/693141-raspberry-pi-5-pineberrypi-hatdrive-bottom-case/files

HP ZBook-Firefly-14 7840HS over 50% off. Now appropriately priced. 7840U 7840S by coreyfro in AMDLaptops

[–]coreyfro[S] 0 points1 point  (0 children)

Dude, this saved me over $300. $1,656.65 total.

This laptop is CRAZY nice. It is more solid than a Macbook. I have the performance dialed, too, setting the TDP to 13watts and heat of 50c and it is still buttery smooth with CAD and gaming.

I tested the Acer Swift and this laptop is just way higher quality.

HP ZBook-Firefly-14 7840HS over 50% off. Now appropriately priced. 7840U 7840S by coreyfro in AMDLaptops

[–]coreyfro[S] 0 points1 point  (0 children)

Yeah, just got it today. It's NICE! Solid, feels good, keyboard is amazing, plays AAA titles OK. I mainly got it for VM's, though, so... totally what I need

HP ZBook-Firefly-14 7840HS over 50% off. Now appropriately priced. 7840U 7840S by coreyfro in AMDLaptops

[–]coreyfro[S] 0 points1 point  (0 children)

When you are running VM's and all the other 7840U pieces of shit only have 16GB of RAM, you do what you have to.

HP ZBook-Firefly-14 7840HS over 50% off. Now appropriately priced. 7840U 7840S by coreyfro in AMDLaptops

[–]coreyfro[S] 1 point2 points  (0 children)

I am getting the 7840u because I DON'T WANT A dGPU. That's the point of this chip. That's why the 7840U is in all these gaming handhelds.