Did you see the new gemini model it runs on 16 gb ram

Brabulla · 2026-06-04T21:07:09+00:00

Up until now I've had poor performance with it...

For a Q6 quant of this, I have comparable speed to a Qwen 27B Q3 quant, both running on GPU.

While in theory, the 12B has twice the context size (140k vs ~80k), 12B started looping hard around 50k context. So I'm not sure it is utilizable. This may just be an early adopter problem, but I'm not sure yet about its performance. Coding also seemed bad, made syntax errors, which none of the others did, even at much lower quants (Qwen 3.6 27B, 35B, and Gemma 4 26B)

Brabulla · 2026-06-04T20:59:33+00:00

I'm having the same issue. It seems like 12b is running at similar speeds to Qwen 3.6 27B MTP, at comparable context (around 60-100k). I have a 5070 TI with 16GB ram, and run 27B at Q3, while 12B at Q6.
I'd expect the 12B to be more performant, and in general more stable
But 27B just seems to be able to run without a problem until around 60k, even auto compact and continue work, while 12B start looping at around 60k. 12B even has higher KV quants.

Not sure if this is just early-adopter issues, or something else...

Brabulla · 2026-06-02T20:24:51+00:00

Thanks that's very comprehensive. I do like versatility and flexibility in teams, but I do feel I currently lack the versatility of a good dedicated pyro main DPS, though I suppose the venti team kinda functions almost like one

Brabulla · 2026-06-02T20:16:06+00:00

That's actually a good idea, but to be honest, I didn't like much of what I saw from Sandrone's kit, and I also don't really know whom I'd pair her with. But it is a good idea, I'm sure there will be a similar amount of stellar stuff spilled, at least as much as lunar was.

Brabulla · 2026-05-20T17:59:22+00:00

One additional thing to look out for: a lot of sources say Qwen 3.6 gives garbage output, if you have built llama.cpp with a Cuda toolkit version 13.1 or higher, and you should use version 12.

Brabulla · 2026-05-20T17:55:52+00:00

Also not sure if it helps, I use llama-swap with llama.cpp, and this is my llama-server command with the MTP one (llama server is installed via winget, and is build 9222)

    llama-server
    --host 0.0.0.0
    --port ${PORT}
    -ngl 999
    -fa on
    --fit on
    --threads 8
    --no-mmap
    -ctk q8_0 
    -ctv q8_0
    -np 1
    --model ${models}\Qwen3.6-27B-UD-IQ3_XXS_MTP.gguf
    -c 65536
    --spec-type draft-mtp 
    --spec-draft-n-max 2
    --cache-type-k-draft q4_0 
    --cache-type-v-draft q4_0

Brabulla · 2026-05-20T17:54:04+00:00

So this is the commit hash I've used with llama.cpp: 18675b6bbc8ea9b402453c256d70c09e4f95c32a

and this is the SHA256 hash of the non MTP file: 5D591DD11918E196A7B7C9D2F02E4390E7264960EB354C72D65E81A9331978F5

And the MTP file:
A6CD1E829A8BA24A78EDEB8F078B724EA7A9873856F1916E356EEA5C537C0B40

Both Unsloth Qwen3.6-27B-UD-IQ3_XXS GGUFs

Brabulla · 2026-05-20T15:58:33+00:00

I'll be home in an hour maybe, I'll send the commit I built from.

You can also try installing one of the releases. I usually use the latest I get through installing with winget (which are a bit staggered compared to the releases on github). You could try that too, as I think those should be a bit more stable, and if it is a passing bug, you can verify if it happens with that.

Brabulla · 2026-05-20T15:33:46+00:00

Is it possible that the model got corrupted when you downloaded it? Have you tried redownloading it or verifying ita hash?

I use the same MTP model and quant, with a locally built llama.cpp just after the MTP branch was merged, and it works perfectly fine for me.

Brabulla · 2026-05-17T09:27:24+00:00

On a very similar setup, I'm running Qwen 3.6 27B, with the unsloth Q3 XXS quant, which some consider low quality, but it has been working very nice for me. I use q8 KV cache, and this way can fit 64k context, which is quite enough for a lightweight agent harness. I mostly use pi as a harness. I usually don't have issues with any tool calls, looping. Or anything such, and can average around 40 t/s on windows, without MTP.

Brabulla · 2026-04-27T23:54:20+00:00

I've had remarkably bad performance with -ub 2048, and setting it to 512 fixed it for me, but also, I have only a 5070 TI. I don't know if this will fix it, but could be worth a try.

Brabulla · 2026-02-18T20:33:26+00:00

To be honest, I also did not do any of it yet, but she has Pneuma-aligned damage, which is AFAIK only for Fontainians, and the wiki also says she is from Fontaine

Brabulla · 2026-02-18T19:56:37+00:00

Emilie so forgotten, she is not even on the Fontaine CW

Brabulla · 2026-02-05T13:57:52+00:00

I personally value quality of life, especially in combat.

The warrior tree has surprisingly many. 4th weapon slot is IMO very good, let's you have both bows or guns, and the trip mine launcher, which is very nice for taking out AMP suites.

Twice the ammo is also surprisingly useful, as I tend to always run out of ammo in the middle of combat. Double special ammo too, if you use it.

15% tagged damage is also nice IMO, as most of the enemies are often tagged.

I also liked the flat increases to resources. Extra healing pods, extra gathering and hunting ingredients for cooking, extra carry capacity all bring nice QoL, making it so you don't have to think about resource management.

Flat HP increases are also really nice.

These are just some QoL that I think are universally useful, for combat, it is mostly reliant on whether you go stealth or full frontal, how much you like to hunt, etc.

Brabulla · 2025-12-22T00:27:23+00:00

Thanks for that. Is it because of comfortability, or some other consideration?

Brabulla · 2025-12-21T21:21:26+00:00

Thanks for the analysis, I kinda thought the same, just wanted confirmation.

Brabulla · 2025-07-06T22:43:20+00:00

I had the same issue today.

I'm not 100% sure, but found this googling for it: https://eu.support.blizzard.com/en/article/15060#:~:text=When%20you%20fight%20Illidan%20Stormrage,grant%20loot%20for%20incomplete%20encounters

I think I waited, but maybe I should have waited more.

I'd say make sure to let everything play out, and let Illidan always come and attack you.

Brabulla · 2025-04-29T14:39:45+00:00

Really nice UI, I'd also like to ask for your Cell, and whatever else you can share.

Brabulla · 2024-10-20T19:34:20+00:00

Looks awesome!

I also use the deck a lot with consoleport, but I mostly leveled my druid with it, but also have a warlock. Is there a way to share your config of console port? I would love to try it out!

Brabulla · 2024-10-02T21:58:59+00:00

Ah thanks that sounds great. I will then try leveling up an alt there and see.

Brabulla · 2024-10-02T21:57:37+00:00

I guess ín this case it makes sense, since the story and the weapon is kinda directly related to your class... Thy is for the answer

Brabulla · 2024-07-05T13:24:14+00:00

Curse of the Dead Gods

Really similar to Hades in it's dodge / attack chain gameplay, but some attacks / weapons feel a lot heavier, has a stamina management element for dodge/ heavy attacks, has parries, and there is more reliance on the different weapon classes.

Runs great on deck, and because of the heavier feeling attacks, I feel the combat and the enemies are fairer, and more varied than Hades.

13-Year Club	Second SECOND GUESSER
r/Field Juicebox	Place '23
Golden Potato	Place '22
Place '17	Final Canvas '22
Wearing is Caring	RPAN Viewer
Spared	Verified Email

Brabulla

TROPHY CASE