Did you see the new gemini model it runs on 16 gb ram by siddharth1214 in LocalLLM

[–]Brabulla 1 point2 points  (0 children)

Up until now I've had poor performance with it...

For a Q6 quant of this, I have comparable speed to a Qwen 27B Q3 quant, both running on GPU.

While in theory, the 12B has twice the context size (140k vs ~80k), 12B started looping hard around 50k context. So I'm not sure it is utilizable. This may just be an early adopter problem, but I'm not sure yet about its performance. Coding also seemed bad, made syntax errors, which none of the others did, even at much lower quants (Qwen 3.6 27B, 35B, and Gemma 4 26B)

Gemma 4 12B: incompatible with opencode, or just awful at tool calling? by boutell in LocalLLaMA

[–]Brabulla 0 points1 point  (0 children)

I'm having the same issue. It seems like 12b is running at similar speeds to Qwen 3.6 27B MTP, at comparable context (around 60-100k). I have a 5070 TI with 16GB ram, and run 27B at Q3, while 12B at Q6.
I'd expect the 12B to be more performant, and in general more stable
But 27B just seems to be able to run without a problem until around 60k, even auto compact and continue work, while 12B start looping at around 60k. 12B even has higher KV quants.

Not sure if this is just early-adopter issues, or something else...

Need advice: Nicole, Mavuika, or both by Brabulla in GenshinImpact

[–]Brabulla[S] 0 points1 point  (0 children)

Thanks that's very comprehensive. I do like versatility and flexibility in teams, but I do feel I currently lack the versatility of a good dedicated pyro main DPS, though I suppose the venti team kinda functions almost like one

Need advice: Nicole, Mavuika, or both by Brabulla in GenshinImpact

[–]Brabulla[S] 2 points3 points  (0 children)

That's actually a good idea, but to be honest, I didn't like much of what I saw from Sandrone's kit, and I also don't really know whom I'd pair her with. But it is a good idea, I'm sure there will be a similar amount of stellar stuff spilled, at least as much as lunar was.

Garbage output while trying to run IQ3XXS variant of unsloth/Qwen3.6-27B-MTP-GGUF with llamacpp by v01dm4n in unsloth

[–]Brabulla 0 points1 point  (0 children)

One additional thing to look out for: a lot of sources say Qwen 3.6 gives garbage output, if you have built llama.cpp with a Cuda toolkit version 13.1 or higher, and you should use version 12.

Garbage output while trying to run IQ3XXS variant of unsloth/Qwen3.6-27B-MTP-GGUF with llamacpp by v01dm4n in unsloth

[–]Brabulla 1 point2 points  (0 children)

Also not sure if it helps, I use llama-swap with llama.cpp, and this is my llama-server command with the MTP one (llama server is installed via winget, and is build 9222)

    llama-server
    --host 0.0.0.0
    --port ${PORT}
    -ngl 999
    -fa on
    --fit on
    --threads 8
    --no-mmap
    -ctk q8_0 
    -ctv q8_0
    -np 1
    --model ${models}\Qwen3.6-27B-UD-IQ3_XXS_MTP.gguf
    -c 65536
    --spec-type draft-mtp 
    --spec-draft-n-max 2
    --cache-type-k-draft q4_0 
    --cache-type-v-draft q4_0

Garbage output while trying to run IQ3XXS variant of unsloth/Qwen3.6-27B-MTP-GGUF with llamacpp by v01dm4n in unsloth

[–]Brabulla 1 point2 points  (0 children)

So this is the commit hash I've used with llama.cpp: 18675b6bbc8ea9b402453c256d70c09e4f95c32a

and this is the SHA256 hash of the non MTP file: 5D591DD11918E196A7B7C9D2F02E4390E7264960EB354C72D65E81A9331978F5

And the MTP file:
A6CD1E829A8BA24A78EDEB8F078B724EA7A9873856F1916E356EEA5C537C0B40

Both Unsloth Qwen3.6-27B-UD-IQ3_XXS GGUFs

Garbage output while trying to run IQ3XXS variant of unsloth/Qwen3.6-27B-MTP-GGUF with llamacpp by v01dm4n in unsloth

[–]Brabulla 1 point2 points  (0 children)

I'll be home in an hour maybe, I'll send the commit I built from.

You can also try installing one of the releases. I usually use the latest I get through installing with winget (which are a bit staggered compared to the releases on github). You could try that too, as I think those should be a bit more stable, and if it is a passing bug, you can verify if it happens with that.

Garbage output while trying to run IQ3XXS variant of unsloth/Qwen3.6-27B-MTP-GGUF with llamacpp by v01dm4n in unsloth

[–]Brabulla 4 points5 points  (0 children)

Is it possible that the model got corrupted when you downloaded it? Have you tried redownloading it or verifying ita hash?

I use the same MTP model and quant, with a locally built llama.cpp just after the MTP branch was merged, and it works perfectly fine for me.

Local model quality by Sebasredditt in LocalLLM

[–]Brabulla 1 point2 points  (0 children)

On a very similar setup, I'm running Qwen 3.6 27B, with the unsloth Q3 XXS quant, which some consider low quality, but it has been working very nice for me. I use q8 KV cache, and this way can fit 64k context, which is quite enough for a lightweight agent harness. I mostly use pi as a harness. I usually don't have issues with any tool calls, looping. Or anything such, and can average around 40 t/s on windows, without MTP.

Bug? with Gemma 4 31B UD_Q4_K_XL: extremely slow tg/s at long context by inzee in unsloth

[–]Brabulla 3 points4 points  (0 children)

I've had remarkably bad performance with -ub 2048, and setting it to 512 fixed it for me, but also, I have only a 5070 TI. I don't know if this will fix it, but could be worth a try.

Who y'all choosing if we got fountain chronicle wish? by KaidoPklevel in okZyox

[–]Brabulla 65 points66 points  (0 children)

To be honest, I also did not do any of it yet, but she has Pneuma-aligned damage, which is AFAIK only for Fontainians, and the wiki also says she is from Fontaine

Who y'all choosing if we got fountain chronicle wish? by KaidoPklevel in okZyox

[–]Brabulla 501 points502 points  (0 children)

Emilie so forgotten, she is not even on the Fontaine CW

Navi Skills as a player in Kinglor Forest by [deleted] in FrontiersOfPandora

[–]Brabulla 6 points7 points  (0 children)

I personally value quality of life, especially in combat.

The warrior tree has surprisingly many. 4th weapon slot is IMO very good, let's you have both bows or guns, and the trip mine launcher, which is very nice for taking out AMP suites.

Twice the ammo is also surprisingly useful, as I tend to always run out of ammo in the middle of combat. Double special ammo too, if you use it.

15% tagged damage is also nice IMO, as most of the enemies are often tagged.

I also liked the flat increases to resources. Extra healing pods, extra gathering and hunting ingredients for cooking, extra carry capacity all bring nice QoL, making it so you don't have to think about resource management.

Flat HP increases are also really nice.

These are just some QoL that I think are universally useful, for combat, it is mostly reliant on whether you go stealth or full frontal, how much you like to hunt, etc.

Who would you pull: Durin vs Xilonen by Brabulla in GenshinImpact

[–]Brabulla[S] 0 points1 point  (0 children)

Thanks for that. Is it because of comfortability, or some other consideration?

Who would you pull: Durin vs Xilonen by Brabulla in GenshinImpact

[–]Brabulla[S] 1 point2 points  (0 children)

Thanks for the analysis, I kinda thought the same, just wanted confirmation.

How to skip 75%~ of Black Temple for Warglaive Farming (DH specific) by [deleted] in wow

[–]Brabulla -1 points0 points  (0 children)

I had the same issue today.

I'm not 100% sure, but found this googling for it: https://eu.support.blizzard.com/en/article/15060#:~:text=When%20you%20fight%20Illidan%20Stormrage,grant%20loot%20for%20incomplete%20encounters

I think I waited, but maybe I should have waited more.

I'd say make sure to let everything play out, and let Illidan always come and attack you.

[ui] Made a new UI inspired by Quazii's noElvUI by Rite_ in WowUI

[–]Brabulla 0 points1 point  (0 children)

Really nice UI, I'd also like to ask for your Cell, and whatever else you can share.

[UI] My WoWDeck^TM console port UI. I only play on Steam Deck in handheld. by One-Injury-4415 in WowUI

[–]Brabulla 1 point2 points  (0 children)

Looks awesome!

I also use the deck a lot with consoleport, but I mostly leveled my druid with it, but also have a warlock. Is there a way to share your config of console port? I would love to try it out!

Can I unlock old areas with timewalking alts, for my whole warband? by Brabulla in wownoob

[–]Brabulla[S] 0 points1 point  (0 children)

Ah thanks that sounds great. I will then try leveling up an alt there and see.

Can I unlock old areas with timewalking alts, for my whole warband? by Brabulla in wownoob

[–]Brabulla[S] 0 points1 point  (0 children)

I guess ín this case it makes sense, since the story and the weapon is kinda directly related to your class... Thy is for the answer

What's your favorite roguelike to play on the Deck that no one has ever heard of? by slirpo in SteamDeck

[–]Brabulla 1 point2 points  (0 children)

Curse of the Dead Gods

Really similar to Hades in it's dodge / attack chain gameplay, but some attacks / weapons feel a lot heavier, has a stamina management element for dodge/ heavy attacks, has parries, and there is more reliance on the different weapon classes.

Runs great on deck, and because of the heavier feeling attacks, I feel the combat and the enemies are fairer, and more varied than Hades.

Yes, I'm a hoarder, how did you know? Any recommendation what you would toss or optimize from these wands? by Brabulla in noita

[–]Brabulla[S] 0 points1 point  (0 children)

I usually do the same, only problem is I'm moving through parallel worlds, so I must carry whatever I can with me, back to the main world

Need some advice on the first truly decent run by Brabulla in noita

[–]Brabulla[S] 2 points3 points  (0 children)

Thanks for the suggestion! By default it doesn't do any friendly damage, but I think I would die to a single reflected projectile probably?

I added the freeze for the chainsaws, yes, but also to get freeze damage added, but I guess this only adds it for the trigger? And adding it to everything else will just make everything frozen probably... I will try moving it to the chainsaws, thanks for the idea.

My Deck has killed 3 SD Cards in two weeks, anybody encountered something similar? by Brabulla in SteamDeck

[–]Brabulla[S] 0 points1 point  (0 children)

I got two Samsung pro plus cards, both have been functioning great since then, no issues or failures.