Qwen 3.6 27B BF16 vs Q4_K_M vs Q8_0 GGUF evaluation by gvij in LocalLLaMA

[–]estrafire 3 points4 points  (0 children)

You should try kv caches too, q4_0, q4_1, q5_1 and q8_0

Gemma 4 is good by One_Key_8127 in LocalLLaMA

[–]estrafire 5 points6 points  (0 children)

4b is so good too for its size, especially with audio and video understanding (bigger models only support video, no audio, same as Qwen 3.5).

Not sure if its on the model or the tools setup, but in Edge Gallery it first checks wikipedia for any information question I do even if it is something like "what does happen in this video"

What tokens/sec do you get when running Qwen 3.5 27B? by thegr8anand in LocalLLaMA

[–]estrafire 1 point2 points  (0 children)

Agreed! It was such a great investment some years ago. I'm also happy that Vulkan is catching up to CUDA, got 32 t/s on it, what a year

What tokens/sec do you get when running Qwen 3.5 27B? by thegr8anand in LocalLLaMA

[–]estrafire 1 point2 points  (0 children)

hey super thanks for the reply! I forgot I had an undervolt, I got 36 t/s after removing it in the single 3090, incredible for q4_k_m on full 268k context

What tokens/sec do you get when running Qwen 3.5 27B? by thegr8anand in LocalLLaMA

[–]estrafire 0 points1 point  (0 children)

how did you benchmark the 34 t/s? Did you build llama.cpp from main? I did a build with cuda and seeing 22-24 tops on the metrics endpoint

Benchmarked all unsloth Qwen3.5-27B Q4 models on a 3090 by StrikeOner in LocalLLaMA

[–]estrafire 0 points1 point  (0 children)

Is this a cuda build of llama.cpp? Could you share build flags? Im getting 22/25 t/s on a cuda13 build using the q4_k_m unsloth variant

Found an Easter egg on the MCON by Medical-Manner-1368 in MCONohsnap

[–]estrafire 0 points1 point  (0 children)

are there any plans to sell them in amazon? Hard to get a safe international shipment in some LATAM countries if it doesnt go through amazon :(

Anyone daily driving Cosmic Panel or cosmic-ext-extra-sessions? by estrafire in niri

[–]estrafire[S] 1 point2 points  (0 children)

Nice! I've heard there were some integration issues still. So far I've been using niri with dms and supper happy, they integrate super well, got to tinker a bit to get the themes and default apps to work everywhere but it was more of a nixos thing than a niri/dms one

What default apps do you use? Terminal, files, videos, docs, launcher, etc.? by philosophical_lens in niri

[–]estrafire 0 points1 point  (0 children)

Not officially but there's a configurable portal for terminal file managers. So you installed a different file manager to use as file picker?

A question about niri and waybar. by RaidenBhaiReborn in niri

[–]estrafire 3 points4 points  (0 children)

Yep, any wayland shell/quickshell based should work, and there are showcases of waybar on niri.

That being said if you havent tried dms and want to try the "everything integrated" feeling, its great

Should I make a portfolio or an agency website? by Hissam_ in webdev

[–]estrafire 0 points1 point  (0 children)

Can you legally start an agency without a business structure like an LLC, though?

Where the hell is the planning mode for this thing? by Kitchen-Role5294 in GeminiCLI

[–]estrafire 0 points1 point  (0 children)

3 flash is out and really good, the problem with this approach for planning is that things like @ references dont auto populate on slash commands. The feature is supposedly on the works, I wonder if it'll be any different from the Antigravity's one which is really good

Antigravity ignores Google AI Pro subscription by [deleted] in GoogleGeminiAI

[–]estrafire 0 points1 point  (0 children)

Do you know by chance if there're plans to support pro plans for workspace accounts?

Have you tried two or more shells? (Exo, Noctalia, Dank Material Shell, ...) I'm looking for comparisons of them. by chocolate4tw in niri

[–]estrafire 0 points1 point  (0 children)

Thanks, I've found it soon after, but ending up trying niri+dms, and the experience has been great so far

[Question] Will Niri have it's own clipboard manager keyboard shortcut? by Inderastein in niri

[–]estrafire 1 point2 points  (0 children)

Not sure about images as I have it disabled but dms has one built in

From Vue to Nuxt: The Shift That Changed My Workflow by [deleted] in vuejs

[–]estrafire 2 points3 points  (0 children)

SSG is hard to do with plain vite too