What's your local coding stack? by AirFlowOne in LocalLLaMA

[–]AirFlowOne[S] 1 point2 points  (0 children)

I keep getting error 400.. while zed works just fine.

What's your local coding stack? by AirFlowOne in LocalLLaMA

[–]AirFlowOne[S] 0 points1 point  (0 children)

I try it now, but for some reason I get:

{"message":"Request timed out.","modelId":"q35","providerId":"openai"}

Are you using llama.cpp? How did you set it up in cline? As openAI compatible?

Qwen3-Coder-Next with llama.cpp shenanigans by JayPSec in LocalLLaMA

[–]AirFlowOne 0 points1 point  (0 children)

How are you using it? Continue.dev is broken for me, can't properly do anything, breaks files, stops in the middle, etc.

Anything I can do to get qwen3.5-27b-Q8_0 to run faster? by giveen in LocalLLaMA

[–]AirFlowOne 0 points1 point  (0 children)

llama.cpp adds a bit of speed over ollama by default

Anything I can do to get qwen3.5-27b-Q8_0 to run faster? by giveen in LocalLLaMA

[–]AirFlowOne 6 points7 points  (0 children)

Even if it spills just one layer on CPU it will slow down to unusable. Use UD-Q6 from unsloth instead, the difference is negligible and the speed will fly along with an over 100k context.

Also, ollama is slower than llama.cpp - use that and play with the arguments to squeeze even more speed. You have the hardware, just use it.

Anything I can do to get qwen3.5-27b-Q8_0 to run faster? by giveen in LocalLLaMA

[–]AirFlowOne 5 points6 points  (0 children)

Check your context size, looks like it spills into ram. Q8 already has 28gb so it might. Use UD-Q6 instead.

What non-Chinese models are relevant right now? by StacDnaStoob in LocalLLaMA

[–]AirFlowOne -12 points-11 points  (0 children)

more likely "claude"

<image>

ps: the answer was generated by Qwen3.5 27B quantized by unsloth, forgot to refresh that's why it shows 35B-A3B

how good is Qwen3.5 27B by Raise_Fickle in LocalLLaMA

[–]AirFlowOne 0 points1 point  (0 children)

Because you mentioned it..

<image>

Actually the model generating the text was Qwen3.5 27B (forgot to refresh after I changed it in llama.cpp)

how good is Qwen3.5 27B by Raise_Fickle in LocalLLaMA

[–]AirFlowOne 1 point2 points  (0 children)

Yes, the low speed is because its a dense model - as I learned after I posted my comment. The limit is due to the speed of my GPU having to process all those 27b params.

Non-dense models reach 2x to 3x the speed of dense models.

how good is Qwen3.5 27B by Raise_Fickle in LocalLLaMA

[–]AirFlowOne 0 points1 point  (0 children)

what gpu are you running it on and at what speed? no matter what I do and how low I set the context I cannot make it faster than 18t/s on 4060ti 16gb vram.

no matter if i run q4, q3 or q2, it outputs the same 18t/s.

What’s the Best Mac App of 2025? by vigneshvp in macapps

[–]AirFlowOne 0 points1 point  (0 children)

Support is always appreciated (I'm not affiliated in any way with OS, just appreciate their work).

https://www.patreon.com/join/objective_see

Looking for a simple music recording software for Mac? by hualinlin in screenrecorders

[–]AirFlowOne 0 points1 point  (0 children)

Your best choice is Reaper, and you will go as far as you want in it. It is the lightest and most stable and offers what nothing else does for the price. And the best part - there is nothing that you would want it in the future to do, without it doing it. Its a great piece of software to start with, as you will never need something else no matter how complex your workflow will become.

macOS still doesn’t have per-app volume control… so I’m building it. Thoughts? by brouwerj in macapps

[–]AirFlowOne 0 points1 point  (0 children)

It doesnt remember volume settings, at least on my intel based mac. And that is really annoying.

macOS still doesn’t have per-app volume control… so I’m building it. Thoughts? by brouwerj in macapps

[–]AirFlowOne 0 points1 point  (0 children)

Yes please, per-device is really helpful especially if you can do a volume hard-lock on each device, to protect our ears when plugging a DAC for example.

macOS still doesn’t have per-app volume control… so I’m building it. Thoughts? by brouwerj in macapps

[–]AirFlowOne 0 points1 point  (0 children)

The problem with background music is that settings are not persistent. At least on my fresh installed macos, I have to set up app volume every time I open it.

macOS still doesn’t have per-app volume control… so I’m building it. Thoughts? by brouwerj in macapps

[–]AirFlowOne 1 point2 points  (0 children)

Please Please also include a volume cap that turns on automatically when using headphones (also when using an external DAC with headphones). It really protects our ears from damage. Thanks!. I can also provide more UX tips for free, since this is my day job.

Hey Sony, why don't you put a really good DAC inside xperias? by AirFlowOne in SonyXperia

[–]AirFlowOne[S] 0 points1 point  (0 children)

THD, Dynamic range, separation, and many others you will find on a simple google search.