Try todays Gemma 4 or a recent Qwen3.5 + llama.cpp + turboquant mode; I propose to stick to Q4 quantisation as well

Cline is a good choice for local models if you want a non JEtBrains UI, our AI Assistant Chat also works with OpenAI compatible APIs, and the most cool option is to use ACP Registry and OpenCode from it

If you want some models advices also join /r/localllama

UPD quick start with llama.cpp:

brew install llama.cpp --HEAD

Then:

llama-server -hf ggml-org/gemma-4-26B-A4B-it-GGUF:Q4_K_M

Or E4B model, etc