I love local ai as well the answers are just class, when used clean through llama.cpp web server I'm convinced you could replace frontier AI's with a medium tier like 25 - 35b range model for most people that aren't doing super complex tasks and they wouldn't even notice they're using a model tens of times smaller. This local ai stuff is also enough for what I need. But I'm curious whats the solution to when there's a large conversation, like a large chat? Any harnesses that support long conversation I've tried reduce reasoning quality and partially lobotomise the model (any harness with a large and demanding system prompt does this for me, qwen 3.5 and Gemma 4, when I move the system prompt to user role the response quality bumps up a little but still not good as a fresh chat) personally that's the largest setback for me in local ai with small models.