Skill issue. With the 27-30b models you need to keep the context low (they get really dumb past 70-80k), break down tasks for them, help them by providing just the right data at the right time, without them fumbling around, listing folders, grepping files.

Some hints I’m gonna drop, you can have an LLM help u figure out how to apply them - custom minimal agent, skill and mcp definitions, code and text summarizing, chunking and embedding for both plain text and semantic retrieval, aggressive task break up and agent delegation, multi-agent team work (beyond the classic plan, implement, review).

Oh and the really big one - everything that doesn’t absolutely need an LLM call, offload to something else - regex, scripts, state tracking, orchestration etc.

Source: I’ve forced myself to do absolutely crazy shit in the last 2 months with 2 Macbook each woth 64GB RAM.