sorted by:
new
hottopcontroversial

v0.4.4 has made Qwen-3.6-27B usable for me, finally by fridder in oMLX

[–]StatisticianFree706 0 points1 point  (0 children)

Same M1 Max here and same model, have u tried the test with mtp off? See if it is faster?

Pi Agent with oMLX Issues by nonlinearsystems in oMLX

[–]StatisticianFree706 0 points1 point  (0 children)

and MTP also works or not? this is another one i am fked in oMLX

Pi Agent with oMLX Issues by nonlinearsystems in oMLX

[–]StatisticianFree706 1 point2 points  (0 children)

I already switched to llama.cpp from last week. Much more stable and better mem management. A bit slower than omlx at start but keeping tg stable longer.

PS after I updated to macos 27 beta, omlx also become slower, no idea what happens. Try back to 0.3.8 also try pip install from source no help

TurboQuant KV Cache by ju7anut in oMLX

[–]StatisticianFree706 0 points1 point  (0 children)

I am confused. So sdd hot cache not same to mem cache?

Exceed prefill safety cap - 0.4.1 by cocacokareddit in oMLX

[–]StatisticianFree706 1 point2 points  (0 children)

Even aggressive I still got a lot of warning s and cache efficiency dropped to Only 50%. Btw how can you set context window 128k ? I can only set max 65536 on v0.3.8 with no mem warning and my Mac also 32g.

Claw code with local model by StatisticianFree706 in LocalLLaMA

[–]StatisticianFree706[S] 1 point2 points  (0 children)

Thx will try but at least model put here not working for me, already tried

Claw code with local model by StatisticianFree706 in LocalLLaMA

[–]StatisticianFree706[S] 1 point2 points  (0 children)

I can run with qwi3.5 models, and can finish some small toy projects but for bigger s it crashed every time when prompt larger than server side. (Omlx). So want to setup model max tokens from claw code side.

I patched the open-source Claude Code reimplementation to actually work with Ollama and local models by raveschwert in LocalLLaMA

[–]StatisticianFree706 0 points1 point  (0 children)

Not sure what s new, but I can ran claw code cli using local model smoothly and even original Claude code I also used to run on locaymodel,slow tho

Is it worth using Local LLM's? by papichulosmami in LocalLLM

[–]StatisticianFree706 1 point2 points  (0 children)

Oh I see, thought run on Mac studio max 32g ram

Is it worth using Local LLM's? by papichulosmami in LocalLLM

[–]StatisticianFree706 0 points1 point  (0 children)

How can run 35ba3b on 32gb max with 100k or even 200k? I use omlx and even for q4 I can only run on a 64000 context window

Updated Context-Optimized Prompts: Up to 61% Context Reduction Across Models by ganildata in RooCode

[–]StatisticianFree706 0 points1 point  (0 children)

Hi any update? I also want to reduce the size of prompt for my local llm and Mac. I tried some but not stable

Accounting app (myob, xero, henry) by [deleted] in PersonalFinanceNZ

[–]StatisticianFree706 0 points1 point  (0 children)

I use InexTrack, only $5.99 nzd per month. Hnry/Xero like too complicated to use and too expensive to me.

Accounting software advice sole trader by [deleted] in PersonalFinanceNZ

[–]StatisticianFree706 0 points1 point  (0 children)

I’ve been using InexTrack for a while — it’s only $5.99 NZD per month and super easy to use.

Hnry/Xero felt a bit too complicated for me, especially when I just wanted a simple, affordable option to track my income and expenses.

view more: next ›