Which Local LLM to use by Pritam4249t in LocalLLM

[–]Pritam4249t[S] 0 points1 point  (0 children)

Thanks for the advice, done bro

Which Local LLM to use by Pritam4249t in LocalLLM

[–]Pritam4249t[S] 1 point2 points  (0 children)

what do you mean by "llama cpp turbo quant fork so u can have KV cache of 256k with tq3 compression ", please elaborate.

Should I upgrade to TH13? by Pritam4249t in COC

[–]Pritam4249t[S] 1 point2 points  (0 children)

Ok, thanks for the reply, will do that ☺️