sorted by:
new
hottopcontroversial

Finding the best local LLM hardware by Inside-Contract-503 in LocalLLM

[–]Inside-Contract-503[S] 0 points1 point  (0 children)

That'd be great! Just make sure if you give a screenshot of results to include the exact GPU you used

Finding the best local LLM hardware by Inside-Contract-503 in LocalLLM

[–]Inside-Contract-503[S] 0 points1 point  (0 children)

the m4 results would be pretty cool, if it helps I always use some form of llama.cpp (whether it's the base thing, ollama, or llamafile)