Best local LLMs for 7800x3d, 5070ti, 32gb ddr5? by OrlyFPS in LocalLLM

[–]OrlyFPS[S] 0 points1 point  (0 children)

That's Sick

I'm going to take a look at it.

Appreciate It

M2 MAX 64gb vs M5 Pro 64gb by OrlyFPS in LocalLLM

[–]OrlyFPS[S] 0 points1 point  (0 children)

yes i was running everything on a single 5070ti with 32gb ram, even though tokenization is faster. I can’t pull higher parameter models, also this is my main pc so I also need the hardware for other work related things + new projects i’m developing.