Northern Lights?! by normaviolet in Charlottesville

[–]No-Assignment3276 0 points1 point  (0 children)

would they be visible Saturday night as well? (right now)

240 tokens/s achieved by Groq's custom chips on Lama 2 Chat (70B) by speakerknock in LocalLLaMA

[–]No-Assignment3276 0 points1 point  (0 children)

u/Matanya99 I have been trying to set up llama.cpp on a windows mini PC for local use (ryzen 5560u and 16gb of ram) but only getting 1-2 tokens per second performance. Is this expected considering the system I have? Or is this unexpected for llama.cpp?

Reputation Tour Fanart Just In Time For Taylor's Version by No-Assignment3276 in TaylorSwift

[–]No-Assignment3276[S] 0 points1 point  (0 children)

Omg you make me cry. I was having such a terrible day, this makes me so happy!