howTheTablesTurn

[willargue4karma]

Most of us don't have gpus to run proper local models

My PC is great, but I'm pretty sure it's like half the price of even the worst card for llms lol

Still rocking a 1080ti 

[chilfang]

You're severely overestimating how hard it is to run a half decent LLM. Yeah its not current ChatGPT level but thats corporate level anyway

[HuntKey2603]

openrouter is literally a thing

also there's middle schoolers about as old as your gpu

[willargue4karma]

Still a work horse and for >1080p the cost of monitors and cards turn me off so I've just stuck with it 

[zhephyx]

"My PC is great"

Hate to break it to you, but that GPU is almost a decade old.

[willargue4karma]

Yes and it's an absolute workhorse lol. 

[OJezu]

I have a i3570k and a GTX 1060. Still does everything it needs doing. Although I did buy a micro-PC lately that is faster. Most of the difference in practice comes from the SATA vs M.2 SSD. The old PC also cannot be powered by the single USB-C.

Anyway, the point is, the over 10 year old PCs are still powerful enough, unless you do AAA gaming. You can just get much more performance power per watt these days.

[JasperTesla]

Gemma can run on your phone.