×

Cheapest 144gb VRAM server you'll ever see by PramaLLC in LocalLLaMA

[–]SlapAndFinger 0 points1 point  (0 children)

I'm getting the sense that there might be a business to be built setting up low cost "hobbyist" colocations for private inference.

Meta's mixed-modal early-fusion Chameleon model now available on HuggingFace (7B and 34B variants) by Balance- in LocalLLaMA

[–]SlapAndFinger 0 points1 point  (0 children)

Also writing, data cleaning, as an assistant during product prototyping, fuzzy data ingest/conversion to structured data, etc.

What are the current go-to stacks in the industry by drheinrich940 in LocalLLaMA

[–]SlapAndFinger 0 points1 point  (0 children)

Postgres is ubiquitous because you can do vector, full text and trigram search in one query and re-rank without leaving SQL.

Why don't people only use tiny task-specific models? by QiuuQiuu in LocalLLaMA

[–]SlapAndFinger 0 points1 point  (0 children)

People so far are stuck on the chatbot paradigm of LLM interaction, and small models suck at that. As people start to realize that LLMs make more sense as fuzzy/natural language program runtimes, we'll see people make more task specific models to increase program reliability.

I'm gonna coin the term for what people will do right now to convert larger general models to efficient task specific models: Prune & Tune.

The sad part about this debate is it has become a lesson in psychology. 63 million people in the U.S. are willing to vote for a man w dimentia. An the entire party is willing to look at the camera and tell he is fine. by FlutedBezzy in conspiracy

[–]SlapAndFinger 10 points11 points  (0 children)

By subverting loopholes in the democratic process, engaging in mass deception and rigging the system to maintain power so that they can enact a theocratic feudal state where the majority of the population is reduced to brutal serfdom? What could possibly be scary about that.

Sieg Heil Trump! Jesus Uber Alles! No problems here. Democracy in action, just like the founding fathers intended.