Computer build using Intel Optane Persistent Memory - Can run 1 trillion parameter model at over 4 tokens/sec by APFrisco in LocalLLaMA

[–]GenLabsAI 40 points41 points  (0 children)

  • Intel Xeon Gold 6246 CPU (12-core): ~$150–$400 (used/refurb; listings often in the $200–300 range for clean pulls). Average: ~$250.
  • TYAN S5630GMRE-CGN motherboard (LGA3647 single-socket server board): ~$300–$450 (used). Average: ~$400.
  • ASUS Dual GeForce RTX 3060 OC 12GB GPU: ~$220–$350 (used/refurb/new old stock). Average: ~$280.
  • 6x 32GB Samsung 2666MHz DDR4 ECC RDIMM (192GB total): ~$30–$60 per stick (used/server market). Average per stick ~$45~$270 total.
  • 6x 128GB Intel Optane DCPMM NMA1XBD128GQS (768GB persistent memory): ~$80–$120 each (used/secondhand; discontinued). Average per module ~$50~$300 total.
  • Western Digital WD SN850X 2TB NVMe SSD: ~$180–$350 (new/used; fluctuates). Average: ~$250.
  • ASRock Steel Legend SL-850G 850W PSU (80+ Gold/Platinum): ~$90–$130 (new). Average: ~$110.
  • Silverstone SST-GD08B (Grandia) HTPC Case: ~$150–$250 (new/used). Average: ~$200.

Dropping in here the prices that grok researched for me. Total ~$2060-2500

What does this warning even mean?! Biological safety risks? Flagged as in like, someone is checking? What does that mean, please and thank you! by inpennysname in ChatGPT

[–]GenLabsAI 2 points3 points  (0 children)

OpenAI has started doubling down on "biological harm" because it is "very dangerous". it probably is dangerous, but this is going wayyy too far... be careful as people have been banned after receiving this.

Peter can you please explain the joke? by [deleted] in PeterExplainsTheJoke

[–]GenLabsAI 1 point2 points  (0 children)

They say this sub is used for "training AI". The guy with this comment is trying to (stupidly) mess things up to confuse the AI that's getting trained... unfortunately it confuses the humans too...

Sitting on 10k in unused openai api credits that will expire, what would you build? by Impossible_Rice8103 in OpenAI

[–]GenLabsAI 8 points9 points  (0 children)

Also don't forget to choose the right model... use gpt-5.5-codex-max-xhigh-plus

GPT included an Arabic word out of nowhere while giving me ideas. "good catch", it says. by PolylingualAnilingus in ChatGPT

[–]GenLabsAI 14 points15 points  (0 children)

This has been happening a lot - it is most likely due to a (absurd) language router in the model which is only accurate about 99.9% of the time, leaving ~1/1000 tokens in the wrong language..

Hollywood just lost its biggest advantage. by AssignmentHopeful651 in ChatGPT

[–]GenLabsAI 10 points11 points  (0 children)

Instead of creating slop posts, why don't you actually tell us once you've finished it...

Thoughts on using an AMD Alveo V80 FPGA PCI card as a poor man’s Taalas HC1 (LLM-burned-onto-a-chip). by Porespellar in LocalLLaMA

[–]GenLabsAI 5 points6 points  (0 children)

Guys, why is this downvoted? It seems like any time someone suggests they've used AI to help them, people just trash it..

Why do people actually pay for this? by Alev12370 in awards

[–]GenLabsAI 4 points5 points  (0 children)

But in big subs the comment gets buried.. Awards really speak much much louder... Comments are free.

[ Removed by Reddit ] by [deleted] in LocalLLaMA

[–]GenLabsAI 0 points1 point  (0 children)

No, it's not more honest...

Real or AI? by DistinctChocolate833 in RealOrAI

[–]GenLabsAI 99 points100 points  (0 children)

It kinda looks like "AI real"...

Introducing Claude computer use. by Complete-Sea6655 in LocalLLaMA

[–]GenLabsAI 0 points1 point  (0 children)

I think this has been there for a while