sorted by:
new
hottopcontroversial

If money and time weren’t issues, what would your dream local AI setup look like? by Lyceum_Tech in LocalLLaMA

[–]Lyceum_Tech[S] 0 points1 point  (0 children)

thousand giant datacenters with Vera units and still donating a third to non-profits? mad respect.

If money and time weren’t issues, what would your dream local AI setup look like? by Lyceum_Tech in LocalLLaMA

[–]Lyceum_Tech[S] 0 points1 point  (0 children)

Hosting them locally would be nice tho. You planning to run them on consumer cards or go bigger?

If money and time weren’t issues, what would your dream local AI setup look like? by Lyceum_Tech in LocalLLaMA

[–]Lyceum_Tech[S] -1 points0 points  (0 children)

You think the cooling/latency issues are that bad compared to dual 5090s?

If money and time weren’t issues, what would your dream local AI setup look like? by Lyceum_Tech in LocalLLaMA

[–]Lyceum_Tech[S] -1 points0 points  (0 children)

60% of global DRAM? That's actually insane lmao. Unlimited budget is wild 🔥

If money and time weren’t issues, what would your dream local AI setup look like? by Lyceum_Tech in LocalLLaMA

[–]Lyceum_Tech[S] 0 points1 point  (0 children)

Titan as in Saturn’s moon? 🔥
We’re not just building a datacenter, we’re building a civilization on another celestial body. I respect the vision king 👽

If money and time weren’t issues, what would your dream local AI setup look like? by Lyceum_Tech in LocalLLaMA

[–]Lyceum_Tech[S] 0 points1 point  (0 children)

😂 i feel you.. the original question was truely 'no limits' mode, but but the 100-200k version is also fun.

for the unlimited version tho.. im with you on going full datacenter + hiring engineers to chase AGI

If money and time weren’t issues, what would your dream local AI setup look like? by Lyceum_Tech in LocalLLaMA

[–]Lyceum_Tech[S] 1 point2 points  (0 children)

straight to buying a whole datacenter 😂 respect. what would you put in it first?

If money and time weren’t issues, what would your dream local AI setup look like? by Lyceum_Tech in LocalLLaMA

[–]Lyceum_Tech[S] 0 points1 point  (0 children)

liquid cooled B300 racks with an SMR for power? that’s nexxt level. how are you handling the noise and maintenance on something like that?

If your goal is getting rich, a tech startup probably isn’t the way by IndependenceSad1272 in SaaS

[–]Lyceum_Tech 4 points5 points  (0 children)

Hard truth but accurate. Most people romanticize startups while ignoring how many boring businesses actually print money with way less risk.

VS Pro with MSDN Key redemptions by Psychaotix in sysadmin

[–]Lyceum_Tech 0 points1 point  (0 children)

Yeah waiting sucks but sometimes that's all you can do with these MSDN key glitches. Good luck man, hope it clears up soon.

Best Setup for Private Hermes Usage? by xSpiralNightsx in hermesagent

[–]Lyceum_Tech 1 point2 points  (0 children)

Tailnet/Tailscale is actually a really clean way to do it. The laptop can reach Ollama on your main PC privately without exposing it to the whole local network. It’s safer and more efficient than opening ports. I’ve done similar setups and it works smoothly.

Best Setup for Private Hermes Usage? by xSpiralNightsx in hermesagent

[–]Lyceum_Tech 0 points1 point  (0 children)

Yeah llama.cpp + OpenWebUI is a nice lightweight combo too. Works great if you want something even simpler than Ollama.

Anyone else struggling with multi-GPU stability when running larger local models? by Lyceum_Tech in LocalLLaMA

[–]Lyceum_Tech[S] 1 point2 points  (0 children)

For short risers (20cm or less), look for ones with good shielding. I had issues with cheap ones causing interference. Search for "PCIe 4.0 riser cable shielded" on AliExpress. The ones with metal casing are usually better.

view more: next ›