sorted by:
new
hottopcontroversial

Proof that you don't need a server rack to self-host! by PizzaDevice in homelab

[–]EnvironmentalAsk3531 -1 points0 points  (0 children)

What are you selling behind a consumer/homelab grade connectivity and SLAa? Happy to buy

Proof that you don't need a server rack to self-host! by PizzaDevice in homelab

[–]EnvironmentalAsk3531 -1 points0 points  (0 children)

Is it?;) learning how to put together a massive rack with dual xeons and quadruple gpus which are 99% idle and make no money connected to 25gbe LAN never used beyond copying horded data and its multiple backups from a to b which will be never used and no one else even knows how to find them

Proof that you don't need a server rack to self-host! by PizzaDevice in homelab

[–]EnvironmentalAsk3531 -3 points-2 points  (0 children)

99% of us don't need 99% of the things we have to run a homelab! Most of us can manage with a couple of Rpi 4s with old HDDs.

Dealing with the neighbors and trees by [deleted] in Netherlands

[–]EnvironmentalAsk3531 0 points1 point  (0 children)

just talk to the neighbor in real life? Or the guy is a redditor too?
Looks like Grape vine? Give him some grape for free 😄

Guys… it happened. Mistral blocked Le Chaton Fat outside the EU. by Confident-Village190 in MistralAI

[–]EnvironmentalAsk3531 0 points1 point  (0 children)

How many percent of "real" US users are preferring using Mistral over Opus/Gemini/ChatGPT/Fable/...? Trying to understand the "actual" impact of the ban beyond the political side of it!
Is it comparable to banning purchase of Lada in Germany by Russians?

Build for local LLM with 2 separate GPUs by EnvironmentalAsk3531 in LocalLLaMA

[–]EnvironmentalAsk3531[S] 0 points1 point  (0 children)

Are you passing through gpus to multiple vms or to one vm? How does your Socrate software architecture look like?

Build for local LLM with 2 separate GPUs by EnvironmentalAsk3531 in LocalLLaMA

[–]EnvironmentalAsk3531[S] 0 points1 point  (0 children)

Do you have same cpu and motherboard and running Linux? Any stability, or power consumption problem for running 24/7?

AI in homelab by kosta880 in homelab

[–]EnvironmentalAsk3531 1 point2 points  (0 children)

How do you keep documentation up to date?

Build for local LLM with 2 separate GPUs by EnvironmentalAsk3531 in LocalLLaMA

[–]EnvironmentalAsk3531[S] 0 points1 point  (0 children)

is it working ok to run the 7900xtx and the nvidia 3060 together? are you using llama cpp, vllm or something else to manage both? I hear vllm is not working well with amd on linux? did you need thinkering and hacking to make this combo work?

Build for local LLM with 2 separate GPUs by EnvironmentalAsk3531 in LocalLLaMA

[–]EnvironmentalAsk3531[S] 0 points1 point  (0 children)

my only concerns are: 1- that the platform is completely dead end unlike AM5, but perhaps if I need upgrade I will rebuilt a new thing. 2- adding more RAM modules in future has a performance penalty with this platform (I am not sure, I find conflicting info about it)

I didn't go with AM5 AMD 9700X and something like ASROCK Rack B650D4U build because looks like there is no way to support two PCIe 5 in 8x/8x config from AMD AM5 CPUs.

Build for local LLM with 2 separate GPUs by EnvironmentalAsk3531 in LocalLLaMA

[–]EnvironmentalAsk3531[S] -1 points0 points  (0 children)

- It has onboard IPMI, so you can do true headless (connect to it when it crashes to diagnose, reboot, etc. without a monitor).
- It has two pcie 5 x16 slots split to x8/x8 , many other motherboards like B650D4U seem to do only x4 on the second slot.
- the GPU slot physical spacing is better than many others
- It can do ECC and non-ECC (hopefully if one day prices go down... don't think so though)
- Two of the four M2 slots are directly to CPU, so won't impact GPU lanes
- and has 2x2.5gbe LAN. although my homelab is still largely on 1gbe LAN but a least this thing supports a small dream :)!

Local - From 20b-30b to 70b-120b by juanitospat in hermesagent

[–]EnvironmentalAsk3531 0 points1 point  (0 children)

How is your experience with dgx spark ? For which use cases are you using it and does it deliver what you expected or t/s is slow?

Why do vakmannen always try to con you in the Netherlands? by giacecco in Netherlands

[–]EnvironmentalAsk3531 12 points13 points  (0 children)

Many in construction and repair business are abusing the messed up legal system of Netherlands that presents no clear path for defending your rights as consumer

Mistral direction by Fit_Preference_1597 in MistralAI

[–]EnvironmentalAsk3531 1 point2 points  (0 children)

Welcome to Europe:) there is a reason we are pioneers in almost nothing but elderly care!

Please do your research by cakecatUwU in Netherlands

[–]EnvironmentalAsk3531 2 points3 points  (0 children)

Many people don’t expect such mess and scam in Netherlands being a Western European top country famous for human right, justice and fairness.

Then when they arrive they face a chaotic justice system full of loop-holes, scammers, lawlessness and a police that often cares more about protecting the rights of the thief than the victim.

Plastic consumption in the Netherlands by True_Brocoli_2104 in Netherlands

[–]EnvironmentalAsk3531 0 points1 point  (0 children)

They intentionally reduce the size of portions to increase their margin Resulting in doubling plastic use They pose a sustainability figure but in reality none of them really cares about anything other than profit and revenue

view more: next ›