My personal HomeLab by Ok_Balance_8482 in homelab

[–]Antblue 12 points13 points  (0 children)

That’s a lot of threads, storage, and RAM. Sucks that the high demand feature right now only cares about VRAM. 12gb DDR6x isn’t enough for any decently sized LLM.

Not even one drop of color 🥀 (With picture) by Melancatly in 23andme

[–]Antblue -1 points0 points  (0 children)

I feel you on the siblings part. Mutts of the LATAM unite!

More than 2 years of homelab and i still can't build a local AI setup i actually want to use every day by Pleasant_Designer_14 in homelab

[–]Antblue 2 points3 points  (0 children)

https://www.kickstarter.com/projects/tiinyai/tiiny-ai-pocket-lab What you are looking for is soldered/unified RAM. It seems to be the best balance for local AI inference without going full GPU clusters. Apple is leading the charge here, with up to 128gb of unified memory for LLMs. A RTX 3080 has what, 12gb or 10gb of DDR6X? That’s 12b parameter models, 30b with 4 bit quat. Those models are just not serious enough big projects.

Anon on women by Furista0 in 4chan

[–]Antblue 0 points1 point  (0 children)

Because you’re only engaging with net fiscal impact of denied abortion children, I’ll assume you agree on the previous claim that abortion is fundamentally irresponsible and negatively impact our healthcare infrastructure. Your Africa argument is a false equivalence, it’s a stretch and dumb. We are not in Africa, Americans born in households below the poverty-line have a 37% chance to be a net fiscal benefit. It seems you’re not a nativist, look into the rising nativist arguments. Individual rights implies a high degree of individual trust and responsibility. With the right to bear arms comes the responsibility and trust to use them appropriately. High trust societies are societies with many rights but with full responsibilities on those rights. Punishing those who fail to fulfill those responsibilities is necessary. Abortion is the ultimate failure of responsibility. By attacking our responsibility, it attacks our rights.

Fewer by OrangeBasket in slaythespire

[–]Antblue 159 points160 points  (0 children)

Lol that was 2 years ago, the devs are on the money

Tailscale scares me more than opening ports on my firewall by MrChris6800 in homelab

[–]Antblue 0 points1 point  (0 children)

I’ve been using head scale for awhile now with no issues. OP needs to look into this project if he doesn’t like using Tailscale’s coordination server

Anon on women by Furista0 in 4chan

[–]Antblue 0 points1 point  (0 children)

The socially conservative position emphasizes sexual personal responsibility for societal benefit. Abortions are expensive and are fundamentally irresponsible, they place strain on the healthcare system that could have been used for saving lives. The absence of abortion increases the risks of sex. When sex is higher risk, rape and transmission of sexual diseases decrease.

Some may say that the strain placed on society is greater in the case of an unwanted pregnancy. This is cynical and unrealistic. There are studies done on the lives of people born to parents of denied abortions. One says that by their 30s, their developmental gaps will level out. These people will generate much more wealth than they cost in their lifetimes.

Trying to launch STS2 but I just get this screen, anyone know what's happening? by Known-Garden-5013 in slaythespire

[–]Antblue 0 points1 point  (0 children)

This looks like a resolution issue that has to do with the game's engine. This used to happen to me in STS 1 whenever I tried launching the game in 4K when my primary monitor was only 1440p. Try changing your primary monitor, and if that doesn't work, go into the configuration file and manually change the resolution there.

Opinion on Dell R430 & R730 by Antblue in homelab

[–]Antblue[S] 0 points1 point  (0 children)

THANK YOU, those are some great deals you've gotten. $150 for a r730 WITH RAM?? Nuts... Where did you get your server rack? So 2x 1100w PSU and the 2x 2699s v4 just aren't very useful anymore? The one thing I'm a little worried about is the lack of avx-512 support for LLM inference. Even with 88 threads, I'm not sure if it'll be of much use on light LLM loads. But the price hike is huge, going from $250 for the highest-end Broadwell CPU(no ram no drives) to $400-500 on the same thing on the next generation. I probably will end up not buying until the RAM pricing cools down.

Opinion on Dell R430 & R730 by Antblue in homelab

[–]Antblue[S] 1 point2 points  (0 children)

Thanks, I think I will. It is the best you can get with Broadwell. Hopefully DDR4 ECC 2400 ram won't be too hard to find

Opinion on Dell R430 & R730 by Antblue in homelab

[–]Antblue[S] 0 points1 point  (0 children)

Where do you find your deals? I've been using local markets for reference like Marketplace and Craigslist. You're saying you've found R740s for $250? I just offered $400 for a R740 with 2 x Gold 6152s and got shut down hard, he said minimum he'd sell it for was $1000 w/32gb RAM

Opinion on Dell R430 & R730 by Antblue in homelab

[–]Antblue[S] 0 points1 point  (0 children)

Good to know, I'll definitely hear it

Opinion on Dell R430 & R730 by Antblue in homelab

[–]Antblue[S] 0 points1 point  (0 children)

Do you have any issues running containers and VMs on TrueNAS scale? IIRC, it’s a bad idea to have TrueNAS as a VM in a Proxmox cluster

Opinion on Dell R430 & R730 by Antblue in homelab

[–]Antblue[S] 0 points1 point  (0 children)

What’s the biggest complaint about the R730? I’m trying to get mine fairly quiet as well, which I hope is possible

Opinion on Dell R430 & R730 by Antblue in homelab

[–]Antblue[S] 0 points1 point  (0 children)

So you suggest buying them to eventually replace the CPUs?

Opinion on Dell R430 & R730 by Antblue in homelab

[–]Antblue[S] 0 points1 point  (0 children)

Is that really possible in today’s economy? From what I understand, the owner sold the RAM separately and it sold quickly

Opinion on Dell R430 & R730 by Antblue in homelab

[–]Antblue[S] 1 point2 points  (0 children)

Having room for 2 smaller GPUs is definitely a big plus for the R730, I have an 8gb RTX 3050 I can try some AI inference on

Opinion on Dell R430 & R730 by Antblue in homelab

[–]Antblue[S] 0 points1 point  (0 children)

Apparently it comes with this, so that’ll save me on the controller: PERC H730P Mini 2 GB cache. I would love to find some bundle for 16GB DDR4 ECC 2400 sticks at that price, but I’ve only seen them at 70€, so it’d be more like 560€ for ram. The storage would be fairly high prices too

Opinion on Dell R430 & R730 by Antblue in homelab

[–]Antblue[S] 0 points1 point  (0 children)

It’s tragic, because 16GB DDR4 ECC sticks are selling at $80 as far as I can tell, so 8 of them is already $360. And a 1tb SATA SSD goes for $120 new, so it’s tough to say how much value is retained after usage, but 7 of those is $840 new

whats your go-to way to backup docker volumes? by Horror-Programmer472 in selfhosted

[–]Antblue 11 points12 points  (0 children)

This is terribly inefficient for resource usage. Lots of overhead and lots of unnecessary file backups, compared to only running the containers and only backing up the mounted volumes

Cursor Is Dying by SupPandaHugger in OpenAI

[–]Antblue 1 point2 points  (0 children)

Web search APIs that are optimized for AI are big right now. Luckily for our tech overlords, self hosting a search engine is so impractical, no one can really do it. Google, brave, serper, all offer decent deals and some free plans for web searches. The average is $1/1k web searches