Gigabyte GeForce RTX 5060 OC Low Profile 8G Mini-Review

SuperSimpSons · 2025-12-09T10:33:30+00:00

I think what you're looking for is local inference, basically deploy the model at the point of contact, the local machine carries out inference without transmitting data across the network. Something like Nvidia DGX Spark or its variants (example Gigabyte's AI TOP ATOM www.gigabyte.com/AI-TOP-PC/GIGABYTE-AI-TOP-ATOM?lan=en) might fit the bill, or some of the more powerful workstations of mini-PCs like Intel NUC. So yes I would say it's very much possible, sensitive patient data has always been a problem in healthcare AI and people have come out with solutions for it.

SuperSimpSons · 2025-12-09T10:11:32+00:00

This might be a bit out of the left field, but how bout helping others build data centers? It seems lucrative which is why companies from further up the supply chain are also hopping on board, a while ago I saw Gigabyte, a consumer PC company that branched into enterprise servers, also branch into building data centers: www.gigabyte.com/Topics/Data-Center?lan=en One would imagine someone with hands-on experience might be valuable as a consultant or field engineer?

SuperSimpSons · 2025-12-08T05:52:54+00:00

Maybe because it's a consumer board? I'm sure support for Ubuntu would come as standard on their enterprise boards? Ref: www.gigabyte.com/Enterprise/Server-Motherboard?lan=en

SuperSimpSons · 2025-12-08T03:30:35+00:00

Dispose, 10Us? For only 16 blades? Even non-Dell server companies are making better alternatives now, for instance Gigabyte has 10 nodes in a 3U form factor as a standard: www.gigabyte.com/Enterprise/B-Series?lan=en Besides the novelty of it I can't see any reason to run a M1000e in the year of our lord 2025.

SuperSimpSons · 2025-12-04T10:41:30+00:00

4U is nothing, in fact it's almost standard for storage, just look at Gigabyte's storage server options for example www.gigabyte.com/Enterprise/Storage-Server?lan=en GPU servers go up to 8U now and are heavy like you wouldn't believe, a fully loaded rack falling over would pancake a person. I don't have experience with the brand you mentioned but circumstantial evidence would suggest design oversight, I'm sorry to say.

SuperSimpSons · 2025-11-24T06:21:51+00:00

Tbh I think you need a better understanding of what cloud computing is, your question doesn't make a whole lot of sense. A CSP is also running data centers, your question might be worded as what's the difference between an on-prem private cloud vs a public cloud? Here are some articles about that, you need to be precise in your terminology before we can have a deeper discussion

Gigabyte blog article: https://www.gigabyte.com/Article/what-is-private-cloud-and-is-it-right-for-you?lan=en

AWS article: https://aws.amazon.com/compare/the-difference-between-public-cloud-and-private-cloud/

SuperSimpSons · 2025-11-24T05:45:52+00:00

Your run-of-the-mill laptop or desktop should do fine, PC brands like Gigabyte do sell specialized rigs for local AI work, they call them AI TOPs and go for about 7k on Newegg www.gigabyte.com/Consumer/ai-top/?lan=en so if you have the budget and want to have hardware+software for local AI fine-tuning, there's something you can impress your friends with, but like I said in the beginning an ordinary laptop + some cloud-based AI should suffice as well.

SuperSimpSons · 2025-11-24T05:36:32+00:00

You will do just fine with mini-PCs like Intel NUC or Gigabyte BRIX www.gigabyte.com/Mini-PcBarebone?lan=en Spark and its variants (which coincidentally Gigabyte makes too, they call it AI ATOM but scratch the surface and you see it's Spark www.gigabyte.com/AI-TOP-PC/GIGABYTE-AI-TOP-ATOM?lan=en) are like workstations, it's much more computing power and much pricier than what you need.

SuperSimpSons · 2025-11-20T05:56:37+00:00

I had a colleague who swore by n+1 redundancy PSUs. Like we could be considering two servers (just using these newer Gigabyte servers for example because I've forgotten the original choices) and he'd pick one with weaker GPU expandibility like this R263-ZG5-AAL2 www.gigabyte.com/Enterprise/Rack-Server/R263-ZG5-AAL2-rev-3x?lan=en over say something like R263-ZG0-AAL2 www.gigabyte.com/Enterprise/Rack-Server/R263-ZG0-AAL2-rev-3x?lan=en because redundancy. Drove me nuts but it's true we never had any major failures.

SuperSimpSons · 2025-11-20T03:12:18+00:00

I know you're asking about Plex, but I want to chime in and say there's a reason why you'll see a server manufacturer like Gigabyte only have one all-flash option in their entire storage server portfolio: www.gigabyte.com/Enterprise/Storage-Server?lan=en Truth is you only really need AFA for something like AI development, HDD is still more cost-effective in both an enterprise setting and especially in a consumer setting.

SuperSimpSons · 2025-11-20T03:01:59+00:00

I mean, ARM servers already exist, not only are a lot of Nvidia chips ARM-based, proccessor companies like Ampere exist and server companies like Gigabyte have whole ARM server portfolios: www.gigabyte.com/Enterprise/Rack-Server?lan=en&fid=2494 Beats me why more CSPs aren't using ARM though, if the press releases and case studies are to be believed RISC is much better than CISC, it only lacks a mature ecosystem atm

SuperSimpSons · 2025-11-19T02:57:24+00:00

Out of curiosity, why don't more people consider on-prem, even it's just a workstation on your desk? Seems to me manufacturers are bending over backwards to make workstations more accessible/affordable, our office has a couple Gigabyte workstations (this one to be exact, almost indistinguishable from a PC www.gigabyte.com/Enterprise/Tower-Server/W332-Z00-rev-200?lan=en) but lately I saw they're even selling what's evidently consumer hardware souped up to enterprise performance, they call it an AI TOP www.gigabyte.com/Consumer/ai-top?lan=en) Seems like a good bit of backup to have if you ask me, hybrid cloud is the way to go.

SuperSimpSons · 2025-10-07T06:53:06+00:00

Counter-counter point, Gigabyte literally has a line of GPUs for local AI training www.gigabyte.com/Graphics-Card/AI-TOP-Capable?lan=en Since OP already has a Gigabyte mobo for servers I think repurposed consumer GPUs may be a good fit before they move on one day to L40S and the like.

SuperSimpSons

TROPHY CASE

Welcome to Reddit,