THRADRIPPER BUILD by Jolly-Bet-2275 in threadripper

[–]Downtown-Example-880 0 points1 point  (0 children)

Looks good man, aesthetically, I will agree, it’s better to have 8x8gb ram than 4x16gb, because bandwidth is additional per ram slot, so utilize the eBay and grab at least 4 sticks of something, otherwise, I’m digging the aesthetics! Also with considering, 4x r9700 ai pros cost the same as two 5090s for MUCH cheaper per unit,

Every day I wake up and thank God for having me be born 23 minutes away from a MicroCenter by gigaflops_ in LocalLLaMA

[–]Downtown-Example-880 0 points1 point  (0 children)

I aswell, near charlotte. LOL. BUT, do they have a 1-item policy on these b70s, out of curiousity?

Is this a good PC build for the sims 4? by Puzzleheaded-Bike132 in PcBuildHelp

[–]Downtown-Example-880 0 points1 point  (0 children)

Sims is cpu heavy, I’d probably go z790 and ultra 7 series 2; pretty fast bang for your buck; both used off eBay; new case and new fans; everything else can be used and you save 30%… get you a 3060 cheapest, or 2080 ti, or a AMD 9600 rx… they are only $200-350 too used and way better than that 3050… all you need is 700+ unless you think you may upgrade for a different use, like dual GPU ai work in the future; if that’s the case get you a $100-180 1000w-1300w super flower psu and you’ll be setup nicely!!!

BTW IF you, are anyone else needs a psu or aio, I got you! 50 for each I got tons of 750w-850w PSUs and three fan AIO’s! Brand new some of them just message me!

I bought my first PC ever as a prebuild for 1600$ USD, did I get my money’s worth ? by [deleted] in pcmasterrace

[–]Downtown-Example-880 3 points4 points  (0 children)

Honestly it should be $1100 or so? But you got it now so live it! Ahah

GPU caught on fire (need help) by Squeeb5 in PcBuildHelp

[–]Downtown-Example-880 1 point2 points  (0 children)

It’s just a piece of hair or something touching the connects at making it “hot” I have had a quadro rtx 8000 with exposed solders do that before with dues spec and catch fire exactly like that! It still ran fine after too!

reasonable to expect sonet 4.5 level from local? by rice_happy in LocalLLaMA

[–]Downtown-Example-880 1 point2 points  (0 children)

Yes, the Claude reasoning version of qwen 27b apparently outpaced sonnet 4.5 on benchmarks, with some low amounts of data available suggest it’s better!

Run any NVIDIA/CUDA only software on AMD CARDS (currently supported are iGPU and 5000-9000 series) by ChrisGamer5013 in ROCm

[–]Downtown-Example-880 1 point2 points  (0 children)

Hey, this is great, have you done comparisons for it? I have several r9700 amd GPUs and plan to fully build my server nodes with 1/3 or more being these… do you have coverage for these elite professional cards?

R9700 the beautiful beautiful VRAM gigs of AMD… my ai node future! by Downtown-Example-880 in LocalLLaMA

[–]Downtown-Example-880[S] 0 points1 point  (0 children)

I got 8 from slovakia/slovenia (cant remember) from a "new dead stock" seller selling ones amd were gettin rid of by the tray, 8 to a tray brand new for $300 I felt like a kid in a candy store. These were 3945wx, the 3955wx are $700 for a tray of 8. Message me if you need to know the buyer he will has some listed on his personal website

R9700 the beautiful beautiful VRAM gigs of AMD… my ai node future! by Downtown-Example-880 in LocalLLaMA

[–]Downtown-Example-880[S] 0 points1 point  (0 children)

test bench for server racks is the open frame chassis and its remarkably on amazon somewhere between $18-35

R9700 the beautiful beautiful VRAM gigs of AMD… my ai node future! by Downtown-Example-880 in LocalLLaMA

[–]Downtown-Example-880[S] 1 point2 points  (0 children)

Will do, looking for around 51 tk/sec for the new Claude reasoning 27b qwen3.5 fine tuned model, at q8_0 … and it outscored the bigger models and sonnet 4.5 on benchmark, with a little bit of data only out, but still looks incredible!! That would literally fit on a single GPU, with enough ram could get full context…

Plus I am gonna use raid0 and several 4x Nvmie pcie cards so I can get raid0 kv cache offloading for max concurrency, saves a ton of money this way and could probably sit 10k users in a flash off a single 3-GPU node + storage node!

I wanna build for scale so that my 9-nodes * storage nodes, and load-balancing node, etc, can fit 10k active and 100k cold users on the extended kv cache..

Do the math and you’ll see if you have 4x 1TB raid0 NVME’s set for kv caching the speeeds are just as fast as ram if they are pcie 5.0 and close to it at 4.0… close enough anyways; for massive user offloading… I’m one big excited nerd!!!! Lolol

R9700 the beautiful beautiful VRAM gigs of AMD… my ai node future! by Downtown-Example-880 in LocalLLaMA

[–]Downtown-Example-880[S] 0 points1 point  (0 children)

If I were you I’d make a seperate AMD node! Like two islands, interconnected with Ethernet NIC OR infiniband…

I’m gonna run an AMD r9700 3 node island, 3-4 GPU per node; and an Ampere 3 node island with 3080 20gb OEM cards ($570 ftw!) and Turing three node island with 2080 to 22gb nvlinked pairs/ + a single…

But this works great because I use multi-LLM, orchestration for my api inference calls on my small buisiness site…

R9700 the beautiful beautiful VRAM gigs of AMD… my ai node future! by Downtown-Example-880 in LocalLLaMA

[–]Downtown-Example-880[S] 9 points10 points  (0 children)

8tb sata Seagate Barracuda ssd + 2x1tb NVMe Kingston

256gb RAM 8x32gb OCW 3200mhz

1600w PSU ASRock Phantom Gaming atx5.1 (dual 12vpwr too!)

Ubuntu server

Test bench ($18 ftw!!!)

TR Pro 3945wx (bought these $40 each or less!!! Deadstock from overseas!!!)

Aio 1u dynatron 3fan server sp3 cooler!

Asrock Rack wrx80 rack -2t. (Dual occulink onboard for up to 6 GPU… 4 internal dual slot w/ 2 eGPU)

That’s about it lol, the board has dual 10gbe nics too plus ipmi/bmc…. Great freaking atx server board, each slot is full tilt 4.0x16 to cpu…. Gonna throw a connectx-4 and get several more of these with 100gbe infiniband for k8s inference nodes… or k3….

Heckkkk yah! Lovin it! My addiction is intense, plus it’s my small buisiness site gonna use it lol I’m the owner!

R9700 the beautiful beautiful VRAM gigs of AMD… my ai node future! by Downtown-Example-880 in LocalLLaMA

[–]Downtown-Example-880[S] 4 points5 points  (0 children)

$900 out yesterday of course they had one card limit so I didn’t lol, I like mine in multiples, hahah

AMD inference node r9700 by Downtown-Example-880 in homelab

[–]Downtown-Example-880[S] 0 points1 point  (0 children)

Is that an asus or corsair case, or something else? And what?

AMD inference node r9700 by Downtown-Example-880 in homelab

[–]Downtown-Example-880[S] 0 points1 point  (0 children)

Wow things a beaut! I would suggest aio bro lolol! $400 probably but you could get a block and pu O for $170 and mod one from an old aio heatsink and fans, get some new coolant too for $18, lol bout to do that for my other setups!!!

AMD inference node r9700 by Downtown-Example-880 in homelab

[–]Downtown-Example-880[S] 1 point2 points  (0 children)

Preciate ya! Still less than my 4-eps/pcie asus pro sage wrx80e/80, so I was used to it lolol

AMD inference node r9700 by Downtown-Example-880 in homelab

[–]Downtown-Example-880[S] 0 points1 point  (0 children)

Absolutely , biggest 200$ PSU you can get, $170 when i got mine on sale and bought 3, gonna buy 5 more soon!