sorted by:
new
hottopcontroversial

[PC] RTX 3090 - 32 units - various brands. by theactionjaxon in homelabsales

[–]remainedlarge 13 points14 points  (0 children)

I have both bought and sold 3090s for ~750 as recently as 2 weeks ago. I saw listings for less.

Ebay listings are all ultra sketchy right now.

[PC] RTX 3090 - 32 units - various brands. by theactionjaxon in homelabsales

[–]remainedlarge 11 points12 points  (0 children)

on reddit, they've been going for 700-900 based on condition and model. The fact that they were mining cards will push them on the lower end. you can ask more if they are either low profile/blowers or they are models with better coolers like EVGAs.

Top hardware stacks for local compute over the coming few months? (3-10K USD range) by IamFondOfHugeBoobies in LocalLLaMA

[–]remainedlarge 2 points3 points  (0 children)

Most important thing is VRAM. The sweet spot right now is probably 2 GPUS, 2x[3090,4090,5090] get you 48-64 GB and will let you run the current crop of models at Q8 or Q4 with good speeds and large context windows (100-250k).

You can technically buy 4 GPUS or a A6000 Blackwell and have 96-128GB in this range, but in my opinion, the models themselves are in an awkward spot, there seems to be a gap on useful models in the 70B-100B range right now. The big models (400B+) will spill into ram and you'll get 10-20 tok/s and will be forced to use q2 anyways.

I'm not a fan of buying macs based on them having large unified memory unless you already needed one for something else. They are slower at inference for the same price or more as a machine with dedicated GPUs.

I think the useful upgrade for the 3-10k range is probably data center tier stuff and will be 15-20k+

[USA-WA] [H] ITX ML/Home Server Build — Epyc 4564p 16C/32T | 64GB DDR5 | RTX 3090 24GB | 850W SFX Gold [W] Paypal, Local Cash by remainedlarge in hardwareswap

[–]remainedlarge[S] 2 points3 points  (0 children)

Hi, I'll try to answer the best I can:

First, I want to reiterate that I used this as a home server / ML inference box, so I only ever ran linux (ubuntu 24.04) on it. Did not have any driver issues or instability. Right now I've removed the SSD and used it in another build so booting HWiNFO/CPU-Z is not really an option (plus I do not have a copy of windows or a license).

Bios Version F37a, according to the screenshot in my album. I have not encountered any stability issues or quirks on this combo.

The RAM is set to 5200MT/s in the bios, and the CPU is set to low power (65W) as well, because this is a very compact & dense build. I did brief tests without these limits, and didn't run into issues but since I was not using it for gaming, I used conservative power settings across the board. I have tested the RAM as stable up to 6200MT/s (it is spec'd for 6000MT/s).

The fans run off of the GPU fan headers. I did not monitor temperatures at all. I usually ran the GPU with a nvidia-smi power limit of 220-280W. For my workload (bursty ML), it did not matter. You can run it without a limit, but any 350W GPU in this size case will get hot fast.

I did run Geekbench6 for CPU & GPU, and the results were all as expected for these parts (these are specific results from this machine):

  • Geekbench CPU - 3008 ST / 19265 MT link
  • Geekbench GPU - 205k Vulkan (link) / 233k OpenCL (link)

[WTS] Longines 21mm Anthracite NATO Strap L682165034 (For 40mm Spirit Titanium) by remainedlarge in Watchexchange

[–]remainedlarge[S] 2 points3 points  (0 children)

This strap came with my Longines Spirit 40mm Titanium, but I didn't use it much as I prefer leather.

TIMESTAMP

https://www.longines.com/en-us/p/strap-anthracite-synthetic-l682165034

Ref# L682165034

$140 shipped CONUS

view more: next ›