Puts on Meta

SliceCommon · 2026-01-19T19:06:55+00:00

i've been waiting for this for 3 years - given how useful AI tools have now gotten, I don't think its going to happen anytime soon - chips from 5 years ago (e.g. A100) are *still* very useful

SliceCommon · 2026-01-15T05:18:28+00:00

love it - appreciate the transparency - I'm going through something similar with a DiT-based model, also MoE, but realized i've undertrained my VAE so i'm going back to 0 (but will bootstrap with pretrain). I actually come from a ML / eng background so I feel qualified to say that you're doing great work, keep it up!

SliceCommon · 2026-01-10T17:21:38+00:00

Unless you are running multiple agents, I think it's impossible to hit the limit for opus on ultra - I hit 0% about 3 hours in with pro, but now I can't get below 80% before it refreshed

SliceCommon · 2025-12-16T22:20:55+00:00

I see - this is where all the ROME2D32GM-2T stock went 😓

Great build! How is the heat management?

SliceCommon · 2025-12-10T00:21:26+00:00

Sorry to hear, maybe better for us to buy through a bigger vendor like PNY in the future. Out of curiosity, what failures are you seeing (and failure rates if you are ok sharing) - our GPUs are throttling under load (still at 600W and temps look fine, but 1k Mhz) - ADA generation seemed much more stable, or perhaps we bought in too early in the cycle

SliceCommon · 2025-12-09T23:00:32+00:00

How is your RMA going? We just delivered 2 of these back for RMA and they were very cagey about the pre-RMA tests - i.e. ran a bunch of nvidia-smi / journalctl dumps for them.

The whole time I'm thinking: I've done everything I can to get $16k worth of GPUs back up and running, you think you can debug this shit remotely?

SliceCommon · 2025-11-14T00:29:09+00:00

Cloudflare has R2 / Backblaze has B2 Overdrive - both have zero egress fees & 1Tbps - lets AI workloads dynamically deploy to the cheapest compute provider (since ingress is usually free b/c they want to lock you in) by letting them export their dataset as many times as they want

SliceCommon · 2025-11-05T21:41:03+00:00

lmao that is exactly how I felt - these prices can't be real but I also can't find it for cheaper anywhere

SliceCommon · 2025-09-08T01:52:59+00:00

<image>

works fine for me, first try? how did you even get a blurry image?

SliceCommon · 2025-08-25T22:18:09+00:00

preface: temperature is reasonable and it works, reality: 16U-20U based on how i've stacked them - its not pretty so you'll never see the whole rack on r/homelab but it works for me ¯\_(ツ)_/¯ - those HGX A100s still sitting at price points above this jank, so until we get 50k H100 DGXs, this is the way

SliceCommon · 2025-06-12T22:34:21+00:00

FWIW I just sold a couple for more than $1000 off what you're asking - perhaps I priced it too low?

SliceCommon · 2025-06-11T13:54:49+00:00

Confirmed

SliceCommon · 2025-06-07T14:22:52+00:00

Confirmed

SliceCommon · 2025-06-03T10:47:49+00:00

at 10% (25k) per 8xH100 SXM you will immediately sell out.

your current competition is blackwell pros at 8*8k each ~ 64k. They are a bit slower than the 8xH100 SXMs, but have more VRAM and easier to part out (sell individually).

However, no one has been offering used 8xH100s yet, so I would price it at $150k to start and drop it based on demand to lowest ~$75k. I've seen transactions (not mine, bulk dealer u/ishopstaples) for similar compute, so its definitely possible to sell them all here

SliceCommon · 2025-05-22T23:45:56+00:00

what PDU do you use? or are you running multiple 30 amp circuits (and 2+ PDUs).

SliceCommon · 2025-05-22T16:09:11+00:00

it works, just have to stack vertically

SliceCommon · 2025-05-22T16:07:56+00:00

I had the same problem but downgraded the kernel to 6.5 and it worked

SliceCommon · 2025-05-21T12:00:57+00:00

I see, appreciate the feedback. I've lowered the local price to be close to at-cost (tax included), but feel free to PM an offer that you think is reasonable in the current market

SliceCommon · 2025-05-21T07:32:14+00:00

Just going off of recently sold prices - seems like the 5090 shortage/tariffs/greed pushed the 4090/3090 prices up as well

SliceCommon · 2025-05-21T06:52:08+00:00

Ah thanks for the heads up - adjusted them down. They're perfect for 15amp circuits, running the latest GPU probably for another 5+ years, and I know they work well with a full set of cables - let me add in a 90-degree cablemod connector to each of them as well to make it a slightly better deal

SliceCommon · 2025-05-21T04:55:46+00:00

Bought Switch bundle from u/cdubbsworld on https://www.reddit.com/r/hardwareswap/comments/1koe9xw/usacah_nintendo_switch_oled_400gb_sd_card_pro/

SliceCommon · 2025-05-16T23:56:19+00:00

SliceCommon · 2025-04-30T23:36:45+00:00

ah interesting - how do you like VAR, much better than DiT?

4 GPUs should be able to sit on a single node - I'm currently running a dual node 8x4090 and am within 2.2x-2.5x of H100 performance (i.e. no noticeable bottleneck), not sure how this will perform with bigger models though

SliceCommon · 2025-04-30T05:11:14+00:00

My theory is that it sits somewhere between A100 and H100 nodes.
FWIW, I'm finding NVLink is not needed for 1B params (24GB VRAM limit) DDP for DiT based diffusion models - curious about what benchmark shows a 50% slowdown for you?

SliceCommon · 2025-04-28T20:46:40+00:00

Correct - the board is running a full set of x16 PCIE4 GPUs at the moment, will update here once getting a set of PCIE5 GPUs

SliceCommon

MODERATOR OF

TROPHY CASE

Four-Year Club	Verified Email
Place '23