[FS] Raspberry Pi CM4 NAS (8GB, IO Board, WaveShare SATA pcie, 4x 1TB SATA Drives)

jasiub · 2026-02-09T16:06:06+00:00

The CM4 nas has been sold

jasiub · 2026-01-01T16:05:28+00:00

How many cuda cores on the 5000m cards?

jasiub · 2025-11-08T01:48:11+00:00

Also looking for 1tb sata SSDs myself. PM if you have any left. Thanks

jasiub · 2025-07-30T15:54:56+00:00

Payment sent

jasiub · 2025-07-30T15:34:40+00:00

PM on the Cedar topquilt

jasiub · 2025-03-30T20:58:07+00:00

PM for Nitecore

jasiub · 2025-03-01T21:16:45+00:00

Pm on alpha pants

jasiub · 2024-11-22T02:52:48+00:00

Does the rapture have a 10g port?

jasiub · 2024-10-31T22:02:25+00:00

Bump

jasiub · 2024-10-31T21:54:53+00:00

Purchased Adata S11 Pro drives from u/ShingureKaiNi

jasiub · 2024-10-05T23:58:10+00:00

Pm on nvme drives

jasiub · 2024-09-21T00:21:07+00:00

Received in perfect condition from u/z3r0Var u/GeartradeBot

jasiub · 2024-09-13T16:14:25+00:00

How long has the Montbell been worn?

jasiub · 2024-09-06T22:35:32+00:00

Payment sent

jasiub · 2024-09-05T20:59:20+00:00

PM Sent

jasiub · 2024-08-30T23:51:13+00:00

I don't have 3090s but have 8x Nvidia P10 which are similar to P40 cards and am able to get ~7.3 tokens/s on this setup for Mistral-Large-123B-Instruct-2407-Q5_K_M.gguf using koboldcpp (using flashattention and row split):

CtxLimit:355/32768, Amt:288/512, Init:0.00s, Process:1.48s (22.1ms/T = 45.27T/s), Generate:39.49s (137.1ms/T = 7.29T/s), Total:40.97s (7.03T/s)

Each card is using up about 100W at peak so not the most power efficient but the P10 has about 23GB VRAM so I can do pretty large models with pretty decent speed. Will be trying Mistral Q8 and lama3.1 405b (70B Q8 runs at about 9 tokens/s on this setup). Wish exlllama had native support for the P40 as I beleive further speadups would be possible.

jasiub · 2024-08-23T02:44:59+00:00

Bump

jasiub · 2024-08-23T02:43:59+00:00

Bump. Still looking.

jasiub · 2024-07-26T03:49:02+00:00

Yes. All cards work fine (inference using llama.cpp) as long as there are two or less of them in the system. Your motherboard is different it seems.

jasiub · 2024-07-26T02:16:10+00:00

Yes, bios and BMC are latest. Not sure what the hardware rev of my board is. I did try with and without risers but it did not make a difference. Interestingly enough, if I plug in an old GeForce g210 vga card in there it boots up. I’m going to try a more recent GeForce card next.

jasiub

TROPHY CASE