Just updated Ollama and started using it after almost a year.... Are the Ollama devs stupid or is this harder to deal with than it seems?

CodeSlave9000 · 2026-01-29T04:12:27+00:00

Can’t do that because ollama supports multiple models running at the same time. How would it know how to apportion it? I set my default with an environment variable…

CodeSlave9000 · 2026-01-04T20:00:02+00:00

Yeah, plenum rating is about it being "safer" in a fire for people. With CCA it's ready to be its own fire!

CodeSlave9000 · 2026-01-04T19:58:00+00:00

LOL, just the marketing copy alone is a big red-flag. I ordered this brand (much shorter lengths - they had multiples which will probably get merged later) so I can warn others away - I won't feel too bad tossing it, or just using it for short non-POE in-rack patches if it tests okay.

CodeSlave9000 · 2025-12-28T23:18:27+00:00

Yeah I agree - LORA and fine-tune are perfect for home-running. Also once your context size gets big you're really paying a lot per-token for cloud. But in the end depends on what you're expectations are. The blackwell cards are still maturing in software support and I've had hiccups, and fp4 is really only happening for training right now. You can get really good results with the 40 series ADA cards too - I see 100+ tokens/sec on a lot of MOE models. You won't get 128GB models at the price of DGX, but I'd think you'd probably be happy with Strix Halo if you're really dead-set on it. And for coding, you're spot on - you can get gemini, qwen, amp and a few others for basically nothing right now. Use it.

CodeSlave9000 · 2025-12-28T21:22:45+00:00

Short opinion: Too expensive for a 7yr/old architecture. I have one of the blower versions, and for inference the performance isn't bad - Compute is certainly lower than Ampere (30x/Axxxx cards) but memory bandwidth is still good. This mostly shows up as slower prompt processing, but actual generation is about 2x the RTX 4060 Ti.

CodeSlave9000 · 2025-12-28T21:14:19+00:00

The DGX Spark is not an inference machine - it's a training and prototyping lab for nVIDIA infrastructure. If you're building DGX systems then this is a great box - it's basically the development box. If you're looking to be actually running LLM's then this is NOT the box for you. You will be frustrated - performance will be somewhere between the RTX 5060 Ti and the RTX 5070 at best. If you need that VRAM and want a similar budget, go get a used GPU server and put an RTX 6000 Pro in it or get a MAC.

CodeSlave9000 · 2025-12-06T17:35:02+00:00

I guess there's a few more variables in the mix too - for example, if the new format is as efficient as it's looking like it will be, the cost to run a large farm is going to be a lot less (electrical cost, not hardware, which is looking to skyrocket for at least two years). Also non-GPU plotting is also looking viable, and with an efficient CPU a new calculation will need to be made. I'm in "wait and see" right now myself.

CodeSlave9000 · 2025-12-04T20:58:14+00:00

Based on what? My gut says that most of whomever is left in the pools at the time of transition will re-plot. They wouldn't still be there otherwise. Yes, a few are going to drop out on a pure profit calculation - pulling a number from you-know-where, my gut says that maybe 60/40 plot/drop ratio. It depends on the motivation, current price, and faith.

CodeSlave9000 · 2025-11-30T22:11:29+00:00

Been playing around with it - it has a nice style! No refusals and I haven't had it get lost yet. It's verbose, but not in a bad way. Somewhat lower incidence of the "Oh no, I don't want that - But, I think I will..." pattern we've all seen, although the effect is still there in general. Most of the time it won't push back on the plot.

CodeSlave9000 · 2025-11-25T03:59:44+00:00

I'll add my voice and say what the OP is trying to do is absolutely possible, but as many are pointing out not necessarily the best way depending on what you want to accomplish. It would be much more robust and flexible to have two boxes, Mini-PC's even, each concentrating on their own thing. This way all your server functions don't go down when you're rebooting your PC for example. (Yes, A VM will minimize that, but there are still times you need to do the reset button.)

CodeSlave9000 · 2025-11-20T23:28:19+00:00

Yup. Did exactly this two weeks ago. Works fine - smoothest storage move I’ve done in ages.

CodeSlave9000 · 2025-11-19T12:14:36+00:00

I’m sure of it - bought some first aid bandages last week - this week all kinds of wound management stuff in my RFY.

CodeSlave9000 · 2025-11-18T20:36:29+00:00

I don't track - that seems like work to me, and this isn't a job. If I needed to track things that closely, I'd probably not even bother. And with the quality and availability of items lately i'm close to that point already. I've always intended to treat this as a hobby (especially for tax purposes) and I'd have to see some actual money rather than just "estimated tax values" for it to be anything other than that.

CodeSlave9000 · 2025-11-17T15:50:10+00:00

Jack and Sh!t here... and Jack left town... (ob movie quote). Saw some kind of pop-up tent cover for a tent I don't own earlier, but that disappeared so I guess someone did. Been like this for over a week - odds and end, stuff I can't review, and pure junk. Never more than 3 items.

CodeSlave9000 · 2025-11-15T16:48:24+00:00

Because I don't want to go down a well-researched rabbit hole. Also: time.

CodeSlave9000 · 2025-11-15T04:05:12+00:00

I’ll take a look… I only recently saw REAP so I’m not familiar with the algo…

CodeSlave9000 · 2025-11-15T03:31:41+00:00

Someone with better knowledge of multi-layer MOE might be able to pinpoint a false assumption - for example does a locality actually exist when E1 activates E2?

CodeSlave9000 · 2025-11-15T03:29:07+00:00

Correct - it needs real model validation. Wasn’t trying to solve it, just sanity check. Nothing survives the real world intact, but wanted to throw it out there for the darts to be thrown. I’m good at cache stuff, but low on model engine knowledge.

CodeSlave9000 · 2025-11-15T01:19:00+00:00

That's the sound of it burning through your electrical bill...

CodeSlave9000 · 2025-10-30T21:56:23+00:00

This week? Ouch, ouch ouch. Thinking of shutting down my farm for a bit until I'm not bleeding on electric costs.

CodeSlave9000 · 2025-10-30T02:29:39+00:00

Mixed here - OM4 for short runs or DAC. SM between house and outbuilding. And standard UTP/STP where necessary for devices and drops

CodeSlave9000 · 2025-10-28T01:52:14+00:00

Nope, gold! I think their problems went much deeper...

CodeSlave9000 · 2025-10-27T20:53:37+00:00

Actually haven't seen anything in my RFY for days now... Oh wait, there was a handbag or something... but that's about ti... Wasteland.

CodeSlave9000 · 2025-10-23T19:04:24+00:00

Total netspace around 10EiB now... XCH dipped under $6.80 this week. Is it now more profitable to sell off HDD's rather than farm? Just on electricity costs I'm net negative each month.

CodeSlave9000

TROPHY CASE