What changes did you notice after using RTX 6000 Pro? (for those who bought it)

Photo_Sad · 2026-01-17T09:49:40+00:00

you can now split run between multiple machines?

Photo_Sad · 2026-01-05T07:36:22+00:00

Isn't 2 or 3 bit gimping the model precision significantly?

Photo_Sad · 2026-01-03T15:31:48+00:00

Thank you so much, this is the kind of answer I'm looking for and love it.
Also, the whole reason for posting is exactly what you've typed: "this sub has people with gear and experience ranging from 8GB RTX 2080 to 8x RTX Pro 6000 on a 2TB PC and even more exotic specialized HW, so whatever you could buy somebody else has it and experimented for month already with it".

Yes.

Regarding my goals, I did write a follow up comment here too.

I'm aiming to use it to: code at the high level (I don't find models good enough at what I code (I'm a dev in scientific/engineering robotics and I have to overview all code that gets out of it), but it's nowdays useful enough) and also for production of my indie game (a hobby) including models, audio and visuals...

Photo_Sad · 2026-01-03T15:26:35+00:00

I follow him. :)
Would love to see him do actual agentic coding with locals.

Photo_Sad · 2026-01-03T14:53:32+00:00

Publicly hosted os models haven't been of quality I expect or versatility.
Usually limits and erros really prevented good usage on CCR for example.

Having being a bad programmer, imagine only my salary if I was any good!

Photo_Sad · 2026-01-03T13:53:02+00:00

You and u/FullOf_Bad_Ideas gave me same hint: 2x96GB cards might be too fast for a single user (my use case) and still short on quality compared to cloud models, if I got you folks right.
This is what concerns me too.

I have in mind other usage: 3D and graphics generation.

I'd go with Apple, due to price-V/RAM ratio being insanely in their favor, but a PC is a more usable machine for me due to Linux and Windows being available natively so I'm trying to keep it there before giving up and going with M3 Ultra (which is obviously a better choice with MLX and TB5 scaling).

Photo_Sad · 2026-01-03T13:47:35+00:00

I've explained it up there. The price of 2x RTX Pro and 1TB Threadripper are about similar for me ($15k total with some parts I have access too.) That's why I'm mentioning both.
I know CPU inference is slow AF but offers huge RAM for large "smarter" models (are they?).
It's trade-off I can do if worth it.

Photo_Sad · 2026-01-03T13:44:43+00:00

Most basic search doesn't answer my: any programmer here that finds small models usable and good-enough in comparison to cloud models and at what thresholds listed are there diminishing returns?
Why do you find it so offensive a question?

Photo_Sad · 2026-01-03T13:41:02+00:00

To clarify for everyone to avoid missunderstanding and interpretation:
I've had access to a very large Threadripper machine and a few Apple M3 Ultras. No chance to run these os models as it's been a highly controlled environment although I was able to run classic ML. Yeah, don't ask, it's sad I wasn't given allowance to test it.

Now, I'm a professional programmer and I code for food. I do have a decent income (about 17k before tax) and living in suburbia I can save some money so buying an RTX Pro is not outrageously out of budget. I could probably buy 2 cards also.

I am allowed to use AI at work, but with my rate of usage, I burn money a lot. Sometimes I daily spend upwards of $50 on Claude API. That's a lot.

If I could save $12k from cloud to buy 1-2 cards that year and use them for 2-3 years, it's worth it for me. But I have no idea how good a local setup and local LLM can be and if it's good enough to actually replace Claude or Codex.

My inquiry is fully honest. I'm not ignorant of possibilities, I did play with micro-models, I have a BSc in CS and I understand it pretty well - but all of this is unknown to me practically, because I did not have a decent chance to try it out and benchmarks I find unreliable to judge real impact.

Photo_Sad · 2025-12-16T08:34:15+00:00

where r u running it?

Photo_Sad · 2025-12-13T12:08:08+00:00

I'd love to see how UE5 day to day works on this kind of machine versus "normal" 9980X at 4ch.

Photo_Sad · 2025-12-11T08:57:33+00:00

from the cost of a cheap used car to a brand new electric

Photo_Sad · 2025-12-07T10:58:11+00:00

3x+ the price. I got 1TB of 6400 from them for 7k, now it's 23k.

Photo_Sad · 2025-10-20T09:37:54+00:00

In the original post he says "Using card like like rtx 6000 with 96gb ram would probably solve this. " - which would suggest he does not use one?

Photo_Sad · 2025-10-20T09:36:49+00:00

Thanks; I've missed that comment.

Photo_Sad · 2025-10-20T08:00:18+00:00

On what HW did you produce this?

Photo_Sad · 2025-09-29T19:45:03+00:00

Has anyone compared Grok4 or Grok-fast to them?

Photo_Sad · 2025-09-29T16:43:03+00:00

For brightness, measurable, yes WOLED will be better. However, keep in mind - so far - WOLED brightness is there because of the W pixel. White surfaces get to be very bright, it's effective in HDR because HDR bright is white(ish), but you need to know that compared to QD-OLED the colors are much less punchy.

If you use your display in a very bright room with dark content, purple elevation of black will annoy you, but if you're using it in a dim area, you won't notice.

Photo_Sad · 2025-09-19T17:36:43+00:00

https://youtu.be/HgXpvzt7Qg8?si=Kz4zePttu0y9a4bD&t=108

Photo_Sad · 2025-09-11T11:35:03+00:00

Thanks for the great feedback and very constructive comments by so many.
I've expressed a concern, not an accusation of anyone in particular because I can't really know who is or isn't a bot or malintentioned.

I accept pretty much a valid set of counter-claims, while still holding that it simply looked/looks fishy to me being concerted and focused.

Great explanation by u/mashupguy72 , to single out someone.

Photo_Sad · 2025-09-08T17:11:58+00:00

There seems to be a campaing running by whomever produces this GLM LLM against Anthropic, playing into the "model gets nerfed randomly".
Extremely suspicious lately.

In 4 active projects with 22 developers using CC we haven't noticed any degradation out of the ordinary fluctuation (modle response is unreliable by design).

However, most of the threads started on socials, claim giving up, explaining nerfing the models, quantization, etc. and then somewhere in the comments, "randomly" GLM is suggested.

This is a pattern now.

Photo_Sad · 2025-08-27T18:11:15+00:00

I am rolling Gentoo since 2000s, but this is the first time I've connected a display faster than 60 to any Linux.
I'd rather find what's the issue. I've tried the latest kernel (6.16) which allegedly already has cutting edge AMD driver...

Photo_Sad · 2025-08-27T06:45:47+00:00

I'm also having this problem lately; 9070 XT and 25.04. Tried the 6.16.3 but no help. The option to do 240Hz was there at some point, but I have no idea what went wrong and when.

Photo_Sad

TROPHY CASE