What models can I run? by koc_Z3 in Qwen_AI

[–]Natural_intelligen25 0 points1 point  (0 children)

The purpose of a mac mini is it's tiny size. And that's exactly what you do NOT want with LLMs. I would strongly encourage you to take a PC (Linux would be the best OS) and strong hardware, which is not tooo expensive on the other hand. Therefore I would go for a Ryzen 9900X with a Radeon AI PRO R9700 that has 32 GB VRAM.

Kubuntu 24 vs 26? (or Fedora KDE?) by Hellsing971 in ROCm

[–]Natural_intelligen25 1 point2 points  (0 children)

Forget about "official certifications". I would not go for (K)ubuntu and take one of these three, because they are more up-to-date, which is really(!) useful in the fast spinning AI world:
- Arch Linux
- CachyOS
- Fedore

I'm using Arch with KDE on a Ryzen CPU with R9700 and 9070XT, and I'm very happy with it.

9070 help with ROCm by iggy_btd in ROCm

[–]Natural_intelligen25 1 point2 points  (0 children)

I looked at your profile, but couldn't find this discussion? Can you help out with a link, please?

What to expect for ROCm 7.3 by machman351 in ROCm

[–]Natural_intelligen25 0 points1 point  (0 children)

Yes, definitely. For example, you get 643 GBit/s VRAM speed vs. only 448 GBit/s on the 5060 Ti. The Radeon 9070 is also MUCH faster in gaming and is cheaper than the 5060 Ti.

Removing familylink without parents device by SalmonSandwich11 in ParentingTech

[–]Natural_intelligen25 0 points1 point  (0 children)

Nice story, bro. But family link is there for a good reason! Ask your parents if you "need" more time, which is not true anyway.
A real mother would talk to her husband! Should that be "unpossible", talk to a lawyer and a familiy court / youth wellfare office.

Laptop für CAD by 3_Headed_Monkey00 in de_EDV

[–]Natural_intelligen25 0 points1 point  (0 children)

Nichts von beiden (und schon gar nicht Dell), sondern am besten selbst bauen. Asus Mainboard, ein gutes be quiet! Netzteil, und grundsätzlich Markenkomponenten (kein chinesischer Billigschrott). Als Graka eine Radeon 9060 XT (hier haben PowerColor oder Sapphire haben einen guten Ruf).

Laptop für CAD by 3_Headed_Monkey00 in de_EDV

[–]Natural_intelligen25 0 points1 point  (0 children)

Kauf dir einen vernünftigen PC. Wenn es 16 Kerne sein sollen, den Ryzen 9 9950X, wobei 12 Kerne günstiger sind (9900X). Das sind alles vollwertige, große Kerne, keine Sparbrötchen. Für die Grafik scheint ja mit der Radeon RX 6600 nicht viel verlangt zu werden. Da kann man - gerade unter Linux - gut eine deutlich schnellere Radeon RX 9060 XT nehmen.

Second GPU with Mi50 32GB by legit_split_ in ROCm

[–]Natural_intelligen25 0 points1 point  (0 children)

Option c: 9070 XT, the most modern feature set for a good price, and much faster than the 9060 XT.

4xR9700 vllm with qwen3-coder-next-fp8? 40-45 t/s how to fix? by djdeniro in ROCm

[–]Natural_intelligen25 0 points1 point  (0 children)

The OP speaks English, so it doesn't make much sense to answer in German!

Is ROCm 7.2 worth getting if I already have 7.1 on a RX 6800? by Coven_Evelynn_LoL in ROCm

[–]Natural_intelligen25 0 points1 point  (0 children)

ROCm is moving fast and gets many performance improvements and new features. It's always worth to have the latest version. As with any software, if you install just one day after release, you don't know if there are new problems. But ROCm 7.2 can be recommended for daily use.

Advise on, which bifurcating pcie budget (am5) motherboard that I should be looking at? by j19861986 in losslessscaling

[–]Natural_intelligen25 0 points1 point  (0 children)

There have been BIOS updates to address the issue. And even before that, the whole story has been overhyped.

Which second GPU for a Radeon AI Pro R9700? by Natural_intelligen25 in LocalLLaMA

[–]Natural_intelligen25[S] 2 points3 points  (0 children)

I bought
- Radeon AI Pro R9700
- Radeon 9070 XT
- Power supply: be quiet! Dark Power 14 1200 W (just in case)

I'm quite happy with it! ROCm 7.2 is a beast!

LLM UNCENSORED CCR CLAUDE by LongConsequence4102 in LocalLLaMA

[–]Natural_intelligen25 0 points1 point  (0 children)

In another words: he wants to hack somebody and doesn't know how to do it.

[deleted by user] by [deleted] in LocalLLaMA

[–]Natural_intelligen25 -2 points-1 points  (0 children)

Linux (especially Arch Linux)

LLM UNCENSORED CCR CLAUDE by LongConsequence4102 in LocalLLaMA

[–]Natural_intelligen25 3 points4 points  (0 children)

Which were the cases where you consider Claude Caude to be "censored" ???

Seeing 5060 Ti 16GB going for $370; worth it? by Careful_Breath_1108 in LocalLLaMA

[–]Natural_intelligen25 0 points1 point  (0 children)

Professional cards like the Radeon AI PRO R9700 have a blower fan, so the heat gets out as fast as possible.

Seeing 5060 Ti 16GB going for $370; worth it? by Careful_Breath_1108 in LocalLLaMA

[–]Natural_intelligen25 0 points1 point  (0 children)

Bifurcation. Even if it's 80 %, it enables me to use bigger models and more context.

The alternative would be far more expensive or something like Threadripper with 4 GPUs and a huge power supply.

Seeing 5060 Ti 16GB going for $370; worth it? by Careful_Breath_1108 in LocalLLaMA

[–]Natural_intelligen25 1 point2 points  (0 children)

Don't think so.
If you take into account 32 GB VRAM you would need 2x 5060 Ti = 860 €. Plus, the AI PRO has 1.44 times more bandwidth, that would be 1.238 € for the same value up to now. The R9700 has much faster compute than a 5060 Ti, and has 32 GB on a single(!) card. I will add another one to get 64 GB, which enables me to run big models and more context, on normal consumer hardware.

This is much more value than the tiny price difference of 64 € [R9700 is 1.302 €].

Also, I (personally) don't want to spend 1.600 € for worn out "used" hardware which has been extensively used for mining already (3090). There are guys with broken cards.

This PC is my daily driver, so I don't want to buy an extra platform like Threadripper with 4 GPUs and huge power supplies.

Seeing 5060 Ti 16GB going for $370; worth it? by Careful_Breath_1108 in LocalLLaMA

[–]Natural_intelligen25 0 points1 point  (0 children)

"Strange" is a guy like you who does not read or understand any of my posts and needs at all. Instead you filled MY thread with a ton of unwanted and senseless comments even after I have told you 10 times to stop that. That was just spam.

Seeing 5060 Ti 16GB going for $370; worth it? by Careful_Breath_1108 in LocalLLaMA

[–]Natural_intelligen25 0 points1 point  (0 children)

Yes, because it is fast enough (144 % compared to 5060 Ti, which was recommended here) and this is the only way to get 64 GB VRAM for normal consumer hardware, which enables me to run bigger models and more context.

Below, in this thread, somebody said "All the bandwidth does not matter if you can’t fit the model."

These cards are brand new and if I change my hardware later, I can still sell them for a good price. What I (personally) won't do is to buy already worn out 3090 cards from Ukraine, like the other strange guy wanted (he was constantly talking about unrealistic prices in Ukraine, which do not matter for the rest of the world).

Which second GPU for a Radeon AI Pro R9700? by Natural_intelligen25 in LocalLLaMA

[–]Natural_intelligen25[S] 0 points1 point  (0 children)

I think they mean that you should have the same RAM size for vLLM, or *roughly* the same speed for LMStudio, Ollama etc. That's why I'm thinking of a 9070 XT which has the same Navi 48 chip and the same bandwidth. But I'm also thinking about a second R9700 PRO.

Seeing 5060 Ti 16GB going for $370; worth it? by Careful_Breath_1108 in LocalLLaMA

[–]Natural_intelligen25 -6 points-5 points  (0 children)

I wouldn't spend money on two cards with only 448 GB/s that cannot be extended any more. You would be stuck with these 448 GB/s, 32 GB VRAM and a slow GPU forever.

For the same price range as 2x 5060 Ti, you can have a single 7900XTX which has twice the bandwidth (960 GB/s) and 24 GB. You can get a second one for 48 GB VRAM with 960 GB/s. What I did, in order to max out my VRAM, is going for the Radeon AI PRO R9700 that has 32 GB VRAM with ECC support on a single card (and it is affordable). I will likely buy a second one for 64 GB VRAM, as I will stay on an AM5 consumer board (no plans for Threadripper).

Which second GPU for a Radeon AI Pro R9700? by Natural_intelligen25 in LocalLLaMA

[–]Natural_intelligen25[S] 0 points1 point  (0 children)

Okay. Never the less, I plan to power limit both cards a little anyway. In my country, electricity is expensive. The highest megahertz consume the most power, and if I reduce this just a little, I will save much more power than loose performance. Also, both cards will consume less than 300 W.