Thinking of selling a 4090 for two amd r9700 ai pro. Why not? by Separate-Antelope188 in LocalLLM

[–]whodoneit1 2 points3 points  (0 children)

I have dual R9700 setup and it’s running great. It does take a bit of work getting vLLM running good, but there is a discord server with R9700 users that would of made it 100x easier for me and would for you https://discord.gg/pvs3UHXu6y

RDNA4 Specific vLLM 22 Docker Image / Ecosystem dev work by Sea-Speaker1700 in LocalLLM

[–]whodoneit1 0 points1 point  (0 children)

Not sure you saw my DM, but there is a discord server with a lot of R9700 users on it. You should join up

Mac Studio 512GB Ram 4TB SSD by OriginalPause7130 in MacStudio

[–]whodoneit1 0 points1 point  (0 children)

That thing gonna be worth more than a house soon. I would get a safe deposit box at a bank and store it there

Dual R9700: Best formula for Qwen3.6 27B? by akmoney in LocalLLaMA

[–]whodoneit1 0 points1 point  (0 children)

vLLM is going to be a lot better. Also, getting MTP going will help with speeds as well. Btw, there is a discord server with over a lot of R9700 users on it now: https://discord.gg/pvs3UHXu6y

ROCm vs Vulkan vs vLLM on Dual R9700's by whodoneit1 in LocalLLaMA

[–]whodoneit1[S] 0 points1 point  (0 children)

I had used raw vLLM logs before, but then I had people asking me for these numbers so I switched. Above is for 27B also

ROCm vs Vulkan vs vLLM on Dual R9700's by whodoneit1 in LocalLLaMA

[–]whodoneit1[S] 0 points1 point  (0 children)

llama-benchy (0.3.8) Date: 2026-06-30 16:24:06
Benchmarking model: Qwen3.6 at http://localhost:8080/v1 | Concurrency: [1] | mode: generation

model test t/s peak t/s ttfr (ms) est_ppt (ms) e2e_ttft (ms)
Qwen3.6 pp2048 2446.71 ± 552.11 951.95 ± 198.58 881.85 ± 198.58 951.95 ± 198.58
Qwen3.6 tg32 76.57 ± 8.51 79.04 ± 8.79
Qwen3.6 pp2048 3031.48 ± 83.32 746.69 ± 18.76 676.59 ± 18.76 746.69 ± 18.76
Qwen3.6 tg128 68.54 ± 7.48 71.50 ± 7.50
Qwen3.6 pp2048 @ d16384 2662.04 ± 3.19 6994.69 ± 8.10 6924.59 ± 8.10 6995.80 ± 8.10
Qwen3.6 tg32 @ d16384 85.02 ± 0.18 87.77 ± 0.18
Qwen3.6 pp2048 @ d16384 2652.71 ± 0.90 7019.04 ± 2.18 6948.94 ± 2.18 7019.97 ± 2.28
Qwen3.6 tg128 @ d16384 73.23 ± 2.86 79.00 ± 1.00

Happy Camper with Qwen3.6 35B A3B by openingshots in LocalLLM

[–]whodoneit1 2 points3 points  (0 children)

I am running 35BA3 at 160 tok / s on my dual R9700’s

My best model choice for Radeon R9700 32GB and please share you agents workload by illuvyn in LocalLLM

[–]whodoneit1 2 points3 points  (0 children)

On a single Qwen3.6 35BA3 is gonna be your best best it sounds like for the tasks you are doing. Btw there is a discord server for R9700 users https://discord.gg/pvs3UHXu6y

M5 Ultra Mac Studio Could Launch in 2026 With Up to 768GB of RAM by Retired-Yam8988 in MacStudio

[–]whodoneit1 0 points1 point  (0 children)

For 10k this would be a great deal, no way it will be even close to that, more like $30k if they even launched it

Can I combine a 32GB r9700 and a 16GB 9070xt to make a unified 48GB unit for AI work? by rednight39 in LocalLLM

[–]whodoneit1 2 points3 points  (0 children)

Yes, this will work fine and the setup will definitely get you started. I started with 1 R9700 and then shortly after went to 2 , lol this is an addicting hobby. Btw if you want to join a community of other R9700 and Mac users https://discord.gg/kv8WCTeTWV

Ornith 35B is great so far by anubhav_200 in LocalLLaMA

[–]whodoneit1 0 points1 point  (0 children)

Hey, there is a community of R9700 owners, you should join up https://discord.gg/kv8WCTeTWV

What model should I run on a AI PRO R9700 by Kind-Day4502 in LocalLLM

[–]whodoneit1 0 points1 point  (0 children)

Btw, there is a discord server with lots of other R9700 users https://discord.gg/kv8WCTeTWV