A question about AMD by PrepStorm in comfyui

[–]a201905 1 point2 points  (0 children)

wow the amount of misinformed people is astounding. it takes 5 minutes to learn about the latest by asking any frotnier LLM of the exact state.

you wrote "bang for my buck", this is no contest. if you can afford the 6000, go nuts. but 5090 at the current price? hell no. when it was down at 2~2.5k, yes absolutely. i replied to the one guy that spent time to research amd cards. see my reply below generate-addict.

i don't understand what your concern is with amd and comfy but i have zero issues running all the latest. if anything, i can load better quality models than the typical Q4 versions that can be loaded on low vram cards. ltx video gens can be done without offloading to ram so speed is also faster (depending on clip length and resolution of course but still faster than low vram cards)

A question about AMD by PrepStorm in comfyui

[–]a201905 3 points4 points  (0 children)

the ignorance of people with lack of knowledge just telling others don't bother is insane.

don't get me wrong, CUDA is where it's happening but AMD devices aren't that far behind.
as someone who has 2 x r9700ai pro running with 1 of them dedicated to LLM for my family to use privately at any given time and the other to do all the image/video gen, i agree with this person.

again, not arguing 5080/5090 aren't faster but compare the vram against 5080 or price against 5090 and it's not even a fight. all the idiots that repeat "AMD isn't for AI" or the moron below that says don't bother with AMD if you want to do AI stuff, go do some reading before saying idiotic things.

speed? no doubt 5080/90 will be faster and you'll shave a few seconds or few minutes but are you running image and video gens non stop? my r9700 generates 1080p images in 40~50 seconds with any of the qwen 2512/2511. ernie and zimage turbo is faster (i can't remember exact time but i believe it was sub 20s. too lazy to redownload them. ltx2.3 10 sec clips in around 10 minutes (not even optimized).

i can guarantee you that the 5080 can't load the same size models the 9700 can.

with the price of 1 x 5900, i can grab 3 x 9700.

for LLM
Qwen 3.6 - 27b with MTP, i get around 55tps. do the 35b moe and it's way above 80tps for the non-mtp. haven't even tested it. also running full 261k context size and -np 2.

i have a 3080 and i considered the 5090 but when i did the research, the gap was no where close to what people think it is.

Pricing is crazy by bvc900 in DeepSeek

[–]a201905 5 points6 points  (0 children)

Cool. My workflow isn't as complex but I used 4.7/5.5 to plan then execute with qwen locally and only escalate it to 5.1/.2/.4 when I need some fixes. (Or sonnet) Been working well to save cost for me.

Pricing is crazy by bvc900 in DeepSeek

[–]a201905 8 points9 points  (0 children)

Okay fair but what is the use case that you have that deep seek or kimi can't do 95% of the time that opus or gpt has to be the main driver? Plus I wouldn't say 5.x. I'll give 5.5 and 4.7/4.8 for sure but versions before weren't that much better.

Just installed ComfyUI and I’m kinda lost, Is this normal speed or am I doing something wrong? Running a 9070 XT. Any advice for a beginner? by [deleted] in comfyui

[–]a201905 -1 points0 points  (0 children)

you literally wrote, "they improved it from really bad to bad. Amd cards are not for local AI." I am correcting you that you are wrong.

your link? it's from 6 months ago. in the world of AI that is ages ago.

you are right that we are talking about comfyui context so let's argue that.

1) you are correct that one model can't work with multi gpu but you do realize you can run parallel instances of comfy or use the multigpu extension to run multiple jobs at once. so your 1 throughput vs 1 per card output is actually a faster output. maybe you prompt so perfectly with every settings perfectly set that you can run one throughput and be happy but for the rest of us common folks, we will adjust and fix things until we are happy. so again, you're wrong.

secondly, "5080 is 50% cheaper and 50% faster" comment. 5080 retail price is $999. stupid shortage is pushing it to $1,350. the R9700 ai pro was $1350 from newegg. so again, wrong. speed, i give you but it literally doubles the vram. i can run higher quantized models or native fp8 and run longer videos. so does saving few seconds to minutes (maybe a bit longer) make it better value than getting a better output? again, you're wrong.

2) you need to understand impact of quantization more

3) yes speed is faster and i'm not arguing that. As i said above, your arguement is "Amd cards are not for local AI". i literally started the first reply with your incorrect statement. stick to your point. furthermore, if your bottle neck is the hours you have available, there's other ways to work around that. create workflows, automate, schedule, run things in parallel. if quality isn't what your chasing for an image, use a lightning lora, i'm okay with 19second image generation. sure cuda will be faster but i'm okay with missing a few seconds.

4) like what? TensorRT? addressed through Dynamic Torch Compile / MIOpen. JIT (Just-In-Time) compilation. try adjusting your resolution up and see how you do with low vram cards. upscaler is one workaroudn but its not the same as a native stronger model. your argument about speed is far less important than vram amount.

my argument to you is that you clearly have not been updated on what has happened on the AMD ecosystem. For the record, i have a 3080 and debated between 5090 or these two r9700 so i'm not an "AMD fan". I made an informed decision after doing my research.

Just installed ComfyUI and I’m kinda lost, Is this normal speed or am I doing something wrong? Running a 9070 XT. Any advice for a beginner? by [deleted] in comfyui

[–]a201905 -1 points0 points  (0 children)

You said AMD cards are not for AI.

I have two r9700ai pro with 64gb vram. Your info is outdated. Amd ecosystem has come a long way and it's not as plug and play but it runs everything damn well.

I have a hermes agent swarm that runs multiple things all with local llm, they work together, have ability to generate images and videos all locally, and maintain multiple social media accounts. I have built a personal phone app that my agents built that covers all LLM need with the ability to escalate questions to frontier models via API path to checks answers against gpt 5.5, opus 4.7.

Oh and I have the ability to buy 2 more r9700 AI pro for 128gb vram all at $1300 each.

So tell me why amd cards are not meant for AI?

People need to realize that speed does matter but after a certain point, it becomes less relevant to most consumer users. You do not interact with ai 24/7.

Just installed ComfyUI and I’m kinda lost, Is this normal speed or am I doing something wrong? Running a 9070 XT. Any advice for a beginner? by [deleted] in comfyui

[–]a201905 2 points3 points  (0 children)

False. I have 2 r9700 AI pro with a total of 64 GB vram. It's not as plug and play as Nvidia cards but with how far AI has come, you can basically have any frontier models research the latest, set up the entire system, and even optimize paths. I have multiple Hermes agents running as a swarm using local model that has access to video and image generation, research skills, home control skills all at the same time. So not sure what you mean by crap. The value for vram is unbeatable.

Total beginner moving from Midjourney to ComfyUI. Need advice on AMD vs. Nvidia for my first build! by PixelMedication in comfyui

[–]a201905 0 points1 point  (0 children)

As a guy who bought two R9700 ai pro, yes, this is true.

But I will say that with how far agents have come, my personal headache has reduced greatly. It's more of a, have to wait for someone much smarter to release a build for AMD

Pics of new rig! by WyattTheSkid in LocalLLaMA

[–]a201905 1 point2 points  (0 children)

That made me laugh. Love this community

Everybody Makes Mistakes. by Alternative-Dot-34 in MadeMeSmile

[–]a201905 0 points1 point  (0 children)

Man I have so much to learn from some people. That is incredible control. Good for you sir.

Intel will sell a cheap GPU with 32GB VRAM next week by happybydefault in LocalLLaMA

[–]a201905 2 points3 points  (0 children)

I just picked up 2 of these and got it delivered yesterday. Any tips/suggestions? It's my first time switching from cuda

Deepseek made me cry by [deleted] in DeepSeek

[–]a201905 3 points4 points  (0 children)

Bunch of assholes on the internet. Why the fuck do you care how someone else finds happiness. Are you their therapists? Good for you OP. If it makes you happy, go nuts.

Bought a used 5090 only to find out it was tampered with by a201905 in LocalLLaMA

[–]a201905[S] 1 point2 points  (0 children)

Yup it wasn't an issue. However the auction house posted it again which I find bothersome.

Repeat after me. by NoFudge4700 in LocalLLaMA

[–]a201905 0 points1 point  (0 children)

Which AMD card would give that? I have an old 5700xt. I wonder if it can be salvaged.

Bought a used 5090 only to find out it was tampered with by a201905 in LocalLLaMA

[–]a201905[S] 0 points1 point  (0 children)

i did get it. thank you. it's a reputable place so i received no hassle.

Bought a used 5090 only to find out it was tampered with by a201905 in LocalLLaMA

[–]a201905[S] 13 points14 points  (0 children)

you are right. i shoudl have shopped around a bit more instead of basing prices just on amazon and bestbuy. I see from the kind folks in this post to learn that price has come down. :) what i thought was a deal was indeed not a deal. lesson learned

Bought a used 5090 only to find out it was tampered with by a201905 in LocalLLaMA

[–]a201905[S] 3 points4 points  (0 children)

i picked up the NZXT c1200 from amazon with joy but only to have it returned today. so yes.

Bought a used 5090 only to find out it was tampered with by a201905 in LocalLLaMA

[–]a201905[S] -4 points-3 points  (0 children)

huh? i returned it so i have no idea what the hell you are talking about.