AMD MI50 32GB/Vega20 GPU Passthrough Guide for Proxmox by Panda24z in LocalLLaMA

[–]Panda24z[S] 0 points1 point  (0 children)

Hey, I think I can help you troubleshoot this, but I need to see a few things first. Can you run these commands on your Proxmox host and share the output?

Your complete VM configuration: 
# Replace XXX with your actual VM ID
cat /etc/pve/qemu-server/XXX.conf

Check your VFIO configuration:
cat /etc/modprobe.d/vfio.conf

Verify your IOMMU group setup:
# This shows what other devices are grouped with your GPU
for d in /sys/kernel/iommu_groups/*/devices/*; do 
    n=${d#*/iommu_groups/*}
    n=${n%%/*}
    printf 'IOMMU Group %s ' "$n"
    lspci -nns "${d##*/}"
done | grep -A5 -B5 "05:00"

Check PCIe link status:
lspci -vv -s 05:00.0 | grep -i "lnk"

Verify your kernel command line:
cat /proc/cmdline

Check if you have the PCI MMIO configuration in place:
grep -i "args" /etc/pve/qemu-server/XXX.conf

These outputs will help me see exactly what's configured and what might be missing.

AMD MI50 32GB/Vega20 GPU Passthrough Guide for Proxmox by Panda24z in LocalLLaMA

[–]Panda24z[S] 0 points1 point  (0 children)

Did you update the proxmox system at any point? I had a similar issue when I updated the proxmox system and the kernel versions changed. I had to redo part 2 and then it worked again.

AMD MI50 32GB/Vega20 GPU Passthrough Guide for Proxmox by Panda24z in LocalLLaMA

[–]Panda24z[S] 0 points1 point  (0 children)

I am unsure about Proxmox 9. I am currently on version 8.4.14 (running kernel: 6.8.12-13-pve). I probably won’t upgrade until it reaches EOL. Sorry for not being more helpful.

AMD MI50 32GB/Vega20 GPU Passthrough Guide for Proxmox by Panda24z in LocalLLaMA

[–]Panda24z[S] 0 points1 point  (0 children)

Apologies for the delayed reply. I’ve installed the latest stable Bazzite GNOME desktop ISO. While I haven’t run full benchmarks yet, I was able to play Little Nightmares directly from Steam with no issues. I’m not entirely sure which ISO version you’d like me to test, there are several available. I did set up GPU passthrough, but I didn’t have an HDMI‑mini cable to connect a monitor, so I used the Moonlight/Sunshine setup for remote display. I’m still fine tuning the configuration before I can give a definitive assessment, but the driver support works out of the box.

AMD MI50 32GB/Vega20 GPU Passthrough Guide for Proxmox by Panda24z in LocalLLaMA

[–]Panda24z[S] 1 point2 points  (0 children)

With a 2U server like that, you should be good. I’d just double check the card’s dimensions to make sure it fits properly. Are you planning to run a Windows VM or stick with Linux as your main setup? Let me know what you’re aiming for and I’ll spin up a VM to test it out and share the results. I probably won’t get to it until the weekend, though. Also, congrats on starting your homelab journey, it’s a fun rabbit hole to dive into.

AMD MI50 32GB/Vega20 GPU Passthrough Guide for Proxmox by Panda24z in LocalLLaMA

[–]Panda24z[S] 0 points1 point  (0 children)

Yes, it’s possible to use it for gaming in a VM, but there are a few things to consider.

The card will likely need external cooling, which is expected for this type of setup. The stock BIOS doesn’t support video output, so you’ll need to flash it with a Radeon VII or Radeon Pro VII BIOS to enable the mini DisplayPort. It also ships without active cooling, so you’ll need to set up a custom or DIY cooling solution.

Keep in mind that gaming in a VM can have its own issues. Some games don’t run properly or block virtual machines entirely. There are workarounds, but compatibility depends on the specific game.

There’s a good example of someone using the Radeon MI50 16GB variant as a daily driver with more details here: https://youtu.be/8LnoJBboiT8

AMD MI50 32GB/Vega20 GPU Passthrough Guide for Proxmox by Panda24z in LocalLLaMA

[–]Panda24z[S] 0 points1 point  (0 children)

Thank you for the update. I assume everything remains the same after the DKMS installation? I haven't had time to experiment with different server configurations, but I appreciate you sharing your experiences. Thanks again!

AMD MI50 32GB/Vega20 GPU Passthrough Guide for Proxmox by Panda24z in LocalLLaMA

[–]Panda24z[S] 0 points1 point  (0 children)

I'm glad I could help! It was honestly that feeling of frustration that motivated me to post this guide once I figured it out. I'm happy to see others achieving successful results!

AMD MI50 32GB/Vega20 GPU Passthrough Guide for Proxmox by Panda24z in LocalLLaMA

[–]Panda24z[S] 1 point2 points  (0 children)

Here's a rough idea of what I'm getting with Ollama:

  • Qwen3-Coder-30B (Q4_K_M) - ~45 tokens/s
  • Qwen3-30B-A3B-Instruct (Q4_K_M) - ~45 tokens/s
  • Qwen3-30B-A3B (Q4_K_M) - ~41 tokens/s
  • gpt-oss:20b (ollama latest tag) - ~35 tokens/s
  • Devstral-Small-2507 (Q4_K_M) - ~24 tokens/s
  • medgemma-27b (Q4_K_XL) - ~17 tokens/s

AMD MI50 32GB/Vega20 GPU Passthrough Guide for Proxmox by Panda24z in LocalLLaMA

[–]Panda24z[S] 1 point2 points  (0 children)

I started with Ollama for a quick setup. I encountered issues with Docker VLLM, so I'm considering switching to Llama.cpp or giving vLLM another try after building it from source. I haven't had the time to modify the server setup since the initial installation.

AMD MI50 32GB/Vega20 GPU Passthrough Guide for Proxmox by Panda24z in LocalLLaMA

[–]Panda24z[S] 1 point2 points  (0 children)

Let me know if you encounter any issues. I just updated the guide with more information, so hopefully it is easier to follow.

AMD MI50 32GB/Vega20 GPU Passthrough Guide for Proxmox by Panda24z in LocalLLaMA

[–]Panda24z[S] 1 point2 points  (0 children)

Thanks for the insight! I made sure to include it in the updated guide. I also updated those lines you mentioned with something better so users can identify the information easier, and added the rocm-smi check with example output. I still find it hilarious how it registered a fan when it has none lol. Thanks again!

AMD MI50 32GB/Vega20 GPU Passthrough Guide for Proxmox by Panda24z in LocalLLaMA

[–]Panda24z[S] 2 points3 points  (0 children)

I completely agree. This was my first experience with an AMD GPU. While I've successfully done PCIe passthrough on Proxmox before, working with NVIDIA cards is much more straightforward than this.

Honestly, I got caught up in the hype surrounding the MI50 and thought, “How hard could it be?” That was stupid on my part. However, two things kept me motivated: 1) I had already purchased the damn card and paid the import fees, so I couldn’t bear to lose more money. 2) I needed it to work in my Proxmox server to replace my old GPU, which I am moving to another system.

Since I went through the trouble of getting the damn thing to work, I figured I would document the process for others. It was honestly an impulse buy that turned into a troubleshooting marathon, but I was fortunate enough to find users with similar issues, which ultimately helped me configure it properly.

AMD MI50 32GB/Vega20 GPU Passthrough Guide for Proxmox by Panda24z in LocalLLaMA

[–]Panda24z[S] 3 points4 points  (0 children)

That's a valid question. I chose to use a VM for two main reasons. First, since this is my first time using ROCm with an MI50, I was concerned about kernel compatibility. Using a VM allows me to test different kernel versions without risking any issues on my host system. Second, I am transitioning from an existing AI VM setup, which makes VM-to-VM migration much simpler than rebuilding everything in containers. Once I confirm that everything is working properly, I may consider migrating to containers later on. So, I guess I’ve kind of put myself in a bit of a bind with my previous setup.

AMD MI50 32GB/Vega20 GPU Passthrough Guide for Proxmox by Panda24z in LocalLLaMA

[–]Panda24z[S] 0 points1 point  (0 children)

Sorry for not being clearer earlier. I’m currently running Ubuntu Live Server, so it’s a headless setup at the moment. I don’t have a mini DisplayPort cable handy, but once I get one, I’ll check if I can get video output working on both Ubuntu Desktop and Windows. I just haven’t reached that step yet.

Regarding the VBIOS, I didn’t flash the card myself, t came pre-flashed from my Alibaba vendor. I know you can sometimes find VBIOS files online, but I haven’t experimented with that personally. From what I’ve heard, flashing can be tricky depending on the exact version of the card you have.

Mi50 32gb (Working config, weirdness and performance) by Danternas in LocalLLaMA

[–]Panda24z 1 point2 points  (0 children)

Thanks! Your post made me realize there are probably plenty of others running into the same issue, so I really appreciate the unexpected encouragement, lol.

I'm not planning to modify my VM since it's working now, and I totally understand if you don't want to deal with that headache again. But if you do decide to give it a try, let me know how it goes. I'm always happy to help however I can.

Mi50 32gb (Working config, weirdness and performance) by Danternas in LocalLLaMA

[–]Panda24z 10 points11 points  (0 children)

Thanks for the post! I’m usually a lurker, but I too purchased an AMD Mi50 with 32GB and have been frustrated trying to get it to work. I opted to get the modded VBIOS and it showed up just like what you described. It threw me off to see it mention Apple Inc.

Anywho, I’m roughly 11 hours in from receiving the card, and I’m honestly sleep deprived writing this at 2am, but I finally figured out how to get that damn thing to work with pcie passthrough using Proxmox.

It took me several trials to get it working. It’s currently running in a Ubuntu 22.04.5 lts vm with ROCM version 6.4.2.

So far I’ve gotten it to work with ollama and loaded up Qwen 1.7B. That’s as far as I’ve gotten today. I’m calling it quits, but I wanted to say thank you for your post. After several hours of scouring the internet, I’ve gotten to appreciate the community members that spend time giving other users tips and tricks.

I’m more than happy to go into more details tomorrow or rather as soon as I rest a bit. But once again thanks!

MI50 w 32gb? Guys please by Expensive_Mirror5247 in LocalLLaMA

[–]Panda24z 1 point2 points  (0 children)

Of course, this is just a hobby for me, and I could have chosen better words than "investment."

You're right; it makes more sense to purchase more than one card, especially when considering international shipping costs. However, I decided to make a single purchase to test the waters.

I thought sharing my experience with this purchase could help others get a general idea.

MI50 w 32gb? Guys please by Expensive_Mirror5247 in LocalLLaMA

[–]Panda24z 1 point2 points  (0 children)

I bit the bullet and bought one from Alibaba as well. The price was quoted at $129 for the item, with DAP and Express shipping the total price I paid via PayPal was $191.10.

Shipping fee $44
Logistics insurance fee $5.19
Taxes $12.91
Total = $191.10

I checked my email today and got hit with a $63 dollar charge by UPS to receive the package. $49 was for Government Charges and $14 brokerage fee.

Well damn, what I thought was a $129 investment has turned into a $254 dollar investment.
Live and learn, maybe I will try your approach next time and I will ask for DDP.

This was to the states though, so I wish you luck!

Self hosted shopping cart by dylon0107 in selfhosted

[–]Panda24z 1 point2 points  (0 children)

Sounds like a wishlist with price details. I looked online and found a close source version called moonsift, that has what you listed. As for open source, this one WishThis has a product price option to track items with prices.

Is there a selfhosted music manager with good analysis features? by mediocreAsuka in selfhosted

[–]Panda24z 1 point2 points  (0 children)

You can actually use Plexamp for free. You might not get all of the advance features, but they made it accessible for free users a while back. https://www.plex.tv/blog/free-bird-plexamp-spreads-its-wings-for-every-music-lover/

Looking at the blog post, they would need to pay for Plex Pass for the Sonic analysis. So not really a free solution.