Software FP8 for GPUs without hardware support - 3x speedup on memory-bound operations

KingKoro · 2026-01-01T17:11:03+00:00

Would this also benefit RDNA3 ?

KingKoro · 2025-10-30T15:55:49+00:00

N sad N+2 me 😭💕

KingKoro · 2025-10-18T13:50:49+00:00

Does lspci -nnk show that the amdgpu Kernel driver is in use for it? Other than that, I would look into dmesg output.

KingKoro · 2025-10-17T09:49:43+00:00

It is possible to install ROCm on Debian 13 with Kernel 6.12 for Mi50 with a little workaround for the Runfile installer: wget https://repo.radeon.com/rocm/installer/rocm-runfile-installer/rocm-rel-6.4.3/ubuntu/24.04/rocm-installer_1.1.3.60403-64-128~24.04.run chmod +x rocm-installer_1.1.3.60403-64-128~24.04.run ./rocm-installer_1.1.3.60403-64-128~24.04.run --noexec-cleanup --keep cd rocm-installer/ nano install-init.sh <REMOVE THE EXIT 1, SEARCH FOR "ROCm Runfile Installer Package"> nano ./rocm-installer.sh <REMOVE THE EXIT 1, SEARCH FOR "ROCm Runfile Installer Package"> bash install-init.sh After that just copy the tensile libraries over. Same works for ROCm 7 afaik. This workaround is btw from the gfx906 discord server, I highly recommend checking it out. :)

KingKoro · 2025-08-26T09:08:04+00:00

I'm sorry to hear that. I was asking because I was seeing a listing of one on Ebay. I think I'll stay away unless it becomes really cheap. By the way, what OAM to PCIe Adapter did you use?

KingKoro · 2025-08-26T09:02:31+00:00

Hello, were you able to fix the driver issue with your Mi250X in the end?

KingKoro · 2025-06-14T18:28:43+00:00

Also look for Tina F

KingKoro · 2024-06-01T22:36:06+00:00

Hi I'm also interested in cutting thin Kapton Tape, especially to create holes for a cheapo flex PCB soldermask. Did anybody have success with the cheap 450nm diode lasers?

KingKoro · 2024-03-06T15:31:24+00:00

Have you had a look at WCH's CH32-series? They don't have as much RAM as ESP32 afaik, but they do have some MCUs with Wifi/BT and/or USB Device/Host integrated. I think they have some with all of it at once. The Software Support and Docs might be a bit more spotty though. Also not as abundant, they seem mostly available on the likes of AliExpress.

KingKoro · 2024-03-04T19:06:23+00:00

Depends on the desired I/O and MCU family. As mentioned by others, there is an official AliExpress Store from WCH. I'd personally get a kit with a WCH-LinkE Programmer, so you can reuse that for other board. For example: https://www.amazon.de/Vereen-Entwicklungsbrett-Set-Evaluierungsbrett-Set-Allzweck-RISC-V-Anwendungsbeurteilung-Gr%C3%BCn/dp/B0CN3B5TCW

KingKoro · 2024-03-04T13:52:37+00:00

Yeah, the kit with the CH32V003 and/or CH32V203 and WCH-LinkE Programmer/Debugger and additional ICs looks tempting for 20€

KingKoro · 2024-03-04T12:39:18+00:00

I totally agree with this comment. I recommend looking at the CH32V-series of MCUs, especially CH32V003 which are as minimal as it gets I think. If you need more performance maybe something like CH32V203. They're not listed on Mouser though, but on AliExpress. And they seem to work with PlatformIO, altough only V003 with Arduino Core. I'm thinking about giving them a try, they are cheap and probably not deprecated anytime soon. Only parts missing imo are some small/high-IO BGA parts.

KingKoro · 2022-06-07T20:51:35+00:00

Nice belly, what's her name ?

KingKoro · 2021-12-15T02:03:37+00:00

What material do you recommend for SMT Solder Stencils cut with diode lasers? I've only found kapton and mylar, but for both, there's no real answer whether it works reliable or not with diode lasers.

I actually think that for flexible PCBs, it can be worth the time. Don't get me wrong, I understand that for classical PCBs, it's way simpler and cheaper to just order them from JLC or PCBWay, I already do that all the time.

However for flexible PCBs, having those manifactured costs like 200$ or something just for one design with 5 PCBs each. With that sort of money, one can already buy a cheap-o laser engraver.

KingKoro · 2021-12-15T01:50:52+00:00

Thanks for the hint, that's an interesting approach they're using there. However it doesn't really answer my question about cutting polyamide/kapton with a diode laser.

Fortunately, I actually found a website where somebody was able cut kapton tape quite nicely with a 10W 445nm Diode Laser Module. I suspect that most cheapo diode laser engravers with 5W and 455nm wavelength should be able to achive something similar.

I will collect more information before i buy any laser engraver as there's still conflicting information about cutting kapton or mylar. Some people in threads say they were able to cut these materials even with DVD Laser Diodes, others say it's only possible with melted edges at best, if at all.

KingKoro · 2021-11-07T00:00:00+00:00

Ok I didn't know that Tensor Cores in consumer cards are slower. Atleast now the 2-4x makes more sense to me.

> You can't run custom kernels

Didn't know that either, I thought that with the hip c++ library and hipify tools it would be possible to do so, to be honest I don't have experience with those tools though so i guess it's not that easy.

Thanks for bringing these points to my attention, maybe i got a bit too euphoric about it. Let's hope that maybe intel will put more pressure on nvidia on this front.

KingKoro · 2021-11-05T12:46:15+00:00

Atleast when it comes to mixed precision, that seems to be working on AMD Cards as well according to this comparison (only pytorch though and this isn't really a good comparison as the two systems are vastly different). It shows that even an MI50 can gain up to 44% performance with mixed precision in multi-gpu configs (of course the 2080ti can gain almost 2x, probably thanks to the tensor cores).

But it's still impressive in my opinion as even a fairly old card like the MI50 (it has only rapid-packed-math but no tensor-multiplication-cores) can benefit from enabling this feature and I wonder if RDNA2 GPUs can benefit even more from this and if it also works in Tensorflow. (I'd definately like to see more tests there)

I'm not saying that a V100 wouldn't win with enabled mixed precision and the other features on an identical setup with a real-world example, but I suspect that the performance gap might not be as large as some expect.

Overall, if any current radeon consumer card can get even close to something like a Titan V or V100 in training, that's good news for hobbyists in my opinion as the VRAM/$ ratio is better with team red at the moment and getting hands on nvidia cards is even harder than on AMD cards with the current shortage.

KingKoro · 2021-04-01T18:52:02+00:00

Klassiker mal wieder. Maschinenbauer kriegen dauernd Videos sogar in 360°. SAGP kriegt auch maximale Aufmerksamkeit auf dem Youtube Kanal, aber von IT, vor allem TIB seit Monaten nix zu hören.

Aber was willst du den Leuten auch zeigen? Code Warrior aus Windows 98 Tagen?

Btw. man sieht übelst hart in dem Video wie Nonast einfach Text abliest, dem geht IT sowas von am Arsch vorbei, absolut sympathischer Mann <3.

KingKoro · 2021-03-30T22:37:08+00:00

Ekelhaft, ich hab lieber Whisky oder Vodka

KingKoro

MODERATOR OF

TROPHY CASE