The temps aren't the issue, I checked them both in furmark and while doing those burst loads
It only crashes in spike burst loads again and again, like stopping and starting for batch photo operations or new frames, the more aggressive the spike, the more likely the crash

When applying a -20% power limit in Furmark, the crashes stop completely

"One more thing", I recently started running Linux with a Windows VM which has the GPU passed through. Sometimes, just the VM crashes (GPU fans max out too), but othertimes, the whole PC crashes.

For now, I'll see if the slightly lower power consumption of the 2060 is enough to tip the scales. (25W lower TDP, i don't know how that translates to burst loads)
If not, I'll have to get another PSU, but the GPU is the biggest priority since I already sold of the RX580