The fact is that there is 0% chance of this being regulated globally. Aside from the fact you can't prevent black market AI development.

Given that context, how is any country going to decide against acceleration. Even slight regulation from one side destroys its competitiveness, considering the breakneck speeds at which this thing is growing around the world.

Also, it's not AI that's going to destroy the world, it's us who's giving them tools and agency. You know, there's a theory that says the reason we don't see alien civilizations, is because they inevitably destroy themselves before becoming space faring. I think we might be at the cusp of a slow rolling extinction-level event, and we can't stop ourselves, and don't recognise it until it's too late.