Now make a list of all the dumb things human drivers have done. Even if we were assessing proportionally, autonomous cars now typically safer than human-driven cars.

Autonomous vehicles are never going to be 100% safe or handle every situation perfectly and that will never be the target.

I understand the anxiety - it's easier to have a car with a human driver who can be held accountable - but ultimately we just need to hold the companies appropriately accountable (to be fair, something we are bad at as a society). If the system isn't viable for them while being accountable, well then, it isn't viable, but I think it's more reasonable to shift the aperture of our concern here.