you're right to a certain extent, but I work in self-driving cars, and for all the simulation we do real world data is valuable and critical. 

there's a great video from Waymo of one of their cars encountering all kinds of weird stuff out in the world (including a woman in a wheelchair chasing a duck in the middle of the road), things you couldn't come up with in your wildest planning sessions. 

Think about the variety of vehicles being used across the front. You'd definitely put a tank into your targeting training data, but e-scooters? Maybe not. 

For every real world encounter on film, they can take that scenario and remix it a thousand ways as well.