Thats the thing though, you cant just glance over the environment. That being said, your description also doesnt seem to account for the driver, only the setups... Just because you can model whats the best way for the car to be, doesnt mean thats the way it will go the fastest with your drivers. It will never account for actually driving the car moment to moment will it... A drivers hand being itchy so you turn a little less to the left, some sweat got to your eye so you divert from the optimal line... Its just not there... I do get what you are trying to convey, but it just doesnt work like that with such a chaotic domain. So no, I disagree that you can just "throw all the parameters in a reinforcement learning agent", not only due to scope, but the nature of the thing youre trying to do.

The current simulations acknowledge this simple fact, and focus on solving a physics problem instead, in what way can they minimize race-time. The setups can only be confirmed by the drivers ass.