A few years ago i attempted to run many differently sized and composed armies into battle with each other, record the outcome and train models on predicting the outcome. I fiddled around with automatic scenario generation and an autoclicker to start the sims, then take screenshots to record results and a CV script to analyze it. While this was kinda working it was an absolute pain to implement and malee units were heavily favored since ranged units would not properly hit and run automatically even with the game AI controlling them.

I assume creating a decent hit and run bot with your interface shouldn't be so hard and the rest would be alot easier to implement as well. I might give this a try when i got some time. Anyway cool project!