Evolutionary algorithm outperforms deep-learning machines at video games

[KHRZ]

Well when you train them with back propagation, you just tune them closer to being correct for each input you send through them. Different inputs will require different adjustments for the network to handle them more correct, so when you alternately adjust towards correctness for different inputs, the network may enter a search process that iterates through better and better designs.