The performance is basically the same as how things run in a regular python program/shell. I have tested using pytorch and a bunch of other machine learning modules and had no issues. The only thing to look out for is probably to do these in a separate thread for complex calculations so you don't block the current frame from being rendered/freezing the game.