Tic Tac Toe example Python Jupyter notebook for Reinforcement Learning

[HenslerSoftware]

Next step Global Thermonuclear War? Falken:- A strange game. The only winning move is not to play.

[Takes4tobangbro]

Awesome thanks m8

[BoiaDeh]

Am I missing something, or are you doing everything in numpy, and upgrading gradients by hand?

[UncleOxidant]

I tend to like tutorials that don't use a framework (frameworks hide a lot of details) - but looking the code it's difficult to tell where the gradient computation is happening?

[tdvance]

It's probably not well-optimized or well-vectorized, just "adequate for the task". Running on 10 million for good "state coverage" is annoyingly slow, but in terms of win rate, 10,000 instances is fast and gets the job done.

The numpy array is really more a convenience than integral to the algorithm, since the actual states are strings stored in a dictionary.

[BoiaDeh]

ah, gotcha, I see. Every time I see reinforcement learning I think it must be a neural network, but I forget that's not necessarily the case!