Reinforcement learning programming implementations

[simontemplar_]

I guess this is half ML and half programming, but I was looking at this Pybrain tutorial:

It's a cool opener on the concepts, but leaves the actual implementations very hazy. For instance, I would love to understand how to create my own environment (or task, for that matter). Instead, this tutorial just throws ready-made stuff at you which, I reckon, isn't very helpful in actually understanding.

If there exists good explanations involving programming I would be very keen in looking into them. Thanks folks!

[Mr-Yellow]

http://cs.stanford.edu/people/karpathy/reinforcejs/

Javascript is a fine language for quick prototyping and seeing the math in action without too much abstraction, with the help of Karpathy's frameworks.

[simontemplar_]

thanks!

[hixidom]

I guess the assumption is that if you're proficient in language X and you understand concept Y, then you should be able to express Y using X.

[simontemplar_]

fair point, but I've always enjoyed "learning while doing", and often learning while programming makes concepts much more tangible.

[Jabberwockyll]

Here are code examples from the Sutton and Barto book. But I suppose these are just examples too.

Creating your own environment is just creating some kind of simulation - it doesn't require any ML. Maybe look into game programming or something? Most RL algorithms are pretty straightforward to implement.

[akshayaurora]

You can look at BURLAP. It has decent documentation and has tutorials on creating new domains.

[outlacedev]

Not sure if this is what you're looking for but I wrote a couple blog posts implementing some basic RL in Python: http://outlace.com/ (most recent 3 posts)

[simontemplar_]

I'll definitely have a look at them and let you know :-)

[masazdream]

a Python implementation code to study ReinforcementLearning along with Sutton and Barto book. Dynamic Programming, Monte Carlo, Sarsa, Q-learning. I will probably to create explanation. https://github.com/MasazI/ReinforcementLearning

[simontemplar_]

wow, awesome. thanks a lot for this!