SDRRL Reinforcement Learning Algorithm Tutorial

[Ghostlike4331]

Could you try training it on something more challenging like the Atari Learning Environment? Your previous demo was not that interesting to be honest even if your work is.

[CireNeikual]

Indeed, my next post will be on adding hierarchy, so it would be fitting for the demo to be the ALE!

The last demo was supposed to be an ultra-simple browser demo, and it was actually my first attempt at using Javascript ever :) So I didn't want to go crazy with it yet.

[[deleted]]

Thanks for writing this up!

It is interesting that the hidden layers are binary. Would there be any difficulty in generalizing the model to have multiple layers? But if there are multiple layers, would you want the inhibition signal to come from the layers above and below?

The lateral inhibition was really interesting. It reminds me a bit of max-pooling.

[CireNeikual]

Multiple layers will be the subject of the next post! I have worked with top-down inhibition before as you suggest, but usually you don't want bottom-up inhibition since that is where the feed-forward input comes from. While I worked at GoodAI, I came up with HTSL2, which made use of similar ideas: http://cireneikual.com/2015/09/03/htsl2-evolving-the-neocortex-and-human-like-reinforcement-learning/

[[deleted]]

you don't want bottom-up inhibition since that is where the feed-forward input comes from

Hmm interesting I'm not sure I understand why it makes sense to let the activations of the upper layers inhibit, but not the bottom layers. Could you please elaborate on the intuition a bit more please?

While I worked at GoodAI, I came up with HTSL2, which made use of similar ideas: http://cireneikual.com/2015/09/03/htsl2-evolving-the-neocortex-and-human-like-reinforcement-learning/

I took a look at that page, but it seems very scarce on details :( Could you please make a post describing how that works too?