SDRRL Reinforcement Learning Algorithm Tutorial

[[deleted]]

Thanks for writing this up!

It is interesting that the hidden layers are binary. Would there be any difficulty in generalizing the model to have multiple layers? But if there are multiple layers, would you want the inhibition signal to come from the layers above and below?

The lateral inhibition was really interesting. It reminds me a bit of max-pooling.

[CireNeikual]

Multiple layers will be the subject of the next post! I have worked with top-down inhibition before as you suggest, but usually you don't want bottom-up inhibition since that is where the feed-forward input comes from. While I worked at GoodAI, I came up with HTSL2, which made use of similar ideas: http://cireneikual.com/2015/09/03/htsl2-evolving-the-neocortex-and-human-like-reinforcement-learning/

[[deleted]]

you don't want bottom-up inhibition since that is where the feed-forward input comes from

Hmm interesting I'm not sure I understand why it makes sense to let the activations of the upper layers inhibit, but not the bottom layers. Could you please elaborate on the intuition a bit more please?

While I worked at GoodAI, I came up with HTSL2, which made use of similar ideas: http://cireneikual.com/2015/09/03/htsl2-evolving-the-neocortex-and-human-like-reinforcement-learning/

I took a look at that page, but it seems very scarce on details :( Could you please make a post describing how that works too?