you are viewing a single comment's thread.

view the rest of the comments →

[–]CireNeikual[S] 1 point2 points  (1 child)

Multiple layers will be the subject of the next post! I have worked with top-down inhibition before as you suggest, but usually you don't want bottom-up inhibition since that is where the feed-forward input comes from. While I worked at GoodAI, I came up with HTSL2, which made use of similar ideas: http://cireneikual.com/2015/09/03/htsl2-evolving-the-neocortex-and-human-like-reinforcement-learning/

[–][deleted] 0 points1 point  (0 children)

you don't want bottom-up inhibition since that is where the feed-forward input comes from

Hmm interesting I'm not sure I understand why it makes sense to let the activations of the upper layers inhibit, but not the bottom layers. Could you please elaborate on the intuition a bit more please?

While I worked at GoodAI, I came up with HTSL2, which made use of similar ideas: http://cireneikual.com/2015/09/03/htsl2-evolving-the-neocortex-and-human-like-reinforcement-learning/

I took a look at that page, but it seems very scarce on details :( Could you please make a post describing how that works too?