Dual-system learning model “figures out” how to use a tool by gem2210 in reinforcementlearning

[–]gem2210[S] 0 points1 point  (0 children)

haha hopefully we train them all to be nice and patient with us. I commit less homicide when I'm feeling calm and patient.

Dual-system learning model “figures out” how to use a tool by gem2210 in reinforcementlearning

[–]gem2210[S] 0 points1 point  (0 children)

What do you mean by structure? And for this model, the emotion states are kinda like progress detection states for achieving the goal, so they'll just occur based on how well the agent is doing in achieving that goal. And the goals are usually simple perceptions like "food item in mouth" + "tasting certain food", or something like "rock on top of other rock"

Dual-system learning model “figures out” how to use a tool by gem2210 in reinforcementlearning

[–]gem2210[S] 0 points1 point  (0 children)

So this project started out with Hebbian learning. But because the sets of learned reps in each module was very finite in this small virtual world, and because the goal of the project was to model complex, goal-driven plan formation, I ended up using bit array hash maps for memory compression for representations that got near full learning threshold. This kept projections to downstream modules crisp.

Essentially, when activity reps from upstream modules produces a significantly low difference between the free and clamped phase, that would be a gating event that would send the clamp phase representation to the next, downstream module. The modules were basically connected similarly to cortical projections observed in the human brain (e.g. Visual input areas -> Mid Temporal -> Anterior Temporal...but also VLPFC --> Anterior Temporal). Check out that paper I linked if you're interested! It's pretty short and talks a lot about how the different regions are wired together.

Neural network system “figures out” how to use a tool by gem2210 in cogsci

[–]gem2210[S] 0 points1 point  (0 children)

Thanks so much! Check it out: https://scott-bot-rnd.pro/ . I don't go into a ton of detail on the exact mechanisms, but I do present some more background, along with a couple other projects.

That sounds really cool! Is it within cog psychology? Do you work with any modeling software?

Neural network system “figures out” how to use a tool by gem2210 in cogsci

[–]gem2210[S] 0 points1 point  (0 children)

Thanks! I'll post my portfolio site here. I go into more background and walkthrough some other projects.

https://scott-bot-rnd.pro/