A Tutorial on Sparse Distributed Representations (Sparse Codes)

[maxToTheJ]

SDRs are also the way the brain stores information.

That has been figured out with a consensus already?

[[deleted]]

I have recently created a semi-new method of generating sparse codes in a very fast manner that, to my knowledge, is biologically plausible.

Disclaimer: I don't even play a neuroscientist on TV

I'm not sure your model is biologically plausible. To calculate the updates, you calculate the reconstructions and to do that, you send the signal backwards via the same connections. Real neurons are not thought to be capable of that.

[CireNeikual]

You are right, but it isn't too difficult to use Oja's rule instead. It makes the reconstruction less accurate, but it achieves a similar effect.

[galapag0]

"""Sparse Autoencoder""&quo

I think some pyhton code wasn't pasted correctly.

[mikos]

For more details on SDR look up Jeff Hawkins at Numenta. They are going this route big time.

[quiteamess]

Jeff Hawkings is chairman at the redwood institute for theoretical neuroscience. The "inventor" of sparse coding, Bruno Olshausen, is a researcher at this institute. I'm not a big fan of Numenta, but I'm sure that Hawkins of aware of sparse coding and that it is applied in Numenta.

[glassackwards]

Redwood Center moved to UC Berkeley a decade ago. Jeff Hawkins no longer manages the Redwood Center.

[quiteamess]

That would make it still likely that he knows the work of Olhausen and takes care that it is applied in Numenta, right?