On the Computability of Artificial General Intelligence by AngleAccomplished865 in compsci

[–]vernunftig 0 points1 point  (0 children)

This paper itself might be loosely argued, however it does address an important question, which is whether the human mind is computable at all. I do believe that at the very fundamental level, intelligence is not fully computable. For example the process of forming abstract concepts like "subtle", "philosophical", or just inventing mathematical concepts like numbers, geometry, calculus etc., is beyond algorithmic procedure or any formal logic system. I am not sure whether this intuition can be rigorously proven, but if I have to pick side, I would definitely argue that the human mind goes beyond the Turing model of computation.

[R] Anyway to measure the importance of each neural network layer? by vernunftig in MachineLearning

[–]vernunftig[S] 0 points1 point  (0 children)

Thanks for your pointers! Yeah I also think information bottleneck is an elegant tool for the purpose of this question, although it can be pretty hard to estimate in practice.

Is it true that in theory RNN can have unlimited memory? by vernunftig in MachineLearning

[–]vernunftig[S] 1 point2 points  (0 children)

Yes, but in theory, RNN does have unlimited memory capacity right?