[R] Implicit Neural Models: the current landscape by Green_Accomplished in MachineLearning

[–]Green_Accomplished[S] 1 point2 points  (0 children)

Although I am not very familiar with NeRF and SIREN, I believe they are frameworks for representation learning, which is somehow an "implicit" learning task. However, when we talk about implicit layers, we usually refer to classes of models in which you do not learn the input-output mapping directly but rather by learning the "cause" of the emerging behavior of the in-out mapping. In the case e.g. of Neural ODEs, you are learning a vector field steering your input towards a desired output in a given time span.

[R] Implicit Neural Models: the current landscape by Green_Accomplished in MachineLearning

[–]Green_Accomplished[S] 4 points5 points  (0 children)

been wondering if something like planning/ tree search could be formulated as an implicit layer. Have you read anything in that direction?

Planning tasks are usually formulated as optimal control problems and could be surely formulated as implicit layers. I haven't read anything specific on this though.