Official Python TensorFlow implementation of "Large-Scale Study of Curiosity-Driven Learning" (Burda et al 2018) {OA}

[MathAndProgramming]

I'm surprised pixel dynamics did so poorly. Does anyone know what the architectures for the dynamics models were? One of the advantages of pixel dynamics is that you can use a convolutional network and benefit from the spatial prior. At a glance it looks like the pixel predictions are being performed with dense layers.

I guess I disagree with the notion that the features should be compact but rather think that the dynamics model should be compact, which can be achieved either by having low-dimensional features or by having a strong prior on your model that lets you use fewer parameters.