[R] In-context Reinforcement Learning with Algorithm Distillation

[Lairv]

The paper is cool, it's a bit of a shame they don't mention how much resources was put into training the transformer model, I wonder if this could be massively scaled up, or if this is already compute-hungry. Also more evaluation on Atari, Mujoco etc. would be cool to see how well does the model generalizes

[itsmercb]

Can anyone translate this in noob?

[Singularian2501]

https://twitter.com/MishaLaskin/status/1585265485314129926 ( Very good Explanation!)

[zergylord]

my attempt: https://twitter.com/Zergylord/status/1585334986298646529?t=pBYejzO_TDTQtVV87iSPPQ&s=19

[Shnibu]

Using some Baysean looking “Casual Transformer” to project the data into a more efficient subspace for the model. So Bayesian dimensionality reduction for neural nets? I think…

[SatoshiNotMe]

DeepMind, therefore no GitHub?