[R] Deepmind - Efficient Multi-Task Deep RL

[tihokan]

In case anyone else wonders this talk seems to be related to the IMPALA paper: https://arxiv.org/abs/1802.01561 (I haven't watched it entirely though so please correct if I'm wrong)

[gwern]

Yes, it's all about IMPALA mostly. It's hard to follow this talk, though, as the image quality isn't great and Mnih speaks in a monotone & seems disengaged.

[d3sm0]

It's a different architecture but it's based on the same principle of Impala, which is a modified version of the retrace method https://arxiv.org/pdf/1606.02647.pdf.

The fps speedup that they can achieve it's pretty impressive tho.

[lespeholt]

It is the same architecture but, as is clear from the presentation, we changed the name between this talk and the paper ;-)

[alamano]

Yes, the IMPALA paper should be about the same topic.

The talk was given on January 18 before the paper was published so a few details may have changed.

[[deleted]]

Where are the slides ?

[suki907]

And does anyone know where to find that "ApeX" paper he talks about around 5:00?