Continual & transfer learning

Publication

Is forgetting less a good inductive bias for forward transfer?

Arslan Chaudhry, Jiefeng Chen, Timothy Nguyen, Dilan Gorur

ICLR

Download

Publication

Graph schemas as abstractions for transfer learning, inference, and planning

Swaroop Guntupalli, Rajkumar Vasudeva Raju, Shrinu Kushagra, Carter Wendelken, Danny Sawyer, Ishan Deshpande, Stannis Zhou, Miguel Lazaro-Gredilla, Dileep George

arXiv

Download

Publication

Scaling Goal-based Exploration via Pruning Proto-goals

Akhil Bagaria *, Ray Jiang, Ramana Kumar, Tom Schaul

arXiv

Download

Publication

Probing Transfer in Deep Reinforcement Learning without Task Engineering

Andrei Rusu, Sebastian Flennerhag, Dushyant Rao, Razvan Pascanu, Raia Hadsell

CoLLAs

Download

Publication

Learning transferable motor skills with hierarchical latent mixture policies

Dushyant Rao, Fereshteh Sadeghi, Leonard Hasenclever, Markus Wulfmeier, Martina Zambelli, Giulia Vezzani, Dhruva TB, Yusuf Aytar, Josh Merel *, Nicolas Heess, Raia Hadsell

ICLR

Download

Publication

Feature and Parameter Selection in Stochastic Linear Bandits

Ahmadreza Moradipari *, Berkay Turan *, Yasin Abbasi Yadkori, Mahnoosh Alizadeh *, Mohammad Ghavamzadeh *

ICML

Download

Publication

On the Role of Neural Collapse in Transfer Learning

Andras Gyorgy, Marcus Hutter

ICLR

Download

Publication

Wide Neural Networks Forget Less Catastrophically

Iman Mirzadeh *, Arslan Chaudhry, Dong Yin, Clara Huiyi Hu, Razvan Pascanu, Dilan Gorur, Mehrdad Farajtabar

ICML

Download

Publication

Powerpropagation: A sparsity inducing weight reparameterisation

Jonathan Schwarz, Siddhant Jayakumar, Razvan Pascanu, Peter Latham *, Yee Whye Teh

NeurIPS

Download

Publication

The Effectiveness of Memory Replay in Large Scale Continual Learning

Yogesh Balaji *, Mehrdad Farajtabar, Dong Yin, Ang Li

arXiv

Download

Publication

Representation Matters: Improving Observations and Exploration for Robotics

Markus Wulfmeier, Arunkumar Byravan, Tim Hertweck, Irina Higgins, Ankush Gupta, Malcolm Reynolds, Denis Teplyashin, Martin Riedmiller, Roland Hafner, Tejas Kulkarni *

IEEE International Conference on Robotics and Automation

Download

Publication

Rethinking Embedding Coupling in Pre-trained Language Models

Hyung Won Chung *, Thibault Févry *, Henry Tsai *, M Johnson *, Sebastian Ruder

ICLR

Download

Publication

Embracing Change: Continual Learning in Deep Neural Networks

Raia Hadsell, Dushyant Rao, Andrei Rusu, Razvan Pascanu

Trends in Cognitive Sciences

Download

Publication

Importance Weighted Policy Learning and Adaption

Alexandre Galashov, Jakub Sygnowski, Guillaume Desjardins, Jan Humplik, Leonard Hasenclever, Rae Jeong, Yee Whye Teh, Nicolas Heess

arXiv

Download

Publication

Data-efficient Hindsight Off-policy Option Learning

Markus Wulfmeier, Dushyant Rao, Roland Hafner, Thomas Lampe, Abbas Abdolmaleki, Tim Hertweck, Michael Neunert, Dhruva Tirumala, Noah Siegel, Nicolas Heess, Martin Riedmiller

arXiv

Download

Publication

CoMic: Complementary Task Learning & Mimicry for Reusable Skills

Leonard Hasenclever, Raia Hadsell, Nicolas Heess, Josh Merel, Fabio Pardo *

ICML

Download

Publication

SOLA: Continual Learning with Second-Order Loss Approximation

Dong Yin, Mehrdad Farajtabar, Ang Li

arXiv

Download