Self-supervised learning

Publication

Meta-Learning Black-Box Optimization via Black-Box Optimization

Robert Lange, Tom Schaul, Tom Zahavy, Yutian Chen, Valentin Dalibard, Chris Lu, Satinder Baveja, Sebastian Flennerhag

ICLR

Download

Publication

Reasoning-Modulated Representations

Petar Veličković, Matko Bošnjak, Thomas Kipf *, Alexander Lerchner, Raia Hadsell, Razvan Pascanu, Charles Blundell

LoG

Download

Publication

Self-supervised video pretraining yields strong image representations

Nikhil Parthasarathy, Ali Eslami, Joao Carreira, Olivier Henaff

arXiv

Download

Publication

Palm up: Playing in the Latent Manifold for Unsupervised Pretraining

Hao Liu *, Tom Zahavy, Vlad Mnih, Satinder Baveja

NeurIPS

Download

Publication

Where Should I Spend My FLOPS? Efficiency Evaluations of Visual Pre-training Methods

Skanda Koppula, Yazhe Li, Evan Shelhamer, Drew Jaegle, Nikhil Parthasarathy, Relja Arandjelovic, Joao Carreira, Olivier Henaff

NeurIPS Workshop

Download

Publication

Object discovery and representation networks

Olivier Henaff, Skanda Koppula, Evan Shelhamer, Daniel Zoran, Drew Jaegle, Andrew Zisserman, Joao Carreira, Relja Arandjelovic

ECCV

Download

Publication

Large-scale representation learning on graphs via bootstrapping

Shantanu Thakoor, Corentin Tallec, Mohammad Gheshlaghi Azar, Mehdi Azabou *, Eva Dyer *, Remi Munos, Petar Veličković, Michal Valko

ICLR

Download

Publication

Mine Your Own vieW: Self-supervised learning through across-sample prediction

Mehdi Azabou *, Mohammad Gheshlaghi Azar, Ran Liu *, Chi-Heng Lin *, Erik Johnson *, Kiran Bhaskaran-Nair *, Max Dabagia *, Bernardo Avila Pires, Lindsey Kitchell *, keith hengen *, William Gray Roncal *, Michal Valko, E Dyer *

NeurIPS Workshop

Download

Publication

Efficient Visual Pretraining with Contrastive Detection

Olivier Henaff, Skanda Koppula, Jean-baptiste Alayrac, Aäron van den Oord, Oriol Vinyals, Joao Carreira

ICCV

Download

Publication

Rethinking Embedding Coupling in Pre-trained Language Models

Hyung Won Chung *, Thibault Févry *, Henry Tsai *, M Johnson *, Sebastian Ruder

ICLR

Download

Publication

Representation learning for improved interpretability and classification accuracy of clinical factors from EEG

Garrett Honke *, Irina Higgins, Nina Thigpen *, Vladimir Miskovic *, Katie Link *, Sunny Duan *, Pramod Gupta *, Julia Klawohn *, Greg Hajcak *

ICLR

Download

Publication

Multi-Format Contrastive Learning of Audio Representations

Luyu Wang, Aäron van den Oord

NeurIPS

Download

Publication

Bootstrap Your Own Latent: A new approach to self-supervised learning

Jean-bastien Grill, Florian Strub, Florent Altché, Corentin Tallec, Pierre Richemond, Elena Buchatskaya, Carl Doersch, Bernardo Avila Pires, Daniel Guo, Mohammad Gheshlaghi Azar, Bilal Piot, Koray Kavukcuoglu, Remi Munos, Michal Valko

NeurIPS

Download

Publication

Learning rich touch representations through cross-modal self-supervision

Martina Zambelli, Yusuf Aytar, Yuxiang Zhou, Francesco Visin, Raia Hadsell

CoRL

Download

Publication

Counting Out Time: Class Agnostic Video Repetition Counting in the Wild

Debidatta Dwibedi *, Yusuf Aytar, Jonathan Tompson *, Pierre Sermanet *, Andrew Zisserman

arXiv

Download

Publication

Probing Emergent Semantics in Predictive Agents via Question Answering

A Das *, Federico Carnevale, Hamza Merzic, Laura Rimell, Rosalia Schneider, Josh Abramson, Alden Hung, Arun Ahuja, Stephen Clark, Gregory Wayne, Felix Hill

ICML

Download

Publication

Syntactic Structure Distillation Pretraining For Bidirectional Encoders

Adhiguna Kuncoro, Lingpeng Kong, Daniel Fried *, Dani Yogatama, Laura Rimell, Chris Dyer, Phil Blunsom

arXiv

Download

Publication

Bootstrap Latent-Predictive Representations for Multitask Reinforcement Learning

Daniel Guo, Bernardo Pires *, Bilal Piot, Jean-Bastian Grill, Florent Altché, Rémi Munos, Mohammad Gheshlaghi Azar

ICML

Download

Publication

Self-Distillation Amplifies Regularization in Hilbert Space

Hossein Mobahi *, Mehrdad Farajtabar, Peter Bartlett *

arXiv

Download

Publication

End-to-End Learning of Visual Representations from Uncurated Instructional Videos

A Miech *, Jean-Baptiste Alayrac, Lucas Smaira, Ivan Laptev *, Josef Sivic *, Andrew Zisserman

arXiv

Download

Publication

Large Scale Adversarial Representation Learning

Jeff Donahue, Karen Simonyan

arXiv

Download

Publication

World Discovery Models

M Gheshlaghi Azar, Bilal Piot, Bernardo Pires *, Jean-Bastian Grill, Florent Altché, Rémi Munos

arXiv

Download

Publication

Fast Task Inference with Variational Intrinsic Successor Features

Steven Hansen, Will Dabney, André Barreto, Tom Van de Wiele, David Warde-Farley, Vlad Mnih

arXiv

Download

Publication

Data-Efficient Image Recognition with Contrastive Predictive Coding

Olivier Hénaff, Ali Razavi, Carl Doersch, S M Ali Eslami, Aäron van den Oord

ICML

Download

Publication

COBRA: Data-Efficient Model-Based RL through Unsupervised Object Discovery and Curiosity-Driven Exploration

Nick Watters, Loic Matthey, Matko Bošnjak, Christopher Burgess, Alexander Lerchner

ICML

Download

Publications

Self-supervised learning