Lifelong Learning Reading Group at CMU

Reading Schedule

Group spreadsheet

The group will be meeting nearly every Friday during 2019 from 1:30-2:30PM EST in GHC 6721.

List of Papers

Table of Contents

• Useful Links
• Survey Papers
• Challenges
  • Long-term Memory Consolidation and Retrieval
  • Catastrophic Forgetting
  • Benchmarks and Evaluation Metrics
  • Stability-Plasticity Dillema
  • Intrinsic Motivation
• Methods
  • Regularization
  • Dynamic Architecture
• Learning Paradigms
  • Transfer Learning
  • Multitask Learning
  • Meta Learning
  • Reinforcement Learning
  • Active Learning
  • Online Learning
  • Curricular Learning

Survey Papers

• Continual Learning in Neural Networks
• Continual Lifelong Learning with Neural Networks: A Review
• Lifelong Machine Learning
  • Tutorial @ KDD 16

Long-term Memory Consolidation and Retrieval

• What Learning Systems do Intelligent Agents Need? Complementary Learning Systems Theory Updated
• Pseudo-recurrent Connectionist Networks: An Approach to the 'Sensitivity-Stability' Dilemma
• Hippocampal and neocortical contributions to memory: Advances in the complementary learning systems framework
• Short-term plasticity as cause–effect hypothesis testing in distal reward learning
• A bio-inspired incremental learning architecture for applied perceptual problems
• Universal Value Function Approximators
• Hindsight Experience Replay
• DHER: Hindsight Experience Replay for Dynamic Goals
• THE KANERVA MACHINE:A GENERATIVE DISTRIBUTED MEMORY
• Evolutionary Architecture Search For Deep Multitask Networks
• Latent Multi-task Architecture Learning
• Using Task Features for Zero-Shot Knowledge Transfer in Lifelong Learning

Catastrophic Forgetting

• Catastrophic Forgetting, Rehearsal, and Pseudorehearsal
• Continual Learning Through Synaptic Intelligence
• Overcoming catastrophic forgetting in neural networks
• Neurogenesis Deep Learning
• Reinforced Continual Learning
• Continual Reinforcement Learning with Complex Synapses
• Lifelong Learning with Dynamically Expandable Networks
• Continual Learning with Deep Generative Replay
• Gradient Episodic Memory for Continual Learning
• Learning without Forgetting
• An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks
• Less-forgetting Learning in Deep Neural Networks
• An Empirical Study of Example Forgetting during Deep Neural Network Learning

Intrinsic Motivation

• Online Learning with Stochastic Recurrent Neural Networks using Intrinsic Motivation Signals
• Curiosity-driven Exploration by Self-supervised Prediction

Reinforcement Learning

• Unicorn: Continual Learning with a Universal, Off-policy Agent
• Continual Learning in Reinforcement Environments
• Safe Policy Search for Lifelong Reinforcement Learning with Sublinear Regret
• A Deep Hierarchical Approach to Lifelong Learning in Minecraft

Useful Links

• Lifelong Machine Leanring Group
• Lifelong Learning: A Reinforcement Learning Approach Workshop @ ICML 2018
• Workshop on Multi-Task and Lifelong Reinforcement Learning @ ICML 2019
• Deep Multi-Task and Meta Learning @ Stanford CS
• Continual learning Workshop @ NIPS 18
• Awesome Lifelong Learning