Skip to content

Learning without Forgetting

Zhizhong Li, Derek Hoiem

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2017 · 4,511 citationsOpen access

No retraction on record in OpenAlex.Check Crossref now

Cite this paper

Li, Z., & Hoiem, D. (2017). Learning without forgetting. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(12), 2935–2947. https://doi.org/10.1109/tpami.2017.2773081

In text: (Li & Hoiem, 2017)

Ask a question about this research

One question, free, no account. Anchorcite finds the papers, checks each against Crossref and links every sentence of the answer to the passage it comes from.

Abstract

When building a unified vision system or gradually adding new apabilities to a system, the usual assumption is that training data for all tasks is always available. However, as the number of tasks grows, storing and retraining on such data becomes infeasible. A new problem arises where we add new capabilities to a Convolutional Neural Network (CNN), but the training data for its existing capabilities are unavailable. We propose our Learning without Forgetting method, which uses only new task data to train the network while preserving the original capabilities. Our method performs favorably compared to commonly used feature extraction and fine-tuning adaption techniques and performs similarly to multitask learning that uses original task data we assume unavailable. A more surprising observation is that Learning without Forgetting may be able to replace fine-tuning with similar old and new task datasets for improved new task performance.

  1. Deep Residual Learning for Image Recognition2016
  2. ImageNet classification with deep convolutional neural networks2017
  3. Going deeper with convolutions2015
  4. Densely Connected Convolutional Networks2017
  5. Fully convolutional networks for semantic segmentation2015

Metadata from OpenAlex (CC0). Citations are generated from the published record.