Skip to content

High-Speed Tracking with Kernelized Correlation Filters

João F. Henriques, Rui Caseiro, Pedro Martins, Jorge P. Batista

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2014 · 5,832 citationsOpen access

No retraction on record in OpenAlex.Check Crossref now

Cite this paper

Henriques, J. F., Caseiro, R., Martins, P., & Batista, J. P. (2014). High-speed tracking with kernelized correlation filters. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37(3), 583–596. https://doi.org/10.1109/tpami.2014.2345390

In text: (Henriques et al., 2014)

Ask a question about this research

One question, free, no account. Anchorcite finds the papers, checks each against Crossref and links every sentence of the answer to the passage it comes from.

Abstract

The core component of most modern trackers is a discriminative classifier, tasked with distinguishing between the target and the surrounding environment. To cope with natural image changes, this classifier is typically trained with translated and scaled sample patches. Such sets of samples are riddled with redundancies-any overlapping pixels are constrained to be the same. Based on this simple observation, we propose an analytic model for datasets of thousands of translated patches. By showing that the resulting data matrix is circulant, we can diagonalize it with the discrete Fourier transform, reducing both storage and computation by several orders of magnitude. Interestingly, for linear regression our formulation is equivalent to a correlation filter, used by some of the fastest competitive trackers. For kernel regression, however, we derive a new kernelized correlation filter (KCF), that unlike other kernel algorithms has the exact same complexity as its linear counterpart. Building on it, we also propose a fast multi-channel extension of linear correlation filters, via a linear kernel, which we call dual correlation filter (DCF). Both KCF and DCF outperform top-ranking trackers such as Struck or TLD on a 50 videos benchmark, despite running at hundreds of frames-per-second, and being implemented in a few lines of code (Algorithm 1). To encourage further developments, our tracking framework was made open-source.

  1. Deep Residual Learning for Image Recognition2016
  2. ImageNet classification with deep convolutional neural networks2017
  3. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks2016
  4. You Only Look Once: Unified, Real-Time Object Detection2016
  5. Going deeper with convolutions2015

Metadata from OpenAlex (CC0). Citations are generated from the published record.