Skip to content

Ridge Regression: Biased Estimation for Nonorthogonal Problems

Arthur E. Hoerl, Robert W. Kennard

Technometrics · 1970 · 9,605 citations

Abstract

In multiple regression it is shown that parameter estimates based on minimum residual sum of squares have a high probability of being unsatisfactory, if not incorrect, if the prediction vectors are not orthogonal. Proposed is an estimation procedure based on adding small positive quantities to the diagonal of X′X. Introduced is the ridge trace, a method for showing in two dimensions the effects of nonorthogonality. It is then shown how to augment X′X to obtain biased estimates with smaller mean square error.

Cite this paper

Hoerl, A. E., & Kennard, R. W. (1970). Ridge regression: Biased estimation for nonorthogonal problems. Technometrics, 12(1), 55–67. https://doi.org/10.1080/00401706.1970.10488634

Read it with every claim anchored

Add this paper to a project, ask questions of it, and get answers that point to the exact passage.

Start free
  1. Bootstrap Methods: Another Look at the Jackknife1979
  2. Least angle regression2004

Metadata from OpenAlex (CC0). Citations are generated from the published record.