Skip to content

The meaning and use of the area under a receiver operating characteristic (ROC) curve.

J A Hanley, Barbara Joyce McNeil

Radiology · 1982 · 22,318 citations

No retraction on record in OpenAlex.Check Crossref now

Cite this paper

Hanley, J. A., & McNeil, B. J. (1982). The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology, 143(1), 29–36. https://doi.org/10.1148/radiology.143.1.7063747

In text: (Hanley & McNeil, 1982)

Ask a question about this research

One question, free, no account. Anchorcite finds the papers, checks each against Crossref and links every sentence of the answer to the passage it comes from.

Abstract

A representation and interpretation of the area under a receiver operating characteristic (ROC) curve obtained by the "rating" method, or by mathematical predictions based on patient characteristics, is presented. It is shown that in such a setting the area represents the probability that a randomly chosen diseased subject is (correctly) rated or ranked with greater suspicion than a randomly chosen non-diseased subject. Moreover, this probability of a correct ranking is the same quantity that is estimated by the already well-studied nonparametric Wilcoxon statistic. These two relationships are exploited to (a) provide rapid closed-form expressions for the approximate magnitude of the sampling variability, i.e., standard error that one uses to accompany the area under a smoothed ROC curve, (b) guide in determining the size of the sample required to provide a sufficiently reliable estimate of this area, and (c) determine how large sample sizes should be to ensure that one can statistically detect differences in the accuracy of diagnostic techniques.

  1. The Measurement of Observer Agreement for Categorical Data1977
  2. Comparing the Areas under Two or More Correlated Receiver Operating Characteristic Curves: A Nonparametric Approach1988
  3. A method of comparing the areas under receiver operating characteristic curves derived from the same cases.1983
  4. The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation2020
  5. The Precision-Recall Plot Is More Informative than the ROC Plot When Evaluating Binary Classifiers on Imbalanced Datasets2015

Metadata from OpenAlex (CC0). Citations are generated from the published record.