A method of comparing the areas under receiver operating characteristic curves derived from the same cases.
J A Hanley, Barbara Joyce McNeil
Radiology · 1983 · 7,054 citations
No retraction on record in OpenAlex.Check Crossref now
Cite this paper
Hanley, J. A., & McNeil, B. J. (1983). A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology, 148(3), 839–843. https://doi.org/10.1148/radiology.148.3.6878708
In text: (Hanley & McNeil, 1983)
Ask a question about this research
One question, free, no account. Anchorcite finds the papers, checks each against Crossref and links every sentence of the answer to the passage it comes from.
Abstract
Receiver operating characteristic (ROC) curves are used to describe and compare the performance of diagnostic technology and diagnostic algorithms. This paper refines the statistical comparison of the areas under two ROC curves derived from the same set of patients by taking into account the correlation between the areas that is induced by the paired nature of the data. The correspondence between the area under an ROC curve and the Wilcoxon statistic is used and underlying Gaussian distributions (binormal) are assumed to provide a table that converts the observed correlations in paired ratings of images into a correlation between the two ROC areas. This between-area correlation can be used to reduce the standard error (uncertainty) about the observed difference in areas. This correction for pairing, analogous to that used in the paired t-test, can produce a considerable increase in the statistical sensitivity (power) of the comparison. For studies involving multiple readers, this method provides a measure of a component of the sampling variation that is otherwise difficult to obtain.
Related papers
- The Measurement of Observer Agreement for Categorical Data1977
- Comparing the Areas under Two or More Correlated Receiver Operating Characteristic Curves: A Nonparametric Approach1988
- The meaning and use of the area under a receiver operating characteristic (ROC) curve.1982
- The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation2020
- The Precision-Recall Plot Is More Informative than the ROC Plot When Evaluating Binary Classifiers on Imbalanced Datasets2015
Metadata from OpenAlex (CC0). Citations are generated from the published record.