Skip to content

Dissecting racial bias in an algorithm used to manage the health of populations

Ziad Obermeyer, Brian W. Powers, Christine Vogeli, Sendhil Mullainathan

Science · 2019 · 8,285 citationsOpen access

No retraction on record in OpenAlex.Check Crossref now

Cite this paper

Obermeyer, Z., Powers, B. W., Vogeli, C., & Mullainathan, S. (2019). Dissecting racial bias in an algorithm used to manage the health of populations. Science, 366(6464), 447–453. https://doi.org/10.1126/science.aax2342

In text: (Obermeyer et al., 2019)

Ask a question about this research

One question, free, no account. Anchorcite finds the papers, checks each against Crossref and links every sentence of the answer to the passage it comes from.

Abstract

Health systems rely on commercial prediction algorithms to identify and help patients with complex health needs. We show that a widely used algorithm, typical of this industry-wide approach and affecting millions of patients, exhibits significant racial bias: At a given risk score, Black patients are considerably sicker than White patients, as evidenced by signs of uncontrolled illnesses. Remedying this disparity would increase the percentage of Black patients receiving additional help from 17.7 to 46.5%. The bias arises because the algorithm predicts health care costs rather than illness, but unequal access to care means that we spend less money caring for Black patients than for White patients. Thus, despite health care cost appearing to be an effective proxy for health by some measures of predictive accuracy, large racial biases arise. We suggest that the choice of convenient, seemingly effective proxies for ground truth can be an important source of algorithmic bias in many contexts.

  1. Artificial intelligence in healthcare: past, present and future2017
  2. Deep Learning in Medical Image Analysis2017
  3. Large language models encode clinical knowledge2023
  4. Convolutional neural networks: an overview and application in radiology2018
  5. Chatting and cheating: Ensuring academic integrity in the era of ChatGPT2023

Metadata from OpenAlex (CC0). Citations are generated from the published record.