Skip to content

Intercoder Reliability in Qualitative Research: Debates and Practical Guidelines

Cliódhna O’Connor, Hélène Joffé

International Journal of Qualitative Methods · 2020 · 4,724 citationsOpen access

No retraction on record in OpenAlex.Check Crossref now

Cite this paper

O’Connor, C., & Joffé, H. (2020). Intercoder reliability in qualitative research: Debates and practical guidelines. International Journal of Qualitative Methods, 19. https://doi.org/10.1177/1609406919899220

In text: (O’Connor & Joffé, 2020)

Ask a question about this research

One question, free, no account. Anchorcite finds the papers, checks each against Crossref and links every sentence of the answer to the passage it comes from.

Abstract

Evaluating the intercoder reliability (ICR) of a coding frame is frequently recommended as good practice in qualitative analysis. ICR is a somewhat controversial topic in the qualitative research community, with some arguing that it is an inappropriate or unnecessary step within the goals of qualitative analysis. Yet ICR assessment can yield numerous benefits for qualitative studies, which include improving the systematicity, communicability, and transparency of the coding process; promoting reflexivity and dialogue within research teams; and helping convince diverse audiences of the trustworthiness of the analysis. Few guidelines exist to help researchers negotiate the assessment of ICR in qualitative analysis. The current article explains what ICR is, reviews common arguments for and against its incorporation in qualitative analysis and offers guidance on the practical elements of performing an ICR assessment.

  1. The Measurement of Observer Agreement for Categorical Data1977
  2. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research2016
  3. Intraclass correlations: Uses in assessing rater reliability.1979
  4. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for Reporting Observational Studies2007
  5. Meta-analysis of Observational Studies in Epidemiology A Proposal for Reporting2000

Metadata from OpenAlex (CC0). Citations are generated from the published record.