Skip to content

Delphi methodology in healthcare research: How to decide its appropriateness

Prashant Nasa, Ravi Jain, Deven Juneja

World Journal of Methodology · 2021 · 2,046 citationsOpen access

No retraction on record in OpenAlex.Check Crossref now

Cite this paper

Nasa, P., Jain, R., & Juneja, D. (2021). Delphi methodology in healthcare research: How to decide its appropriateness. World Journal of Methodology, 11(4), 116–129. https://doi.org/10.5662/wjm.v11.i4.116

In text: (Nasa et al., 2021)

Ask a question about this research

One question, free, no account. Anchorcite finds the papers, checks each against Crossref and links every sentence of the answer to the passage it comes from.

Abstract

The Delphi technique is a systematic process of forecasting using the collective opinion of panel members. The structured method of developing consensus among panel members using Delphi methodology has gained acceptance in diverse fields of medicine. The Delphi methods assumed a pivotal role in the last few decades to develop best practice guidance using collective intelligence where research is limited, ethically/logistically difficult or evidence is conflicting. However, the attempts to assess the quality standard of Delphi studies have reported significant variance, and details of the process followed are usually unclear. We recommend systematic quality tools for evaluation of Delphi methodology; identification of problem area of research, selection of panel, anonymity of panelists, controlled feedback, iterative Delphi rounds, consensus criteria, analysis of consensus, closing criteria, and stability of the results. Based on these nine qualitative evaluation points, we assessed the quality of Delphi studies in the medical field related to coronavirus disease 2019. There was inconsistency in reporting vital elements of Delphi methods such as identification of panel members, defining consensus, closing criteria for rounds, and presenting the results. We propose our evaluation points for researchers, medical journal editorial boards, and reviewers to evaluate the quality of the Delphi methods in healthcare research.

  1. The Measurement of Observer Agreement for Categorical Data1977
  2. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research2016
  3. Intraclass correlations: Uses in assessing rater reliability.1979
  4. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for Reporting Observational Studies2007
  5. Meta-analysis of Observational Studies in Epidemiology A Proposal for Reporting2000

Metadata from OpenAlex (CC0). Citations are generated from the published record.