Skip to content

Two Quantitative Approaches for Estimating Content Validity

Christine A. Wynd, Michelle Atkins Schaefer

Western Journal of Nursing Research · 2003 · 859 citations

No retraction on record in OpenAlex.Check Crossref now

Cite this paper

Wynd, C. A., Schmidt, B., & Schaefer, M. A. (2003). Two quantitative approaches for estimating content validity. Western Journal of Nursing Research, 25(5), 508–518. https://doi.org/10.1177/0193945903252998

In text: (Wynd et al., 2003)

Ask a question about this research

One question, free, no account. Anchorcite finds the papers, checks each against Crossref and links every sentence of the answer to the passage it comes from.

Abstract

Instrument content validity is often established through qualitative expert reviews, yet quantitative analysis of reviewer agreements is also advocated in the literature. Two quantitative approaches to content validity estimations were compared and contrasted using a newly developed instrument called the Osteoporosis Risk Assessment Tool (ORAT). Data obtained from a panel of eight expert judges were analyzed. A Content Validity Index (CVI) initially determined that only one item lacked interrater proportion agreement about its relevance to the instrument as a whole (CVI = 0.57). Concern that higher proportion agreement ratings might be due to random chance stimulated further analysis using a multirater kappa coefficient of agreement. An additional seven items had low kappas, ranging from 0.29 to 0.48 and indicating poor agreement among the experts. The findings supported the elimination or revision of eight items. Pros and cons to using both proportion agreement and kappa coefficient analysis are examined.

  1. Evaluating Structural Equation Models with Unobservable Variables and Measurement Error1981
  2. The Hospital Anxiety and Depression Scale1983
  3. Coefficient Alpha and the Internal Structure of Tests1951
  4. An Inventory for Measuring Depression1961
  5. A new criterion for assessing discriminant validity in variance-based structural equation modeling2014

Metadata from OpenAlex (CC0). Citations are generated from the published record.