Two Quantitative Approaches for Estimating Content Validity
Christine A. Wynd, Michelle Atkins Schaefer
Western Journal of Nursing Research · 2003 · 859 citations
No retraction on record in OpenAlex.Check Crossref now
Cite this paper
Wynd, C. A., Schmidt, B., & Schaefer, M. A. (2003). Two quantitative approaches for estimating content validity. Western Journal of Nursing Research, 25(5), 508–518. https://doi.org/10.1177/0193945903252998
In text: (Wynd et al., 2003)
Ask a question about this research
One question, free, no account. Anchorcite finds the papers, checks each against Crossref and links every sentence of the answer to the passage it comes from.
Abstract
Instrument content validity is often established through qualitative expert reviews, yet quantitative analysis of reviewer agreements is also advocated in the literature. Two quantitative approaches to content validity estimations were compared and contrasted using a newly developed instrument called the Osteoporosis Risk Assessment Tool (ORAT). Data obtained from a panel of eight expert judges were analyzed. A Content Validity Index (CVI) initially determined that only one item lacked interrater proportion agreement about its relevance to the instrument as a whole (CVI = 0.57). Concern that higher proportion agreement ratings might be due to random chance stimulated further analysis using a multirater kappa coefficient of agreement. An additional seven items had low kappas, ranging from 0.29 to 0.48 and indicating poor agreement among the experts. The findings supported the elimination or revision of eight items. Pros and cons to using both proportion agreement and kappa coefficient analysis are examined.
Related papers
- Evaluating Structural Equation Models with Unobservable Variables and Measurement Error1981
- The Hospital Anxiety and Depression Scale1983
- Coefficient Alpha and the Internal Structure of Tests1951
- An Inventory for Measuring Depression1961
- A new criterion for assessing discriminant validity in variance-based structural equation modeling2014
Metadata from OpenAlex (CC0). Citations are generated from the published record.