Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Two quantitative approaches for estimating content validity.

Christine A Wynd1, Bruce Schmidt, Michelle Atkins Schaefer

  • 1University of Akron College of Nursing, Ohio, USA.

Western Journal of Nursing Research
|September 6, 2003
PubMed
Summary

Quantitative analysis of expert agreement for the Osteoporosis Risk Assessment Tool (ORAT) revealed significant discrepancies. Using both Content Validity Index (CVI) and multirater kappa, eight items required revision or elimination due to poor interrater reliability.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Celebrating 40 Years of the Midwest Nursing Research Society.

Western journal of nursing research·2017
Same author

Factors influencing professionalism in nursing among Korean American registered nurses.

Journal of professional nursing : official journal of the American Association of Colleges of Nursing·2010
Same author

Factors influencing nurses' participation in clinical research.

Gastroenterology nursing : the official journal of the Society of Gastroenterology Nurses and Associates·2008
Same author

Meta-analysis as a tool for evidence-based practice: an example using the Rice meta-analysis of smoking cessation interventions.

Applied nursing research : ANR·2008
Same author

Employee health fair data: evidence for planning health promotion programs.

Clinical nurse specialist CNS·2007
Same author

Smoking patterns, beliefs, and the practice of healthy behaviors in abstinent, relapsed, and recalcitrant smokers.

Journal of vascular nursing : official publication of the Society for Peripheral Vascular Nursing·2007

Area of Science:

  • Health Sciences
  • Medical Informatics
  • Psychometrics

Background:

  • Instrument content validity is crucial for reliable health assessments.
  • Qualitative expert reviews are common, but quantitative agreement analysis is increasingly advocated.
  • The Osteoporosis Risk Assessment Tool (ORAT) is a newly developed instrument requiring validation.

Purpose of the Study:

  • To compare and contrast two quantitative approaches for estimating content validity.
  • To assess interrater agreement among experts using the ORAT.
  • To identify items needing revision or elimination based on quantitative analysis.

Main Methods:

  • Utilized data from eight expert judges evaluating the ORAT.
  • Calculated Content Validity Index (CVI) to assess proportion agreement.

Related Experiment Videos

  • Employed multirater kappa coefficient to account for chance agreement.

    • Main Results:

    • Initial CVI indicated only one item lacked sufficient interrater agreement (CVI = 0.57).
    • Multirater kappa analysis revealed poor agreement for an additional seven items (kappa = 0.29–0.48).
    • A total of eight items were identified for elimination or revision.

    Conclusions:

    • Quantitative methods, particularly multirater kappa, are essential for robust content validity assessment.
    • Expert agreement analysis using both CVI and kappa is vital for instrument refinement.
    • Findings support the revision or removal of eight ORAT items to enhance reliability.