Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Stability of psychometric questionnaires.

A M Nevill1, A M Lane, L J Kilgour

  • 1School of Sport, Performing Arts and Leisure, University of Wolverhampton, UK. a.m.nevill@wlv.ac.uk

Journal of Sports Sciences
|April 20, 2001
PubMed
Summary

This study shows that assessing test-retest stability using agreement proportion is less effective than analyzing within-individual differences. A simpler method focusing on score changes provides more sensitive psychometric questionnaire stability assessment.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Prehabilitation of Patients With Oesophageal Malignancy Undergoing Peri-Operative Treatment (Pre-EMPT): Outcomes From a Prospective Controlled Trial.

Journal of surgical oncology·2025
Same author

Impact of gene expression profiling on diagnosis and survival after metastasis in patients with uveal melanoma.

Melanoma research·2024
Same author

Assessing feasibility, construct validity, and reliability of a new aged care-specific preference-based quality of life instrument: evidence from older Australians in residential aged care.

Health and quality of life outcomes·2022
Same author

BMI is dead; long live waist-circumference indices: But which index should we choose to predict cardio-metabolic risk?

Nutrition, metabolism, and cardiovascular diseases : NMCD·2022
Same author

Common mental disorders among Irish jockeys: prevalence and risk factors.

The Physician and sportsmedicine·2020
Same author

Lights4Violence: a quasi-experimental educational intervention in six European countries to promote positive relationships among adolescents.

BMC public health·2019

Area of Science:

  • Psychometrics
  • Psychological Measurement
  • Behavioral Science

Background:

  • Wilson and Batterham (1999) proposed assessing psychometric questionnaire test-retest stability via proportion of agreement.
  • They utilized bootstrapping to estimate the uncertainty of this agreement proportion.

Purpose of the Study:

  • To demonstrate that the binomial distribution, not bootstrapping, accurately describes the sampling distribution of agreement proportion.
  • To propose a simpler, more sensitive method for assessing questionnaire stability using test-retest differences.

Main Methods:

  • The study analyzed test-retest differences for each item of the Social Physique Anxiety Scale in 97 sport students.
  • Participants completed the scale on two separate occasions.

Related Experiment Videos

Main Results:

  • The proportion of agreement overlooks the nature of disagreement between test-retest responses.
  • Analysis of within-individual differences revealed contrasting stability for items with similar agreement rates.
  • A proposed threshold suggests 90% of participants should have test-retest differences within +/- 1 point on a 5-point scale.

Conclusions:

  • The proportion of agreement is a redundant measure for assessing test-retest stability.
  • Analyzing within-individual differences offers a more sensitive and informative method for evaluating psychometric questionnaire stability.
  • A +/- 1 point difference threshold is recommended for assessing stability in 5-point scale questionnaires.