Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

The order effect: reflections on the validity of multiple test presentations.

C P Lucas1

  • 1Department of Psychological Medicine (Children), Leeds General Infirmary.

Psychological Medicine
|February 1, 1992
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Endurance Training in Middle-Aged Male Physicians.

The Physician and sportsmedicine·2016
Same author

The DISC Predictive Scales (DPS): efficiently screening for diagnoses.

Journal of the American Academy of Child and Adolescent Psychiatry·2001
Same author

External validity of conduct and oppositional defiant disorders determined by the NIMH Diagnostic Interview Schedule for children.

Journal of abnormal child psychology·2000
Same author

Features of interviews questions associated with attenuation of symptom reports.

Journal of abnormal child psychology·2000
Same author

Effects of weight loss with orlistat on glucose tolerance and progression to type 2 diabetes in obese adults.

Archives of internal medicine·2000
Same author

NIMH Diagnostic Interview Schedule for Children Version IV (NIMH DISC-IV): description, differences from previous versions, and reliability of some common diagnoses.

Journal of the American Academy of Child and Adolescent Psychiatry·2000

The order of tests significantly impacts scores, with later tests receiving lower ratings. This "occasion effect" can affect agreement on caseness, highlighting the need to analyze test order in research.

Area of Science:

  • Psychological assessment
  • Psychometrics
  • Research methodology

Background:

  • Test order effects are known in test-retest studies.
  • The impact of sequential test presentation on outcomes is often underestimated.
  • Understanding order effects is crucial for accurate psychological measurement.

Purpose of the Study:

  • To investigate the impact of sequential test presentation on rating scale scores.
  • To determine if order effects influence agreement on caseness using standard cut-off scores.
  • To emphasize the importance of accounting for test order in research design and analysis.

Main Methods:

  • Administered two rating scales sequentially to participants.
  • Analyzed score changes based on the order of scale presentation.

Related Experiment Videos

  • Evaluated the effect of order on agreement on caseness using established cut-off scores.

    • Main Results:

    • Rating scales administered second in a pair consistently received lower scores.
    • This order effect (occasion effect) significantly impacted agreement on caseness.
    • Standard cut-off scores for determining caseness were markedly affected by test order.

    Conclusions:

    • Sequential test presentation introduces a significant occasion effect.
    • This effect can substantially alter conclusions about caseness.
    • Researchers must employ counterbalanced designs and analyze for test order effects.