Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

A comparison of reliability estimation using trials-to-criterion and sequential probability ratio testing.

P Patterson1, B Shifflett

  • 1San Diego State University.

Research Quarterly for Exercise and Sport
|December 1, 1989
PubMed
Summary

The sequential probability ratio (SPR) test offers higher reliability and fewer errors than trials-to-criterion (TTC) testing, especially for certification. TTC testing is simpler for classroom use, despite potentially higher misclassification rates.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Dual therapy based on co-formulated darunavir/ritonavir plus lamivudine for initial therapy of HIV infection: The ANDES randomized controlled trial.

International journal of antimicrobial agents·2024
Same author

Piloting a new cross-sector model of care to support parents with cancer: feasibility and acceptability of the Parent Support Worker role.

Supportive care in cancer : official journal of the Multinational Association of Supportive Care in Cancer·2024
Same author

Cancer patients as parents: implementation of a cross sector service for families with adolescent and young adult children.

BMC health services research·2023
Same author

Correction: An online parenting intervention to prevent affective disorders in high-risk adolescents: the PIPA trial protocol.

Trials·2022
Same author

An online parenting intervention to prevent affective disorders in high-risk adolescents: the PIPA trial protocol.

Trials·2022
Same author

The effect of protease inhibitor-based dual antiretroviral regimens on CD4/CD8 ratio during the first year of therapy in ART-naïve patients with HIV-infection.

HIV medicine·2020

Area of Science:

  • Sports Science
  • Educational Measurement
  • Psychometrics

Background:

  • Assessing test reliability is crucial for accurate classification of performance.
  • Sequential testing plans offer adaptive approaches to measurement.
  • Consistency of classification is a key aspect of reliability.

Purpose of the Study:

  • To compare test reliability estimates between trials-to-criterion (TTC) and sequential probability ratio (SPR) testing methods.
  • To evaluate classification consistency under different mastery levels and criteria.
  • To analyze misclassification error rates for each sequential testing approach.

Main Methods:

  • Utilized data from a golf chip test administered to 110 beginning students.
  • Applied SPR test specifications (alpha = beta = .05, theta 0 = .70, theta 1 = .50).

Related Experiment Videos

  • Examined TTC mastery levels of .70 and .60 with success criteria (R) from 6 to 12.
  • Calculated reliability using P and kappa statistics for both plans.

    • Main Results:

    • SPR testing yielded higher reliability at a .70 mastery level compared to TTC.
    • Reliability estimates were similar between SPR and TTC testing at a .60 mastery level.
    • TTC testing generally had shorter median test lengths (12) than SPR (21), but higher misclassification error rates, particularly false nonmaster errors.

    Conclusions:

    • SPR testing is preferable when minimizing misclassification errors is critical, such as in certification contexts.
    • TTC testing remains a practical option for classroom assessments due to its administrative simplicity and shorter test length.
    • The choice between SPR and TTC depends on the balance between classification accuracy and practical implementation needs.