Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Multiple Comparison Tests01:13

Multiple Comparison Tests

3.9K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
3.9K
Reliability and Validity01:29

Reliability and Validity

12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
Bonferroni Test01:10

Bonferroni Test

2.7K
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
2.7K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Examining Subtypes of Victimization in Saudi Arabia: A Comparative Analysis Across Gender Using PISA 2022.

Children (Basel, Switzerland)·2026
Same author

Sensitivity and Specificity of Common Autism Diagnostic Instruments for Early School-Aged Children.

Children (Basel, Switzerland)·2026
Same author

Modeling person guessing as a random effect: a Bayesian approach of the two-parameter logistic model.

Frontiers in psychology·2026
Same author

Initial validation of a pediatric cataplexy survey for children and adolescents with narcolepsy type 1.

Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine·2026
Same author

Cognitive Development in Children with Autism Spectrum Disorder and the Moderating Role of Intervention and ASD Persistence.

Behavioral sciences (Basel, Switzerland)·2025
Same author

Neurobehavioural Patterns in the Diagnosis of Autism Spectrum Disorder in Down Syndrome.

Journal of intellectual disability research : JIDR·2025

Related Experiment Video

Updated: Jul 8, 2025

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

789

Contrasting multistage and computer-based testing: score accuracy and aberrant responding.

Georgios Sideridis1,2, Hanan Ghamdi3, Omar Zamil3

  • 1Boston Children's Hospital, Harvard Medical School, Boston, MA, United States.

Frontiers in Psychology
|December 20, 2023
PubMed
Summary

Multistage testing (MST) offers significant advantages over traditional computer-based testing (CBT) by improving test score accuracy, particularly for individuals at lower and higher ability levels. This adaptive approach enhances assessment efficiency and reduces aberrant response patterns.

Keywords:
aberrant respondingcarelessnessguessingitem response theorymultistage testingperson fit statistics

More Related Videos

Computerized Adaptive Testing System of Functional Assessment of Stroke
05:21

Computerized Adaptive Testing System of Functional Assessment of Stroke

Published on: January 7, 2019

5.8K
RBDT: A Computerized Task System based in Transposition for the Continuous Analysis of Relational Behavior Dynamics in Humans
11:09

RBDT: A Computerized Task System based in Transposition for the Continuous Analysis of Relational Behavior Dynamics in Humans

Published on: July 17, 2021

3.0K

Related Experiment Videos

Last Updated: Jul 8, 2025

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

789
Computerized Adaptive Testing System of Functional Assessment of Stroke
05:21

Computerized Adaptive Testing System of Functional Assessment of Stroke

Published on: January 7, 2019

5.8K
RBDT: A Computerized Task System based in Transposition for the Continuous Analysis of Relational Behavior Dynamics in Humans
11:09

RBDT: A Computerized Task System based in Transposition for the Continuous Analysis of Relational Behavior Dynamics in Humans

Published on: July 17, 2021

3.0K

Area of Science:

  • Psychometrics
  • Educational Measurement
  • Computerized Adaptive Testing

Background:

  • Traditional computer-based testing (CBT) presents all items to all participants, regardless of ability.
  • This can lead to inefficiencies and potential response errors for individuals at the extremes of the ability spectrum.
  • Multistage testing (MST) offers a more adaptive approach to assessment design.

Purpose of the Study:

  • To compare the efficacy of a three-path multistage testing (MST) design against a traditional computer-based testing (CBT) approach.
  • To evaluate differences in person ability accuracy and aberrant responding between MST and CBT.
  • To determine the benefits of MST over CBT in educational and psychological measurement.

Main Methods:

  • A sample of 627 participants completed both a CBT instrument and an MST measure.
  • MST utilized adaptive routing to content appropriate for low, middle, and high ability levels.
  • Analyses focused on person ability accuracy estimates and aberrant response indicators, including Guttman-related errors.

Main Results:

  • MST assessments showed marked deviations from CBT, especially for low- and high-ability individuals.
  • Overall test score accuracy was higher in MST compared to CBT.
  • While MST enhanced accuracy, it also increased the error of measurement for high-ability individuals.
  • Fewer Guttman-related errors were observed in MST compared to CBT, as indicated by person-fit aberrant response indicators.

Conclusions:

  • MST demonstrates significant benefits over traditional CBT in terms of assessment accuracy and response patterns.
  • The adaptive nature of MST effectively routes individuals to relevant content, improving overall measurement.
  • Further research may explore optimizing MST designs to mitigate increased error of measurement for high-ability participants.