Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Friedman Two-way Analysis of Variance by Ranks01:21

Friedman Two-way Analysis of Variance by Ranks

310
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
310
Quantifying and Rejecting Outliers: The Grubbs Test01:02

Quantifying and Rejecting Outliers: The Grubbs Test

2.2K
Sometimes, a data set can have a recorded numerical observation that greatly  deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier.  To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
2.2K
Sign Test for Matched Pairs01:17

Sign Test for Matched Pairs

216
The sign test for matched pairs offers a robust method for comparing two paired samples, often for the effects of an intervention in one of them. This method is very useful in situations where the underlying distribution of the data is unknown. The test compares two related samples—often pre- and post-treatment measurements on the same subjects—to determine if there are significant differences in their median values.
To conduct the sign test, we first calculate the differences in...
216
Wilcoxon Rank-Sum Test01:21

Wilcoxon Rank-Sum Test

355
The Wilcoxon rank-sum test, also known as the Mann-Whitney U test, is a nonparametric test used to determine if there is a significant difference between the distributions of two independent samples. This test is designed specifically for two independent populations and has the following key requirements:
355
Wald-Wolfowitz Runs Test I01:17

Wald-Wolfowitz Runs Test I

749
The Wald-Wolfowitz test, also known as the runs test, is a nonparametric statistical test used to assess the randomness of a sequence of two different types of elements (e.g., positive/negative values, successes/failures). It examines whether the order of the elements in a sequence is random or if there is a pattern or trend present. This nonparametric test applies to any ordered data despite the population and sample data distribution, even if a higher sample size is available.
The test works...
749
Wald-Wolfowitz Runs Test II01:17

Wald-Wolfowitz Runs Test II

330
The Wald-Wolfowitz runs test, commonly referred to as the runs test, is a nonparametric test used to assess the randomness of ordered data. The test evaluates the number of runs, which are consecutive sequences of similar elements within the data. If the number of runs is significantly higher or lower than expected, the data is considered non-random, indicating a detectable pattern or structure.
For binary data, runs are identified using symbols such as + and −, or equivalently, 1s and...
330

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Latent Poisson count models for action count data from technology-enhanced assessments.

The British journal of mathematical and statistical psychology·2026
Same author

A Latent Markov Model for Noninvariant Measurements: An Application to Interaction Log Data From Computer-Interactive Assessments.

Psychometrika·2025
Same author

Location-Matching Adaptive Testing for Polytomous Technology-Enhanced Items.

Applied psychological measurement·2024
Same author

Flow with an intelligent tutor: A latent variable modeling approach to tracking flow during artificial tutoring.

Behavior research methods·2023
Same author

Polytomous Testlet Response Models for Technology-Enhanced Innovative Items: Implications on Model Fit and Trait Inference.

Educational and psychological measurement·2022
Same author

Computerized adaptive testing for testlet-based innovative items.

The British journal of mathematical and statistical psychology·2021
Same journal

BAYESIAN MIXED MULTIDIMENSIONAL SCALING FOR AUDITORY PROCESSING.

Psychometrika·2026
Same journal

Testing linear hypotheses in repeated measures generalized linear models using external information.

Psychometrika·2026
Same journal

When Do Unifactorial Items Increase the Reliability?

Psychometrika·2026
Same journal

Longitudinal Designs for Diagnostic Models: Identification and Estimation.

Psychometrika·2026
Same journal

Modeling Rare Events and Nonmonotone Nonignorable Missingness of Time-Varying Outcomes and Predictors in Binary Time-Series Daily Diary Data: A Bayesian Selection Model.

Psychometrika·2026
Same journal

Revelle's Beta: The Wait Is Over-Computation Becomes Possible.

Psychometrika·2026
See all related articles

Related Experiment Video

Updated: Sep 21, 2025

Methods to Test Visual Attention Online
09:44

Methods to Test Visual Attention Online

Published on: February 19, 2015

12.0K

Sequential Generalized Likelihood Ratio Tests for Online Item Monitoring.

Hyeon-Ah Kang1

  • 1University of Texas at Austin, Austin, USA. hkang@austin.utexas.edu.

Psychometrika
|June 6, 2022
PubMed
Summary
This summary is machine-generated.

This study introduces statistical methods for monitoring item functioning over time. These generalized likelihood ratio tests effectively detect parameter shifts, ensuring item quality control with superior performance.

Keywords:
cumulative sum control chartitem parameter driftonline monitoringresponse timesequential generalized likelihood ratio test

More Related Videos

Lexical Decision Task for Studying Written Word Recognition in Adults with and without Dementia or Mild Cognitive Impairment
06:48

Lexical Decision Task for Studying Written Word Recognition in Adults with and without Dementia or Mild Cognitive Impairment

Published on: June 25, 2019

9.3K
A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
12:18

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

7.6K

Related Experiment Videos

Last Updated: Sep 21, 2025

Methods to Test Visual Attention Online
09:44

Methods to Test Visual Attention Online

Published on: February 19, 2015

12.0K
Lexical Decision Task for Studying Written Word Recognition in Adults with and without Dementia or Mild Cognitive Impairment
06:48

Lexical Decision Task for Studying Written Word Recognition in Adults with and without Dementia or Mild Cognitive Impairment

Published on: June 25, 2019

9.3K
A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
12:18

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

7.6K

Area of Science:

  • Statistical monitoring
  • Psychometrics
  • Quality control

Background:

  • Monitoring item functioning over time is crucial for maintaining assessment quality.
  • Existing methods may lack efficiency in detecting parameter drift across multiple item parameters.

Purpose of the Study:

  • To propose and validate statistical procedures for monitoring item functioning and parameter stability over time.
  • To develop generalized likelihood ratio tests for continuous or intermittent surveillance of item parameters.
  • To provide practical strategies for online item monitoring.

Main Methods:

  • Utilized generalized likelihood ratio tests to surveil multiple item parameters.
  • Implemented various sampling techniques for continuous or intermittent monitoring.
  • Validated procedures using simulated and real-assessment data.

Main Results:

  • The proposed procedures adequately identified parameter drift with satisfactory detection power.
  • Timely signals were generated while maintaining reasonably low error rates.
  • Demonstrated superior performance compared to existing methods.

Conclusions:

  • Multivariate parametric monitoring offers an efficient and powerful tool for quality control of items.
  • Joint monitoring of multiple item parameters using likelihood-ratio tests achieves sufficient statistical power.
  • The study provides practical strategies for effective online item monitoring.