Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Statistical Significance01:50

Statistical Significance

22.1K
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
22.1K
Probability in Statistics01:14

Probability in Statistics

23.5K
Probability is the likelihood of an event occurring. The term event is defined as a collection of results of a procedure. An event is a simple event when an outcome cannot be divided into simpler parts.
An example of a simple event is a coin toss. The result of a coin toss is either a head or a tail. Here, head and tail are two simple events. These two simple events make up the sample space. Further, the probability of an event occurring falls within the range of 0 to 1. The probability of an...
23.5K
Introduction to Statistics01:17

Introduction to Statistics

64.2K
The science of statistics involves collecting, analyzing, interpreting, and presenting data. The method of collecting, organizing, and summarizing data is called descriptive statistics. The systematic method of drawing inferences from the sample data and predicting unknown characteristics of a population is called inferential statistics.
In statistics, the collection of individuals or objects under study is called population. The idea of sampling is to select a portion of the larger population...
64.2K
Statistical Analysis: Overview01:11

Statistical Analysis: Overview

16.6K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
16.6K
Identifying Statistically Significant Differences: The F-Test01:14

Identifying Statistically Significant Differences: The F-Test

3.9K
The F-test is used to compare two sample variances to each other or compare the sample variance to the population variance. It is used to decide whether an indeterminate error can explain the difference in their values. The underlying assumptions that allow the use of the F-test include the data set or sets are normally distributed, and the data sets are independent of each other. The test statistic F is calculated by dividing one variance by another. In other words, the square of one standard...
3.9K
Introduction to Nonparametric Statistics01:28

Introduction to Nonparametric Statistics

1.4K
Nonparametric statistics offer a powerful alternative to traditional parametric methods, useful when assumptions about the population distribution cannot be made. Unlike parametric tests, which require data to follow a specific distribution with well-defined parameters (such as the mean and standard deviation), nonparametric tests do not require such constraints. This makes them particularly valuable when dealing with small sample sizes, skewed data, or ordinal and categorical variables.
One of...
1.4K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A supervised learning approach to estimating IRT models in small samples.

The British journal of mathematical and statistical psychology·2025
Same author

Detecting Examinees With Item Preknowledge on Real Data.

Applied psychological measurement·2022
Same author

Graph Theory Approach to Detect Examinees Involved in Test Collusion.

Applied psychological measurement·2021
Same author

On the Optimality of the Detection of Examinees With Aberrant Answer Changes.

Applied psychological measurement·2018
Same author

Distributions of the Kullback-Leibler divergence with applications.

The British journal of mathematical and statistical psychology·2011

Related Experiment Video

Updated: Feb 9, 2026

A High Performance Impedance-based Platform for Evaporation Rate Detection
06:39

A High Performance Impedance-based Platform for Evaporation Rate Detection

Published on: October 17, 2016

6.9K

Comparing the Performance of Eight Item Preknowledge Detection Statistics.

Dmitry I Belov1

  • 1Law School Admission Council, Newtown, PA, USA.

Applied Psychological Measurement
|June 9, 2018
PubMed
Summary

Item preknowledge compromises test validity. This study analyzes how uncertainty in detecting compromised items impacts statistical detection methods, crucial for maintaining test integrity in educational and professional settings.

Keywords:
Kullback–Leibler divergenceNeyman–Pearson lemmaROChypothesis testingitem preknowledgelzperson fitperson misfittest security

More Related Videos

Leveraging CyVerse Resources for De Novo Comparative Transcriptomics of Underserved Non-model Organisms
10:41

Leveraging CyVerse Resources for De Novo Comparative Transcriptomics of Underserved Non-model Organisms

Published on: May 9, 2017

9.6K
Array Comparative Genomic Hybridization Array CGH for Detection of Genomic Copy Number Variants
09:16

Array Comparative Genomic Hybridization Array CGH for Detection of Genomic Copy Number Variants

Published on: February 21, 2015

20.5K

Related Experiment Videos

Last Updated: Feb 9, 2026

A High Performance Impedance-based Platform for Evaporation Rate Detection
06:39

A High Performance Impedance-based Platform for Evaporation Rate Detection

Published on: October 17, 2016

6.9K
Leveraging CyVerse Resources for De Novo Comparative Transcriptomics of Underserved Non-model Organisms
10:41

Leveraging CyVerse Resources for De Novo Comparative Transcriptomics of Underserved Non-model Organisms

Published on: May 9, 2017

9.6K
Array Comparative Genomic Hybridization Array CGH for Detection of Genomic Copy Number Variants
09:16

Array Comparative Genomic Hybridization Array CGH for Detection of Genomic Copy Number Variants

Published on: February 21, 2015

20.5K

Area of Science:

  • Psychometrics
  • Educational Measurement
  • Statistical Analysis

Background:

  • Item preknowledge, where examinees access test items beforehand, invalidates scores and compromises testing programs.
  • Detecting item preknowledge is challenging due to unknown aberrant examinees, locations, and item subsets.
  • Existing statistical methods for detecting compromised items yield a 'suspicious subset' with inherent uncertainty.

Purpose of the Study:

  • To evaluate the impact of uncertainty in the suspicious subset on the performance of eight statistical detection methods.
  • To understand how various factors influence the effectiveness of these detection statistics.

Main Methods:

  • Performance assessment using receiver operating characteristic (ROC) curves.
  • Computer simulations to model the effects of uncertainty and independent variables on statistic performance.

Main Results:

  • Uncertainty in the suspicious subset significantly affects the performance of statistical detection methods.
  • The impact of uncertainty varies depending on factors like test type and aberrant examinee distribution.
  • Simulations quantified the performance degradation across different statistics under varying uncertainty levels.

Conclusions:

  • The performance of statistical methods for detecting compromised items is sensitive to uncertainty in the identified suspicious item subset.
  • Understanding these performance impacts is vital for developing robust detection strategies in high-stakes testing.
  • Further research should focus on mitigating the effects of uncertainty in item preknowledge detection.