Jove
Visualize
Contact Us

Related Concept Videos

Detection of Gross Error: The Q Test01:00

Detection of Gross Error: The Q Test

6.4K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.4K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A supervised learning approach to estimating IRT models in small samples.

The British journal of mathematical and statistical psychology·2025
Same author

Graph Theory Approach to Detect Examinees Involved in Test Collusion.

Applied psychological measurement·2021
See all related articles
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Sep 22, 2025

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
08:33

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences

Published on: September 4, 2019

7.1K

Detecting Examinees With Item Preknowledge on Real Data.

Dmitry I Belov1, Sarah L Toton2

  • 1Psychometric Research, Law School Admission Council, Newtown, PA, USA.

Applied Psychological Measurement
|May 23, 2022
PubMed
Summary
This summary is machine-generated.

This study enhances methods for detecting cheating on tests by analyzing response patterns. Combining answer similarity and response times effectively identifies examinees with item preknowledge (IP).

Keywords:
clique detectorgraph theoryitem preknowledgeresponse similarity indextest security

More Related Videos

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
10:26

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

4.1K
A Real-world What-Where-When Memory Test
09:13

A Real-world What-Where-When Memory Test

Published on: May 16, 2017

11.5K

Related Experiment Videos

Last Updated: Sep 22, 2025

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
08:33

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences

Published on: September 4, 2019

7.1K
Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
10:26

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

4.1K
A Real-world What-Where-When Memory Test
09:13

A Real-world What-Where-When Memory Test

Published on: May 16, 2017

11.5K

Area of Science:

  • Educational Measurement
  • Psychometrics
  • Data Science

Background:

  • Graph theory offers a novel approach to detecting collusive behavior among test-takers.
  • Existing methods for identifying collusion may not fully leverage response patterns and timing data.
  • Item preknowledge (IP) presents a unique challenge in detecting sophisticated cheating methods.

Purpose of the Study:

  • To evaluate the performance of a graph-based collusion detection method using real-world data.
  • To investigate the impact of different response similarity indices (RSIs) on detecting examinees with item preknowledge (IP).
  • To develop and validate new RSIs tailored for identifying collusion.

Main Methods:

  • Utilized a graph-based approach, representing examinees and their responses as nodes and edges.
  • Developed and compared three novel response similarity indices (RSIs) for edge formation.
  • Incorporated both response accuracy and response times into the RSI calculations.
  • Applied the method to real-world test data exhibiting item preknowledge (IP).

Main Results:

  • The performance of the graph-based method is sensitive to the chosen RSI.
  • Three new RSIs were developed, showing improved detection capabilities.
  • Combining response data and response times significantly enhanced the detection of examinees with IP.
  • The study identified specific RSIs that are more effective in detecting collusion.

Conclusions:

  • The graph-based collusion detection method is a promising tool for educational assessment.
  • Integrating response times with answer similarity provides a powerful advantage for identifying item preknowledge (IP).
  • Recommendations for practitioners and suggestions for future research directions were provided.