Related Experiment Video
Updated: Feb 27, 2026

Testing for Metacognitive Responding Using an Odor-based Delayed Match-to-Sample Test in Rats
Published on: June 18, 2018
A single error is one too many: Examining alternative cutoffs on Trial 2 of the TOMM
Laszlo A Erdodi1, Jaspreet K Rai1
1a Department of Psychology , University of Windsor , Windsor , ON , Canada.
Objective:
This study investigated the potential of alternative, more liberal cutoffs on Trial 2 of the Test of Memory Malingering (TOMM) to improve classification accuracy relative to the standard cutoffs (≤44).
Method:
The sample consisted of 152 patients (49.3% male) with psychiatric conditions (PSY) and traumatic brain injury (TBI) referred for neuropsychological assessment in a medico-legal setting (MAge = 44.4, MEducation = 11.9 years). Classification accuracy for various TOMM Trial 2 cutoffs was computed against three criterion measures.
Results:
Patients with TBI failed TOMM Trial 2 cutoffs at higher rates than patients with PSY. Trial 2 ≤49 achieved acceptable combinations of sensitivity (0.38-0.67) and specificity (0.89-0.96) in all but one comparison group. Trial 2 ≤48 improved specificity (0.94-0.98) with minimal loss in sensitivity. The standard cutoff (≤44) disproportionally traded sensitivity (0.15-0.50) for specificity (0.96-1.00).
Conclusions:
One error on TOMM Trial 2 constitutes sufficient evidence to question the credibility of a response set. However, the confidence in classifying a score as invalid continues to increase with each additional error. Even at the most liberal conceivable cutoff (≤49), the TOMM detected only about half of the patients who failed other criterion measures. Therefore, it should never be used in isolation to determine performance validity.
More Related Videos
09:00Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
Published on: August 16, 2024
05:58Using Rapid Serial Visual Presentation to Measure Set-Specific Capture, a Consequence of Distraction While Multitasking
Published on: August 29, 2018
Related Concept Videos
Quantifying and Rejecting Outliers: The Grubbs Test
Bonferroni Test
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
Detection of Gross Error: The Q Test
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Comparing Experimental Results: Student's t-Test
Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...