Related Experiment Video
Updated: Mar 13, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
ERP Reliability Analysis (ERA) Toolbox: An open-source toolbox for analyzing the reliability of event-related brain
Peter E Clayson1, Gregory A Miller2
1Department of Psychology, University of California Los Angeles, Los Angeles, CA, United States.
Abstract:
Generalizability theory (G theory) provides a flexible, multifaceted approach to estimating score reliability. G theory's approach to estimating score reliability has important advantages over classical test theory that are relevant for research using event-related brain potentials (ERPs). For example, G theory does not require parallel forms (i.e., equal means, variances, and covariances), can handle unbalanced designs, and provides a single reliability estimate for designs with multiple sources of error. This monograph provides a detailed description of the conceptual framework of G theory using examples relevant to ERP researchers, presents the algorithms needed to estimate ERP score reliability, and provides a detailed walkthrough of newly-developed software, the ERP Reliability Analysis (ERA) Toolbox, that calculates score reliability using G theory. The ERA Toolbox is open-source, Matlab software that uses G theory to estimate the contribution of the number of trials retained for averaging, group, and/or event types on ERP score reliability. The toolbox facilitates the rigorous evaluation of psychometric properties of ERP scores recommended elsewhere in this special issue.
More Related Videos
09:39An Open-Source, Fully Customizable 5-Choice Serial Reaction Time Task Toolbox for Automated Behavioral Training of Rodents
Published on: January 19, 2022
08:59The Other End of the Leash: An Experimental Test to Analyze How Owners Interact with Their Pet Dogs
Published on: October 13, 2017
Related Concept Videos
Reliability and Validity
Self-Report Tests of Personality
Friedman Two-way Analysis of Variance by Ranks
Spearman's Rank Correlation Test
Spearman's test calculates correlation by...
Fisher's Exact Test
Microsoft Excel: Pearson's Correlation