Related Experiment Video
Updated: Mar 14, 2026
Author Spotlight: Capturing Infant-Caregiver Interactions Through Synchronized Multimodal Data Collection
Published on: May 31, 2024
Characteristics of EEG Interpreters Associated With Higher Interrater Agreement
Jonathan J Halford1, Amir Arain, Giridhar P Kalamangalam
1*Department of Neurology, Medical University of South Carolina, Charleston, South Carolina, U.S.A.; †Department of Neurology, Vanderbilt University, Nashville, Tennessee, U.S.A.; ‡Department of Neurology, University of Texas Health Science Center of Huston, Huston, Texas, U.S.A.; §Mission Health, Asheville, North Carolina, U.S.A.; ‖Department of Neurology, Wayne State University and Detroit Medical Center, Detroit, Michigan, U.S.A.; ¶Academic Health System, Hamad Medical Corporation, Doha, Qatar; #Norton Neurology Services, Louisville, Kentucky, U.S.A.; **Department of Public Health Sciences, Medical University of South Carolina, Charleston, South Carolina, U.S.A.; and ††School of Computing, Clemson University, Clemson, South Carolina, U.S.A.
Purpose:
The goal of the project is to determine characteristics of academic neurophysiologist EEG interpreters (EEGers), which predict good interrater agreement (IRA) and to determine the number of EEGers needed to develop an ideal standardized testing and training data set for epileptiform transient (ET) detection algorithms.
Methods:
A three-phase scoring method was used. In phase 1, 19 EEGers marked the location of ETs in two hundred 30-second segments of EEG from 200 different patients. In phase 2, EEG events marked by at least 2 EEGers were annotated by 18 EEGers on a 5-point scale to indicate whether they were ETs. In phase 3, a third opinion was obtained from EEGers on any inconsistencies between phase 1 and phase 2 scoring.
Results:
The IRA for the 18 EEGers was only fair. A select group of the EEGers had good IRA and the other EEGers had low IRA. Board certification by the American Board of Clinical Neurophysiology was associated with better IRA performance but other board certifications, years of fellowship training, and years of practice were not. As the number of EEGers used for scoring is increased, the amount of change in the consensus opinion decreases steadily and is quite low as the group size approaches 10.
Conclusions:
The IRA among EEGers varies considerably. The EEGers must be tested before use as scorers for ET annotation research projects. The American Board of Clinical Neurophysiology certification is associated with improved performance. The optimal size for a group of experts scoring ETs in EEG is probably in the 6 to 10 range.
More Related Videos
08:40Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
Published on: June 12, 2019
10:22Interictal High Frequency Oscillations Detected with Simultaneous Magnetoencephalography and Electroencephalography as Biomarker of Pediatric Epilepsy
Published on: December 6, 2016
