Unveiling variability: A systematic review of reproducibility in visual EEG analysis, with focus on seizures
View abstract on PubMed
Summary
This summary is machine-generated.Reproducibility of visual electroencephalogram (EEG) analysis is variable. Experienced raters show substantial-to-perfect interrater reliability for seizure detection using raw EEG, but this decreases with inexperienced raters or transformed EEG.
Area Of Science
- Neurology
- Medical Imaging Analysis
- Clinical Diagnostics
Background
- Reproducibility is critical for diagnostic tests relying on expert subjective evaluation.
- Visual analysis of clinical electroencephalograms (EEGs) is a common diagnostic method.
- Systematic reviews are needed to assess the reliability of EEG interpretation.
Purpose Of The Study
- To systematically review the reproducibility of visual analysis in clinical electroencephalograms (EEGs).
- To determine the scope of EEG features evaluated and provide detailed reproducibility data for the most studied features.
Main Methods
- A comprehensive search of four databases was conducted for articles on clinical EEG reproducibility up to June 2023.
- 27,553 citations were screened, followed by full-text review of 2,736 articles.
- Study quality was assessed using the GRRAS guidelines.
Main Results
- 275 studies addressed 606 EEG features; only 38 were studied in more than two papers.
- Seizure detection, the most studied feature (62 papers), showed substantial-to-almost-perfect interrater reproducibility (kappa .62-.88) with experienced raters and raw EEG.
- Reproducibility was lower for inexperienced raters, transformed EEG, and seizure lateralization (kappa .58-.77).
Conclusions
- Most EEG reproducibility studies are limited, with rare intrarater assessments.
- Visual EEG analysis reproducibility is variable, particularly between raters and within the same rater.
- There is a need for larger collaborative studies with improved methodology and more intrarater evaluations.

