Reliability of ERP and single-trial analyses

A reliable measure is one we can trust in the long run. Thus, the reliability of measurements is as important as their validity. Here we investigated the reliability of brain electrical visual evoked responses to faces and noise textures. For the first time, we provide reliability measures for the full time course of event-related potentials (ERPs). Our analyses were also performed on a R(2)(t) metric that reflects results from single-trial analyses, therefore providing the first reliability analysis of ERP single-trial analyses. Results show that ERPs and R(2)(t) are highly reliable (cross-correlation ~0.9, lag ~4/6ms, intra-class correlation ~0.9) but also idiosyncratic: ERPs and R(2)(t) are highly reproducible within subjects, who differ reliably from each other and the grand average across subjects. Consequently, grand averages, although highly reliable, can be misleading because they might not reflect the actual brain dynamic of any subjects.