Related Experiment Video
Updated: Mar 9, 2026
12:18
A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
Published on: January 11, 2020
8.2K
Data-driven region-of-interest selection without inflating Type I error rate.
Joseph L Brooks1,2, Alexia Zoumpoulaki2,3, Howard Bowman2,3,4
1School of Psychology, University of Kent, Canterbury, UK.
Psychophysiology
|December 22, 2016
Summary
Data-driven methods for selecting regions of interest (ROIs) in neuroscience data can increase study power. The aggregate grand average from trials (AGAT) method is often safe, but avoid it when noise differs between conditions.
Area of Science:
- Neuroscience
- Cognitive Neuroscience
- Data Analysis
Background:
- Researchers analyzing large neuroscience datasets like event-related potentials (ERPs) select regions of interest (ROIs).
- ROI selection methods significantly impact study conclusions, potentially leading to missed effects or false positives.
- Traditional methods rely on a priori hypotheses or independent data, which can lack sensitivity to experiment-specific variations.
Purpose of the Study:
- To evaluate the power and validity of data-driven ROI selection methods in neuroscience.
- To compare data-driven approaches against traditional methods for ROI localization.
- To identify conditions under which data-driven ROI selection, specifically using the aggregate grand average from trials (AGAT), is reliable.
Main Methods:
- Simulations of simple event-related potential (ERP) experiments were used to assess ROI selection strategies.
- The study compared the statistical power of data-driven ROI selection against a priori or independent ROI selection.
- The aggregate grand average from trials (AGAT) method was specifically analyzed for its performance and limitations.
Main Results:
- Data-driven ROI selection demonstrated greater statistical power compared to a priori or independent methods in simulations.
- The AGAT method proved safe for ROI selection in many scenarios, despite using the analyzed data.
- However, the AGAT method inflated Type I error rates when significant noise differences existed between experimental conditions.
Conclusions:
- Data-driven ROI selection can enhance the power of neuroscience studies.
- The AGAT method is a viable data-driven approach for ROI selection under specific assumptions.
- Researchers and reviewers should carefully consider the assumptions and potential pitfalls of data-driven ROI methods, especially concerning noise differences between conditions.
More Related Videos
Related Concept Videos
01:13Accuracy and Errors in Hypothesis Testing
653
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
653
01:15Receiver Operating Characteristic Plot
543
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
543