Related Experiment Videos
The quantitative evaluation of functional neuroimaging experiments: mutual information learning curves
U Kjems1, L K Hansen, J Anderson
1Department of Mathematical Modelling, Technical University of Denmark, DK-2800 Lyngby, Denmark. uk@oticon.dk
Neuroimage
|March 22, 2002
Summary
This study introduces learning curves for unbiased neuroimaging model evaluation. These curves assess predictive performance and aid in understanding model bias and variance for improved data analysis.
Area of Science:
- Neuroimaging Data Analysis
- Machine Learning in Neuroscience
- Statistical Modeling
Background:
- Evaluating neuroimaging model performance requires unbiased methods.
- Learning curves offer a robust approach to assess generalization error.
- Cross-validation is crucial for reliable performance estimation.
Purpose of the Study:
- To present learning curves as an unbiased method for evaluating neuroimaging analysis models.
- To demonstrate the application of mutual information for quantifying prediction error.
- To explore bias/variance trade-offs and sensitivity mapping in model performance.
Main Methods:
- Utilized cross-validation resampling for unbiased estimates of a multivariate Gaussian classifier.
- Applied learning curves to [(15)O]water PET data across four activation experiments.
- Expressed prediction error using mutual information, measured in bits.
Main Results:
- Demonstrated the utility of mutual information learning curves for evaluating methodological choices.
- Showcased the sensitivity map as a method for extracting activation maps.
- Illustrated the link between mutual information and pattern reproducibility.
Conclusions:
- Learning curves provide an unbiased framework for neuroimaging model performance assessment.
- Mutual information offers a quantifiable measure of prediction error in neuroimaging.
- The presented methods enhance understanding of model bias, variance, and activation patterns.