Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Shrinkage estimators for covariance matrices.

M J Daniels1, R E Kass

  • 1Department of Statistics, Iowa State University, Ames 50011, USA. mdaniels@iastate.edu

Biometrics
|January 5, 2002
PubMed
Summary

Shrinkage methods improve covariance matrix estimation in small samples, offering stable and efficient estimates for regression coefficients. These data-driven approaches balance structured and unstructured estimators for better performance.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Bayesian methods for nonignorable dropout in joint models in smoking cessation studies.

Journal of the American Statistical Association·2017
Same author

Temporally Segmented Directionality in the Motor Cortex.

Cerebral cortex (New York, N.Y. : 1991)·2017
Same author

Associations among sugar sweetened beverage intake, visceral fat, and cortisol awakening response in minority youth.

Physiology & behavior·2016
Same author

Covariance Partition Priors: A Bayesian Approach to Simultaneous Covariance Estimation for Longitudinal Data.

Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America·2016
Same author

Sparsity Inducing Prior Distributions for Correlation Matrices of Longitudinal Data.

Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America·2014
Same author

Computationally efficient banding of large covariance matrices for ordered data and connections to banding the inverse Cholesky factor.

Journal of multivariate analysis·2014

Area of Science:

  • Statistics
  • Biostatistics
  • Econometrics

Background:

  • Standard covariance matrix estimators (ML, REML) are unstable in small samples.
  • Structured estimators lack consistency if the structure is incorrect.
  • Sandwich estimators are robust but inefficient for large matrices.

Purpose of the Study:

  • To develop stable and efficient shrinkage-based covariance matrix estimators.
  • To improve estimation of regression coefficients with correlated data.
  • To provide data-driven methods balancing structured and unstructured approaches.

Main Methods:

  • Shrinking eigenvalues of unstructured estimators (ML/REML).
  • Shrinking unstructured estimators toward structured estimators.
  • Combining both shrinkage approaches, with data determining shrinkage intensity.

Main Results:

  • Shrinkage estimators are consistent and yield asymptotically efficient regression coefficient estimates.
  • Simulations demonstrate improved operating characteristics over standard methods.
  • A combined shrinkage approach (eigenvalue and structural) is proposed.

Conclusions:

  • Shrinkage estimators offer a robust and efficient alternative for covariance matrix estimation.
  • The proposed combined shrinkage method provides a practical compromise.
  • Recommended for inference in small samples, particularly in complex models like sleep EEG studies.

Related Experiment Videos