Regularized sandwich estimators for analysis of high-dimensional data using generalized estimating equations
Related Experiment Video
Updated: Jun 12, 2026

Quantification of Information Encoded by Gene Expression Levels During Lifespan Modulation Under Broad-range Dietary Restriction in C. elegans
Published on: August 16, 2017
1School of Mathematics and Statistics and Evolution and Ecology Research Centre, The University of New South Wales, NSW 2052, Australia. David.Warton@unsw.edu.au
Abstract:
A modification of generalized estimating equations (GEEs) methodology is proposed for hypothesis testing of high-dimensional data, with particular interest in multivariate abundance data in ecology, an important application of interest in thousands of environmental science studies. Such data are typically counts characterized by high dimensionality (in the sense that cluster size exceeds number of clusters, n>K) and over-dispersion relative to the Poisson distribution. Usual GEE methods cannot be applied in this setting primarily because sandwich estimators become numerically unstable as n increases. We propose instead using a regularized sandwich estimator that assumes a common correlation matrix R, and shrinks the sample estimate of R toward the working correlation matrix to improve its numerical stability. It is shown via theory and simulation that this substantially improves the power of Wald statistics when cluster size is not small. We apply the proposed approach to study the effects of nutrient addition on nematode communities, and in doing so discuss important issues in implementation, such as using statistics that have good properties when parameter estimates approach the boundary (), and using resampling to enable valid inference that is robust to high dimensionality and to possible model misspecification.
Related Concept Videos
One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation
On...
Friedman Two-way Analysis of Variance by Ranks
Statistical Methods for Analyzing Epidemiological Data
Expected Frequencies in Goodness-of-Fit Tests
Distributions to Estimate Population Parameter
Estimating Population Mean with Unknown Standard Deviation
William S. Gosset (1876–1937) of the Guinness...
