Testing for inequality constraints in singular models by trimming or winsorizing the variance matrix
Ori Davidov1, Casey M Jelsema2, Shyamal Peddada3
1Department of Statistics, University of Haifa, Mount Carmel, Haifa 31905 Israel.
Journal of the American Statistical Association
|October 23, 2020
Summary
This study introduces a new statistical framework for analyzing data with nearly singular variance matrices, addressing limitations in constrained hypothesis testing for scientific research. The method offers a unified approach for ordered alternatives in various statistical models.
Area of Science:
- Statistics
- Bioinformatics
- Genomics
Background:
- Many statistical applications involve normal distributions with singular or nearly singular variance matrices, common in linear regression with multicollinearity.
- Existing methods effectively test linear equality constraints for two-sided alternatives, but lack corresponding approaches for one-sided (ordered) alternatives.
- There is increasing interest in statistical methods for nearly singular variance matrices, highlighting a gap in handling constrained alternatives.
Purpose of the Study:
- To develop a unified statistical framework for analyzing problems with nearly singular variance matrices under one-sided (ordered) alternatives.
- To extend existing methodologies for hypothesis testing to accommodate inequality constraints in statistical models.
- To provide a robust approach applicable to diverse scientific and statistical modeling scenarios.
Main Methods:
- The proposed methodology involves a unified framework for analyzing statistical problems with nearly singular variance matrices.
- The core technique is described as trimming or winsorizing the eigenvalues of the relevant variance matrix.
- The approach is designed to handle inequality constraints arising in various statistical models.
Main Results:
- A unified framework for analyzing one-sided hypothesis testing with nearly singular variance matrices has been developed.
- The methodology provides a means to address inequality constraints in statistical models where variance matrices are singular or nearly singular.
- The approach is demonstrated to be applicable across a broad spectrum of scientific problems.
Conclusions:
- The developed methodology offers a significant advancement for statistical inference in situations with nearly singular variance matrices and ordered alternatives.
- This unified framework enhances the analysis of scientific data, particularly in fields like genomics and bioinformatics.
- The eigenvalue trimming/winsorizing approach provides a versatile tool for statistical modeling involving inequality constraints.
Related Concept Videos
Quantifying and Rejecting Outliers: The Grubbs Test
3.3K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
3.3K
Truncation in Survival Analysis
446
Truncation in survival analysis refers to the exclusion of individuals or events from the dataset based on specific criteria related to the time of the event. This exclusion can happen in two primary forms: left truncation and right truncation.
Left truncation occurs when individuals who experienced the event of interest before a certain time are not included in the study. This is often due to a "delayed entry" into the study where only those who survive until a certain entry point are...
Left truncation occurs when individuals who experienced the event of interest before a certain time are not included in the study. This is often due to a "delayed entry" into the study where only those who survive until a certain entry point are...
446
One-Way ANOVA: Unequal Sample Sizes
6.4K
One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:
6.4K
Testing a Claim about Standard Deviation
2.7K
A complete procedure to test a claim about population standard deviation or population variance is explained here.
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
2.7K
One-Way ANOVA: Equal Sample Sizes
3.8K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
3.8K
Gaussian Elimination: Problem Solving
86
Systems of linear equations in several variables are pivotal in modeling complex scenarios involving multiple unknowns and constraints. Such systems are widely used in various fields to represent relationships where several conditions must be simultaneously satisfied. Each variable in the system corresponds to an unknown quantity, while each equation imposes a linear constraint, leading to a structured approach for analyzing and solving real-world problems.A system of three equations with three...
86


