Related Experiment Video
Updated: May 7, 2026
07:57
Quantification of Protein Interaction Network Dynamics using Multiplexed Co-Immunoprecipitation
Published on: August 21, 2019
Estimating the Proportion of True Null Hypotheses Using the Pattern of Observed p-values
Tiejun Tong1, Zeny Feng, Julia S Hilton
1Department of Mathematics, Hong Kong Baptist University, Hong Kong ; Institute of Computational and Theoretical Studies, Hong Kong Baptist University, Hong Kong.
Journal of Applied Statistics
|October 1, 2013
Summary
This study introduces new data-driven methods to estimate the proportion of true null hypotheses (π₀), improving accuracy even when statistical tests are dependent. These methods reduce variance for better performance in multiple testing procedures.
Area of Science:
- Statistics
- Bioinformatics
- Genomics
Background:
- Estimating the proportion of true null hypotheses (π₀) is crucial for multiple testing procedures.
- Existing methods often assume independence of test statistics, which is frequently violated in real-world data.
- This violation can lead to poor performance and increased variance in π₀ estimators.
Purpose of the Study:
- To develop novel data-driven methods for estimating π₀ that account for dependence among test statistics.
- To improve the accuracy and reduce the variance of π₀ estimation.
Main Methods:
- Proposed data-driven approaches incorporating the distribution of observed p-values.
- Utilized a linear fit to estimate the proportion of true-null p-values across the entire range [0, 1].
- Addressed potential dependence among test statistics by analyzing p-value distribution patterns.
Main Results:
- The proposed estimators demonstrated a substantial decrease in the variance of the estimated true null proportion.
- The new methods showed improved overall performance compared to existing estimators under dependent test statistics.
- Data-driven estimation using p-value distributions proved effective in handling statistical dependencies.
Conclusions:
- The developed methods offer a practical and robust approach to estimating π₀, particularly in scenarios with dependent test statistics.
- These findings have significant implications for enhancing the reliability of multiple testing procedures in various scientific fields.
- The proposed estimators provide a more stable and accurate estimation of the true null proportion, leading to more reliable scientific conclusions.
Related Concept Videos
01:09Decision Making: P-value Method
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can have a...
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can have a...
01:10P-value
P-value is one of the most crucial concepts in statistics.
P-value stands for the probability value. P-value is the probability that, if the null hypothesis is true, the results from another randomly selected sample will be as extreme or more extreme as the results obtained from the given sample.
A large P-value calculated from the data indicates to not reject the null hypothesis. But a higher P-value does not mean that the null hypothesis is true. The smaller the P-value, the more unlikely...
P-value stands for the probability value. P-value is the probability that, if the null hypothesis is true, the results from another randomly selected sample will be as extreme or more extreme as the results obtained from the given sample.
A large P-value calculated from the data indicates to not reject the null hypothesis. But a higher P-value does not mean that the null hypothesis is true. The smaller the P-value, the more unlikely...
01:24Testing a Claim about Population Proportion
A complete procedure for testing a claim about a population proportion is provided here.
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
01:14Decision Making: Traditional Method
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
01:14Errors In Hypothesis Tests
When performing a hypothesis test, there are four possible outcomes depending on the actual truth (or falseness) of the null hypothesis and the decision to reject or not.
01:11Types of Hypothesis Testing
There are three types of hypothesis tests: right-tailed, left-tailed, and two-tailed.
When the null and alternative hypotheses are stated, it is observed that the null hypothesis is a neutral statement against which the alternative hypothesis is tested. The alternative hypothesis is a claim that instead has a certain direction. If the null hypothesis claims that p = 0.5, the alternative hypothesis would be an opposing statement to this and can be put either p > 0.5, p < 0.5, or p ≠ 0.5.
When the null and alternative hypotheses are stated, it is observed that the null hypothesis is a neutral statement against which the alternative hypothesis is tested. The alternative hypothesis is a claim that instead has a certain direction. If the null hypothesis claims that p = 0.5, the alternative hypothesis would be an opposing statement to this and can be put either p > 0.5, p < 0.5, or p ≠ 0.5.