Related Experiment Video
Updated: Jun 10, 2026

The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups
Published on: May 13, 2022
General solutions to consistency problems in multiple hypothesis testing
Haibing Zhao1, Bushi Wang, Xinping Cui
1Shanghai University of Finance and Economics, P R China.
Abstract:
Coherence and consonance are the two important concepts to ensure consistent conclusions drawn from multiple tests. Unlike coherence, consonance of a multiple testing procedure (MTP) has not yet received much attention. Although most of the MTPs used in practice are consonant, cases still exist that dissonant tests have to be used due to their unique advantages, for example, the likelihood ratio tests and sum tests. Consonance adjustments are necessary for such tests to avoid difficulty in interpretation. Moreover, in terms of detecting elementary hypotheses, a consonant test procedure is uniformly more powerful than the corresponding dissonant one. In this paper, several general methods using the partitioning principle to construct (strongly) consonant and strongly coherent MTPs are proposed. As a result, any dissonant (but coherent) multiple level α test can be improved by a consonant one without any cost in terms of inferences on elementary hypotheses.
Related Concept Videos
Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5% chance...
Errors In Hypothesis Tests
Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
Bonferroni Test
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
Statistical Hypothesis Testing
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
Types of Hypothesis Testing
When the null and alternative hypotheses are stated, it is observed that the null hypothesis is a neutral statement against which the alternative hypothesis is tested. The alternative hypothesis is a claim that instead has a certain direction. If the null hypothesis claims that p = 0.5, the alternative hypothesis would be an opposing statement to this and can be put either p > 0.5, p < 0.5, or p ≠ 0.5.
