Related Experiment Video
Updated: Jun 28, 2025

Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment
Published on: April 19, 2024
Use one system for all results to avoid contradiction: Advice for using significance tests, equivalence tests, and
1School of Psychology, University of Sussex.
Abstract:
A nonsignificant result against an H0 of no effect does not distinguish evidence for no effect from no evidence at all one way or the other. Thus, a researcher engaged primarily in significance testing may decide to follow up just the nonsignificant results with a test from another system of inference, such as equivalence tests (more generally, inference by intervals) or Bayes factors. However, selectively using two systems of inference in this way, can lead to inferential inconsistency because different tests are based on different principles, and therefore a researcher can be tempted to select the way each system is used to get the results the researcher wants for just the tests that system is applied to. For a related set of tests, one system of inference should be consistently used. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Related Concept Videos
Significance Testing: Overview
Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
Bonferroni Test
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
Statistical Hypothesis Testing
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...

