Equivalence Tests: A Practical Primer for t Tests, Correlations, and Meta-Analyses.

Daniël Lakens1

  • 1Human Technology Interaction Group, Eindhoven University of Technology, Eindhoven, the Netherlands.

Summary

Researchers can now test for the absence of meaningful effects using equivalence tests. This method, including the two one-sided tests (TOST) procedure, helps avoid incorrectly concluding no effect exists based on nonsignificant results.

Related Concept Videos

Comparing Experimental Results: Student's t-Test01:09

Comparing Experimental Results: Student's t-Test

The t-test is a statistical method used to compare the sample mean with a population mean or compare two means from two data sets. The test statistic is calculated from the standard deviation, mean, and number of measurements in the data set at a selected confidence interval and then compared to a table of critical values at this confidence level. If the test statistic is smaller than the critical value, the null hypothesis is accepted. In this case, we state that the difference between the...
6.1K
Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test01:09

Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test

In parametric statistics, two fundamental tests stand out for their utility and wide application: the Student's t-test and goodness-of-fit tests. These tests provide researchers with a robust method for drawing insights from data, testing hypotheses, and making informed decisions based on their findings.
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
7.0K
Microsoft Excel: Student's t-Test01:25

Microsoft Excel: Student's t-Test

Student's t-test in Microsoft Excel is a statistical method used to compare the means of two groups to determine if they are significantly different from each other. It's commonly used to evaluate hypotheses, such as testing whether a treatment has an effect compared to a control group. Excel provides built-in functions to perform t-tests, making it accessible for users needing to conduct basic statistical analysis.
To conduct a t-test in Excel, use the T.TEST function or the "Data...
1.8K
Multiple Comparison Tests01:13

Multiple Comparison Tests

Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
4.5K
Spearman's Rank Correlation Test01:20

Spearman's Rank Correlation Test

Spearman's rank correlation test, also known as Spearman's rho, is a nonparametric method for assessing the strength and direction of association between two variables. This test is particularly valuable when the data distribution is unknown or when the assumption of normality does not hold. Named after the English psychologist and statistician Dr. Charles Edward Spearman, it serves as the nonparametric counterpart to Pearson's correlation coefficient.
Spearman's test calculates correlation by...
1.5K
Bonferroni Test01:10

Bonferroni Test

The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
3.5K