Related Experiment Video
Updated: Jul 28, 2026
05:57
Novel Object Recognition and Object Location Behavioral Testing in Mice on a Budget
Published on: November 20, 2018
Are effect sizes and confidence levels problems for or solutions to the null hypothesis test?
1Louisiana State University, USA. riopell@attglobal.net
The Journal of General Psychology
|June 8, 2000
Summary
The t test may hinder psychological research progress. Alternative methods like confidence intervals and effect sizes offer clearer insights into mean differences and their reliability, improving statistical understanding.
Area of Science:
- Psychology
- Statistics
Background:
- Null hypothesis significance testing (NHST) using t tests is criticized for impeding psychological research.
- Neyman-Pearson confidence intervals and Cohen's d (standardized effect size) are proposed as improvements.
- Concerns exist regarding the interrelation and information overlap between these statistical approaches.
Purpose of the Study:
- To clarify the scope and application of the t test in psychological research.
- To highlight the distinct information provided by confidence intervals and effect sizes.
- To address the ambiguity in interpreting the t test beyond simple mean differences.
Main Methods:
- Conceptual analysis of statistical testing methodologies.
- Review of literature on null hypothesis significance testing, confidence intervals, and effect sizes.
- Examination of the mathematical underpinnings of the t test.
Main Results:
- The t test, relying on sample standard deviation, is not limited to comparing means.
- The t test addresses the broader concept of sample differences, incorporating standard deviation variability.
- Recommended alternatives (confidence intervals, effect sizes) offer complementary, not identical, information.
Conclusions:
- The t test's application is more nuanced than often assumed.
- Confidence intervals and effect sizes provide valuable, distinct information for interpreting research findings.
- A comprehensive understanding of these statistical tools is crucial for advancing psychological science.
Related Concept Videos
01:16Critical Region, Critical Values and Significance Level
The critical region, critical value, and significance level are interdependent concepts crucial in hypothesis testing.
In hypothesis testing, a sample statistic is converted to a test statistic using z, t, or chi-square distribution. A critical region is an area under the curve in probability distributions demarcated by the critical value. When the test statistic falls in this region, it suggests that the null hypothesis must be rejected. As this region contains all those values of the test...
In hypothesis testing, a sample statistic is converted to a test statistic using z, t, or chi-square distribution. A critical region is an area under the curve in probability distributions demarcated by the critical value. When the test statistic falls in this region, it suggests that the null hypothesis must be rejected. As this region contains all those values of the test...
01:14Decision Making: Traditional Method
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
01:14Errors In Hypothesis Tests
When performing a hypothesis test, there are four possible outcomes depending on the actual truth (or falseness) of the null hypothesis and the decision to reject or not.
01:04Significance Testing: Overview
Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...
01:16Statistical Hypothesis Testing
Hypothesis testing is a critical statistical procedure facilitating informed, evidence-based decisions. It begins with a hypothesis, which is a tentative explanation, or a prediction about a population parameter. This hypothesis can be either a null hypothesis (H0), indicating no effect or difference, or an alternative hypothesis (Ha), suggesting an effect or difference.
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
01:13Accuracy and Errors in Hypothesis Testing
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5% chance...
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5% chance...