Statistical requirements for properly investigating a null hypothesis
1School of Family Studies and Human Services, Kansas State University, 1700 Anderson Avenue, Manhattan, KS 66506-1403, USA. schumm@ksu.edu
Psychological Reports
|February 18, 2011
Summary
Researchers should use rigorous methods for evaluating null hypotheses, including equivalence testing and reporting effect sizes. Adhering to statistical best practices ensures credible research findings in social science.
Area of Science:
- Social Sciences
- Statistics
Background:
- Evaluating null hypotheses is crucial in research.
- Traditional methods like t-tests and F-tests have limitations.
- Ensuring research credibility requires adherence to statistical standards.
Purpose of the Study:
- To discuss issues in null hypothesis evaluation.
- To recommend alternative statistical approaches.
- To highlight the importance of rigorous methodology in social science research.
Main Methods:
- Discussion of statistical evaluation techniques.
- Recommendation of equivalence testing.
- Consideration of one-tailed tests and significance levels for low power studies.
Main Results:
- Equivalence testing is a viable alternative to simple t or F tests.
- Reporting effect sizes alongside significance levels is essential.
- Addressing pre-existing group differences and potential biases is critical for valid comparisons.
Conclusions:
- Researchers must rigorously test null hypotheses using best professional standards.
- Deviations from these standards reduce research credibility.
- Proper statistical practices are vital, especially in sensitive research areas like family social science.
More Related Videos
Related Concept Videos
01:14Decision Making: Traditional Method
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
01:13Accuracy and Errors in Hypothesis Testing
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5% chance...
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5% chance...
01:16Statistical Hypothesis Testing
Hypothesis testing is a critical statistical procedure facilitating informed, evidence-based decisions. It begins with a hypothesis, which is a tentative explanation, or a prediction about a population parameter. This hypothesis can be either a null hypothesis (H0), indicating no effect or difference, or an alternative hypothesis (Ha), suggesting an effect or difference.
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
01:16Critical Region, Critical Values and Significance Level
The critical region, critical value, and significance level are interdependent concepts crucial in hypothesis testing.
In hypothesis testing, a sample statistic is converted to a test statistic using z, t, or chi-square distribution. A critical region is an area under the curve in probability distributions demarcated by the critical value. When the test statistic falls in this region, it suggests that the null hypothesis must be rejected. As this region contains all those values of the test...
In hypothesis testing, a sample statistic is converted to a test statistic using z, t, or chi-square distribution. A critical region is an area under the curve in probability distributions demarcated by the critical value. When the test statistic falls in this region, it suggests that the null hypothesis must be rejected. As this region contains all those values of the test...
01:14Errors In Hypothesis Tests
When performing a hypothesis test, there are four possible outcomes depending on the actual truth (or falseness) of the null hypothesis and the decision to reject or not.
01:16Null and Alternative Hypotheses
The actual hypothesis testing begins by considering two hypotheses. They are termed the null hypothesis and the alternative hypothesis. These hypotheses contain opposing viewpoints.
The null hypothesis, denoted by H0 is a statement of no difference between the variables—they are not related. This can often be considered the status quo. As a result if you cannot accept the null, it requires some action.
The alternative hypothesis, denoted by H1 or Ha, is a claim about the population that is...
The null hypothesis, denoted by H0 is a statement of no difference between the variables—they are not related. This can often be considered the status quo. As a result if you cannot accept the null, it requires some action.
The alternative hypothesis, denoted by H1 or Ha, is a claim about the population that is...