Related Experiment Video
Updated: Oct 4, 2025
07:40
Validation of a Psychosocial Intervention on Body Image in Older People: An Experimental Design
Published on: May 31, 2021
3.5K
Separate substantive from statistical hypotheses and treat them differently
1Department of Philosophy, Bates College, Lewiston, ME04240, USA. mdacey@bates.edu; mikedacey.net.
The Behavioral and Brain Sciences
|February 10, 2022
Summary
This study proposes separating statistical and substantive hypotheses for better analysis. Statistical tests directly address statistical hypotheses, while substantive hypotheses require additional qualitative inference for theory choice.
Area of Science:
- Cognitive Science
- Philosophy of Science
- Statistical Inference
Background:
- Yarkoni's identified problems in current research practices.
- The limitations of purely statistical hypothesis testing.
Purpose of the Study:
- To propose a method for addressing problems in hypothesis evaluation.
- To differentiate between statistical and substantive hypotheses.
Main Methods:
- Separating statistical hypotheses from substantive hypotheses.
- Applying distinct evaluation methods for each hypothesis type.
Main Results:
- Statistical tests are directly relevant only to statistical hypotheses.
- Substantive hypothesis evaluation necessitates qualitative inference to the best explanation.
Conclusions:
- Statistical inference alone is insufficient for comprehensive theory choice.
- A dual approach is needed for robust scientific reasoning and hypothesis evaluation.
Related Concept Videos
01:16Statistical Hypothesis Testing
2.6K
Hypothesis testing is a critical statistical procedure facilitating informed, evidence-based decisions. It begins with a hypothesis, which is a tentative explanation, or a prediction about a population parameter. This hypothesis can be either a null hypothesis (H0), indicating no effect or difference, or an alternative hypothesis (Ha), suggesting an effect or difference.
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
2.6K
01:16Null and Alternative Hypotheses
10.4K
The actual hypothesis testing begins by considering two hypotheses. They are termed the null hypothesis and the alternative hypothesis. These hypotheses contain opposing viewpoints.
The null hypothesis, denoted by H0 is a statement of no difference between the variables—they are not related. This can often be considered the status quo. As a result if you cannot accept the null, it requires some action.
The alternative hypothesis, denoted by H1 or Ha, is a claim about the...
The null hypothesis, denoted by H0 is a statement of no difference between the variables—they are not related. This can often be considered the status quo. As a result if you cannot accept the null, it requires some action.
The alternative hypothesis, denoted by H1 or Ha, is a claim about the...
10.4K
01:16Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data
245
Statistical inference techniques, paramount in hypothesis testing, differentiate into two broad categories: parametric and nonparametric statistics.
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
245
01:16Hypothesis Test for Test of Independence
4.2K
The test of independence is a chi-square-based test used to determine whether two variables or factors are independent or dependent. This hypothesis test is used to examine the independence of the variables. One can construct two qualitative survey questions or experiments based on the variables in a contingency table. The goal is to see if the two variables are unrelated (independent) or related (dependent). The null and alternative hypotheses for this test are:
H0: The two variables (factors)...
H0: The two variables (factors)...
4.2K
01:11Types of Hypothesis Testing
26.9K
There are three types of hypothesis tests: right-tailed, left-tailed, and two-tailed.
When the null and alternative hypotheses are stated, it is observed that the null hypothesis is a neutral statement against which the alternative hypothesis is tested. The alternative hypothesis is a claim that instead has a certain direction. If the null hypothesis claims that p = 0.5, the alternative hypothesis would be an opposing statement to this and can be put either p > 0.5, p < 0.5, or p...
When the null and alternative hypotheses are stated, it is observed that the null hypothesis is a neutral statement against which the alternative hypothesis is tested. The alternative hypothesis is a claim that instead has a certain direction. If the null hypothesis claims that p = 0.5, the alternative hypothesis would be an opposing statement to this and can be put either p > 0.5, p < 0.5, or p...
26.9K
01:04Significance Testing: Overview
5.1K
Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...
5.1K