Evaluating statistical difference, equivalence, and indeterminacy using inferential confidence intervals: an
1Department of Psychology, Fordham University, Bronx, New York 10458-5198, USA. wtryon@fordham.edu
Psychological Methods
|January 10, 2002
Summary
This study introduces a confidence interval approach as an alternative to null hypothesis statistical testing (NHST). This method aims to reduce misuse and improve the interpretation of statistical results in research.
Area of Science:
- Statistics
- Research Methodology
Background:
- Null hypothesis statistical testing (NHST) is widely used but frequently misused, leading to interpretation issues.
- Existing NHST methods face criticism regarding human factors and potential misinterpretations.
Purpose of the Study:
- To present an integrated, alternative inferential confidence interval (CI) approach for statistical testing.
- To address the human factors problem associated with NHST misuse and improve statistical interpretation.
- To provide a method for testing statistical difference, equivalence, and indeterminacy.
Main Methods:
- Developed an algebraically equivalent CI approach to standard NHST procedures.
- Integrated numeric and graphic tests for statistical difference, equivalence, and indeterminacy.
- Discussed key statistical concepts including multiple comparisons, power, sample size, test reliability, effect size, and cause-effect ratio.
Main Results:
- The proposed CI approach is algebraically equivalent to NHST, maintaining the same evidential standard.
- The combined numeric and graphic tests are designed to mitigate common interpretive problems of NHST.
- Provides a framework for clear decision-making regarding statistical outcomes.
Conclusions:
- The confidence interval approach offers a viable alternative to NHST, enhancing clarity and reducing misinterpretation.
- This method maintains rigorous evidential standards while improving practical application in research.
- Proper interpretation of confidence intervals is crucial for accurate statistical inference.
Related Concept Videos
01:04Significance Testing: Overview
11.3K
Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...
11.3K
01:14Decision Making: Traditional Method
5.0K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
5.0K
01:14Identifying Statistically Significant Differences: The F-Test
3.0K
The F-test is used to compare two sample variances to each other or compare the sample variance to the population variance. It is used to decide whether an indeterminate error can explain the difference in their values. The underlying assumptions that allow the use of the F-test include the data set or sets are normally distributed, and the data sets are independent of each other. The test statistic F is calculated by dividing one variance by another. In other words, the square of one standard...
3.0K
01:19Interpretation of Confidence Intervals
9.1K
A confidence interval is a better estimate of the population than a point estimate, as it uses a range of values from a sample instead of a single value.
Confidence intervals have confidence coefficients that are crucial for their interpretation. The most common confidence coefficients are 0.90, 0.95, and 0.99, which can be written as percentages–90%, 95%, and 99%, respectively.
Suppose a person calculates a confidence interval with a confidence coefficient of 0.95. In that case, they can...
Confidence intervals have confidence coefficients that are crucial for their interpretation. The most common confidence coefficients are 0.90, 0.95, and 0.99, which can be written as percentages–90%, 95%, and 99%, respectively.
Suppose a person calculates a confidence interval with a confidence coefficient of 0.95. In that case, they can...
9.1K
01:16Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data
404
Statistical inference techniques, paramount in hypothesis testing, differentiate into two broad categories: parametric and nonparametric statistics.
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
404
01:10Bonferroni Test
3.3K
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
3.3K