Related Experiment Video
Updated: Apr 14, 2026
05:37
An R-Based Landscape Validation of a Competing Risk Model
Published on: September 16, 2022
2.8K
Common pitfalls in statistical analysis: "P" values, statistical significance and confidence intervals.
Priya Ranganathan1, C S Pramesh2, Marc Buyse3
1Department of Anaesthesiology, Tata Memorial Centre, Mumbai, Maharashtra, India.
Perspectives in Clinical Research
|April 17, 2015
Summary
This study clarifies statistical significance reporting, explaining P-values and confidence intervals. It emphasizes including both P-values and confidence intervals for accurate scientific communication.
Area of Science:
- Statistics
- Biostatistics
- Scientific Research Methodology
Background:
- Statistical analysis is crucial in research.
- Misinterpretation of statistical results can lead to flawed conclusions.
- Reporting standards for statistical significance require careful attention.
Purpose of the Study:
- To address common pitfalls in expressing statistically significant study results.
- To debunk myths surrounding the P-value.
- To highlight the importance of confidence intervals and their inclusion in research papers.
Main Methods:
- Review of statistical reporting practices.
- Analysis of P-value interpretations and common misconceptions.
- Explanation of confidence intervals and their statistical underpinnings.
Main Results:
- P-values alone can be misleading.
- Confidence intervals provide a range of plausible values for an effect.
- Joint reporting of P-values and confidence intervals enhances result interpretation.
Conclusions:
- Accurate reporting of statistical significance is essential for scientific integrity.
- Researchers should prioritize clear communication of P-values alongside confidence intervals.
- Understanding and correctly applying these statistical measures improves the reliability of research findings.
More Related Videos
Related Concept Videos
01:37Statistical Significance
24.4K
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
24.4K
01:10P-value
9.6K
P-value is one of the most crucial concepts in statistics.
P-value stands for the probability value. P-value is the probability that, if the null hypothesis is true, the results from another randomly selected sample will be as extreme or more extreme as the results obtained from the given sample.
A large P-value calculated from the data indicates to not reject the null hypothesis. But a higher P-value does not mean that the null hypothesis is true. The smaller the P-value, the more...
P-value stands for the probability value. P-value is the probability that, if the null hypothesis is true, the results from another randomly selected sample will be as extreme or more extreme as the results obtained from the given sample.
A large P-value calculated from the data indicates to not reject the null hypothesis. But a higher P-value does not mean that the null hypothesis is true. The smaller the P-value, the more...
9.6K
01:09Decision Making: P-value Method
7.4K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
7.4K
01:14Errors In Hypothesis Tests
6.4K
When performing a hypothesis test, there are four possible outcomes depending on the actual truth (or falseness) of the null hypothesis and the decision to reject or not.
6.4K
01:13Accuracy and Errors in Hypothesis Testing
707
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
707
01:19Interpretation of Confidence Intervals
10.6K
A confidence interval is a better estimate of the population than a point estimate, as it uses a range of values from a sample instead of a single value.
Confidence intervals have confidence coefficients that are crucial for their interpretation. The most common confidence coefficients are 0.90, 0.95, and 0.99, which can be written as percentages–90%, 95%, and 99%, respectively.
Suppose a person calculates a confidence interval with a confidence coefficient of 0.95. In that case, they can...
Confidence intervals have confidence coefficients that are crucial for their interpretation. The most common confidence coefficients are 0.90, 0.95, and 0.99, which can be written as percentages–90%, 95%, and 99%, respectively.
Suppose a person calculates a confidence interval with a confidence coefficient of 0.95. In that case, they can...
10.6K