Related Experiment Video
Updated: Apr 7, 2026
Assessing Early Stage Open-Angle Glaucoma in Patients by Isolated-Check Visual Evoked Potential
Published on: May 25, 2020
Review of null hypothesis significance testing in the ophthalmic literature: are most 'significant' P values false
Paul G Sanfilippo1,2, Robert J Casson3, Seyhan Yazar2
1Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, University of Melbourne, Melbourne, Victoria, Australia.
Abstract:
P values associated with null hypothesis significance testing (NHST) are almost universal in the ophthalmic literature. A P value < 0.05 is traditionally considered 'significant'. This concept may deflect further thought about the veracity of the results. P values influence the publishability of the data and have flow-on effects for funding success and the direction of future research. Despite their importance, the problems inherent in P values have been recognized since their inception, and in more recent years have been increasingly highlighted in some scientific fields. In this review, we aim to bring the problems associated with P values and NHST to the attention of the ophthalmic research community. We do not offer a universal solution to the problem of determining the veracity of a scientific claim; however, we demonstrate the need for caution in interpreting 'significant' P values by performing a Bayesian re-analysis of t-tests in the ophthalmic literature.
Related Concept Videos
01:16Statistical Hypothesis Testing
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
01:04Significance Testing: Overview
01:13Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
01:11Types of Hypothesis Testing
When the null and alternative hypotheses are stated, it is observed that the null hypothesis is a neutral statement against which the alternative hypothesis is tested. The alternative hypothesis is a claim that instead has a certain direction. If the null hypothesis claims that p = 0.5, the alternative hypothesis would be an opposing statement to this and can be put either p > 0.5, p < 0.5, or p...
01:14Errors In Hypothesis Tests
01:14Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...