Related Experiment Video
Updated: Jul 5, 2025
Determining the Likelihood of Variant Pathogenicity Using Amino Acid-level Signal-to-Noise Analysis of Genetic Variation
Published on: January 16, 2019
Misuse of the P Value: Using Quality Improvement Analyses to Identify Clinically Significant Improvements
Introduction:
Quantitative research and quality improvement (QI) both seek to improve care provided to patients. However, clinicians often blur the lines between how to appropriately analyze data from these methodologies. Clinicians may inappropriately use statistical analyses for QI initiatives, rather than using run and statistical process control (SPC) charts to analyze improvements in outcomes.
Objective:
The purpose of this article was to address the analytic methods used for QI initiatives in the clinical setting in an effort to show clinicians how to identify meaningful improvements in clinical practice.
Methods:
In this article, we provide an example comparing the same evidence-based practice/QI initiative (chlorhexidine gluconate bathing in a medical intensive care unit) using a quasi-experimental pretest/posttest research design with statistical analyses completed with t tests with analyses using run and SPC charts to show the data trended over time. Using a pretest/posttest design, chlorhexidine gluconate bathing compliance improved from 63% to 65%, a nonsignificant change, P = .075. These same data plotted on run and SPC charts, however, show a shift and a trend, indicating clinically significant improvements per QI methodologies.
Conclusion:
The example in this article highlights the pitfall of relying only on statistical analyses and P values to determine the importance of a clinical project, and provides a practical example for how run or SPC charts can be used to identify improvements over time.
Related Concept Videos
01:09Decision Making: P-value Method
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
01:13Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
01:10P-value
P-value stands for the probability value. P-value is the probability that, if the null hypothesis is true, the results from another randomly selected sample will be as extreme or more extreme as the results obtained from the given sample.
A large P-value calculated from the data indicates to not reject the null hypothesis. But a higher P-value does not mean that the null hypothesis is true. The smaller the P-value, the more...
01:04Significance Testing: Overview
01:50Statistical Significance