Do not throw the baby out with the bath water: a guide for using non-significant results in practice

Mouaffaa Tello1, Feras Zaiem1, Mary Catherine Tolcher2

  • 1Evidence-based Practice Center, Mayo Clinic, Rochester, Minnesota, USA.

Evidence-Based Medicine
|August 20, 2016
PubMed

Insights

Interpreting non-significant research findings is difficult for healthcare providers. This study introduces a framework using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to guide clinical application of these results.

Area of Science:

  • Clinical decision-making
  • Evidence-based practice
  • Medical research interpretation

Background:

  • Clinicians face challenges in applying research results lacking statistical significance.
  • Non-significant findings are frequently dismissed as indicating no association or being irrelevant.
  • Effective use of all research evidence is crucial for optimal patient care.

Purpose of the Study:

  • To provide a structured framework for interpreting non-significant research findings.
  • To guide clinicians in applying non-significant results at the point of care.
  • To enhance the utility of all research evidence in clinical practice.

Main Methods:

  • Utilized the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach.
  • Developed a systematic framework for evaluating non-significant results.
  • Focused on practical application in clinical settings.

Main Results:

  • A clear framework for interpreting non-significant results was established.
  • Guidance was provided on how to apply these results in clinical decision-making.
  • The GRADE approach was adapted for evaluating evidence with non-significant findings.

Conclusions:

  • Non-significant results can be valuable when interpreted correctly.
  • The proposed framework facilitates the use of non-significant findings in clinical practice.
  • Implementing this approach can improve the application of research evidence by clinicians.

Related Concept Videos

Statistical Significance01:37

Statistical Significance

Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
23.3K
Significance Testing: Overview01:04

Significance Testing: Overview

Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...
12.9K
Regression Toward the Mean01:52

Regression Toward the Mean

Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
7.3K
Unusual Results01:16

Unusual Results

Unusual results are those that have a very low chance of occurring. Unusual results can be identified using probabilities and the range rule of thumb. In problems involving probability, unusual results can be observed in 2 instances – an unusually high number of successes or an unusually low number of successes.
According to the range rule of thumb, any value above or below two standard deviations, 2σ  from the mean, μ  is considered unusual.
Maximum unusual value =...
4.0K
Sign Test for Matched Pairs01:17

Sign Test for Matched Pairs

The sign test for matched pairs offers a robust method for comparing two paired samples, often for the effects of an intervention in one of them. This method is very useful in situations where the underlying distribution of the data is unknown. The test compares two related samples—often pre- and post-treatment measurements on the same subjects—to determine if there are significant differences in their median values.
To conduct the sign test, we first calculate the differences in...
452
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches01:23

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches

Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
519