Methodology over metrics: current scientific standards are a disservice to patients and society

Ben Van Calster1, Laure Wynants2, Richard D Riley3

  • 1Department of Development and Regeneration, KU Leuven, Leuven, Belgium; Department of Biomedical Data Sciences, Leiden University Medical Centre, Leiden, Netherlands; EPI-Centre, KU Leuven, Leuven, Belgium.

Insights

Medical research quality remains poor, with methodology undervalued. Top-down reforms are needed from journals, universities, funders, and governments to prioritize research methodology for societal benefit.

Area of Science:

  • Medical research
  • Scientific integrity
  • Research methodology

Background:

  • Despite decades of criticism, the quality of medical research remains consistently poor.
  • The COVID-19 pandemic highlighted persistent issues in research integrity and execution.
  • Current research practices often prioritize outcomes and metrics over robust methodology.

Purpose of the Study:

  • To identify the root causes of poor medical research quality.
  • To propose systemic solutions for improving research integrity and methodology.
  • To advocate for a paradigm shift prioritizing methodological rigor in scientific endeavors.

Main Methods:

  • Analysis of systemic issues within the scientific research community.
  • Review of existing initiatives aimed at improving research quality.
  • Formulation of recommendations for stakeholders including journals, universities, funders, and governments.

Main Results:

  • A core paradox exists where methodology, the foundation of research, is consistently undervalued.
  • Existing initiatives to improve research are fragmented and insufficient to address systemic problems.
  • A monolithic and slow-adapting system hinders progress in research quality.

Conclusions:

  • Systemic, top-down interventions are crucial to elevate the importance of methodology in research.
  • Recommendations include adopting registered reports, balanced funding, transparent peer review, and enhanced methodological training.
  • Prioritizing methodology is essential to ensure medical research effectively serves patients and society.

Related Concept Videos

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches01:23

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches

Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
217
The Scientific Method in Nursing Process01:18

The Scientific Method in Nursing Process

The scientific method provides the foundation for any research. It is the most reliable and objective of all forms of gaining knowledge and guides in applying research-based evidence in practice and conducting future research.
When using research findings to change practice, one must understand the process used to guide a study. The scientific method is a systematic, step-by-step process that supports the data's validity, reliability, and generalizability. As a result, findings can be...
14.9K
Measurement of Bioavailability: Pharmacodynamic Methods01:20

Measurement of Bioavailability: Pharmacodynamic Methods

Pharmacodynamic methods provide insights into a drug's effects on physiological processes over time and play a crucial role in understanding bioavailability and therapeutic efficacy. These methods can be broadly classified into acute pharmacological and therapeutic response approaches, each with distinct mechanisms and applications.The acute pharmacological response method directly correlates a drug's physiological effects, such as ECG or pupil diameter changes, to its time course in the body.
43
Statistical Methods for Analyzing Epidemiological Data01:25

Statistical Methods for Analyzing Epidemiological Data

Epidemiological data primarily involves information on specific populations' occurrence, distribution, and determinants of health and diseases. This data is crucial for understanding disease patterns and impacts, aiding public health decision-making and disease prevention strategies. The analysis of epidemiological data employs various statistical methods to interpret health-related data effectively. Here are some commonly used methods:
656
Scientific Nature of Social Psychology01:30

Scientific Nature of Social Psychology

Social psychology is a scientific discipline dedicated to understanding how individuals think, feel, and behave in social contexts. Unlike common sense, which relies on anecdotal experiences and intuition, social psychology employs systematic research and empirical methods to ensure objectivity and reliability. This distinction is fundamental in distinguishing scientifically supported findings from mere speculation.Four fundamental scientific values guide a structured approach to research in...
275
Regression Toward the Mean01:52

Regression Toward the Mean

Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.6K