Related Experiment Video
Updated: Nov 3, 2025

Using Visual and Narrative Methods to Achieve Fair Process in Clinical Care
Published on: February 16, 2011
Methodology over metrics: current scientific standards are a disservice to patients and society
Ben Van Calster1, Laure Wynants2, Richard D Riley3
1Department of Development and Regeneration, KU Leuven, Leuven, Belgium; Department of Biomedical Data Sciences, Leiden University Medical Centre, Leiden, Netherlands; EPI-Centre, KU Leuven, Leuven, Belgium.
Abstract:
Covid-19 research made it painfully clear that the scandal of poor medical research, as denounced by Altman in 1994, persists today. The overall quality of medical research remains poor, despite longstanding criticisms. The problems are well known, but the research community fails to properly address them. We suggest that most problems stem from an underlying paradox: although methodology is undeniably the backbone of high-quality and responsible research, science consistently undervalues methodology. The focus remains more on the destination (research claims and metrics) than on the journey. Notwithstanding, research should serve society more than the reputation of those involved. While we notice that many initiatives are being established to improve components of the research cycle, these initiatives are too disjointed. The overall system is monolithic and slow to adapt. We assert that top-down action is needed from journals, universities, funders and governments to break the cycle and put methodology first. These actions should involve the widespread adoption of registered reports, balanced research funding between innovative, incremental and methodological research projects, full recognition and demystification of peer review, improved methodological review of reports, adherence to reporting guidelines, and investment in methodological education and research. Currently, the scientific enterprise is doing a major disservice to patients and society.
Insights
Medical research quality remains poor, with methodology undervalued. Top-down reforms are needed from journals, universities, funders, and governments to prioritize research methodology for societal benefit.
Area of Science:
- Medical research
- Scientific integrity
- Research methodology
Background:
- Despite decades of criticism, the quality of medical research remains consistently poor.
- The COVID-19 pandemic highlighted persistent issues in research integrity and execution.
- Current research practices often prioritize outcomes and metrics over robust methodology.
Purpose of the Study:
- To identify the root causes of poor medical research quality.
- To propose systemic solutions for improving research integrity and methodology.
- To advocate for a paradigm shift prioritizing methodological rigor in scientific endeavors.
Main Methods:
- Analysis of systemic issues within the scientific research community.
- Review of existing initiatives aimed at improving research quality.
- Formulation of recommendations for stakeholders including journals, universities, funders, and governments.
Main Results:
- A core paradox exists where methodology, the foundation of research, is consistently undervalued.
- Existing initiatives to improve research are fragmented and insufficient to address systemic problems.
- A monolithic and slow-adapting system hinders progress in research quality.
Conclusions:
- Systemic, top-down interventions are crucial to elevate the importance of methodology in research.
- Recommendations include adopting registered reports, balanced funding, transparent peer review, and enhanced methodological training.
- Prioritizing methodology is essential to ensure medical research effectively serves patients and society.
More Related Videos
11:21Methodology for Establishing a Community-Wide Life Laboratory for Capturing Unobtrusive and Continuous Remote Activity and Health Data
Published on: July 27, 2018
14:43A Novel Method for Involving Women of Color at High Risk for Preterm Birth in Research Priority Setting
Published on: January 12, 2018
Related Concept Videos
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
The Scientific Method in Nursing Process
When using research findings to change practice, one must understand the process used to guide a study. The scientific method is a systematic, step-by-step process that supports the data's validity, reliability, and generalizability. As a result, findings can be...
Measurement of Bioavailability: Pharmacodynamic Methods
Statistical Methods for Analyzing Epidemiological Data
Scientific Nature of Social Psychology
Regression Toward the Mean