Related Experiment Video
Updated: Jun 7, 2025
06:05
The Participant-Reported Implementation Update and Score PRIUS: A Novel Method for Capturing Implementation-Related Data Over Time
Published on: February 19, 2021
1.2K
Yet another problem with systematic reviews: a living review update.
Lesley Uttley1, Yuliang Weng2, Louise Falzon1
1School of Medicine and Population Health, University of Sheffield, Sheffield, United Kingdom.
Journal of Clinical Epidemiology
|November 14, 2024
Summary
A living systematic review update reveals new problems, including author gender diversity issues and vested interests influencing conclusions. This highlights the need for research culture reform to improve systematic review quality and reduce research waste.
Area of Science:
- Systematic review methodology
- Meta-research
- Research culture and reform
Background:
- A living systematic review on problems with systematic reviews was updated for May 2023.
- New problems and themes related to research culture have emerged since the last update.
Purpose of the Study:
- To identify and analyze new problems and emerging themes in systematic reviews.
- To assess the impact of identified flaws on systematic review conclusions.
- To advocate for reforms in research culture.
Main Methods:
- Literature searches were conducted for articles published or indexed between May 2022 and May 2023.
- Thematic analysis was used to code articles and problems across four domains: comprehensiveness, rigor, transparency, and objectivity.
- Meta-epidemiological studies were used to examine the effect of flaws on conclusions.
Main Results:
- 152 new articles were included, bringing the total to 637.
- A new problem, lack of gender diversity in author teams, was identified, bringing the total problems to 68.
- Emerging themes include fast science (COVID-19 reviews), citation failures of guidelines, and vested interests influencing conclusions.
- 77 meta-epidemiological studies assessed the impact of flaws on review conclusions.
Conclusions:
- An emerging theme is the composition of review author teams and its potential effect on equity reporting.
- Meta-research should move beyond documenting known issues to exploring lesser-known problems in systematic reviews.
- Reforms in research culture are needed to address incentives driving research production and publication.
Keywords:
Author influenceMetaresearchResearch cultureResearch integrityResearch team diversitySystematic reviewMore Related Videos
Related Concept Videos
02:20Longitudinal Research
11.9K
Sometimes we want to see how people change over time, as in studies of human development and lifespan. When we test the same group of individuals repeatedly over an extended period of time, we are conducting longitudinal research. Longitudinal research is a research design in which data-gathering is administered repeatedly over an extended period of time. For example, we may survey a group of individuals about their dietary habits at age 20, retest them a decade later at age 30, and then again...
11.9K
01:21Methods of Documentation III: PIE
1.3K
Problem-intervention-evaluation (PIE) is a systematic approach to documentation used in healthcare settings for clinical decision-making and patient care planning. It is a structured approach to organizing patient data based on problems, interventions, and evaluations. Here's a breakdown of its key features and considerations:
1.3K
01:22Bias
3.7K
Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
3.7K
01:26Methods of Documentation II: POMR
917
The Problem-Oriented Medical Record (POMR) revolutionized medical record-keeping by introducing a systematic approach focusing on the patient's problems rather than merely listing symptoms. Dr. Lawrence Weed's introduction of this method in the 1960s marked a significant advancement in medical documentation. The POMR framework consists of four key components: the database, problem list, plan of care, and progress notes.
917
02:07Blind Procedures
10.6K
Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which...
10.6K
01:56Ethics in Research
22.9K
Today, scientists agree that good research is ethical in nature and is guided by a basic respect for human dignity and safety. However, this has not always been the case. Modern researchers must demonstrate that the research they perform is ethically sound.
22.9K