Reporting Bias Is Highly Prevalent in Systematic Reviews and Meta-Analyses Related to Medial Patellofemoral Ligament

Kenneth T Nguyen1, Erin L Brown1, William C Rittmeyer1

  • 1Tulane University School of Medicine, New Orleans, Louisiana, U.S.A.

Abstract

Insights

Reporting bias, or spin, is prevalent in systematic reviews of medial patellofemoral ligament reconstruction (MPFLR), with nearly 90% of abstracts showing spin. Low study quality, indicated by AMSTAR 2 ratings, correlates with this bias, suggesting overstated MPFLR efficacy.

Area of Science:

  • Orthopedics
  • Biomedical Engineering
  • Evidence-Based Medicine

Background:

  • Medial patellofemoral ligament reconstruction (MPFLR) is a common surgical procedure.
  • Systematic reviews and meta-analyses are crucial for synthesizing evidence on MPFLR outcomes.
  • Reporting bias, specifically 'spin,' can distort the perceived effectiveness of interventions.

Purpose of the Study:

  • To assess the prevalence and types of reporting bias (spin) in systematic reviews and meta-analyses concerning MPFLR.
  • To evaluate the quality of these systematic reviews using the AMSTAR 2 tool.
  • To identify factors associated with the presence and type of spin in MPFLR literature.

Main Methods:

  • Systematic reviews on MPFLR were identified from major databases (PubMed, Web of Science, Embase).
  • Abstracts were analyzed for 15 predefined types of spin.
  • Study quality was assessed using the A Measurement Tool to Assess Systematic Reviews 2 (AMSTAR 2) checklist.
  • Statistical analyses, including t-tests, ANOVA, Fisher's tests, and Spearman correlations, were employed.

Main Results:

  • Of 57 included studies, 89.5% (51/57) exhibited spin in their abstracts.
  • Spin types 5, 3, and 9 were most frequent, observed in 84.2%, 56.1%, and 52.6% of studies, respectively.
  • A significant negative correlation was found between AMSTAR 2 scores and the presence of spin (P < .01).
  • Over 91% of studies received critically low AMSTAR 2 ratings, indicating poor methodological quality.

Conclusions:

  • Systematic reviews on MPFLR frequently contain reporting bias (spin).
  • The high prevalence of spin, coupled with critically low study quality (AMSTAR 2 ratings), suggests an overstatement of MPFLR effectiveness.
  • Further research and adherence to reporting guidelines are needed to improve the reliability of evidence synthesis in this field.

Related Concept Videos

Prevalence and Incidence01:08

Prevalence and Incidence

In statistical epidemiology and health sciences, two essential metrics—prevalence and incidence—are fundamental for understanding disease dynamics within a population. These measures enable public health officials, epidemiologists, and researchers to assess the burden of diseases, allocate resources effectively, and design impactful public health policies and interventions.
Prevalence indicates the proportion of individuals in a population who have a specific disease or health...
1.8K
Confirmation Biases01:31

Confirmation Biases

The confirmation bias is the tendency to focus on information that confirms our existing beliefs and ignore information that is inconsistent with our expectations. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. Have you ever fallen prey to the confirmation bias, either as the source or target of such bias?
8.2K
Hindsight Biases01:12

Hindsight Biases

Hindsight bias leads you to believe that the event you just experienced was predictable, even though it really wasn’t. In other words, you knew all along that things would turn out the way they did. Can you relate this to the phrase "Hindsight is 20/20" now? 
4.3K
Review and Preview01:10

Review and Preview

In statistics, several tools are used to interpret the data. Measures of central tendency represent the characteristics of the data, such as mean, median, and mode. Additionally, measures of variance like standard deviation and range are used to find the spread of data from the mean. Relative standing measures the distance between data locations. Commonly used measures of relative standings are percentile, z score, and quartiles.
Percentiles are a type of fractile that partition data into...
8.4K
Review and Preview01:13

Review and Preview

Data are individual items of information obtained from a population or sample. Data may be classified as qualitative (categorical), quantitative continuous, or quantitative discrete. Because it is not practical to measure the entire population in a study, researchers use samples to represent the population. A random sample is a representative group from the population chosen by using a method that gives each individual in the population an equal chance of being included in the sample. Random...
11.1K
Bias01:22

Bias

Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
7.3K