DOES SIZE MATTER? A CRITICAL REVIEW OF META-ANALYSIS IN AGRONOMY

Area of Science:

• Agricultural Science
• Research Methodology
• Data Analysis

Background:

• Meta-analysis is a statistical technique for synthesizing data from multiple studies to increase power and identify patterns.
• Organic agriculture (OA) and conservation agriculture (CA) are subjects of significant debate in agricultural research.
• The political economy of agricultural research influences the interpretation and application of findings.

Purpose of the Study:

• To examine how meta-analysis has been applied to debates surrounding organic agriculture (OA) and conservation agriculture (CA).
• To assess the influence of data selection, research framing, and interpretation on meta-analytical outcomes in these debates.
• To provide recommendations for critically evaluating meta-analyses in agricultural research.

Main Methods:

• Review and assessment of prominent meta-analyses concerning OA and CA.
• Analysis of data-selection criteria, research question framing, and result interpretation in selected meta-analyses.
• Examination of meta-analyses within the context of the political economy of agricultural research.

Main Results:

• The organization of meta-analyses can affect the generalizability and usefulness of their findings, despite the aim to pool all relevant studies.
• Politicized debates surrounding OA and CA lead to divergent interpretations and extrapolations of meta-analytical results.
• Meta-analyses, while increasingly popular for statistical inference, may not resolve scientific contestation on politicized topics.

Conclusions:

• Critical assessment of data collection and study organization is crucial for evaluating meta-analyses.
• Careful scrutiny of research questions, farming system framing, and extrapolation scales is needed.
• Conservative interpretations of meta-analytical results are recommended for politicized topics, acknowledging the social and political context of research.