Related Experiment Video
Updated: Jan 8, 2026
08:36
Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment
Published on: April 19, 2024
1.1K
MATES: A tool for appraising the completeness with which a meta-analysis has been reported
Kyle Morrison1, Patrice Pottier2, Pietro Pollo1
1Evolution & Ecology Research Centre and the School of Biological, Earth and Environmental Sciences at the University of New South Wales, Sydney, Australia.
Environment International
|December 18, 2025
Summary
A new tool, the Meta-analysis Appraisal Tool for Environmental Sciences (MATES), assesses the completeness of reported meta-analyses. This 14-item checklist ensures the validity and reproducibility of environmental science research syntheses.
Area of Science:
- Environmental Science
- Research Synthesis
- Meta-analysis Methodology
Background:
- Meta-analysis is crucial for systematic reviews but faces challenges due to poor reporting practices.
- Existing reporting checklists do not specifically appraise meta-analysis completeness.
- A validated tool is needed to evaluate the quality of reported meta-analyses in environmental science.
Purpose of the Study:
- To develop and validate a tool for appraising the completeness of reported meta-analyses in environmental sciences.
- To enhance the reliability and reproducibility of meta-analysis reporting.
Main Methods:
- Developed the Meta-analysis Appraisal Tool for Environmental Sciences (MATES) using an iterative Delphi process with experts.
- The Delphi process involved workshops, a survey of 193 participants, and a validation task with 30 participants.
- MATES is a 14-item appraisal tool validated on 50 meta-analyses.
Main Results:
- MATES achieved an average agreement rate of 88.97%, indicating high repeatability.
- The tool is time-efficient, taking an average of 17.00 ± 12.23 minutes to implement.
- A ShinyApp was developed to enhance MATES usability with a training module and application tool.
Conclusions:
- MATES offers a reliable and accessible method for appraising meta-analysis completeness in environmental sciences.
- The tool supports authors, readers, stakeholders, and editors in evaluating research syntheses.
- MATES promotes transparency and rigor in environmental science meta-analysis reporting.
More Related Videos
Related Concept Videos
01:24Kaplan-Meier Approach
536
The Kaplan-Meier estimator is a non-parametric method used to estimate the survival function from time-to-event data. In medical research, it is frequently employed to measure the proportion of patients surviving for a certain period after treatment. This estimator is fundamental in analyzing time-to-event data, making it indispensable in clinical trials, epidemiological studies, and reliability engineering. By estimating survival probabilities, researchers can evaluate treatment effectiveness,...
536
01:13Multiple Comparison Tests
4.4K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
4.4K
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
380
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
380
01:11Statistical Analysis: Overview
14.0K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
14.0K
01:20Comparing the Survival Analysis of Two or More Groups
533
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
533
01:19The Mantel-Cox Log-Rank Test
965
The Mantel-Cox log-rank test is a widely used statistical method for comparing the survival distributions of two groups. It tests whether a statistically significant difference exists in survival times between the groups without assuming a specific distribution for the survival data, making it a non-parametric test. This flexibility makes the log-rank test particularly valuable in medical research and other fields where the timing of an event, such as death or disease recurrence, is of...
965