Related Experiment Video
Updated: Jun 18, 2026
10:33
Expedited Radiation Biodosimetry by Automated Dicentric Chromosome Identification (ADCI) and Dose Estimation
Published on: September 4, 2017
Evaluating the accuracy and speed of eight deduplication tools: A comparative study
Sarah Bateup1, Helen Fulbright2, Klas Moberg3
1Library Services, https://ror.org/006jxzx88Bond University, Gold Coast, Australia.
Research Synthesis Methods
|June 17, 2026
Summary
Deduplicating systematic review search results is crucial. Eight tools were evaluated for accuracy and speed, with Rayyan, Covidence, and ASySD showing strengths, but no single tool was perfect.
Area of Science:
- Evidence Synthesis
- Information Science
- Health Research Methodology
Background:
- Deduplication of search results is a critical step in systematic reviews.
- Manual deduplication is time-consuming and error-prone.
- Automated tools vary in cost, transparency, and effectiveness.
Purpose of the Study:
- To evaluate the performance of eight deduplication tools for systematic reviews.
- To compare tools based on unique records removed in error, duplicate records retained in error, and time taken.
Main Methods:
- Eight deduplication tools were assessed: ASySD, Covidence, Deduklick, EPPI-Reviewer, PICO Portal, Rayyan, SRA Deduplicator (Focused), and SRA Deduplicator (Relaxed).
- Five gold standard sets were created from Cochrane reviews.
- Tools were compared against gold standards for unique records removed, duplicate records retained, and deduplication time.
Main Results:
- Error rates for unique records removed ranged from 2 to 22 (best: Rayyan, Covidence, SRA Deduplicator: Focused).
- Error rates for duplicate records retained ranged from 34 to 280 (best: ASySD, Rayyan, EPPI-Reviewer).
- Deduplication times varied from 1 minute to over 20 hours (fastest: SRA Deduplicator: Relaxed, Deduklick, Covidence).
Conclusions:
- All evaluated tools have limitations and strengths.
- No single tool excelled in all evaluated aspects (accuracy and speed).
- Review teams should carefully compare tools based on their specific needs and priorities to select the most suitable option.
Related Concept Videos
01:13Multiple Comparison Tests
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
02:26Comparing Copy Number Variations and SNPs
Sequencing of the human genome has opened up several best-kept secrets of the genome. Scientists have identified thousands of genome variations that exist within a population. These variations can be a single nucleotide or a larger chromosomal variation.
Copy number variations or CNVs are the structural variations that cover more than 1kb of DNA sequence. The single nucleotide polymorphism (SNP), on the other hand, is a single nucleotide change or a point mutation that is found in more than 1%...
Copy number variations or CNVs are the structural variations that cover more than 1kb of DNA sequence. The single nucleotide polymorphism (SNP), on the other hand, is a single nucleotide change or a point mutation that is found in more than 1%...
01:28Comparison Tests
An infinite series composed of positive terms may either approach a finite value or increase without bound. Determining which outcome occurs is a central task in calculus, and comparison tests provide structured methods for making this determination. Rather than evaluating a series directly, these tests relate it to another series whose behavior is already known, allowing conclusions to be drawn through logical comparison.The direct comparison test applies to series with positive terms. If each...
02:54Evolutionary Relationships through Genome Comparisons
Genome comparison is one of the excellent ways to interpret the evolutionary relationships between organisms. The basic principle of genome comparison is that if two species share a common feature, it is likely encoded by the DNA sequence conserved between both species. The advent of genome sequencing technologies in the late 20th century enabled scientists to understand the concept of conservation of domains between species and helped them to deduce evolutionary relationships across diverse...