Related Experiment Video
Updated: Aug 5, 2026

CIRCLE-Seq for Interrogation of Off-Target Gene Editing
Published on: November 1, 2024
Systematic Benchmarking of CRISPR-Cas9 Off-Target Prediction Tools Reveals Limitations and Implications for
Masako M Kaufmann1, Maren Hackenberg2, William Jobson Pargeter3
1Institute for Transfusion Medicine and Gene Therapy, Medical Center-University of Freiburg, Freiburg, Germany.
Abstract:
Accurate identification of CRISPR-Cas9 off-target sites is essential for the safety assessment of genome-editing-based therapies. While numerous in silico prediction tools have been developed, their comparative performance and practical utility in preclinical workflows remain incompletely defined. We performed a systematic benchmarking of 14 in silico CRISPR-Cas9 off-target prediction tools, including both standard approaches and machine learning-based models. The analysis was based on a curated dataset derived from the CRISPRoffT database, comprising 3,827 deep-sequenced genomic sites across 26 guide RNA/Cas9 combinations in human cells. Sites with indel frequencies ≥0.1% were operationally defined as true off-targets. We evaluated tool performance using score distributions, correlation with indel frequencies, precision-recall characteristics, recall among top-ranked candidate sites, and the effect of combining tools. All tools assigned higher scores to true off-target sites compared with nontarget sites, although substantial overlap between classes was observed. Correlation between prediction scores and indel frequencies was weak to moderate, indicating limited ability to predict editing magnitude. Precision-recall performance was moderate across all tools, reflecting inherent trade-offs between sensitivity and specificity. Recall increased with the number of predicted sites considered, reaching approximately 77% among the top 500 and up to 83% among the top 1,250 sites, but leaving a substantial fraction of true off-targets undetected. Combining tools yielded only modest improvements. Current in silico tools enable prioritization of CRISPR-Cas9 off-target candidates but remain limited in their ability to comprehensively identify and quantitatively predict off-target activity. Our findings highlight the importance of considering both ranking performance and candidate site coverage and support the use of combined computational and experimental strategies for robust off-target assessment in preclinical gene editing workflows.
Insights
Accurate CRISPR-Cas9 off-target prediction is crucial for gene therapy safety. While in silico tools aid prioritization, they have limitations in comprehensively identifying and quantifying off-target effects, necessitating combined computational and experimental strategies.
Area of Science:
- Genomics
- Bioinformatics
- Molecular Biology
Background:
- Accurate identification of CRISPR-Cas9 off-target sites is critical for the safety evaluation of genome-editing therapies.
- Numerous in silico prediction tools exist, but their comparative performance and utility in preclinical workflows are not fully understood.
Purpose of the Study:
- To systematically benchmark 14 in silico CRISPR-Cas9 off-target prediction tools.
- To evaluate tool performance based on a curated dataset of deep-sequenced genomic sites.
Main Methods:
- A systematic benchmarking of 14 in silico CRISPR-Cas9 off-target prediction tools was performed.
- The analysis utilized a dataset of 3,827 deep-sequenced genomic sites from the CRISPRoffT database in human cells.
- Tool performance was assessed using score distributions, correlation with indel frequencies, precision-recall curves, and recall at top-ranked sites.
Main Results:
- All tools distinguished true off-target sites from non-target sites, but with significant overlap.
- Correlation between prediction scores and indel frequencies was weak to moderate, limiting prediction of editing magnitude.
- Precision-recall performance was moderate, with recall reaching up to 83% among the top 1,250 predicted sites, leaving some true off-targets undetected.
Conclusions:
- Current in silico tools are valuable for prioritizing CRISPR-Cas9 off-target candidates but have limitations in comprehensive identification and quantitative prediction.
- Robust off-target assessment in preclinical gene editing requires considering both ranking performance and candidate site coverage, integrating computational and experimental approaches.
Related Concept Videos
CRISPR
CRISPR and crRNAs
The CRISPR-Cas system stores a copy of foreign DNA in the host genome and uses it to identify the foreign DNA upon reinfection. CRISPR-Cas has three different...
CRISPR/Cas9 Genome Editing
