Related Experiment Video
Updated: Aug 8, 2026
05:45
Validating Whole Genome Nanopore Sequencing, using Usutu Virus as an Example
Published on: March 11, 2020
Inter-tool Analysis of a NIST Dataset for Assessing Baseline Nucleic Acid Sequence Screening
Tyler S Laird1, Kevin Flyangolts2, Craig Bartling3
1NIST, Gaithersburg, Maryland, USA.
Summary
Nucleic acid synthesis screening tools show high accuracy (>95% sensitivity, >97% accuracy) in identifying sequences of concern (SOCs). Minor disagreements stemmed from differing definitions and methods, highlighting the need for harmonization in biosecurity protocols.
Area of Science:
- Biosecurity
- Molecular Biology
- Bioinformatics
Background:
- Nucleic acid synthesis is a dual-use technology with significant potential benefits and risks.
- Safeguarding this technology is crucial to prevent misuse.
- Sequence screening for Sequences of Concern (SOCs) is a key biosecurity measure.
Purpose of the Study:
- To assess the harmonization and performance consistency of nucleic acid sequence screening tools.
- To evaluate if existing tools meet a baseline performance standard for biosecurity.
Main Methods:
- The National Institute of Standards and Technology (NIST) developed a test dataset based on current screening recommendations.
- Blinded datasets were distributed to developers of nucleic acid sequence screening tools for evaluation.
Main Results:
- A general agreement was observed between the screening tools and NIST-assigned labels.
- All tools demonstrated a baseline performance exceeding 95% sensitivity and 97% accuracy.
- Discrepancies were primarily attributed to variations in defining SOCs and differences in screening methodologies.
Conclusions:
- Current nucleic acid sequence screening tools exhibit high baseline performance.
- Differences in tool performance are linked to variations in SOC definitions and algorithms.
- Further harmonization of screening criteria and methodologies is recommended for enhanced biosecurity.
