Related Experiment Video
Updated: May 6, 2026

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
Published on: September 4, 2019
The value of simulation testing for the evaluation of ambient digital scribes: a case report
Joshua M Biro1, Jessica L Handley1, James Mickler2
1MedStar Health National Center for Human Factors in Healthcare, Washington, DC 20008, United States.
Objectives:
The objective of this work is to demonstrate the value of simulation testing for rapidly evaluating artificial intelligence (AI) products.
Materials And Methods:
Researcher-physician teams simulated the use of 2 Ambient Digital Scribe (ADS) products by reading scripts of outpatient encounters while using both products, yielding a total of 44 draft notes. Time to edit, perceived amount of effort and editing, and errors in the AI-generated draft notes were analyzed.
Results:
Ambient Digital Scribe Product A draft notes took significantly longer to edit, had fewer omissions, and more additions and irrelevant or misplaced text errors than ADS Product B. Ambient Digital Scribe Product A was rated as performing better for most encounters.
Discussion:
Artificial intelligence-enabled products are being rapidly developed and implemented into practice, outpacing safety concerns. Simulation testing can efficiently identify safety issues.
Conclusion:
Simulation testing is a crucial first step to take when evaluating AI-enabled technologies.
More Related Videos
07:15Tactile Vibrating Toolkit and Driving Simulation Platform for Driving-Related Research
Published on: December 18, 2020
09:00Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
Published on: August 16, 2024
Related Concept Videos
Uncertainty in Measurement: Reading Instruments
Self-Report Tests of Personality