Related Experiment Video
Updated: Sep 12, 2025
08:08
Author Spotlight: Capturing Infant-Caregiver Interactions Through Synchronized Multimodal Data Collection
Published on: May 31, 2024
1.0K
Documenting Care with AI: A Comparative Analysis of Commercial Scribe Tools.
Leopold Arko Iv1, Carly Hudelson1, Jaya Kumar2
1University of Minnesota, Minneapolis, MN, USA.
Studies in Health Technology and Informatics
|August 8, 2025
Summary
Artificial intelligence (AI) scribes can summarize clinical encounters, but their accuracy varies. This study found AI scribe notes contained errors, primarily omissions, highlighting the need for clinician oversight.
Area of Science:
- Medical Informatics
- Artificial Intelligence in Healthcare
- Clinical Documentation
Background:
- Clinical documentation is a significant contributor to clinician burnout.
- Artificial intelligence (AI) scribes offer automated summarization of clinical encounters using generative AI.
- Limited comparative studies exist for commercially available AI scribe tools.
Purpose of the Study:
- To evaluate and compare the quality and accuracy of notes generated by four commercial AI scribes.
- To assess AI-generated notes against physician documentation quality standards.
Main Methods:
- Four commercial AI scribe tools were tested using simulated internal medicine and surgical patient encounters.
- AI-generated notes were compared to transcripts, quantifying errors (omissions, additions, incorrect facts).
- The Physician Documentation Quality Instrument (PDQI) assessed note quality (succinctness, usefulness, comprehensiveness).
Main Results:
- Omission errors were the most frequent (71%), followed by addition errors (19.4%) and incorrect facts (6.5%).
- Vendor A exhibited the lowest overall error rate (12.2%) with balanced note quality and length.
- Vendor C had the highest omission rate (24.4%) and shortest notes; Vendor B produced the longest notes with the highest addition error rate (7.3%). PDQI-9 scores ranged from 35.5 to 39.5, with Vendors C & D scoring highest.
Conclusions:
- Commercial AI scribes demonstrate variable performance in generating accurate and high-quality clinical documentation.
- Omissions represent a significant error type, necessitating careful clinician review and oversight.
- Further research is needed on AI scribes' impact on clinical communication, patient safety, and overall documentation quality.
Related Concept Videos
01:29Documentation in Long-Term and Home Healthcare Setting
987
Documentation in long-term care facilities and home healthcare settings is crucial for ensuring continuous, coordinated, and comprehensive care for patients. Each setting has its specific documentation processes and tools:
Long-Term Care Facilities
Long-Term Care Facilities
987
01:23Methods of Documentation V: CBE
981
Charting by Exception, or CBE, is a method of documentation used in healthcare, particularly in nursing, that focuses on documenting only significant or abnormal findings rather than recording every detail. This approach aims to streamline the documentation process, improve efficiency, and ensure that healthcare providers can quickly identify deviations from normalcy in patient assessments.
In CBE, healthcare professionals establish predefined standards of practice that define what constitutes...
In CBE, healthcare professionals establish predefined standards of practice that define what constitutes...
981
01:15Methods of Documentation VI: Case Management Model
628
The case management model is a multidisciplinary approach that involves healthcare professionals from diverse disciplines, such as physicians, nurses, therapists, social workers, and pharmacists, working collaboratively to address the various needs of patients. Each healthcare professional brings unique expertise and perspectives, contributing to a more comprehensive understanding of the patient's condition and tailoring treatment plans accordingly.
For example, a patient with a chronic...
For example, a patient with a chronic...
628
01:21Methods of Documentation III: PIE
1.5K
Problem-intervention-evaluation (PIE) is a systematic approach to documentation used in healthcare settings for clinical decision-making and patient care planning. It is a structured approach to organizing patient data based on problems, interventions, and evaluations. Here's a breakdown of its key features and considerations:
1.5K
01:16Non-equilibrium in the Cell
4.8K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
4.8K
01:29Issues And Trends In Healthcare Delivery System
5.8K
The issues and trends in healthcare delivery are constantly changing. The COVID-19 pandemic is one recent issue that wreaked havoc on healthcare systems, causing a shortage of healthcare workers, high demand for medicines and supplies, and increased medical expenditure due to a lack of insurance. Other issues include rising healthcare costs and care fragmentation.
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
5.8K