Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Methods of Documentation VII: EMR01:30

Methods of Documentation VII: EMR

1.4K
Electronic Medical Records (EMRs) primarily center around electronically documenting patients' health information within a single healthcare organization or practice. They contain essential clinical data related to a patient's medical history, diagnoses, medications, treatment plans, lab results, and other pertinent information relevant to the specific encounter or episode of care. EMRs are designed to streamline documentation and workflow processes within individual healthcare...
1.4K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Barriers and opportunities to improve fluid balance recognition and reduction: a qualitative study.

Frontiers in pediatrics·2026
Same author

Variability in Vasoactive Medication use Across Pediatric Intensive Care Units: A PICU Data Collaborative Study, 2010-2022.

Journal of intensive care medicine·2026
Same author

The Challenges and Promise of AI for Clinical Documentation in Pediatric Inpatient Care.

Hospital pediatrics·2026
Same author

Change in vasoactive inotropic score following hydrocortisone administration in the pediatric intensive care unit: a PICU data collaborative study, 2010-2022.

Frontiers in pediatrics·2026
Same author

Leadership and Communication Skills Used by Pediatric Residents in the First 5 Minutes of Simulated High-Acuity Events.

Academic pediatrics·2026
Same author

Temporal trends and risk factors for bleeding and thrombosis in pediatric ECMO: A multicenter cohort study.

Perfusion·2025
Same journal

Optimizing Clinical Decision Support for Antibiotic Prescribing in Pediatric Acute Respiratory Tract Infections: A Usability Study.

Applied clinical informatics·2026
Same journal

Disparities in Activation and Use of Patient Portals Among Spanish-Speaking Patients.

Applied clinical informatics·2026
Same journal

Real-World Utilization of a Hospital-Integrated Internet Hospital in Henan Province, China: A 1-Year Observational Study.

Applied clinical informatics·2026
Same journal

From Pandemic Response to Kill the Clipboard: Patient-Controlled Sharing of Health Data Using International Patient Summary (IPS) and QR codes.

Applied clinical informatics·2026
Same journal

Usage of and Satisfaction with Artificial Intelligence-Generated Draft Replies to Patient Portal Messages.

Applied clinical informatics·2026
Same journal

Automating Ambulatory Central Line Data Capture and Calculations.

Applied clinical informatics·2026
See all related articles

Related Experiment Video

Updated: Jan 18, 2026

Automated Visual Cognitive Tasks for Recording Neural Activity Using a Floor Projection Maze
11:15

Automated Visual Cognitive Tasks for Recording Neural Activity Using a Floor Projection Maze

Published on: February 20, 2014

13.5K

Identifying Electronic Health Record Tasks and Activity Using Computer Vision.

Liem Manh Nguyen1, Amrita Sinha2, Adam Dziorny3

  • 1Department of Pediatric Critical Care, Stanford University School of Medicine, Stanford, California, United States.

Applied Clinical Informatics
|September 10, 2025
PubMed
Summary
This summary is machine-generated.

A new computer vision model accurately classifies electronic health record (EHR) tasks and quantifies active use time from screen recordings. This approach improves EHR analytics by distinguishing between active work and inactivity, offering a more precise measure of clinical activity.

More Related Videos

Web-based Clinician Guide to Record Compatible Video of Standardized Drinking Task Kinematics for Computer Vision Analysis
07:28

Web-based Clinician Guide to Record Compatible Video of Standardized Drinking Task Kinematics for Computer Vision Analysis

Published on: November 28, 2025

198
Capturing Representative Hand Use at Home Using Egocentric Video in Individuals with Upper Limb Impairment
06:25

Capturing Representative Hand Use at Home Using Egocentric Video in Individuals with Upper Limb Impairment

Published on: December 23, 2020

2.9K

Related Experiment Videos

Last Updated: Jan 18, 2026

Automated Visual Cognitive Tasks for Recording Neural Activity Using a Floor Projection Maze
11:15

Automated Visual Cognitive Tasks for Recording Neural Activity Using a Floor Projection Maze

Published on: February 20, 2014

13.5K
Web-based Clinician Guide to Record Compatible Video of Standardized Drinking Task Kinematics for Computer Vision Analysis
07:28

Web-based Clinician Guide to Record Compatible Video of Standardized Drinking Task Kinematics for Computer Vision Analysis

Published on: November 28, 2025

198
Capturing Representative Hand Use at Home Using Egocentric Video in Individuals with Upper Limb Impairment
06:25

Capturing Representative Hand Use at Home Using Egocentric Video in Individuals with Upper Limb Impairment

Published on: December 23, 2020

2.9K

Area of Science:

  • Health Informatics
  • Computer Vision Applications
  • Clinical Workflow Analysis

Background:

  • Electronic health record (EHR) use metrics are crucial for assessing clinical activity but vendor-derived data may not reflect actual user experience.
  • Quantifying precise active EHR time is challenging due to difficulties in translating discrete audit log timestamps and measuring inactivity.
  • Existing methods lack sufficient data to accurately measure time spent actively engaged with EHR systems.

Purpose of the Study:

  • To develop and validate a computer vision-based model for classifying EHR tasks and detecting task changes.
  • To quantify active EHR use time from clinician session screen recordings.
  • To enable customized EHR use metrics using raw audit log data.

Main Methods:

  • Utilized YOLOv8, Tesseract OCR, and a predefined dictionary for task classification and change detection on simulated and real-world EHR screen recordings.
  • Developed a frame comparison algorithm to differentiate between active use and inactivity, enabling active time quantification.
  • Validated model performance against clinician annotations for task classification, task change identification, and active time measurement.

Main Results:

  • The model achieved 94% accuracy in classifying high-level EHR tasks and 90.6% sensitivity in detecting task changes.
  • Active-use quantification accuracy varied by task, with lower error for tasks exhibiting clear visual changes (e.g., Results Review).
  • Post hoc analysis indicated improved active-use quantification with adjusted inactivity thresholds.

Conclusions:

  • A computer vision approach is feasible for identifying EHR tasks and measuring active time spent within the EHR system.
  • This method offers a potential solution for defining context-sensitive thresholds to quantify clinically relevant active EHR time.
  • Future research should focus on refining task-specific thresholds and validating the model across diverse clinical settings.