Determining differences in user performance between expert and novice primary care doctors when using an electronic...

Area of Science:

• Health Informatics
• Human-Computer Interaction
• Medical Education

Background:

• Electronic Health Records (EHRs) are integral to modern healthcare delivery.
• Usability of EHR systems significantly impacts clinician efficiency and patient care.
• Existing research often focuses on general usability, with less attention to expertise-based differences.

Purpose of the Study:

• To identify and analyze usability gaps in Electronic Health Records (EHRs) between expert and novice primary care physicians.
• To evaluate how varying levels of EHR experience influence task completion efficiency and success rates.
• To provide data for improving EHR system design and training programs.

Main Methods:

• A mixed-methods approach was employed, including video analysis and think-aloud strategy.
• Usability testing involved 17 primary care physicians (7 expert, 10 novice) performing 19 standardized tasks.
• Data collection included performance metrics, System Usability Scale (SUS) scores, and post-session debriefings.

Main Results:

• Expert physicians achieved slightly higher SUS scores (70) than novices (68), indicating marginally better perceived usability.
• Despite efficiency differences, 'percent task success rate' was comparable between expert (74%) and novice (78%) groups (P=0.98).
• No significant increase in proficiency was observed in expert physicians despite longer EHR system usage.

Conclusions:

• Physician experience with EHR systems does not necessarily correlate with improved proficiency or task success.
• Findings suggest a need for enhanced EHR training programs and user interface improvements to address usability challenges.
• Optimizing EHR usability can potentially reduce system-related errors and enhance overall physician performance.