Related Experiment Video
Updated: Jan 13, 2026

Reduced Procedure Time and Variability with Active Esophageal Cooling During Radiofrequency Ablation for Atrial Fibrillation
Published on: August 25, 2022
Manually Abstracted versus Electronic Health Record Data for Surgical Quality Improvement
James L Galloway1, Vivi W Chen2, Jennifer Kramer3
1Veterans Affairs Quality Scholars Program, Atlanta VA Health Care System, Decatur, Georgia; Department of Surgery, Emory University School of Medicine, Atlanta, Georgia.
Automating data collection for the Veterans Affairs Surgical Quality Improvement Program (VASQIP) using electronic health records (EHR) shows high accuracy for most variables. This automation can enhance surgical quality improvement (QI) programs by saving resources and improving data timeliness.
Area of Science:
- Health Informatics
- Surgical Quality Improvement
- Data Science in Healthcare
Background:
- Manual data abstraction is the benchmark for surgical quality improvement (QI) programs.
- Automating data collection can significantly benefit QI initiatives by reducing resource demands.
- The Veterans Affairs Surgical Quality Improvement Program (VASQIP) relies on manual abstraction.
Purpose of the Study:
- To assess the accuracy and concordance of electronic health record (EHR)-derived variables compared to manually abstracted VASQIP variables.
- To determine the feasibility of automating data collection for VASQIP.
- To evaluate the potential of EHR data for enhancing surgical QI.
Main Methods:
- A national, cross-sectional analysis comparing EHR-derived VASQIP variable correlates with manually abstracted VASQIP variables (2016-2020).
- Used Cohen's kappa, sensitivity, specificity, and predictive values to measure agreement.
- Defined strong agreement as kappa ≥80%.
Main Results:
- Evaluated 533,164 cases across 113 hospitals.
- High agreement (median kappa 98.1%) for race and ethnicity.
- Variable agreement for preoperative risk factors (median 28.6%) and postoperative complications (median 15.1%).
- Strong agreement for preoperative labs (median 91.9%) and intraoperative factors (median 93.9%).
Conclusions:
- EHR-derived correlates demonstrate high accuracy for automating data collection for many VASQIP variables, excluding postoperative complications.
- Automation can reduce manual data abstraction resources.
- Increased timeliness and robustness of surgical QI programs are achievable through EHR data utilization.
Related Concept Videos
Methods of Documentation VII: EMR
Health Information Technology and Healthcare Information System
Health Information Technology, commonly called HIT, integrates advanced information systems and technology in healthcare settings. Its primary functions include:
Purpose of Health Records I
Here's a breakdown of how health records serve these purposes:
Data Reporting and Recording
Methods of Documentation V: CBE
In CBE, healthcare professionals establish predefined standards of practice that define what constitutes...
Methods of Documentation I: Source-Oriented Records
In an SOR, each discipline involved in patient care maintains a separate medical record section. This record-keeping method enables easy tracking of patient progress and ensures healthcare staff have access to up-to-date information.
Key Attributes include the following:

