Related Experiment Video
Updated: Jun 21, 2026

A Metadata Extraction Approach for Clinical Case Reports to Enable Advanced Understanding of Biomedical Concepts
Published on: September 20, 2018
Medical record review conduction model for improving interrater reliability of abstracting medical-related
Lisa Engel1, Courtney Henderson, Jennifer Fergenbaum
1University of Toronto, ON, Canada.
Abstract:
Medical record review (MRR) is often used in clinical research and evaluation, yet there is limited literature regarding best practices in conducting a MRR, and there are few studies reporting interrater reliability (IRR) from MRR data. The aim of this research was twofold: (a) to develop a MRR abstraction tool and standardize the MRR process and (b) to examine the IRR from MRR data. This study introduces the MRR-Conduction Model, which was used to implement a MRR, and examines the IRR between two abstractors who collected preinjury medical and psychiatric, incident-related medical and postinjury head symptom information from the medical records of 47 neurologically injured workers. Results showed that the percentage agreement was > or =85% and the unweighted kappa statistic was > or =.60 for most variables, indicating substantial IRR. An effective and reliable MRR to abstract medical-related information requires planning and time. The MRR-Conduction Model is proposed to guide the process of creating a MRR.
Insights
This study developed a Medical Record Review (MRR) process and tool, finding substantial interrater reliability (IRR) for abstracting worker injury data. The MRR-Conduction Model improves data collection reliability.
Area of Science:
- Clinical Research Methodology
- Occupational Health and Safety
Background:
- Medical Record Review (MRR) is crucial for clinical research but lacks standardized best practices.
- Limited studies report interrater reliability (IRR) for MRR data, impacting research validity.
Purpose of the Study:
- To develop a standardized Medical Record Review (MRR) abstraction tool and process.
- To evaluate the interrater reliability (IRR) of data extracted using the developed MRR process.
Main Methods:
- Developed the MRR-Conduction Model for standardized medical record abstraction.
- Two abstractors collected preinjury, incident-related, and postinjury data from 47 neurologically injured workers' records.
- Calculated percentage agreement and unweighted kappa statistics to assess IRR.
Main Results:
- Achieved percentage agreement of >=85% for most variables.
- Obtained unweighted kappa statistics of >=0.60 for most variables, indicating substantial IRR.
- Demonstrated the reliability of the MRR-Conduction Model in abstracting medical information.
Conclusions:
- An effective and reliable Medical Record Review (MRR) requires careful planning and dedicated time.
- The MRR-Conduction Model provides a structured approach to enhance the quality and consistency of MRR data.
- Substantial IRR supports the use of this model for reliable medical record abstraction in research.
Related Concept Videos
Purpose of Health Records I
Here's a breakdown of how health records serve these purposes:
Data Reporting and Recording
Methods of Documentation II: POMR
Methods of Documentation I: Source-Oriented Records
In an SOR, each discipline involved in patient care maintains a separate medical record section. This record-keeping method enables easy tracking of patient progress and ensures healthcare staff have access to up-to-date information.
Key Attributes include the following:
Introduction to Documentation and Reporting
Nursing documentation records essential information and details regarding a patient's care and treatment in written or electronic form. It is a critical aspect of nursing practice that involves documenting assessments, interventions, outcomes, and other relevant details about a patient's health status.
Documentation maps the patient's health journey by creating a comprehensive and precise...
Methods of Documentation VI: Case Management Model
For example, a patient with a chronic illness...
