Related Experiment Video
Updated: Jul 12, 2026
08:40
Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
Published on: June 12, 2019
Inter-rater reliability of case-note audit: a systematic review
Richard Lilford1, Alex Edwards, Alan Girling
1Department of Public Health and Epidemiology, University of Birmingham, Birmingham, UK. R.J.Lilford@bham.ac.uk
Journal of Health Services Research & Policy
|August 25, 2007
Summary
Assessing clinical care quality through case-note audits shows variable inter-rater reliability. Reliability is higher with explicit criteria and outcome focus, but publication bias may inflate results.
Area of Science:
- Healthcare Quality Improvement
- Medical Record Analysis
- Clinical Audit Research
Background:
- Retrospective case-note audit is a common method for evaluating clinical care quality.
- Determining the consistency of judgments between different reviewers (inter-rater reliability) is crucial for accurate assessments.
Purpose of the Study:
- To systematically review and synthesize the existing literature on the inter-rater reliability of case-note audits.
- To identify factors influencing the reliability of case-note reviews.
Main Methods:
- A systematic review was conducted, analyzing 26 studies that compared the independent judgments of two or three raters.
- Sixty-six separate reliability comparisons were extracted and analyzed.
Main Results:
- Mean kappa values, a measure of agreement, ranged from 0.32 to 0.70, with potential inflation due to publication bias.
- Higher reliability was observed when using explicit criteria versus implicit criteria.
- Reviews focusing on patient outcomes demonstrated greater reliability than those focusing on process errors.
Conclusions:
- The reliability of case-note audits is influenced by the review criteria and focus (outcome vs. process).
- The relationship between kappa statistics and the prevalence of errors necessitates careful consideration in study design and interpretation.
- Alternative statistical methods, such as tetrachoric and polychoric correlations, may be more appropriate for assessing inter-rater reliability in certain contexts.
Related Concept Videos
01:15Methods of Documentation VI: Case Management Model
The case management model is a multidisciplinary approach that involves healthcare professionals from diverse disciplines, such as physicians, nurses, therapists, social workers, and pharmacists, working collaboratively to address the various needs of patients. Each healthcare professional brings unique expertise and perspectives, contributing to a more comprehensive understanding of the patient's condition and tailoring treatment plans accordingly.
For example, a patient with a chronic illness...
For example, a patient with a chronic illness...
01:21Methods of Documentation III: PIE
Problem-intervention-evaluation (PIE) is a systematic approach to documentation used in healthcare settings for clinical decision-making and patient care planning. It is a structured approach to organizing patient data based on problems, interventions, and evaluations. Here's a breakdown of its key features and considerations:
01:23Methods of Documentation V: CBE
Charting by Exception, or CBE, is a method of documentation used in healthcare, particularly in nursing, that focuses on documenting only significant or abnormal findings rather than recording every detail. This approach aims to streamline the documentation process, improve efficiency, and ensure that healthcare providers can quickly identify deviations from normalcy in patient assessments.
In CBE, healthcare professionals establish predefined standards of practice that define what constitutes...
In CBE, healthcare professionals establish predefined standards of practice that define what constitutes...
01:11Purpose of Health Records I
The vital purpose of health records is to provide a complete and accurate account of a patient's medical history, including communication, diagnostic and therapeutic orders, care planning, research, and quality review.
Here's a breakdown of how health records serve these purposes:
Here's a breakdown of how health records serve these purposes:
01:20Assessment of Ventilation I: Respiratory Rate
Assessment of Ventilation
A Ventilation assessment is critical for monitoring a patient's health status. Respiration, one of the most accessible vital signs, provides insights into the function of numerous body systems and can indicate serious health issues, such as brainstem injuries from head trauma.
Critical Guidelines for Assessing Ventilation:
A Ventilation assessment is critical for monitoring a patient's health status. Respiration, one of the most accessible vital signs, provides insights into the function of numerous body systems and can indicate serious health issues, such as brainstem injuries from head trauma.
Critical Guidelines for Assessing Ventilation:
01:25Assessment of apical radial pulse
Apical-Radial (A-R) Pulse Assessment
The A-R pulse assessment involves simultaneous evaluation of the apical and radial pulses. When the apical and radial pulse rates vary, this assessment helps identify a pulse deficit.
Pre-Procedural Preparation
The A-R pulse assessment involves simultaneous evaluation of the apical and radial pulses. When the apical and radial pulse rates vary, this assessment helps identify a pulse deficit.
Pre-Procedural Preparation