Related Experiment Videos
Medical audit data: counting is not enough
Insights
This audit of surgical inpatient data revealed significant data collection challenges and limitations in outcome measures. Accurate data collection is crucial for meaningful surgical audits and effective patient care management.
Area of Science:
- Healthcare Management
- Surgical Audit
- Medical Informatics
Background:
- Surgical audits are essential for evaluating and improving patient care.
- The meaningfulness and utility of audit data are often questioned.
- Accurate data collection is a prerequisite for reliable audit findings.
Purpose of the Study:
- To assess the value of one year of general surgeon inpatient audit data.
- To critically evaluate the usefulness of specific outcome measures in surgical audits.
- To identify challenges in data collection and reporting for surgical audits.
Main Methods:
- Analysis of inpatient records from a consultant general surgeon's audit computer data (Dunnfile) over one year.
- Comparison of audit data with ward records and the patient administration system for accuracy verification.
- Analysis of procedures by complexity (BUPA code), surgeon grade, complications, and returns to theatre.
Main Results:
- Audit data provided insights into surgical activity, such as registrar vs. senior registrar operation numbers and complication rates.
- Simple complication rates lacked context regarding avoidability, and returns to theatre required further qualification.
- Significant data collection deficits (30% initially, 17% by end of audit) were identified compared to ward and patient administration systems.
Conclusions:
- Ensuring adequate data collection for surgical audits is challenging and requires interdisciplinary effort.
- Integrating audit systems with patient administration systems could improve data accuracy and completeness.
- While crude analyses of workload and complications have limitations, audit data aids in measuring activity and managing surgical services, necessitating careful data interpretation.
Objective:
To assess the meaningfulness of a year's worth of audit data relating to all the inpatients of one consultant general surgeon and to question the usefulness of certain outcome measures.
Design:
Analysis of records entered on to audit computer (Dunnfile) and relating to inpatient episodes for one consultant general surgeon over one year. Data obtained were compared with ward records and the patient administration system to check their accuracy.
Setting:
The three hospitals and 12 wards in Brighton health district where the surgeon admitted patients.
Subjects:
859 Records relating to inpatient episodes from 1 January to 31 December 1988. These covered 655 main procedures and 79 secondary procedures performed at the same time.
Main Outcome Measures:
Procedures were analysed by complexity of operation (BUPA code) and grade of surgeon; complications were counted and rates constructed by surgeon and by BUPA code: returns to theatre were analysed.
Results:
Simple counts revealed some data, such as the fact that one registrar performed more major operations (32) than the senior registrars (22 and 14), and an analysis of complications showed that he had a lower complication rate (11.4% v 20.0% and 19.4%). But the simple complication rate disclosed nothing about whether the complication was avoidable. Likewise, the number of returns to theatre needed further qualification. Analysis of data collection for February to April 1988 showed a 30% deficit of information on the audit system compared with ward records and prompted a re-examination of everyone's role in collecting data. After the year's audit there was still a 17% shortfall compared with the district's patient administration system, though some of this was accounted for by a backlog of work.
Conclusions:
It is difficult to ensure adequate data collection and entails everyone in an unfamiliar discipline. Connecting the audit system to the patient administration system would help. Despite the limitations of crude analyses of workload and complications rates, the audit data helped to measure activity and in the management of the firm. Nevertheless, time and care have to be taken in presenting and interpreting audit data carefully.
Implications:
Counting is not enough.