Comparative hospital databases: value for management and quality

To establish an accurate and reliable comparative database of discharge abstracts and to appraise its value for assessments of quality of care.

Retrospective review of case notes by trained research abstractors and comparison with matched information as routinely collected by the hospitals' own information systems.

Three district general hospitals and two major London teaching hospitals.

The database included 3905 medical and surgical cases and 2082 obstetric cases from 1990 and 1991.

Accessibility of case notes; measures of reliability between reviewers and of validity of case note content; application of high level quality indicators.

The existing hospital systems extracted insufficient detail from case notes to conduct clinical comparative analyses for medical and surgical cases. The research abstractors at least doubled the diagnostic codes extracted. Interabstractor agreement of about 70% was obtained for primary diagnosis and assignment to diagnosis related group. These data were sufficient to create a comparative database and apply high level quality indicators designed to flag topics for further study. For obstetric-specific indicators the rates were comparable for abstractors and the hospital information systems, which in each case was a departmentally based system (SMMIS) producing more detailed and accessible data.

Current methods of extracting and coding diagnostic and procedural data from case notes in this sample of hospitals is unsatisfactory: notes were difficult to access and recording is unacceptably incomplete.

Improvements as piloted in this project, are readily available should the NHS, hospital managers, and clinicians see the value of these data in their clinical and managerial activities.