Evaluating an information system for medical care evaluation studies

Area of Science:

• Health Informatics
• Medical Quality Improvement
• Hospital Administration

Background:

• Medical care evaluation studies are crucial for improving patient outcomes and hospital efficiency.
• Computerized systems offer potential benefits in data collection and analysis for quality improvement initiatives.
• Evaluating the effectiveness and efficiency of these systems is essential for healthcare organizations.

Purpose of the Study:

• To evaluate the Professional Activity Study-Medical Audit Program (PAS-MAP) for conducting medical care evaluation studies.
• To compare the PAS-MAP system with a manual data collection method.
• To determine the cost-effectiveness, timeliness, data completeness, and reliability of PAS-MAP.

Main Methods:

• A comparative study design was employed, contrasting PAS-MAP with a manual data collection system.
• Data collection focused on information not readily available on medical record face sheets.
• Decision-makers assigned weights to various performance metrics (cost, timeliness, data elements, error protection) for a comprehensive evaluation.

Main Results:

• PAS-MAP demonstrated cost-effectiveness only when over 41% of hospitalized patients were included in studies.
• The system's timeliness was comparable to the manual method for available data, but it provided fewer requested clinical data elements.
• PAS-MAP was found to be less effective in preventing human error compared to the manual approach.

Conclusions:

• The manual system was recommended for implementation based on a weighted scoring model.
• The trade-offs between cost, data completeness, and error reduction influenced the final recommendation.
• Findings suggest that the suitability of PAS-MAP depends on specific hospital study parameters and priorities.