Development of an Evaluation Framework for Health Information Systems (DIPSA)

Area of Science:

• Health Informatics
• Information Systems Evaluation
• Healthcare Management

Background:

• Integrated Health Information Systems (IHIS) are crucial for modern healthcare delivery, offering benefits to both professionals and patients.
• Continuous evaluation and upgrading of IHIS are essential to optimize their supportive role in healthcare services.

Purpose of the Study:

• To develop a comprehensive evaluation framework for hospitals implementing Integrated Health Information Systems (IHIS).
• The framework focuses on three critical areas: Human Factor, Technology, and Organization.

Main Methods:

• A questionnaire with 43 questions covering procedures, system quality, satisfaction, safety, and collaboration was administered.
• Open-ended questions were included to gather detailed user perceptions for service improvement.
• Data were collected, processed, and analyzed using a developed database.

Main Results:

• Factor analysis identified 5 key categories for the evaluation framework.
• All categories demonstrated high reliability, with Cronbach's alpha coefficients exceeding 0.85.

Conclusions:

• Evaluation frameworks can be developed using diverse methodologies tailored to specific research aims and healthcare settings.
• The proposed framework, incorporating satisfaction, collaboration, safety, system quality, and procedures, offers a holistic evaluation of IHIS.
• Utilizing Likert scale and open-ended questions provides a comprehensive understanding of IHIS performance in hospitals.