Evaluation of automated information systems in health care: an approach to classifying evaluative studies

In this paper we discuss an approach to classifying evaluative studies of automated information systems in health care. Selected literature (76 studies) is classified according to the type of automated information system (based on relationship to the care process), the study design used, the data collection methods used, the effect(s) measured and the type of evaluation (e.g. cost-benefit analysis). First results show that certain types of automated information systems have not been evaluated much, going by the number of studies selected. Furthermore, it is observed that certain study designs (time-series design), data collection methods (modelling and simulation) and effect measures (job satisfaction) are hardly to be found in the literature. Only 10 of 76 selected studies used a type of evaluation for which both consequences and costs are considered. Detailed investigation of the literature may provide information for the development of a general framework for the evaluation of different types of automated information systems.