Evaluating medical expert systems

Approximately 90% of all computerized medical expert systems have not been evaluated in clinical environments. This paper: identifies the principal methods used to assess the performance of medical expert systems in both laboratory and clinical settings, describes the different research strategies used in the evaluation of medical expert systems at different development stages, and discusses past evaluation efforts in relationship to future applications of different decision support technologies and expert systems in health care.