Techniques in evaluating nursing expert systems: A case study

This study addresses the problems in evaluating nursing diagnostic artificial intelligence (AI) expert systems. Two separate experiments (N = 49) were conducted using a computer expert system. The first experiment, the "white box" experiment (n = 9), compared the diagnostic techniques applied by experience RNs against the programmed techniques used by the expert system. The second experiment, the "black box" experiment (n = 40), compared diagnostic results of beginning nurses against the computer expert systems results. In some cases the computer outperformed the nurses and vice versa. The evaluation techniques, as applied in both experiments, enhance the ability of nurses to evaluate and select AI expert systems to be used in computer-assisted diagnosis of nursing problems.