Measuring the predictive performance of computer-controlled infusion pumps

Current measures of the performance of computer-controlled infusion pumps (CCIPs) are poorly defined, of little use to the clinician using the CCIP, and pharmacostatistically incorrect. We propose four measures be used to quantitate the performance of CCIPs: median absolute performance error (MDAPE), median performance error (MDPE), divergence, and wobble. These measures offer several significant advantages over previous measures. First, their definitions are based on the performance error as a fraction of the predicted (rather than measured) drug concentration, making the measures much more useful to the clinician. Second, the measures are defined in a way that addresses the pharmacostatistical issue of appropriate estimation of population parameters. Finally, the measure of inaccuracy, MDAPE, is defined in a way that is consistent with iteratively reweighted least squares nonlinear regression, a commonly used method of estimating pharmacokinetic parameters. These measures make it possible to quantitate the overall performance of a CCIP or to compare the predictive performance of CCIPs which differ in either general approach (e.g., compartmental model driven vs. plasma efflux approach), pump mechanics, software algorithms, or pharmacokinetic parameter sets.