Evaluation of KNAVE-II: a tool for intelligent query and exploration of patient data

We present the results of a preliminary evaluation of KNAVE-II, a distributed knowledge-based computational framework for visualization, interpretation, and exploration of longitudinal clinical data and of multiple levels of concepts derivable from these data. KNAVE-II uses a distributed architecture to access at run-time clinical time-oriented data, a domain-specific knowledge base containing properties of the clinical data, and a knowledge-based problem-solving method for computing on-the-fly interpretations of these data. The purpose of the evaluation was to compare efficiency and user satisfaction when answering clinical queries of variable complexity about clinical time-oriented data using KNAVE-II, versus using methods available in standard clinical settings: paper chart or electronic spreadsheet (ESS). Subjects answered high-complexity queries significantly faster using KNAVE-II than when using paper or ESS. User satisfaction with KNAVE-II was significantly superior compared to satisfaction using paper or ESS, based on a standard usability scale. Users also explicitly ranked KNAVE-II as superior to paper and the ESS.