Assessment of a knowledge-acquisition tool for writing Medical Logic Modules in the Arden Syntax

We have created a tool that allows users unfamiliar with the Arden Syntax and our underlying database to create Medical Logic Modules (MLMs). In a study of this tool (N 16), subjects found it easy to use (mean score - 4.69 on a scale of 1-5, 5 being best). Each subject created 3 MLMs of varying complexity following a protocol. On average, subjects required 312, 308 and 318 seconds, respectively, to complete each MLM. Comparison of clinicians to non-clinicians and those with to those without knowledge of Arden showed no significant difference. Of the 48 MLMs, 47 compiled and executed with appropriate output. Independent manual review of the MLM correlated well and found few errors. We conclude that our tool is easily used by inexperienced persons to write MLMs in the Arden Syntax.