Barriers to evaluation of clinical vocabularies

The importance of standard vocabularies for representing clinical data is widely accepted. The selection of suitable vocabularies for a given task relies upon criteria for systematically differentiating vocabularies. However, methods and measures for comparing vocabularies are only now emerging. Substantial barriers inhibit progress in the development of these measures.

As part of a larger project, the authors are developing quantitative measures for characteristics of controlled vocabulary as identified in the literature.

Seven barriers have been identified that inhibit the development of quantitative measures of the characteristics of controlled vocabularies: 1) application dependence; 2) empirical v. independent assessment; 3) dichotomous v. continuous measures of characteristics; 4) poor definition of characteristics; 5) number of characteristics; 6) multiple levels of significance of characteristics; and 7) interdependence of characteristics.

Progress toward quantitative assessment of clinical vocabularies is dependent upon overcoming barriers to the development of appropriate measures. Such progress requires innovative solutions and collaboration among investigators.