Issues in creating and maintaining value sets for clinical quality measures
Related Experiment Video
Updated: May 15, 2026

Using Visual and Narrative Methods to Achieve Fair Process in Clinical Care
Published on: February 16, 2011
Rainer Winnenburg1, Olivier Bodenreider
1National Library of Medicine, National Institutes of Health, Bethesda, Maryland, USA. winnenburgr@mail.nih.gov
Objective:
To develop methods for assessing the validity, consistency and currency of value sets for clinical quality measures, in order to support the developers of quality measures in which such value sets are used.
Methods:
We assessed the well-formedness of the codes (in a given code system), the existence and currency of the codes in the corresponding code system, using the UMLS and RxNorm terminology services. We also investigated the overlap among value sets using the Jaccard similarity measure.
Results:
We extracted 163,788 codes (76,062 unique codes) from 1463 unique value sets in the 113 quality measures published by the National Quality Forum (NQF) in December 2011. Overall, 5% of the codes are invalid (4% of the unique codes). We also found 67 duplicate value sets and 10 pairs of value sets exhibiting a high degree of similarity (Jaccard > .9).
Conclusion:
Invalid codes affect a large proportion of the value sets (19%). 79% of the quality Measures have at least one value set exhibiting errors. However, 50% of the quality measures exhibit errors in less than 10 % of their value sets. The existence of duplicate and highly-similar value sets suggests the need for an authoritative repository of value sets and related tooling in order to support the development of quality measures.
Related Concept Videos
Methods of Documentation VI: Case Management Model
For example, a patient with a chronic illness...
Health Information Technology and Healthcare Information System
Health Information Technology, commonly called HIT, integrates advanced information systems and technology in healthcare settings. Its primary functions include:
Ethical Issues
Ethical Concerns in Healthcare:
Methods of Documentation III: PIE
Issues And Trends In Healthcare Delivery System
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
Methods of Documentation V: CBE
In CBE, healthcare professionals establish predefined standards of practice that define what constitutes...