Association of Qualified Clinical Data Registry Clinician Dashboard Engagement With Performance on Quality-of-Care...

Qualified Clinical Data Registries (QCDRs) have proliferated across many medical specialties, facilitating quality measure performance monitoring and reporting in programs like the CMS Merit-based Incentive Payment System. Many of these QCDRs offer web-based, clinician-facing dashboards to support quality improvement. However, it is unknown whether engagement with such dashboards is associated with improvements in quality of care.

We investigated the cross-sectional relationship between engagement with a QCDR dashboard and quality measure performance.

Data derived from a rheumatology QCDR ("Rheumatology Informatics System for Effectiveness [RISE]") and audit log data from the dashboard (exposure) and Merit-based Incentive Payment System submission data (outcome) from 2020-2022 were included. Among practices participating in RISE, we assessed aggregated engagement with the QCDR dashboard and quality performance for 8 rheumatology-specific measures at the practice level. For each measure, the binomial generalized linear model was used to examine the association between dashboard engagement and measure performance, adjusting for EHR vendor, study year, and clustering at the practice level to account for repeated measures. Two types of engagement were analyzed: (1) measure-specific (interactions with patient-level information for a particular measure) and (2) global (interactions with any feature of the dashboard, classified into 4 profiles). Linear trends between the level of dashboard engagement and performance were also tested in the global analysis.

In total, 211 practices were included in the study; over half were single-specialty practices. During their first year in the study, 65% of the practices had "most" or "moderate" levels of global engagement. In measure-specific analyses, we observed a positive but nonsignificant association of each individual and "any" actions with performance on 6-8 measures. However, having a ≥90th percentile number of drill-down views on 1 measure (rheumatoid arthritis (RA) periodic disease activity assessment) was statistically significant (odds ratio [OR] 2.3, 95% CI 1.2-4.3). In global analyses, we observed a similar pattern, where practices "most" engaged with the dashboard had higher odds of better performance compared to those with "none." In total, 4 measures (osteoporosis screening, RA functional status assessment, RA periodic disease activity assessment, and gout serum urate target) had a statistically significant association with engagement and exhibited a "dose-response" relationship (P=.004, .02, <.001, and .04, respectively, for trend). Practices with "any" global engagement had higher performance on 6 out of 8 measures, again, with RA periodic disease activity assessment being statistically significant (OR 2.9, 95% CI 1.3-6.6).

We found that higher levels of engagement were associated with higher performance on some, but not all, rheumatology-specific quality measures. Additional work is needed to understand whether the dashboard facilitates quality improvement or is merely a marker for high-performing practices.