Related Experiment Video
Updated: Aug 27, 2025

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
End-user understanding of qualitative comparative analysis used within evidence synthesis: A mixed-methods study
Leila C Kahwati1,2, Bridget J Kelly2, Mihaela Johnson2
1RTI-University of North Carolina Evidence Based Practice Center, Research Triangle Park, Durham, North Carolina, USA.
Background:
Enhanced uptake of systematic reviews that use qualitative comparative analyses (QCA) requires knowing how end-users interpret such findings. The study purpose was to identify effective approaches to communicating results from a QCA within a systematic review.
Methods:
Sequential exploratory mixed methods design; thematic analysis of interviews with 11 end-users followed by a randomized experiment with 254 participants that provided QCA results for a hypothetical review presented through three formats (text, table, and figure). A survey administered after the experiment assessed subjective and objective comprehension of QCA results.
Results:
Interview themes included use of jargon; appropriate use of appendices, tables, figures; and integration of QCA results within the systematic review. In the experiment, we observed a significant difference (p = 0.035) in subjective comprehension across the three presentation formats. Participants randomized to the figure and text formats scored higher compared to the table. No significant differences were observed for objective comprehension overall (p = 0.11). However, for parameter interpretation (a unique component of QCA results), scores among participants that received the figure format were significantly higher than scores for participants who received the text (p = 0.001) or table (p = 0.004). No significant differences (p = 0.09) were observed in objective comprehension for configuration interpretation.
Conclusions:
End-users of systematic reviews saw value in the use of QCA, but unfamiliar methods and terminology were barriers to full understanding of the findings. When presenting results, a figure format appears to be superior to text or table formats based on measures of subjective comprehension and some measures of objective comprehension.
Related Concept Videos
Qualitative Analysis
There are two main approaches to qualitative analysis:...
Bioequivalence: Overview
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Cochran's Q Test
Comparing the Survival Analysis of Two or More Groups
Significance Testing: Overview

