Development of a practice-based skills measure for community-based organizations implementing evidence-based...

Community-based organizations (CBOs) are well-positioned to deliver evidence-based interventions (EBIs) to communities facing health inequities. However, CBO practitioners do not typically have the opportunity to build the necessary skills for EBI delivery. Few validated measures assess EBI skill levels among CBO practitioners, limiting the development and evaluation of capacity-building interventions. Additionally, capacity-building models typically represent academics' views of the subject, with little incorporation of practitioner voices. Thus, we sought to develop a new measure of EBI skills among CBO practitioners.

Drawing on existing measures, qualitative research, and group concept mapping processes that privileged practitioner and academic expertise, we developed a 54-item instrument covering 10 core EBI skill domains (assessing needs, collaborating with partners, identifying evidence-based programs, adapting for context, implementing; evaluating and iterating; community engagement; planning for sustainability; managing; and funding). After conducting cognitive testing (n = 12), the instrument was administered online to CBO practitioners with at least 3 years of practice experience who served populations experiencing health inequities. Complete case factor analysis and reliability testing were conducted using R.

Participants included 314 respondents, 96% of whom (n = 304) were included in this analysis. They predominantly identified as Black or African American (31%) and White (30%), female (76%), social workers (45%), having 3-5 years of work experience, and were predominantly from the Northeast region of the United States. All work with populations experiencing health inequities. Exploratory factor analysis confirmed measure reliability of a 24-item version with Cronbach's alpha of 0.93. Factor loadings indicated three underlying domains: 1) community needs and partnerships to support implementation, 2) community engagement to support implementation, and 3) evaluation and adaptation of EBIs.

This study is the first step towards a validated, practitioner-informed measure of EBI skills tailored to the unique contexts of CBOs addressing inequities, contributing to the growing literature on capacity-building for EBI implementation in community settings. By centering practitioner perspectives and aligning with long-term health promotion goals, this measure offers a practical tool for strengthening the foundational skills necessary to address health inequities. Future research should explore its application in diverse CBO contexts and assess its impact on EBI implementation and health equity outcomes.