Evaluation capacity building in community health using a learning-by-doing approach: project overview and study...

Evaluation capacity building (ECB) is pivotal in advancing the quality and impact of community health services. Despite the recognised value of evidence-informed practice, ECB among community health staff remains limited, and published ECB initiatives have rarely been rigorously evaluated. The Integrated and Community Health directorate of the Western Sydney Local Health District in NSW, Australia, serves an urban population of approximately 1.1 million people characterised by high levels of cultural, linguistic and socioeconomic diversity. An internal needs assessment conducted in 2020 confirmed significant gaps in staff skills, confidence and organisational support for evaluation. This paper presents the rationale, theoretical foundations, and study protocol for the evaluation of a novel 'learning-by-doing' (LbD) ECB initiative developed in response to these needs.

The study uses a mixed-methods approach, combining qualitative and quantitative data to assess the implementation and outcomes of the initiative's three main phases: stakeholder engagement, participant selection and project identification, and skills training using a LbD approach. Quantitative data from pre- and post-intervention surveys measured changes in skills, attitudes and organisational support, whereas qualitative data from focus groups and interviews provided in-depth insights into participants' experiences and the initiative's perceived impact.

The findings contribute to understanding the methods for practitioner training, organisational development and cultural change to enable evidence-informed health service delivery at the community level. By involving frontline staff, managers and leaders in its co-design process, the LbD initiative ensures relevance and applicability, contributing significantly to research, practice and policy with a replicable model for similar capacity-building initiatives.