Evaluation of the Integrated Services Pilot Program from Western Australia.

Area of Science:

• Public Health
• Social Sciences
• Program Evaluation

Background:

• Independent evaluation of refugee programs is mandated by funding bodies in developed countries.
• The Integrated Services Centre (ISC) Pilot Project in Australia aimed to provide comprehensive support to humanitarian refugees.
• The project focused on settlement, physical health, mental health, and employment assistance.

Purpose of the Study:

• To evaluate the effectiveness and outcomes of the Integrated Services Centre (ISC) Pilot Project.
• To explore stakeholder perceptions and identify unintended outcomes of the integrated support model.
• To discuss methodological challenges in program evaluation, specifically regarding baseline data collection.

Main Methods:

• A qualitative 'engaged' methodology was employed for the evaluation.
• Data collection involved interviews, focus groups, and telephone interviews with stakeholders, project staff, and refugee families.
• The narrative-rich qualitative data aimed to capture stakeholder perspectives and daily operational insights.

Main Results:

• The qualitative approach successfully highlighted issues as perceived by different stakeholders.
• The evaluation provided insights into the daily work of ISC staff, revealing unintended outcomes.
• The study identified a common challenge in program evaluations: the late recruitment of evaluators, hindering baseline data collection.

Conclusions:

• Qualitative methodologies offer valuable insights into program implementation and stakeholder experiences.
• Effective program evaluation requires early engagement of independent evaluators to collect baseline data.
• Addressing methodological limitations, such as delayed baseline data collection, is crucial for robust program assessment.