Evaluating the impact of training in psychosocial interventions: a stakeholder approach to evaluation--part I

A range of psychosocial interventions (PSI) have developed as approaches to the treatment and support of people with enduring mental health problems and their carers. The impact of training mental health workers in PSI has also been subject to extensive research and evaluation for the past decade. Most previous research in the PSI and PSI training arenas have tended to adopt quasi-experimental designs and professionally defined outcomes-focused approaches to judging the success of training. This paper offers a critique of such approaches and presents a rationale for the methodology used in a qualitative study that evaluated five short PSI courses. The study emphasized a stakeholder approach to evaluation, involving collaborative activities between service users, carers, lecturers and mental health workers. These activities were intended to define what outcomes should be used to judge the success of training and how these should be examined during the research process. This paper details the processes and findings of these stakeholder activities that suggested, for service users particularly, process rather than outcome issues were the most important determinants of the success of PSI. Additionally, if outcomes were used to judge the success of interventions these should be highly individualized to reflect the aspirations of the person receiving the intervention. On the basis of the findings presented, discussion explores a proposal for a different methodological direction to the evaluation of PSI training. Part II of this paper presents and discusses the findings from the evaluation of the courses.