Development of a psychometrically valid training needs analysis instrument for use with primary health care teams

The growing demand for professional updating and training within the health service has created a proliferation of post-registration courses, many of which fail to reach the appropriate personnel or the real training objectives of the participants and their managers. One reason behind this problem relates to the fact that many such courses are constructed and delivered in a haphazard way, without systematic reference to the direct and indirect consumers of the educational programmes. A more rational approach to post-experience provision of this sort might involve the methodical collection of information regarding the training needs of target health professional populations. Such a data base would afford a global overview of competencies and deficiencies, both within and between individuals. From this the content, level and focus of training could be customized to meet the reported needs, thereby streamlining the commissioning process to enhance efficiency and effectiveness. Previous attempts to rationalize provision through the prior use of training needs analysis instruments have been compromised by the shortcomings of the analysis tool. This study, then, was an attempt to redress this problem, using a training needs analysis instrument developed along traditional psychometric principles. The tool was intended to be used with primary health care teams because of the increasing role this sector of the health service will play in the future delivery of care, although this would not preclude its use with other health care professionals (following appropriate modification), since the principles behind its construction and format are transferable. The instrument has demonstrable construct, content and face validity and significant reliability. Moreover, preliminary investigations suggest that it also has criterion validity in the areas tested. These findings suggest that the instrument is unique of its kind. Early use of the tool has demonstrated its value in a variety of ways, such as in team building exercises and skill mix reviews as well as in precise and effective commissioning of training and education in a range of areas.