Assessing the performance of specialist registrars

Assessing the performance of doctors while they are engaged in clinical work is a challenging concept. The introduction of objective-based curricula provides the stimulus and opportunity for the Royal Colleges of Physicians to develop relevant and reliable methods of in-service assessment. We propose to pilot a study investigating the validity, reliability and feasibility of three assessment methods--direct observation of the clinical encounter using an adapted mini-CEX, direct observation of the performance of practical procedures (DOPS), and the doctor's ability to perform effectively as part of a team using 360 degree assessment. The methods will be studied in the setting of routine clinical care. Whilst demanding of time from both trainees and trainers, they will represent a significant advance on the current system which is characterised by a lack of evidence in the assessment process.