Related Experiment Video
Updated: Jun 5, 2026

Simulator Training for Endovascular Neurosurgery
Published on: May 6, 2020
Evaluation of procedure-based assessment for assessing trainees' skills in the operating theatre
J Marriott1, H Purdie, J Crossley
1Department of Reproductive and Developmental Medicine, University of Sheffield, Sheffield, UK.
Background:
Procedure-based assessment (PBA) is used within most UK surgical training programmes for assessing trainees' procedural skills in the operating theatre. All postgraduate assessment methods require evidence to support their implementation. The aims were to evaluate the validity, reliability and acceptability of PBA.
Methods:
Eighty-one trainees in six surgical specialties were assessed performing common procedures; 749 PBAs were provided across 348 operations by 57 clinical supervisors and four independent assessors.
Results:
Construct validity was demonstrated by correlation of PBA scores with measures of surgical training and experience. Reliability (G exceeding 0·8) of the adjusted total item score and global summary score for a given procedure was achieved using four and three assessor judgements respectively; assessing a mix of procedures required more cases/assessors because performance is procedure specific. The acceptability of PBA for assessment and feedback within surgical training was predominantly positive among clinical supervisors and trainees.
Conclusion:
PBA demonstrated good overall validity and acceptability, and exceptionally high reliability. Trainees should be assessed adequately for each given procedure.
Related Concept Videos
Assessment of apical radial pulse
The A-R pulse assessment involves simultaneous evaluation of the apical and radial pulses. When the apical and radial pulse rates vary, this assessment helps identify a pulse deficit.
Pre-Procedural Preparation
Nursing Process for Patient and Caregiver Teaching III: Evaluation and Documentation
Nurses can use several methods to evaluate patient outcomes. For example, oral questions can assess cognitive learning, patient...
Tracheostomy Care II: Procedure
Step 1: Perform hand hygiene, and put on personal protective equipment: gown, gloves, mask and...
Tracheostomy Suctioning II: Procedure