Related Experiment Video
Updated: Jun 26, 2026

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
Psychometric properties of an integrated assessment of technical and communication skills
Vicki R LeBlanc1, Diana Tabak, Roger Kneebone
1Wilson Centre, Faculty of Medicine, University of Toronto, 200 Elizabeth St., 1ES-565, Toronto, Ontario, M5G 2C4 Canada. vicki.leblanc@utoronto.ca
Purpose:
The Integrated Procedural Performance Instrument (IPPI) consists of clinical scenarios in which bench-top models are positioned to simulated patients. Trainees are required to perform technical skills while engaging with the patient. The purpose of this study was to determine whether an IPPI format examination could discriminate between different levels of trainees.
Methods:
Sixteen fourth-year medical students and 16 first-year surgery residents participated in 4 IPPI scenarios. Videotaped performances were scored by 2 blinded independent clinician raters on previously validated instruments: checklist of technical skills, Global Rating Scale of technical skills, and communication scale. We conducted separate mixed design analyses of variance (level x cases) on the 3 scales.
Results:
Residents performed better than medical students on the checklist (74% vs 60%, P < .05), the Global Rating Scale of technical skills (75% vs 56%, P < .01), and the coherence communication subscale (79% vs 69%, P < .05).
Conclusions:
An IPPI examination discriminated between students' and residents' technical skills and coherence in communication skills. It also highlighted a potential gap in the training of residents' communication skills.
Related Concept Videos
Self-Report Tests of Personality
Triarchic Theory of Intelligence
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this; it...
Wechsler's Contribution to Measures of Intelligence
Intelligence
Self-Esteem
