Related Experiment Video
Updated: Aug 7, 2026
One Dimensional Turing-Like Handshake Test for Motor Intelligence
Published on: December 15, 2010
Computer-assisted assessment of one-handed knot tying skills performed within various contexts: a construct validity
Ryan Brydges1, Roger Classen, James Larmer
1Department of Surgery, University of Toronto, Surgical Skills Centre at Mount Sinai Hospital, 600 University Avenue, Level 2-Room 250, Toronto, Ontario, M5G 1X5, Canada.
Background:
The widespread use of computer-assisted assessment of technical proficiency in surgical residents shows the need for further investigations of the construct validity of these devices (eg, hand motion analysis) before implementation into competency testing.
Methods:
Thirty general surgery residents performed 1-handed knot tying in 2 contexts: superficial and deep. The Imperial College Surgical Assessment Device (ICSAD) was used to evaluate performance. It was hypothesized that senior residents (postgraduate year [PGY] 4-5) would perform better then junior residents (PGY 1-3) and that the superficial version of the skill would be easier than the deep.
Results:
Technical efficiency scores were better for seniors than for juniors (P < .001) and on the superficial versus the deep model (P < .001). Both groups were equally affected by the contextual changes to the skill, suggesting a consistent impact on the skill-specific movement patterns.
Conclusions:
Additional evidence for the validity of ICSAD as a competency assessment tool has been shown. First, it distinguished senior and junior residents. Second, it discerned differences on the same skill performed in 2 different contexts.
