Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Search research articles

Related Experiment Videos

Exporting a technical skills evaluation technology to other sites.

G Ault¹, R Reznick, H MacRae

¹Department of Surgery, University of Southern California, Los Angeles, CA, USA.

American Journal of Surgery

|October 6, 2001

Summary

The Objective Structured Assessment of Technical Skill (OSATS) examination is portable and effective for remote administration. This study found the remote OSATS to be feasible, reliable, and valid for assessing surgical residents.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Canadian Surgery Forum: Abstracts of presentations to the Annual Meetings of the Canadian Association of Bariatric Physicians and Surgeons, Canadian Association of General Surgeons, Canadian Association of Thoracic Surgeons, Canadian Hepato-Pancreato-Biliary Association, Canadian Society of Surgical Oncology, Canadian Society of Colon and Rectal Surgeons, Vancouver, BC, Sept. 17-21, 2013.

Canadian journal of surgery. Journal canadien de chirurgie·2025

Same author

Canadian Surgery Forum: Abstracts of presentations to the Annual Meetings of the Canadian Association of Bariatric Physicians and Surgeons, Canadian Association of General Surgeons, Canadian Association of Thoracic Surgeons, Canadian Hepato-Pancreato-Biliary Society, Canadian Society of Surgical Oncology, Canadian Society of Colon and Rectal Surgeons, London, Ont. Sept. 15-18, 2011.

Canadian journal of surgery. Journal canadien de chirurgie·2022

Same author

Canadian Surgery Forum.

Canadian journal of surgery. Journal canadien de chirurgie·2022

Same author

2021 Canadian Surgery Forum: Virtual, online Sept. 21-24, 2021.

Canadian journal of surgery. Journal canadien de chirurgie·2022

Same author

Enhanced recovery protocol: implementation at a county institution with limited resources.

The American surgeon·2012

Same author

Transatlantic comparison of the competence of surgeons at the start of their professional career.

The British journal of surgery·2010

Area of Science:

Medical Education
Surgical Training Assessment

Background:

The Objective Structured Assessment of Technical Skill (OSATS) is a key tool for evaluating surgical resident technical skills.
Implementing remote administration of OSATS presents unique logistical and psychometric challenges.

Purpose of the Study:

To explore implementation issues in remote Objective Structured Assessment of Technical Skill (OSATS) administration.
To assess the feasibility and psychometric properties of a remotely administered OSATS.

Main Methods:

An eight-station OSATS was administered to surgical residents across two geographically distinct sites (Los Angeles and Chicago).
A collaborative model involving central organization (University of Toronto) and local institutional administration was employed.

Related Experiment Videos

Main Results:

High reliability was observed for both checklist (alpha = 0.68-0.73) and global rating forms (alpha = 0.82).
Evidence of construct validity was demonstrated, with significant effects of training year on both rating forms.
The central organization and peripheral delivery model proved effective despite some implementation challenges.

Conclusions:

The remote administration of OSATS demonstrated psychometric properties consistent with prior studies, indicating its portability.
Both faculty and residents reported satisfaction with the remote examination experience.
A centralized administration model with peripheral delivery is a feasible and effective approach for remote OSATS implementation.