Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Surveys02:16

Surveys

14.7K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
14.7K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same authorSame journal

Advising Through the Noise: Medical Student Advisor Perspectives on How Preference Signals Have Influenced Surgical Residency Recruitment.

Journal of surgical education·2026
Same authorSame journal

Mixed Signals: General Surgery Residency Applicant Attitudes Toward Preference Signaling.

Journal of surgical education·2026
Same author

The Genetics of Familial Neoplastic Thyroid Disease and Primary Hyperparathyroidism.

The Surgical clinics of North America·2026
Same author

Anatomical versus non-anatomical liver resection for hepatocellular carcinoma - an international multicenter propensity score-matched analysis of short- and long-term outcomes in an international multicenter cohort.

HPB : the official journal of the International Hepato Pancreato Biliary Association·2026
Same author

Graduate Medical Education Data in the United States: Availability and Accessibility Across National Organizations.

Journal of graduate medical education·2026
Same author

Access to Surgical Cancer Care in the Safety-Net: A Survey of California Hospitals.

Journal of surgical oncology·2026

Related Experiment Video

Updated: Jun 25, 2025

E-Patient Counseling Trial E-PACO: Computer Based Education versus Nurse Counseling for Patients to Prepare for Colonoscopy
06:28

E-Patient Counseling Trial E-PACO: Computer Based Education versus Nurse Counseling for Patients to Prepare for Colonoscopy

Published on: August 1, 2019

8.3K

How Reliable are Single-Question Workplace-Based Assessments in Surgery?

Rebecca S Gates1, Andrew E Krumm2, Olle Ten Cate3

  • 1Center for Surgical Training and Research, Department of Surgery, University of Michigan 010-A193, North Campus Research Complex 2800, Plymouth Road Ann Arbor, Michigan 48109; Department of Surgery, Carilion Clinic, 1906 Belleview Ave, Roanoke, VA 24014.

Journal of Surgical Education
|May 30, 2024
PubMed
Summary

Workplace-based assessments (WBAs) in surgery show low to moderate inter-rater reliability. Multiple observations by trained faculty are essential for accurate trainee performance evaluation.

Keywords:
general surgeryinter-rater reliabilityreliabilityworkplace-based assessment

More Related Videos

Author Spotlight: Evaluating Clinicians' Adoption of Ultrasound-Guided Vascular Cannulation Through Simulation Training
05:04

Author Spotlight: Evaluating Clinicians' Adoption of Ultrasound-Guided Vascular Cannulation Through Simulation Training

Published on: August 9, 2024

905
A Quantitative Sensory Testing Paradigm to Obtain Measures of Pain Processing in Patients Undergoing Breast Cancer Surgery
07:14

A Quantitative Sensory Testing Paradigm to Obtain Measures of Pain Processing in Patients Undergoing Breast Cancer Surgery

Published on: January 18, 2018

9.3K

Related Experiment Videos

Last Updated: Jun 25, 2025

E-Patient Counseling Trial E-PACO: Computer Based Education versus Nurse Counseling for Patients to Prepare for Colonoscopy
06:28

E-Patient Counseling Trial E-PACO: Computer Based Education versus Nurse Counseling for Patients to Prepare for Colonoscopy

Published on: August 1, 2019

8.3K
Author Spotlight: Evaluating Clinicians' Adoption of Ultrasound-Guided Vascular Cannulation Through Simulation Training
05:04

Author Spotlight: Evaluating Clinicians' Adoption of Ultrasound-Guided Vascular Cannulation Through Simulation Training

Published on: August 9, 2024

905
A Quantitative Sensory Testing Paradigm to Obtain Measures of Pain Processing in Patients Undergoing Breast Cancer Surgery
07:14

A Quantitative Sensory Testing Paradigm to Obtain Measures of Pain Processing in Patients Undergoing Breast Cancer Surgery

Published on: January 18, 2018

9.3K

Area of Science:

  • Medical Education
  • Surgical Training Assessment
  • Quality Improvement in Healthcare

Background:

  • Workplace-based assessments (WBAs) are crucial for evaluating surgical trainees.
  • Inter-rater reliability is vital for consistent interpretation of WBA data.
  • Evidence for the validity of WBAs exists, but inter-rater reliability data is often lacking.

Purpose of the Study:

  • To assess the inter-rater reliability of various operative WBAs used in general surgery residency.
  • To determine the consistency of ratings across different faculty members for surgical trainees.

Main Methods:

  • Nine faculty raters evaluated videos of 6 general surgery operations.
  • Residents were rated using the SIMPL Performance Scale, OPRS Scale, ten Cate Entrustment-Supervision Scale, and Zwisch Scale.
  • Inter-rater reliability was analyzed using percent agreement and intraclass correlations.

Main Results:

  • Absolute intraclass correlation coefficients ranged from 0.33 to 0.47 across all scales.
  • This indicates low to moderate inter-rater reliability for the assessed WBAs.

Conclusions:

  • Single-item WBAs demonstrate limited inter-rater reliability in surgical training.
  • Rater training may enhance reliability for individual observations.
  • A comprehensive assessment strategy requires numerous observations from multiple raters to reliably gauge surgical trainee performance.