Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Language Development01:22

Language Development

460
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
460
Language and Cognition01:27

Language and Cognition

456
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
456
Language01:16

Language

430
Language is a unique communication system that uses words and systematic rules to organize and transmit information. Unlike other forms of communication, which may involve postures, movements, odors, or vocalizations, language relies on symbols and grammar. This makes human communication distinct from that of other species, who also communicate but do not use language in the same way humans do.
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
430
Components of Language01:24

Components of Language

410
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
410
Nursing Evaluation01:15

Nursing Evaluation

3.6K
The evaluation stage signals the end of the nursing process. The nurse gathers evaluative data to assess whether or not the patient has attained the expected results. Whereas the nurse collects data in the nursing assessment to identify the patient's health concerns, the evaluation stage data determines if the indicated health issues are resolved. Evaluative data collection includes two sections: the data acquired to evaluate patient outcomes and the time criteria for data collection.
3.6K
Higher Mental Functions of the Brain: Language01:10

Higher Mental Functions of the Brain: Language

1.0K
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
1.0K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Assessing Financial Toxicity in Cancer: A Global Systematic Review and Meta-Analysis Using an Asset Framework.

Cancer medicine·2026
Same author

On and Off-Ramps: Residents Transferring Into and Out of Otolaryngology-Head and Neck Surgery.

Laryngoscope investigative otolaryngology·2026
Same author

The Landscape of Vestibular Schwannoma Microsurgical Resection Clinical Trials: A Scoping Review.

Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology·2026
Same author

Preserving music reward in age-related hearing loss through training and adaptation.

BMC geriatrics·2026
Same author

Sustainable Practices in the Operating Room for Septorhinoplasty: A 10-Case Prospective Waste Audit Regarding How Much Waste Is Generated.

Facial plastic surgery & aesthetic medicine·2026
Same author

From Expectations to Experience: A Comparison of Program Director Priorities to Resident Case Logs.

The Laryngoscope·2026

Related Experiment Video

Updated: Sep 18, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

692

Evaluating Resident Feedback Using a Large Language Model: Are We Missing Core Competencies?

Syed Ameen Ahmad1, Maria Armache2, Danielle R Trakimas2

  • 1Johns Hopkins University School of Medicine, Baltimore, Maryland, USA.

The Laryngoscope
|June 27, 2025
PubMed
Summary
This summary is machine-generated.

Large language models can effectively evaluate surgical resident feedback. Different assessment tools yield varied feedback quality, highlighting the need for a multimodal approach to resident education.

Keywords:
medical educationnatural language processingresident education

More Related Videos

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody
09:09

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Published on: September 27, 2024

540
Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

1.6K

Related Experiment Videos

Last Updated: Sep 18, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

692
Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody
09:09

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Published on: September 27, 2024

540
Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

1.6K

Area of Science:

  • Medical Education
  • Artificial Intelligence in Healthcare
  • Surgical Training Assessment

Background:

  • Effective narrative feedback is crucial for surgical resident development.
  • Current assessment methods, including workplace-based assessments (SIMPL-OR), Objective Structured Assessment of Technical Skills (OSATS), and end-of-rotation (EOR) evaluations, provide feedback of varying quality.
  • Optimizing feedback requires understanding the strengths and weaknesses of each assessment modality.

Purpose of the Study:

  • To utilize a large language model (LLM) to analyze the content and quality of narrative feedback given to surgical residents.
  • To compare feedback across three distinct assessment formats: SIMPL-OR, OSATS, and EOR evaluations.
  • To assess the LLM's concordance with faculty evaluation of feedback.

Main Methods:

  • A retrospective analysis of narrative feedback from 2017-2021 at a single institution.
  • Initial evaluation of 60 feedback entries (20 per format) by two faculty members for specific criteria (encouraging, corrective, specific, and core competencies).
  • Validation of ChatGPT4o's performance against faculty evaluations, followed by its analysis of the remaining 776 feedback entries.

Main Results:

  • ChatGPT demonstrated high concordance (90%, κ=0.94) with faculty in evaluating feedback.
  • Significant differences in addressed competencies were observed: patient care was highest in SIMPL-OR (97%), while professionalism was highest in EOR (40%).
  • SIMPL-OR provided the most "corrective" (71%) and "specific" (97%) feedback, whereas OSATS and EOR showed lower specificity and corrective feedback rates.

Conclusions:

  • Different feedback instruments yield feedback of varying content and quality.
  • A multimodal approach to feedback is essential for comprehensive resident assessment and development.
  • LLMs show promise as a tool for analyzing and potentially improving the quality of educational feedback.