Related Experiment Video
Updated: Sep 17, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
Echoing Intelligence: Assessing the Capabilities of a Novel Generative AI With a Large Language Model in Cardiology
Muneeb Ahmed1, Flora Huang2, Chi-Ming Chow1
1Department of Medicine, University of Toronto, Toronto, Ontario, Canada.
Background:
Artificial intelligence (AI) holds promise for enhancing medical education, particularly in complex fields like cardiology. We assessed the ability of a large language model (LLM) to generate and evaluate educational material comparable to that created by human experts.
Methods:
We trained an AI model on cardiology-specific content using 80 lectures from the St. Michael's Hospital Virtual Echo Rounds. The AI generated 10 multiple-choice questions (MCQs), and experienced cardiologists crafted an additional 10 MCQs. Eleven postgraduate year 4-6 cardiology trainees answered all 20 questions and attempted to identify the source (AI or human) of each question. The AI also answered the same set of questions. We analyzed performance using the Wilcoxon signed-rank test and recognition ability.
Results:
Trainees scored similarly on AI-generated and human-generated questions (median 8/10 vs 8/10; P > 0.05). Their ability to identify the source of questions did not exceed chance levels (median correct identifications: 10/20; P > 0.05). The AI achieved 95% accuracy on AI-generated questions and 100% on human-generated questions.
Conclusions:
The AI-generated educational content was of comparable quality to that produced by human experts, and trainees could not reliably distinguish between the 2 sources. Our findings suggest that AI could significantly augment cardiology education by providing high-quality, scalable learning resources.
More Related Videos
Related Concept Videos
Language Development
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
Higher Mental Functions of the Brain: Language
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language and Cognition
Components of Language
Improving Translational Accuracy
Language
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...

