用LLM和测试结果的统计分析生成医学教育的学习指南
Iván Roselló Atanet1, Mihaela Tomova2, Miriam Sieg3
1Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt Universität zu Berlin, AG Progress Test Medizin, Charitéplatz 1, 10117, Berlin, Germany. ivan.rosello-atanet@charite.de.
BMC medical education
|March 29, 2025
概括
本研究引入了一种自动化方法,使用人工智能和统计分析来个性化医学生反. 该系统识别了数百个主题的知识差距,改善了医学教育的形成性评估.
科学领域:
- 医疗教育 技术 技术 医学教育
- 医疗保健中的人工智能
- 教育评估的教育评估
背景情况:
- 进步测试医学 (PTM) 是一个大规模的,每年两次对医学学生的形成性评估.
- 目前的PTM反是数值的,缺乏针对目标改进的具体主题见解.
- 由于PTM的规模 (10,000+参与者),需要自动化详细的反.
研究的目的:
- 开发一个自动化系统,为医学学生提供个性化,主题特定的反.
- 通过提供可操作的见解,增强进步测试医学 (PTM) 的形成价值.
- 利用大型语言模型和统计分析进行详细的学生绩效评估.
主要方法:
- 使用ChatGPT 4.0从PTM问题中提取医学科目标题 (MeSH) 术语.
- 分析PTM问题模式,以确定医疗主题之间的关系.
- 开发了一个框架,将MeSH术语与PTM问题联系起来,用于绩效评估和个性化反生成.
主要成果:
- 对1,401名PTM参与者进行模拟个性化反,涵盖34至243个医学主题.
- 在14.67%至21.76%的学习主题中发现了实质性的知识差距.
- 证明了生成详细,专题特定反的可行性.
结论:
- 设计并验证了一种新的方法,用于基于MeSH术语生成全面的学生反.
- 对于后期学习阶段的学生来说,反的细节增加了,与他们的更广泛的知识基础保持一致.
- 该自动化系统通过精确确定医学生改进的具体领域来增强形成性评估.
相关概念视频
Study Design in Statistics
A study design is a set of techniques that allow a researcher to collect and analyze data from different variables defined for a specific research problem. Statistics is commonly for effective study design and more robust experiments,
Does aspirin reduce the risk of heart attacks? Is one brand of fertilizer more effective at growing roses than another? Is fatigue as dangerous to a driver as the influence of alcohol? Questions like these are answered using randomized experiments with proper...
Does aspirin reduce the risk of heart attacks? Is one brand of fertilizer more effective at growing roses than another? Is fatigue as dangerous to a driver as the influence of alcohol? Questions like these are answered using randomized experiments with proper...
Biostatistics: Overview
Biostatistics plays a crucial role in understanding and analyzing data in healthcare and biology. Biostatisticians conduct experiments, gather evidence, and draw meaningful conclusions using statistical methods and techniques. Different variables form the foundation of biostatistical analysis, allowing researchers to understand and interpret data effectively. These variables are classified into different types, each serving a specific purpose in statistical analysis.
Discrete variables are...
Discrete variables are...
Statistical Software for Data Analysis and Clinical Trials
Statistical software is pivotal in data analysis and clinical trials by providing tools to analyze data, draw conclusions, and make predictions. These software packages range from simple data management applications to complex analytical platforms, supporting various statistical tests, models, and simulation techniques. Their significance lies in their ability to handle vast amounts of data with precision and efficiency, enabling researchers to validate hypotheses, identify trends, and make...


