聊天机器人在生物学方面的表现不佳和医学教育中的基于图像的问题
Joyce Santana Rizzi1, Lorraine Silva Requena1, Angelica Maria Bicudo2
1Laboratory of Muscle Biology, Department of Structural and Functional Biology, Institute of Bioscience of Botucatu, Sao Paulo State University (UNESP), Botucatu, Brazil.
Journal of CME
|December 8, 2025
概括
人工智能聊天机器人在医学教育方面表现有前途,但在基于图像和与侵略相关的生物学问题上扎. 它们的准确性各不相同,这凸显了在这些领域进一步发展的需要.
科学领域:
- 医学教育 医学教育
- 人工智能在生物学中的应用
背景情况:
- 人工智能聊天机器人在医学教育评估中表现有变化.
- 它们在生物学中的有效性,特别是基于图像和学科特定的问题,在很大程度上没有得到检查.
研究的目的:
- 评估人工智能聊天机器人的准确性和可靠性,从医学评估中回答生物学问题.
- 识别与问题类型和内容相关的绩效模式.
主要方法:
- 一项观察性横截面研究,涉及进步测试中的180个生物学问题.
- 按形态,功能和攻击性对问题进行分类,并通过多次聊天机器人尝试进行评估.
- 应用物流回归和层次聚类来分析绩效模式.
主要成果:
- 聊天机器人实现了高准确度 (85-91.7%) 的形态和功能问题.
- 对于与侵略有关的和基于图像的生物问题,准确性显著下降.
- 基于图像的问题将正确答案的概率降低了高达17.6% (ChatGPT-4),聊天机器人的响应协议很弱.
结论:
- 人工智能聊天机器人在医学教育中具有潜力,但在视觉和与侵略有关的生物内容方面表现出局限性.
- 需要进一步开发,以提高聊天机器人的可靠性,以进行复杂的生物评估.
- 聊天机器人的性能根据问题类型和视觉元素大大不同.
更多相关视频
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
1.3K
05:33Introduction of an Integrated Pathology Image Management, Artificial Intelligence, and Reporting System
Published on: July 11, 2025
752
相关概念视频
Stereotype Content Model
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence categorization, a person will feel...
Imaging Biological Samples with Optical Microscopy
Optical microscopy uses optic principles to provide detailed images of samples. Antonie van Leeuwenhoek designed the first compound optical microscope in the 17th century to visualize blood cells, bacteria, and yeast cells. In 1830, Joseph Jackson Lister created an essentially modern light microscope. The 20th century saw the development of microscopes with enhanced magnification and resolution.
In optical microscopy, the specimen to be viewed is placed on a glass slide and clipped on the stage...
In optical microscopy, the specimen to be viewed is placed on a glass slide and clipped on the stage...
