评估聊天生成预训练变压器 (GPT-4o) 在日本生物医学工程一级证书考试中的解决问题的表现
1Faculty of Engineering, Shonan Institute of Technology, Fujisawa, JPN.
Cureus
|April 23, 2025
概括
聊天GPT (GPT-4o) 在医学工程方面显示出潜力,但在生物医学工程类1级证书考试中难以解决复杂的问题. 目前的知识不足以在这个领域实现普遍的准确性.
科学领域:
- 医疗工程 医疗工程
- 医疗保健中的人工智能
背景情况:
- 生物医学工程1级证书考试 (CEBM1) 评估医疗器械维护和安全专业知识.
- 聊天GPT (GPT-4o) 越来越多地应用于各种专业领域,包括医疗工程.
研究的目的:
- 评估ChatGPT (GPT-4o) 在CEBM1.o上的表现.
- 在生物医学工程评估中,将AI能力与人类水平的期望进行比较.
主要方法:
- 171个日本CEBM1问题 (第26~28期考试) 被输入到ChatGPT (GPT-4o).
- 绩效是根据问题的难度 (基本,应用,解决问题) 进行评估的.
- 没有应用快速优化; 响应与正确答案相比较.
主要成果:
- 聊天GPT获得了68.4% (基本),57.9% (应用) 和59.6% (解决问题) 的分数.
- 只有在第28次考试中才达到60%的合格门.
- 错误的答案主要源于知识缺陷或不准确,有误解和幻觉的情况.
结论:
- 聊天GPT展示了基础的医学工程知识,但缺乏普遍的准确性.
- 目前的人工智能能力不足以充分解决复杂的医疗器械安全和维护挑战.
- 需要进一步开发人工智能,可靠地通过医学工程专业专业考试.
相关概念视频
Biot-Savart Law: Problem-Solving
3.7K
The magnitude and direction of a magnetic field created by a steady current can be calculated using the Biot-Savart law.
Consider a mobile phone battery bank as a source of steady current, which flows through the wire connected between the two. What is the magnitude of the magnetic field created by this current at a field point P?
To estimate the magnitude of the total magnetic field, we first consider a small current element of length dl, at a distance r from the field point. Now the following...
Consider a mobile phone battery bank as a source of steady current, which flows through the wire connected between the two. What is the magnitude of the magnetic field created by this current at a field point P?
To estimate the magnitude of the total magnetic field, we first consider a small current element of length dl, at a distance r from the field point. Now the following...
3.7K
Ampere's Law: Problem-Solving
3.4K
Ampere's law states that for any closed looped path, the line integral of the magnetic field along the path equals the vacuum permeability times the current enclosed in the loop. If the fingers of the right hand curl along the direction of the integration path, the current in the direction of the thumb is considered positive. The current opposite to the thumb direction is considered negative.
Specific steps need to be considered while calculating the symmetric magnetic field distribution...
Specific steps need to be considered while calculating the symmetric magnetic field distribution...
3.4K
Ampere-Maxwell's Law: Problem-Solving
1.4K
A parallel-plate capacitor with capacitance C, whose plates have area A and separation distance d, is connected to a resistor R and a battery of voltage V. The current starts to flow at t = 0. What is the displacement current between the capacitor plates at time t? From the properties of the capacitor, what is the corresponding real current?
To solve the problem, we can use the equations from the analysis of an RC circuit and Maxwell's version of Ampère's law.
For the first part of the...
To solve the problem, we can use the equations from the analysis of an RC circuit and Maxwell's version of Ampère's law.
For the first part of the...
1.4K
Machines: Problem Solving I
846
A toggle clamp is a mechanical device commonly used for holding and clamping objects in various applications, such as woodworking, metalworking, and assembly operations. Consider a toggle clamp subjected to a force of 200 N at the handle. The vertical clamping force can be calculated, provided the dimensions of the toggle clamp are known.
The toggle clamp system is a machine structure consisting of movable, pin-connected multi-force members that form a stabilized system to transmit forces. The...
The toggle clamp system is a machine structure consisting of movable, pin-connected multi-force members that form a stabilized system to transmit forces. The...
846
Machines: Problem Solving II
793
Machines are complex structures consisting of movable, pin-connected multi-force members that work together to transmit forces. Consider a lifting tong carrying a 100 kg load. It comprises movable sections DAF and CBG linked together with member AB.
793
Normal and Tangetial Components: Problem Solving
753
Consider a man with a mass of 70 kg seated in a chair connected to a pin support through a member BC. If the man maintains an upright position, the task is to determine the horizontal and vertical reactions of the chair on the man when the member makes a 45° angle with the horizontal. At this moment, the man has a speed of 5 m/s, increasing at a rate of 1 m/s².
753


