Related Experiment Video
Updated: May 6, 2026
06:57
Utilizing Electroencephalography Measurements for Comparison of Task-Specific Neural Efficiencies: Spatial Intelligence Tasks
Published on: August 9, 2016
11.3K
Evaluating Chat Generative Pretrained Transformer (GPT-4o) Problem-Solving Performance in the Japan Certificate
1Faculty of Engineering, Shonan Institute of Technology, Fujisawa, JPN.
Cureus
|April 23, 2025
Summary
ChatGPT (GPT-4o) shows potential in medical engineering but struggles with complex problem-solving on the Certificate Examination for Biomedical Engineering class 1. Its current knowledge is insufficient for universal accuracy in this field.
Area of Science:
- Medical Engineering
- Artificial Intelligence in Healthcare
Background:
- The Certificate Examination for Biomedical Engineering class 1 (CEBM1) assesses medical device maintenance and safety expertise.
- ChatGPT (GPT-4o) is increasingly applied across various professional domains, including medical engineering.
Purpose of the Study:
- To evaluate the performance of ChatGPT (GPT-4o) on the CEBM1.
- To compare AI capabilities against human-level expectations in biomedical engineering assessment.
Main Methods:
- 171 Japanese CEBM1 questions (26th-28th exams) were input into ChatGPT (GPT-4o).
- Performance was assessed based on question difficulty (fundamental, applied, problem-solving).
- No prompt optimizations were applied; responses were compared to correct answers.
Main Results:
- ChatGPT achieved scores of 68.4% (fundamental), 57.9% (applied), and 59.6% (problem-solving).
- The 60% passing threshold was only met for the 28th examination.
- Incorrect answers stemmed primarily from knowledge gaps or inaccuracies, with some instances of misunderstanding and hallucination.
Conclusions:
- ChatGPT demonstrates foundational medical engineering knowledge but lacks universal accuracy.
- Current AI capabilities are insufficient for fully addressing complex medical device safety and maintenance challenges.
- Further development is needed for AI to reliably pass specialized professional examinations in medical engineering.
Keywords:
artificial intelligencecertificate examinationchatgptlarge language modelsmedical engineeringMore Related Videos
Related Concept Videos
00:59Biot-Savart Law: Problem-Solving
3.7K
The magnitude and direction of a magnetic field created by a steady current can be calculated using the Biot-Savart law.
Consider a mobile phone battery bank as a source of steady current, which flows through the wire connected between the two. What is the magnitude of the magnetic field created by this current at a field point P?
To estimate the magnitude of the total magnetic field, we first consider a small current element of length dl, at a distance r from the field point. Now the following...
Consider a mobile phone battery bank as a source of steady current, which flows through the wire connected between the two. What is the magnitude of the magnetic field created by this current at a field point P?
To estimate the magnitude of the total magnetic field, we first consider a small current element of length dl, at a distance r from the field point. Now the following...
3.7K
01:31Ampere's Law: Problem-Solving
3.4K
Ampere's law states that for any closed looped path, the line integral of the magnetic field along the path equals the vacuum permeability times the current enclosed in the loop. If the fingers of the right hand curl along the direction of the integration path, the current in the direction of the thumb is considered positive. The current opposite to the thumb direction is considered negative.
Specific steps need to be considered while calculating the symmetric magnetic field distribution...
Specific steps need to be considered while calculating the symmetric magnetic field distribution...
3.4K
01:17Ampere-Maxwell's Law: Problem-Solving
1.4K
A parallel-plate capacitor with capacitance C, whose plates have area A and separation distance d, is connected to a resistor R and a battery of voltage V. The current starts to flow at t = 0. What is the displacement current between the capacitor plates at time t? From the properties of the capacitor, what is the corresponding real current?
To solve the problem, we can use the equations from the analysis of an RC circuit and Maxwell's version of Ampère's law.
For the first part of the...
To solve the problem, we can use the equations from the analysis of an RC circuit and Maxwell's version of Ampère's law.
For the first part of the...
1.4K
01:22Machines: Problem Solving I
846
A toggle clamp is a mechanical device commonly used for holding and clamping objects in various applications, such as woodworking, metalworking, and assembly operations. Consider a toggle clamp subjected to a force of 200 N at the handle. The vertical clamping force can be calculated, provided the dimensions of the toggle clamp are known.
The toggle clamp system is a machine structure consisting of movable, pin-connected multi-force members that form a stabilized system to transmit forces. The...
The toggle clamp system is a machine structure consisting of movable, pin-connected multi-force members that form a stabilized system to transmit forces. The...
846
01:30Machines: Problem Solving II
793
Machines are complex structures consisting of movable, pin-connected multi-force members that work together to transmit forces. Consider a lifting tong carrying a 100 kg load. It comprises movable sections DAF and CBG linked together with member AB.
793
01:24Normal and Tangetial Components: Problem Solving
753
Consider a man with a mass of 70 kg seated in a chair connected to a pin support through a member BC. If the man maintains an upright position, the task is to determine the horizontal and vertical reactions of the chair on the man when the member makes a 45° angle with the horizontal. At this moment, the man has a speed of 5 m/s, increasing at a rate of 1 m/s².
753