在MKSAP心脏病委员会审查问题上评估ChatGPT的性能
Stefan Milutinovic1, Marija Petrovic2, Dustin Begosh-Mayne1
1Florida State University College of Medicine Internal Medicine Residency Program at Lee Health, Cape Coral, Florida, USA.
International journal of cardiology
|September 21, 2024
概括
聊天GPT在心血管医学董事会式问题上表现适度,与住院医生相比,但低于心脏病医生的表现. 为了可靠的医学教育工具,需要进一步开发人工智能.
科学领域:
- 人工智能在医学中的应用
- 医疗教育 技术 技术 医学教育
- 自然语言处理自然语言处理.
背景情况:
- 人工智能 (AI) 和ChatGPT等自然语言处理工具显示了增强医疗实践的潜力.
- 关于人工智能在提高医疗效率和减少医疗错误方面的作用,正在进行讨论.
研究的目的:
- 评估ChatGPT (版本3.5和4) 在回答心血管医学委员会式问题的性能.
- 将AI性能与内科住院医生和主治医生进行比较.
主要方法:
- 使用了医学知识自我评估计划 (MKSAP) 心血管医学章节的98个多选择题.
- 评估了ChatGPT-3.5,ChatGPT-4,内科实习生,高级住院医生,内科主治医生和心脏病主治医生的表现.
主要成果:
- 聊天GPT-4的准确率达到74.5%,相当于住院医生和内科医生的准确率,但低于心脏病医生的准确率 (85.7%).
- 在大多数子类别中,在ChatGPT和医生之间没有发现显著差异,除了膜心脏病和心力衰竭.
- 在心力衰竭问题上,ChatGPT-4的表现优于老年居民.
结论:
- 聊天GPT是一个有前途的教育工具,但需要提高准确性来超越教练.
- 人工智能性能需要接近近乎完美的分数,才能被认为是医疗专业人员可靠的工具.
更多相关视频
10:17Real-Time Cardiac Mapping with a Noninvasive Imageless Electrocardiographic Imaging System
Published on: April 11, 2025
430
12:45Benefits of Cardiac Resynchronization Therapy in an Asynchronous Heart Failure Model Induced by Left Bundle Branch Ablation and Rapid Pacing
Published on: December 11, 2017
10.4K
相关概念视频
Electrocardiogram
2.2K
An electrocardiogram (ECG or EKG) is a critical diagnostic tool that records the electrical signals produced by the heart during each heartbeat. This recording is achieved through electrodes placed strategically on the arms, legs, and chest. The electrocardiograph amplifies these signals and produces 12 distinct tracings, offering a comprehensive understanding of the heart's electrical activity.
Three major waveforms are present in a typical ECG recording: the P wave, the QRS complex, and...
Three major waveforms are present in a typical ECG recording: the P wave, the QRS complex, and...
2.2K
Assessment of the Cardiovascular System III: Palpation
214
Palpation involves feeling the body to evaluate texture, size, consistency, and tenderness for assessing cardiovascular health. The following steps are organized in a head-to-toe order:
Jugular Venous Pressure (JVP) Measurement
Position the patient at a thirty- to forty-five-degree angle or in a semi-fowler's position. Look for the highest point of pulsation in the internal jugular vein and measure the vertical distance to the angle of Loius or sternal angle. A normal JVP is 3-4 cm above...
Jugular Venous Pressure (JVP) Measurement
Position the patient at a thirty- to forty-five-degree angle or in a semi-fowler's position. Look for the highest point of pulsation in the internal jugular vein and measure the vertical distance to the angle of Loius or sternal angle. A normal JVP is 3-4 cm above...
214
Assessment of the Cardiovascular System I: Subjective Data
282
A thorough health history and physical assessment are essential for identifying cardiovascular disease (CVD) symptoms and distinguishing them from other health issues.
Initial Enquiry
Ask the patient about their primary concern and thoroughly explore all reported symptoms.
Medical History
Investigate past illnesses affecting the cardiovascular system, such as angina, anemia, rheumatic fever, congenital heart disease, stroke, thrombophlebitis, dysrhythmias, varicosities
Inquire about symptoms...
Initial Enquiry
Ask the patient about their primary concern and thoroughly explore all reported symptoms.
Medical History
Investigate past illnesses affecting the cardiovascular system, such as angina, anemia, rheumatic fever, congenital heart disease, stroke, thrombophlebitis, dysrhythmias, varicosities
Inquire about symptoms...
282
