相关实验视频

Updated: May 5, 2026

Ultrasonography of the Adult Male Urinary Tract for Urinary Functional Testing

Ultrasonography of the Adult Male Urinary Tract for Urinary Functional Testing

Published on: August 14, 2019

美国GPT-3.5和GPT-4在标准化泌尿病知识评估项目上的表现:一项描述性研究

Max Samuel Yudovich¹, Elizaveta Makarova², Christian Michael Hague¹

¹Department of Urology, Penn State Health Milton S. Hershey Medical Center, Hershey, PA, USA.

Journal of educational evaluation for health professions

|July 8, 2024

概括

包括GPT-4和GPT-3.5在内的ChatGPT在泌尿器科委员会考试问题上表现不佳. GPT-4的准确性高于GPT-3.5,但两者都低于60%的合格标准,这表明AI的反应需要仔细审查.

科学领域:

人工智能在医学中的应用
医疗教育技术技术医学教育
泌尿器科泌尿器科泌尿器科泌尿器科

背景情况:

人工智能 (AI) 越来越多地融入医疗保健,需要评估其在专业医疗领域的表现.
在医学检查中评估像ChatGPT这样的大型语言模型的能力对于理解其潜力和局限性至关重要.
标准化测试为评估复杂医疗领域的AI性能提供了可靠的基准.

研究的目的:

评估聊天生成预训练变压器 (ChatGPT) 模型的性能,特别是GPT-3.5和GPT-4,在标准化泌尿病学多选择题上.
为了比较GPT-3.5和GPT-4在不同泌尿器科子专业和问题复杂性的准确性.
为了确定当前的AI模型是否符合医疗委员会检查所需的标准.

主要方法:

700个多项选择性泌尿器科委员会考试样式的项目被管理到GPT-3.5和GPT-4.
项目按泌尿病学主题 (例如瘤学,性医学,儿科) 和认知复杂性 (回忆,解释,解决问题) 分类.
两种AI模型的准确率在各个项目类别之间进行了统计比较.

主要成果:

GPT-4的精度达到44.4%,显著超过了GPT-3.5的30.9% (P>0.0001).
在泌尿外科瘤学,性医学和儿科泌尿外科以及回忆和解释问题上,GPT-4的准确性更高.
两种模型的性能都没有达到美国泌尿病学会为知识增强设定的60%准确度值.

结论:

目前的ChatGPT模型在标准化泌尿病学委员会考试问题上表现出有限的准确性,GPT-4显示出比GPT-3.5.5的改进.
两种AI版本的性能都低于医疗认证的既定基准,强调需要谨慎应用.
随着人工智能技术的进步,对其在医学教育和实践中的实用性和准确性的持续评估至关重要.

关键词:

人工智能的人工智能是人工智能.认证认证认证认证认证认证研究生医学教育.美国的美国.泌尿器科泌尿器科泌尿器科泌尿器科

更多相关视频

Urethral Stricture Induction Followed by Buccal Mucosa Graft Urethroplasty in a Rat Model

Urethral Stricture Induction Followed by Buccal Mucosa Graft Urethroplasty in a Rat Model

Published on: April 28, 2023

Author Spotlight: Evaluating Clinicians' Adoption of Ultrasound-Guided Vascular Cannulation Through Simulation Training

Author Spotlight: Evaluating Clinicians' Adoption of Ultrasound-Guided Vascular Cannulation Through Simulation Training

Published on: August 9, 2024

相关概念视频

Nursing Assessment of the Genitourinary System III: Percussion and Auscultation

Nursing Assessment of the Genitourinary System III: Percussion and Auscultation

The genitourinary system maintains the body's fluid balance, waste excretion, and overall homeostasis. Proper assessment is essential for early detection of disorders, with percussion and auscultation integral to this evaluation. These methods help identify signs of kidney or bladder issues and provide important diagnostic clues.Percussion for Kidney TendernessPercussion is used to assess tenderness and detect kidney and bladder abnormalities. A common method for determining kidney tenderness...

Urinary Tract Infection III: Diagnostic Studies and Interprofessional Care

Urinary Tract Infection III: Diagnostic Studies and Interprofessional Care

A healthcare provider can diagnose a urinary tract infection (UTI) through several methods:Medical History and Symptoms: The provider will take a detailed medical history and ask about symptoms such as frequent urination, burning sensation during urination, and lower abdominal pain.Urinalysis: A clean-catch urine sample is collected in a sterile container and tested for the presence of bacteria, white blood cells (leukocytes), nitrites, blood, and protein. The presence of leukocytes and...

Imaging Studies III: Computed Tomography

Imaging Studies III: Computed Tomography

DefinitionComputed Tomography (CT) of the genitourinary (GU) tract is a non-invasive imaging modality that utilizes X-rays and computer processing to generate detailed cross-sectional images of the urinary system, encompassing the kidneys, ureters, bladder, and adjacent structures such as the adrenal glands.PurposeCT scans of the GU tract serve several diagnostic and therapeutic purposes, including:Diagnosis of Urinary Tract Diseases: Detects kidney stones, tumors, cysts, and congenital...

Imaging Studies V: Intravenous Urography and Retrograde Pyelography

Imaging Studies V: Intravenous Urography and Retrograde Pyelography

IntroductionIntravenous Urography (IVU) and Retrograde Pyelography (RP) are important diagnostic imaging techniques used to evaluate the urinary system. These methods help identify structural abnormalities, obstructions, and functional issues in the kidneys, ureters, and bladder. Both procedures use iodine-based contrast media to enhance the visibility of urinary tract structures on X-ray images, though they differ in their methods and indications.1. Intravenous Urography (IVU)Intravenous...

Urodynamic Studies: Uroflowmetry

Urodynamic Studies: Uroflowmetry

Uroflowmetry is a non-invasive urodynamic test designed to measure various aspects of urination, including volume, flow rate, and the time to void. This test is crucial for diagnosing and assessing conditions such as bladder outlet obstruction, bladder dysfunction, incomplete bladder emptying, incontinence, and urinary tract blockages caused by benign prostatic hyperplasia (BPH) and urethral strictures.Pre-Test Instructions:Before a uroflowmetry test, patients are typically advised to drink...

Urologic Endoscopic Procedure: Cystoscopic Examination

Urologic Endoscopic Procedure: Cystoscopic Examination

Meaning of Cystoscopic Examination:Cystoscopy is an essential diagnostic tool in urology that is used to assess the structure and function of the genitourinary system. It provides a direct view of the urethra, bladder, and, in some cases, the ureteral openings. This procedure helps detect structural abnormalities, infections, cancers, and blockages in the urinary tract. There are two types of cystoscopy:Flexible cystoscopy is commonly performed in outpatient settings due to its less invasive...