专家对ChatGPT准确性和可靠性的评估对于基本的乳病常见问题
Mohadeseh Mahmoudi Ghehsareh1, Nastaran Asri2, Mehdi Azizmohammad Looha3
1Gastroenterology and Liver Diseases Research Center, Research Institute for Gastroenterology and Liver Diseases, Shahid Beheshti University of Medical Sciences, Tehran, Iran.
Scientific reports
|August 14, 2025
概括
人工智能 (AI) 对乳病 (CD) 信息显示出希望,ChatGPT-3.5为常见问题提供了准确的答案,特别是在疾病管理方面. 这项研究对AI进行了基准测试.
科学领域:
- 医疗信息学 医疗信息学
- 医疗保健中的人工智能
- 结核病研究 结核病研究
背景情况:
- 人工智能 (AI) 在传播乳病 (CD) 信息中的作用尚未得到充分证实.
- 广泛使用的人工智能模型ChatGPT-3.5被评估其在患者教育方面的潜力.
- 为人工智能辅助的CD信息建立一个基准对于未来的应用至关重要.
研究的目的:
- 评估ChatGPT-3.5对病基本查询的答案的准确性和可靠性.
- 建立人工智能驱动的腹腔疾病教育的绩效基准.
- 评估专家对人工智能生成的腹腔疾病信息的共识.
主要方法:
- 两位独立专家在利克特尺度上对20个腹腔疾病常见问题评价了ChatGPT-3.5对20个腹腔疾病常见问题的反应的准确性.
- 响应被分类为乳病管理领域.
- 通过使用科恩的卡帕,威尔科克森的签名等级和弗里德曼测试,统计分析了互评分和内部评分的可靠性.
主要成果:
- 聊天GPT-3.5表现出高准确度,专家评级大多在4到5之间.
- 关于乳病管理的AI反应比疾病病因学更强烈.
- 观察到中度的评价者间可靠性 (κ=0.22),对一个专家来说,评价者内可靠性很高.
结论:
- 聊天GPT-3.5显示了作为病信息的可靠来源的潜力,特别是在疾病管理指导方面.
- 人工智能工具可以补充现有的病教育资源.
- 需要进一步的研究来完善AI的准确性,并解决评估人工智能产生的健康信息的评分者之间的差异.
相关概念视频
Assessment of the Gastrointestinal System I: Subjective Data
280
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health History
The initial step in assessing the GI system is obtaining a comprehensive health history. This includes inquiring about the patient's history or presence of problems...
Health History
The initial step in assessing the GI system is obtaining a comprehensive health history. This includes inquiring about the patient's history or presence of problems...
280
Assessment of the Gastrointestinal System II: Health Perception Pattern
162
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
162
Serum Laboratory Studies, Stool Test, Breath Test
475
Gastrointestinal (GI) diagnostic studies are pivotal in confirming, ruling out, diagnosing, or staging various diseases, including cancers. Following diagnosis, allocating time for discussions with the patient and providing informational resources is crucial. Diagnostic assessments of the GI tract often occur in outpatient settings like endoscopy suites or GI labs. Preparation for these tests may include dietary restrictions, fasting, liquid bowel preparations, laxatives, enemas, and the...
475
Chronic Pancreatitis II: Collaborative Care
128
The management of chronic pancreatitis is multifaceted, involving a comprehensive approach that includes thorough assessment, diagnostic testing, and a variety of management strategies.
Assessment:
Assessment:
128
Irritable Bowel Syndrome II: Clinical Features and Diagnostic Evaluation
245
Irritable Bowel Syndrome II: Clinical Features and Diagnostic Evaluation
Irritable Bowel Syndrome (IBS) is classified into subtypes based on the predominant bowel habits as determined by the Bristol Stool Form Scale (BSFS). The subtypes are:
Irritable Bowel Syndrome (IBS) is classified into subtypes based on the predominant bowel habits as determined by the Bristol Stool Form Scale (BSFS). The subtypes are:
245
Myasthenia Gravis: Diagnostic Tests
1.3K
Myasthenia gravis is an autoimmune condition affecting neuromuscular transmission, causing generalized weakness in skeletal muscles. Initial diagnoses rely on patients' signs, symptoms, and medical history. The challenge lies in distinguishing myasthenia from other muscular dystrophies. An important diagnostic feature is the significant improvement of symptoms after administering anticholinesterase inhibitors.
The edrophonium test is a diagnostic tool for myasthenia gravis. It involves...
The edrophonium test is a diagnostic tool for myasthenia gravis. It involves...
1.3K


