聊天GPT作为常见骨科疾病的自我诊断工具的潜力:探索性研究
Tomoyuki Kuroiwa1,2, Aida Sarcon3, Takuya Ibara4
1Department of Orthopaedic and Spinal Surgery, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Tokyo, Japan.
Journal of medical Internet research
|September 15, 2023
概括
聊天GPT在自我诊断骨科疾病方面表现出不一致的准确性,对医疗咨询的强有力的建议有限. 需要进一步开发可靠的AI驱动的医疗保健支持.
科学领域:
- 整形外科医学 整形外科医学
- 人工智能的人工智能
- 自然语言处理自然语言处理.
背景情况:
- 人工智能 (AI) 和自然语言处理 (NLP) 正在迅速发展,像ChatGPT这样的聊天机器人提供对话功能.
- 人工智能融入医疗保健具有改变服务交付的巨大潜力.
- 现有的关于ChatGPT医疗准确性的研究主要集中在自我诊断上,对其准确性的调查和医疗咨询的建议有限.
研究的目的:
- 评估ChatGPT在自我诊断常见的骨科疾病中的准确性和精度.
- 评估ChatGPT在诊断疾病时建议医疗咨询的程度.
主要方法:
- 作者在5天内向ChatGPT提交了关于五种骨科疾病 (手腕道综合症,椎骨髓病,腰椎狭窄症,膝关节骨关节炎,关节骨关节炎) 的相同问题.
- 答案被分类为正确,部分正确,不正确或差异诊断.
- 使用Fleiss κ系数评估可重复性,并对推强度进行分类.
主要成果:
- 在不同条件下,准确性差异很大,尤其是宫骨髓病 (1/25) 的正确答案比率很低,手腕道综合征 (25/25) 的正确答案比率更高.
- 日与评级者之间的可重现性不一致,从非常低 (例如,评级者之间的CM为0.1) 到完美 (1.0对于CTS).
- 虽然大多数回答建议医疗照顾,但这些建议的强度各不相同,其中"重要"是最常见的资格 (94/125).
结论:
- 在自我诊断的骨科疾病中,ChatGPT的性能在准确性和可重现性方面都不一致.
- 人工智能诊断准确度的提高可能需要纳入更具体的症状数据.
- 虽然AI聊天机器人可能是获得护理的第一步,但由于自我诊断的风险,AI聊天机器人应该为患者提供更明确的指导,以便患者寻求专业的医疗建议.
相关概念视频
02:05Self-Presentation: Self-Monitoring and Self-Handicapping
People can go to great lengths to protect their self-image and present themselves in ways that they want others to see them. Sociologist Erving Goffman presented the idea that a person is like an actor on a stage. Calling his theory dramaturgy, Goffman believed that we use “impression management” to present ourselves to others as we hope to be perceived. Each situation is a new scene, and individuals perform different roles depending on who is present (Goffman, 1959). Think about the way you...
01:29Assessment of the Gastrointestinal System II: Health Perception Pattern
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
01:22Self-Report Tests of Personality
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.