向神经病学中基于社区的AI评估:为大型语言模型开发头痛诊断数据集
Anika Zahn1, Sebastian Strauss1, Dorian Zwanzig2
1Department of Neurology, University Medicine Greifswald, Greifswald, Germany.
Studies in health technology and informatics
|October 3, 2025
概括
大型语言模型在诊断头痛障碍方面表现有前途,在群体层面达到高达92%的准确性. 需要进一步验证,以便在头痛药物中临床应用.
科学领域:
- 神经学 神经学
- 人工智能在医学中的应用
- 临床信息学 临床信息学
背景情况:
- 由于症状多样化和缺乏生物标志物,头痛疾病的诊断是复杂的.
- 准确的差异诊断对于有效的头痛管理至关重要.
研究的目的:
- 在头痛医学中评估大语言模型 (LLM) 的诊断准确性.
- 建立一个基准数据集,用于评估神经学中的AI诊断能力.
主要方法:
- 在20个ICHD-3诊断中创建了50个头痛病例 (34个真实,16个合成) 的精心策划的数据集.
- 三个基于GPT的LLM被提示使用各种策略来评估诊断性能.
- 在个人诊断和更广泛的诊断小组水平上评估了表现.
主要成果:
- 在诊断层面上,LLM顶级-1准确度从24%到63%不等.
- 在评估诊断组时,准确度高达92%.
- 结果表明有很大的潜力,但强调了LLM业绩的变化.
结论:
- LLM显示出作为工具的潜力,有助于对头痛疾病的差异诊断.
- 用更大,更多样化的数据集进行进一步的研究对于临床验证至关重要.
- 对医学专业人员进行LLM的比较是必要的,以确定他们在临床决策中的作用.
更多相关视频
03:14Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
1.0K
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
1.3K
相关概念视频
Ethics in Research
Today, scientists agree that good research is ethical in nature and is guided by a basic respect for human dignity and safety. However, this has not always been the case. Modern researchers must demonstrate that the research they perform is ethically sound.
The Stanford Prison Experiment
The famous and controversial Stanford Prison Experiment, conducted by social psychologist Philip Zimbardo and his colleagues at Stanford University, demonstrated the power of social roles, social norms, and scripts.
Bullying
A modern form of aggression is bullying. As you learn in your study of child development, socializing and playing with other children is beneficial for children’s psychological development. However, as you may have experienced as a child, not all play behavior has positive outcomes. Some children are aggressive and want to play roughly. Other children are selfish and do not want to share toys. One form of negative social interactions among children that has become a national concern is bullying.
Sex Linked Disorders
Like autosomes, sex chromosomes contain a variety of genes necessary for normal body function. When a mutation in one of these genes results in biological deficits, the disorder is considered sex-linked.
Sexually Transmitted Infections
Sexually transmitted infections (STIs) are diseases transmitted primarily through unsafe sexual interactions. Bacteria, viruses, or parasites cause them and can result in severe health complications if untreated.ChlamydiaThe bacterium Chlamydia trachomatis is responsible for the disease Chlamydia, the most common STI in the United States. This peculiar pathogen requires human cells to reproduce, residing intracellularly. The initial infection often goes unnoticed because it typically does not...
Conduct Disorder
Conduct disorder is a complex mental health diagnosis characterized by a repetitive and persistent pattern of behavior that violates societal norms, the rights of others, or age-appropriate rules. The diagnostic criteria for conduct disorder require the presence of at least three problematic behaviors within the past 12 months, with at least one occurring in the past six months. These behaviors are grouped into four categories: aggression toward people and animals; destruction of property;...
