大型语言模型可以提取元数据用于人类神经成像出版物的注释
Matthew D Turner1, Abhishek Appaji2, Nibras Ar Rakib3
1Department of Psychiatry, The Ohio State University, Columbus, Ohio, USA.
bioRxiv : the preprint server for biology
|June 4, 2025
概括
最近的大型语言模型 (LLM) 在神经成像元数据提取和注释方面表现出强的表现. GPT-4o实现了与人类相比较的准确性,表明LLM对于大规模的注释任务是可行的.
科学领域:
- 神经成像是一种神经成像.
- 人工智能的人工智能
- 数据科学数据科学数据科学
背景情况:
- 元数据提取和注释对于组织和分析神经成像数据至关重要.
- 人类专家手动注释是耗时和资源密集的.
- 评估最近的大型语言模型 (LLM) 对这些任务的能力是必不可少的.
研究的目的:
- 评估最近商业大型语言模型 (LLM) 在神经成像中进行元数据提取和注释的有效性.
- 为了比较LLM (GPT-4o) 与人类注释员在现实任务中的表现.
- 确定LLM用于可扩展元数据注释的可用性.
主要方法:
- 调查了OpenAI的GPT-4o模型,以示实世界的神经成像元数据注释任务为例.
- 通过使用零射击提示而没有反来评估LLM绩效.
- 将LLM注释与黄金标准的人类注释进行比较,分析分歧.
主要成果:
- GPT-4o实现了高性能,精度得分在0.91到0.97.9之间.
- 法学士的表现与训练有素的人类注释员的表现相当.
- LLM 错误不常见,通常与人为错误相比,许多分歧不是实际错误.
结论:
- 最近的大型语言模型 (LLM) 能够在神经成像中进行高质量的元数据提取和注释,以最小的调查者努力.
- 士学位的性能可用于大规模的元数据注释,与人类注释者相似.
- 鼓励开发专门的微基准来评估LLM和代理系统注释性能.
相关概念视频
01:20Anatomy of the Brain: Major Regions
The brain is the most complex organ in the human body. It consists of four main parts: the cerebrum, diencephalon, cerebellum, and brainstem.
The cerebrum is the largest section of the brain and divides into left and right hemispheres, separated by a deep fissure. The cerebral outer layer of grey matter — the cerebral cortex — comprises elevations called gyri and shallow groves called sulci. The inner portion of white matter includes long nerve fibers known as axons, which connect various areas...
The cerebrum is the largest section of the brain and divides into left and right hemispheres, separated by a deep fissure. The cerebral outer layer of grey matter — the cerebral cortex — comprises elevations called gyri and shallow groves called sulci. The inner portion of white matter includes long nerve fibers known as axons, which connect various areas...
01:10Higher Mental Functions of the Brain: Language
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...