制作大型语言模型可靠的数据科学编程辅助飞行员用于生物医学研究
Zifeng Wang1,2, Benjamin Danek1,2, Ziwei Yang3
1Keiji AI, Seattle, WA, USA.
Nature biomedical engineering
|January 22, 2026
概括
大型语言模型 (LLM) 在生物医学数据可视化任务中显示精度低 (<40%). 一个改进的AI代理通过改进分析计划,提高科学研究可靠性,实现了74%的准确性.
科学领域:
- 生物医学研究的研究.
- 数据可视化数据可视化
- 人工智能的人工智能是人工智能.
背景情况:
- 大型语言模型 (LLM) 显示出从用户请求中生成数据可视化的潜力.
- 在科学背景下,LLM生成的可视化的准确性在很大程度上没有被评估.
- 当前的LLM可能会造成传播不准确科学发现的风险.
研究的目的:
- 在生物医学数据可视化中对各种LLM的准确性进行基准测试.
- 开发和评估一个改进的人工智能代理,用于生成准确的科学可视化.
- 创建一个平台,与LLMs合作开发分析计划.
主要方法:
- 从7个生物医学研究领域的39项研究中创建了293个编码任务的基准.
- 用不同的提示策略评估了8个专有和8个开源的LLM.
- 一个人工智能代理被开发出来,可以在代码生成之前代地改进分析计划.
主要成果:
- 在基准任务中,LLM的整体准确率低于40%.
- 开发的AI代理在生成分析代码时实现了74%的准确性.
- 一项用户研究表明,该平台使研究人员能够完成三项研究的80%以上的分析代码.
结论:
- 在科学数据可视化方面盲目依赖当前的LLM带来了严重的错误风险.
- 一个优先考虑分析计划改进的AI代理可以大大提高准确性.
- 整合LLM的协作平台可以提高生物医学数据分析的效率和可靠性.
相关概念视频
Reliability and Validity
13.8K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.8K
Language
898
Language is a unique communication system that uses words and systematic rules to organize and transmit information. Unlike other forms of communication, which may involve postures, movements, odors, or vocalizations, language relies on symbols and grammar. This makes human communication distinct from that of other species, who also communicate but do not use language in the same way humans do.
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
898
Psychology as a Science
3.8K
Psychology, as a scientific discipline, aims to understand the mind and behavior through rigorous and systematic methods. The foundation of psychological research is evidence-based, relying heavily on the scientific method to derive and validate knowledge. This structured approach ensures that findings are reliable, valid, and applicable to broader contexts.
The scientific method in psychology involves six critical steps: making observations, formulating hypotheses, conducting tests, analyzing...
The scientific method in psychology involves six critical steps: making observations, formulating hypotheses, conducting tests, analyzing...
3.8K
Components of Language
796
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
796
Language Development
877
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
877
Language and Cognition
741
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
741


