为跨学科的环境挑战微调大型语言模型
Yuanxin Zhang1,2, Sijie Lin1,3, Yaxin Xiong1,2
1State Key Laboratory of Soil Pollution Control and Safety, Southern University of Science and Technology, Shenzhen, 518055, China.
Environmental science and ecotechnology
|August 13, 2025
概括
我们为环境科学中的大型语言模型 (LLM) 开发了一个统一的管道,创建了EnvGPT,ChatEnv数据集和EnvBench基准. EnvGPT实现了最先进的性能,加速了环境研究中的AI采用.
科学领域:
- 环境科学 环境科学
- 人工智能的人工智能
- 计算科学 计算科学
背景情况:
- 大型语言模型 (LLM) 提供先进的推理,但由于术语和数据异质性,在环境科学等专业领域面临挑战.
- 现有的LLM框架缺乏针对特定领域的培训数据和全面环境应用的评估基准.
研究的目的:
- 引入一个统一的管道来开发和评估适合环境科学的LLM.
- 创建一个特定领域的数据集和培训和评估环境背景下LLM绩效的基准.
主要方法:
- 开发了EnvInstruct,这是一个用于快速生成的多代理系统.
- 创建了ChatEnv,一个1亿令牌指令数据集,涵盖五个环境主题.
- 建立了EnvBench,这是一个4998项的基准,用于评估LLM分析,推理,计算和描述.
- 微调了一个80亿参数模型,EnvGPT,使用开发的管道.
主要成果:
- 在EnviroExam基准测试中,EnvGPT实现了92.06±1.85%的准确性,超过了可比较和较大的模型.
- 在相关性,事实性,完整性和风格指标方面,EnvGPT超过了EnvBench的基线.
- 微调方法证明了紧的LLM能够通过精心策划的域数据达到最先进的性能.
结论:
- 对特定领域的数据进行有针对性的微调显著提高了环境科学中的LLM能力.
- 发布的EnvGPT,ChatEnv和EnvBench为推动环境研究,政策和实践中的LLM采用提供了可重复的基础.
- 该管道为开发专门的LLM提供了可扩展的方法,具有多式联运和实时应用的潜力.
相关概念视频
Environmental Influences on Intelligence
414
Despite the strong genetic influence on traits like intelligence, environmental factors significantly shape outcomes. For example, while over 90% of height variation is due to genetic differences, environmental factors such as nutrition also have a notable impact. Similarly, for intelligence, changes in a child's surroundings can significantly alter their IQ. Research shows that enriched environments boost children's academic success and help them develop key cognitive skills. Children...
414
Environmental Applications of Microorganisms
242
Microorganisms play a pivotal role in maintaining ecosystem balance by recycling essential elements such as carbon, nitrogen, and phosphorus, as well as supporting processes like bioremediation, wastewater treatment, and biofuel production.Microbes in Elemental CyclesIn the carbon cycle, microorganisms decompose organic matter, releasing carbon dioxide via aerobic respiration. This carbon dioxide is subsequently used by photosynthetic organisms to synthesize organic compounds, closing the...
242
Improving Translational Accuracy
11.9K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
11.9K
Language and Cognition
441
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
441
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
101
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
101
Generalization, Discrimination, and Extinction
788
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
788


