nach0:多式自然和化学语言基础模型的基础模型
Micha Livne1, Zulfat Miftahutdinov2, Elena Tutubalina3
1NVIDIA 2788 San Tomas Expressway Santa Clara 95051 CA USA.
Chemical science
|June 7, 2024
概括
一个新的基础模型,nach0,在各种化学和生物任务中表现出色. 这种多域大型语言模型 (LLM) 在科学应用中表现出卓越的性能.
科学领域:
- 计算化学是一种计算化学.
- 生物信息学是一种生物信息学.
- 科学中的人工智能.
背景情况:
- 大型语言模型 (LLM) 越来越多地用于跨科学学科的复杂问题解决.
- 现有的LLM有前途,但往往缺乏用于复杂的化学和生物任务的专业能力.
研究的目的:
- 介绍nach0,一种新的多领域和多任务基础模型,专为化学和生物应用而设计.
- 评估nach0在一系列任务上的表现,包括生物医学问题答案,命名实体识别,分子生成和合成预测.
主要方法:
- 在科学文献,专利和分子字符串的多样性上进行预培训,以整合化学和语言知识.
- 使用指令调整来为特定下游任务微调模型.
- 利用NeMo框架,有效地平行优化模型培训.
主要成果:
- 在单一领域和跨领域的科学任务上,nach0的性能超过了最先进的基线.
- 该模型证明了在分子和文本格式中生成高质量的输出的能力.
- 在多领域的科学问题解决中,nach0显示出显著的有效性.
结论:
- nach0代表了科学研究的基础模型的重大进步,特别是在化学和生物学领域.
- 该模型的多域和多任务功能为加速发现和创新提供了多功能工具.
- nach0的表现凸显了专门的LLM在应对复杂的科学挑战方面的潜力.
相关概念视频
01:10Higher Mental Functions of the Brain: Language
793
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
793
02:00Molecular Models
38.2K
Physical models representing molecular architectures of chemical compounds play essential roles in understanding chemistry. The use of molecular models makes it easier to visualize the structures and shapes of atoms and molecules.
38.2K
01:27Language and Cognition
342
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
342
01:29The Two-State Receptor Model
1.9K
The two-state receptor model explains a drug's interaction with receptors, such as G protein-coupled receptors and ligand-gated ion channels, to induce or inhibit a biological response. When no natural ligands are present, a receptor exists in an equilibrium of inactive (Ri) and active (Ra) conformations. The inactive form does not produce a response, while the active form generates a basal effect known as constitutive activity.
The binding affinity of a drug determines its interaction with...
The binding affinity of a drug determines its interaction with...
1.9K
01:11Genetic Lingo
102.7K
Overview
102.7K
02:30Naturalistic Observations
15.4K
If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...
15.4K