scELMo:语言模型的嵌入是单细胞数据分析的良好学习者
bioRxiv : the preprint server for biology
|September 2, 2025
概括
我们介绍 scELMo,一种使用大型语言模型 (LLM) 分析单细胞数据的新方法. scELMo在较少的资源中实现了诸如细胞聚类和注释等任务的高性能,超过了现有的基础模型.
科学领域:
- 计算生物学
- 生物信息学
- 基因组学
背景情况:
- 基础模型 (FM) 越来越多地用于单细胞数据分析,但成功程度不同.
- 现有的方法通常需要大量的资源和特定任务的培训.
研究的目的:
- 提出scELMo (语言模型的单细胞嵌入),一种用于单细胞数据分析的新方法.
- 利用大型语言模型 (LLM) 来生成元数据描述和嵌入.
- 为了实现零射击和微调功能,用于各种单细胞任务.
主要方法:
- scELMo使用LLM来从元数据描述中生成嵌入.
- 在零射击学习框架下将LLM嵌入与原始单细胞数据结合起来.
- 使用微调框架进行高级任务,如处理分析.
主要成果:
- 在没有新模型训练的情况下,scELMo执行细胞聚类,批量效应校正和细胞类型注释.
- 与scGPT和Geneformer等已建立的FM相比, 实现了更高的性能.
- 在像扰动模型这样的复杂任务中表现出有效性.
结论:
- scELMo为单单元数据分析提供了计算效率和资源节约的方法.
- 代表了开发生物数据领域特定的FM的有希望的方向.
- 在评估中优于现有的基于LLM的管道和大规模的FM.
相关概念视频
Cell Specific Gene Expression
Multicellular organisms contain a variety of structurally and functionally distinct cell types, but the DNA in all the cells originated from the same parent cells. The differences in the cells can be attributed to the differential gene expression. Liver cells, whose functions include detoxification of blood, production of bile to metabolize fats, and synthesis of proteins essential for metabolism, must express a specific set of genes to perform their functions. Gene expression also varies with...
Cell Specific Gene Expression
Multicellular organisms contain a variety of structurally and functionally distinct cell types, but the DNA in all the cells originated from the same parent cells. The differences in the cells can be attributed to the differential gene expression. Liver cells, whose functions include detoxification of blood, production of bile to metabolize fats, and synthesis of proteins essential for metabolism, must express a specific set of genes to perform their functions. Gene expression also varies with...
Introduction to Learning
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
Cognitive Learning
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
Components of Language
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs. “eh”). Phonemes combine to...
Language Development
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...


