可扩展的嵌入融合与蛋白质语言模型:从基准测试文本集成表示的见解
Young Su Ko1, Jonathan Parkinson1, Wei Wang1,2
1Department of Chemistry and Biochemistry, University of California San Diego, 9500 Gilman Drive, La Jolla, CA 92093-0359, United States.
Briefings in bioinformatics
|January 29, 2026
概括
蛋白质语言模型 (pLMs) 对生物学至关重要. 这项研究通过整合文本数据和融合嵌入来增强pLM表示,在关键的生物任务中取得最先进的结果.
科学领域:
- 计算生物学是一种计算生物学.
- 生物信息学是一种生物信息学.
- 机器学习在生物学中的应用
背景情况:
- 蛋白质语言模型 (pLMs) 使用预训练的嵌入式用于各种生物应用.
- 标准培训目标可能导致下游任务的表现不足.
- 模型缩放并不总是保证更好的表示质量.
研究的目的:
- 调查增强蛋白质语言模型表示的策略.
- 在数据稀缺的生物环境中提高pLMs的实用性.
- 开发用于组合多个pLM嵌入式的高效方法.
主要方法:
- 使用对比学习将生物文本注释与pLM集成.
- 开发一种嵌入式融合策略,以结合多个pLMs的表示.
- 为高效嵌入子集识别提出一个贪的前向选择算法.
主要成果:
- 文本集成的pLMs (tpLMs) 和大规模的pLMs在六个不同的生物任务中进行了基准测试.
- 没有一个单一的模型在所有任务中始终超过其他模型.
- 嵌入融合在大多数任务上提高了性能,贪的前置选择有效地识别了近乎最佳的子集.
- 在同源序列恢复和蛋白质-蛋白质相互作用预测方面取得了最新的结果.
结论:
- 嵌入融合是改善蛋白质表示的实用和可扩展的策略.
- 整合文本数据和结合嵌入式为plm性能提供了显著的优势.
- 高效的算法对于利用在大型应用中嵌入核聚变的好处至关重要.
相关概念视频
Tagging and Fusion Proteins
8.5K
Proteins are involved in several cellular processes and biochemical reactions. Analyzing a specific protein of interest requires it to be isolated from the other proteins in the cell. This is achieved by overexpressing the specific gene in a suitable host to produce large quantities of the target protein. A tag or label is recombined with the gene to produce a fusion protein containing the target protein and the tag. The tags on these fusion proteins can then be used for easy detection and...
8.5K
Nuclear Fusion
33.8K
The process of converting very light nuclei into heavier nuclei is also accompanied by the conversion of mass into large amounts of energy, a process called fusion. The principal source of energy in the sun is a net fusion reaction in which four hydrogen nuclei fuse and ultimately produce one helium nucleus and two positrons.
A helium nucleus has a mass that is 0.7% less than that of four hydrogen nuclei; this lost mass is converted into energy during the fusion. This reaction produces about...
A helium nucleus has a mass that is 0.7% less than that of four hydrogen nuclei; this lost mass is converted into energy during the fusion. This reaction produces about...
33.8K
Language
909
Language is a unique communication system that uses words and systematic rules to organize and transmit information. Unlike other forms of communication, which may involve postures, movements, odors, or vocalizations, language relies on symbols and grammar. This makes human communication distinct from that of other species, who also communicate but do not use language in the same way humans do.
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
909
State Space Representation
570
The frequency-domain technique, commonly used in analyzing and designing feedback control systems, is effective for linear, time-invariant systems. However, it falls short when dealing with nonlinear, time-varying, and multiple-input multiple-output systems. The time-domain or state-space approach addresses these limitations by utilizing state variables to construct simultaneous, first-order differential equations, known as state equations, for an nth-order system.
Consider an RLC circuit, a...
Consider an RLC circuit, a...
570
Control Volume and System Representations
1.6K
Two key frameworks are employed to analyze mass, energy, and momentum transfer: the control volume approach and the system approach. These frameworks offer different perspectives, depending on whether the focus is on a specific region in space (control volume approach) or a defined mass of fluid (system approach).
The control volume approach considers a stationary region in space through which fluid flows. This region is bounded by a control surface. For instance, in the case of water...
The control volume approach considers a stationary region in space through which fluid flows. This region is bounded by a control surface. For instance, in the case of water...
1.6K
Graphical Representation of Inequalities
204
The graph of the equation where y equals x squared forms a curve known as a parabola. This curve acts as a boundary in the coordinate plane, dividing it into distinct regions based on the relative position of points.When the equality sign in the equation is replaced with an inequality—such as greater than, less than, greater than or equal to, or less than or equal to—the graphical representation changes from a single curve into a broader shaded area that signifies the set of all...
204


