HiGen:用于层次文字分类的层次意识序列生成
Vidit Jain1, Mukund Rungta1,2, Yuchen Zhuang1
1Georgia Institute of Technology.
概括
层次性文本分类 (HTC) 模型与不平衡的数据和静态表示作斗争. 我们的HiGen框架使用动态文本生成来提高性能,特别是对于稀有类,并引入ENZYME数据集.
科学领域:
- 自然语言处理自然语言处理.
- 机器学习 机器学习
- 生物信息学是一种生物信息学.
背景情况:
- 层次性文本分类 (HTC) 由于复杂的标签分类学和不平衡的数据集,提出了挑战.
- 现有的模型通常依赖于静态文档表示,这可能无法捕捉不同层次层次的文本部分的不同相关性.
研究的目的:
- 开发一种基于文本生成的新框架HiGen,用于HTC中的动态文档表示.
- 通过调整语言模型以适应域内知识,提高HTC模型的性能,特别是对于具有有限示例的类.
主要方法:
- 建议使用语言模型进行动态文本表示的HiGen框架.
- 引入了一个水平指导损失函数来对齐文本和标签语义.
- 实施了一项特定任务的预训练策略,以提高领域内的适应能力.
- 开发了HTC的ENZYME数据集,专注于PubMed文章中的酶委员会 (EC) 数量预测.
主要成果:
- 在ENZYME,WOS和NYT数据集上,HiGen在现有方法上表现出卓越的性能.
- 该框架有效地处理了数据不平衡,并减轻了几例类的性能问题.
- 针对特定任务的预训练显著提高了代表性不足的班级的表现.
结论:
- 拟议的HiGen框架通过使用动态文档表示方式,在层次性文本分类方面取得了重大进展.
- ENZYME数据集为HTC的研究提供了宝贵的资源,特别是在生物信息学领域.
- HiGen的方法在解决数据不平衡和改善复杂分类任务中的模型概括方面是有效的.
相关概念视频
Per-Unit Sequence Models
67
An ideal Y-Y transformer, grounded through neutral impedances, displays per-unit sequence networks akin to those of a single-phase ideal transformer when subjected to balanced positive- or negative-sequence currents. These currents do not produce neutral currents, and their associated voltage drops.
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
67
Classification of Systems-II
133
Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,
133
Classification of Systems-I
167
Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
167
Force Classification
1.1K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.1K
Hierarchy of Motor Control
2.4K
The hierarchy of motor control refers to the different levels of organization and processing involved in controlling movement in the body. These levels range from higher cortical areas involved in planning and decision-making to lower spinal cord reflexes that respond automatically to external stimuli.
2.4K
Aggregates Classification
299
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
299


