通过使用上下文化词汇表示来进行多任务学习,用于对形态丰富的语言进行语法解析
Toqeer Ehsan1, Miriam Butt2, Sarmad Hussain3
1Quantitative Science and Technology Studies (QSTS), VTT Technical Research Centre of Finland, Espoo, Finland.
PloS one
|September 25, 2025
概括
这项研究通过将短语结构树库转换为依赖树库,并开发一种新的序列标记方案,推进了乌尔都语语语法解析. 多任务学习显著改善了选区和依赖性解析性能.
科学领域:
- 计算语言学 计算语言学
- 自然语言处理自然语言处理.
- 乌尔都语语言处理
背景情况:
- 对于像乌尔都语这样的形态丰富语言的语法解析提出了重大挑战.
- 现有的乌尔都语树库需要用于依赖性解析任务的转换.
- 为乌尔都语开发有效的解析框架对于推进NLP研究至关重要.
研究的目的:
- 为了在乌尔都语的选区和依赖性解析中获得最先进的结果.
- 引入一个新的序列标记方案,以实现统一的解析表示.
- 探索单任务和多任务学习模式对乌尔都语解析的好处.
主要方法:
- 使用特定语言的映射规则将CLE-UTB短语结构树库转换为依赖树库.
- 开发一种新的序列标记方案,以统一解析任务.
- 培训在一个大规模的2200万令牌乌尔都语语库上进行了上下文化词汇表示.
- 实施一个使用单任务和多任务学习的解析框架.
主要成果:
- 在选区解析中获得了F1得分91.39,提高了3.29分.
- 在依赖性解析中获得了85.69的标记附件得分,提高了1.49分.
- 通过多任务学习证明了显著的性能提升.
结论:
- 拟议的序列标记方案和多任务学习方法有效地改善了乌尔都语语法解析.
- 学习交叉任务表示为解析形态丰富的语言提供了可衡量的好处.
- 这项工作推进了乌尔都语选区和依赖性解析的最新技术.
更多相关视频
12:49Transcranial Direct Current Stimulation tDCS of Wernicke's and Broca's Areas in Studies of Language Learning and Word Acquisition
Published on: July 13, 2019
17.9K
06:15Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism
Published on: October 3, 2018
8.1K
相关概念视频
Language Development
852
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
852
Components of Language
752
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
752
Language and Cognition
715
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
715
Purposive Learning
444
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
444
Associative Learning
1.2K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.2K
Higher Mental Functions of the Brain: Language
3.5K
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
3.5K
