Jove
Visualize
联系我们
JoVE
x logofacebook logolinkedin logoyoutube logo
关于 JoVE
概览领导团队博客JoVE 帮助中心
作者
出版流程编辑委员会范围与政策同行评审常见问题投稿
图书馆员
用户评价订阅访问资源图书馆顾问委员会常见问题
研究
JoVE JournalMethods CollectionsJoVE Encyclopedia of Experiments存档
教育
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab Manual教师资源中心教师网站
使用条款与条件
隐私政策
政策

相关概念视频

Language and Cognition01:27

Language and Cognition

375
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
375
Language Development01:22

Language Development

395
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
395
Components of Language01:24

Components of Language

318
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
318
Cognitive Learning01:21

Cognitive Learning

423
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
423
Purposive Learning01:22

Purposive Learning

142
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
142
Chunking01:12

Chunking

143
Chunking is a powerful cognitive technique that improves short-term memory retention by organizing information into smaller, more manageable units. The brain, limited by working memory capacity, can more easily process and store information when it is divided into "chunks" rather than presented as discrete, unrelated elements. Chunking is especially useful when dealing with large amounts of information, such as numerical sequences, words, or complex ideas.
The principle behind chunking...
143

您也可能阅读

相关文章

通过共同作者、期刊和引用图与本文相关的文章。

排序
Same author

Engineered Lipid Nanoparticles with Promoted Endosomal Escape and R283S-Mediated Stimulator of Interferon Genes (STING) Activation for Pancreatic Cancer Immunotherapy.

Pharmaceutics·2026
Same author

Dual-Functional Injectable Photothermal Nanohydrogel Promotes Anti-Inflammation and Bone Regeneration in Distraction Osteogenesis.

Advanced healthcare materials·2025
Same author

Engineered lipid nanoparticles with synergistic dendritic cell targeting and enhanced endosomal escape for boosted mRNA cancer vaccines.

Materials today. Bio·2025
Same author

From Blood to Therapy: The Revolutionary Application of Platelets in Cancer-Targeted Drug Delivery.

Journal of functional biomaterials·2025
Same author

Identification of sweetpotato virus disease-infected leaves from field images using deep learning.

Frontiers in plant science·2024
Same author

A complex network approach to analyse pre-trained language models for ancient Chinese.

Royal Society open science·2024

相关实验视频

Updated: Jul 19, 2025

Examining Online Syntactic Processing of Spoken Complex Sentences in Chinese Using Dual-Modal Interference Tasks
08:32

Examining Online Syntactic Processing of Spoken Complex Sentences in Chinese Using Dual-Modal Interference Tasks

Published on: September 5, 2019

5.7K

中国的BERT学习了什么关于语法知识?

Jianyu Zheng1, Ying Liu1

  • 1Department of Chinese Language and Literature, Tsinghua University, Haidian Distinct, Beijing, China.

PeerJ. Computer science
|August 7, 2023
PubMed
概括

这项研究探讨了中国的BERT,揭示了它的注意力和隐藏状态编码语法知识. 精心调整的模型还保留了语言结构,解释了BERT.

科学领域:

  • 自然语言处理 (NLP) 是一种自然语言处理.
  • 计算语言学 计算语言学
  • 人工智能的人工智能

背景情况:

  • 预先训练有素的语言模型,如从变压器 (BERT) 的双向编码器表示,在NLP任务中表现出色.
  • 关于BERT学习知识的研究在英语方面广泛,但在中文方面有限.
  • 由于其基于字符的写作系统,中文BERT的语法知识获取仍未得到充分探索.

研究的目的:

  • 调查嵌入在中国BERT注意力和隐藏状态中的语法知识.
  • 分析微调如何影响各种NLP任务中中文BERT中语法信息的保存.

主要方法:

  • 采用探测方法来识别中文BERT的注意力机制和层次表示中的语法信息.
  • 分析了个人和组合的注意力头来编码特定和整体的语法关系.
  • 检查了在各种任务中微调的中国BERT模型,以评估结构性信息保留.

主要成果:

  • 特定的注意点和它们的组合有效地编码了中文BERT中的语法关系.
  • 跨BERT层的隐藏表示包含不同程度的语法信息.
  • 精心调整的中国BERT模型在保留核心语言结构的同时展示了适应性.
关键词:
贝尔特 (BERT) 公司华人中文 华人中文是什么意思精细调整了我们的声音.在NLP中,我们使用了NLP.语法 语法 语法 语法 语法

更多相关视频

Experimental Paradigm for Measuring the Effect of Induced Emotion on Grammar Learning
05:33

Experimental Paradigm for Measuring the Effect of Induced Emotion on Grammar Learning

Published on: January 29, 2020

6.1K
Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism
06:15

Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism

Published on: October 3, 2018

7.8K

相关实验视频

Last Updated: Jul 19, 2025

Examining Online Syntactic Processing of Spoken Complex Sentences in Chinese Using Dual-Modal Interference Tasks
08:32

Examining Online Syntactic Processing of Spoken Complex Sentences in Chinese Using Dual-Modal Interference Tasks

Published on: September 5, 2019

5.7K
Experimental Paradigm for Measuring the Effect of Induced Emotion on Grammar Learning
05:33

Experimental Paradigm for Measuring the Effect of Induced Emotion on Grammar Learning

Published on: January 29, 2020

6.1K
Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism
06:15

Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism

Published on: October 3, 2018

7.8K

结论:

  • 中国的BERT在其注意点和隐藏状态中拥有重要的语法知识.
  • 该模型在微调后保留语法结构的能力有助于其在中国NLP任务中的强大表现.
  • 结果为基于字符的语言的BERT模型的语言能力提供了见解.