在桥梁信息处理过程中进行文本和图像集成:英语和中文L1和L2发言者的比较
Chenyi Zhang1, Ianthi Tsimpli2, Elaine Schmidt2,3
1Department of Theoretical and Applied Linguistics, University of Cambridge, 9 West Road, Cambridge, CB3 9DP, United Kingdom. cz344@cam.ac.uk.
Memory & cognition
|May 20, 2025
概括
桥梁信息有助于故事的理解. 整合图片与文本是无的,但为英语发言者和第二语言学习者增加图片的文本会带来挑战.
科学领域:
- 认知心理学 认知心理学
- 教育心理学教育心理学
- 多模式学习是多模式学习.
背景情况:
- 桥接信息可以提高单一模式故事 (文本或图片) 的理解.
- 整合跨文本和图像的桥梁信息的认知负载尚未得到充分理解.
- 个体差异可能会影响个体如何有效地处理多模式信息.
研究的目的:
- 调查信息桥梁在多式联络故事理解中的作用.
- 检查文本和图像模式之间的切换如何影响理解.
- 探索个体差异 (语言背景) 对多式联络理解的影响.
主要方法:
- 参与者 (L1/L2讲汉语和英语) 在六个条件下阅读四部分故事:原始图片/文本,切换模式与桥接,以及缺失的桥接信息.
- 理解时间被测量为主要依赖变量.
- 分析了语言背景 (L1/L2) 的个体差异.
主要成果:
- 缺失的桥梁信息显著增加了所有参与者群体的理解时间.
- 从图片切换到与桥接信息的文本并没有妨碍理解.
- 当文字添加到图片上时,中国L1说话者没有表现出理解困难;然而,英语L1/L2和中国L2说话者有.
- 个人差异显著调节了信息桥接和模式切换的影响.
结论:
- 桥梁信息对于多式联运理解至关重要,而它的缺失阻碍了处理.
- 将文本整合到图形叙事中是认知上高效的,特别是对中国的母语人士来说.
- 在字母和第二语言文本中处理图形桥接信息会带来更大的认知挑战,突出模式和语言熟练程度的影响.
相关概念视频
Language and Cognition
302
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
302
Group Design
8.9K
The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between...
8.9K


