对话面部信号结合成组成意义,改变了演讲者的意图的解释
James P Trujillo1,2, Judith Holler3,4
1Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands. James.Trujillo@mpi.nl.
Scientific reports
|January 27, 2024
概括
结合视觉线索,如头部转动和眉毛抬起,改变了我们理解口语的方式. 这种多式联络是以一种格斯塔尔特式的,构成性的方式被感知,而不仅仅是附加的.
科学领域:
- 认知科学 认知科学
- 语言学的语言学.
- 人与计算机的交互
背景情况:
- 人类语言依赖于将有限的信号结合在一起,以获得无限的表达.
- 对话视觉信号在多式发言中的作用仍然不清楚.
- 了解视觉线索如何与口语融合对于沟通研究至关重要.
研究的目的:
- 调查视觉信号的组合是否会改变口语表达的解释.
- 为了确定多式联络语言感知是否是组成性的和非添加性的.
主要方法:
- 参与者观察到一个虚拟的化身用单个或组合的视觉信号 (头转,头倾斜,眉毛抬起) 发出口语问题.
- 在观看后,参与者分类了化身发言背后的沟通意图.
- 分析的重点是比较单个与联合视觉信号条件的解释.
主要成果:
- 具有多个视觉信号的复合发言产生了不同的解释,而不是单信号发言.
- 综合信号的解释显示与相关的单个信号相似,而不是与无关的信号相似.
- 这表明,个别的视觉信号始终影响着整体的多式联络信息.
结论:
- 这项研究提供了第一个证据,证明了多模式语言的构成性,非添加性感知.
- 视觉信号以类似于 Gestalt 的方式集成,其中整体不仅仅是其部分的总和.
- 这些发现对理解人类沟通和设计更自然化的虚拟代理产生了影响.
相关概念视频
Therapeutic Communication
4.5K
Communication is a lifelong learning process. Through therapeutic communication, nurses can collect relevant assessment data, provide education and counseling, and interact during nursing interventions. Sending and receiving messages occur through verbal and nonverbal communication techniques and can happen separately or simultaneously.
Verbal communication depends on language or a prescribed way of using words so that people can share information effectively. The critical aspects of verbal...
Verbal communication depends on language or a prescribed way of using words so that people can share information effectively. The critical aspects of verbal...
4.5K
Facial Feedback Hypothesis
153
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
153
Sympathetic Signaling
963
Sympathetic signaling, a vital part of the autonomic nervous system, plays a crucial role in mobilizing the body's resources in response to stress or emergencies. It involves the transmission of nerve impulses from sympathetic preganglionic fibers to postganglionic fibers. This results in the release of specific neurotransmitters and activation of adrenergic receptors.
Sympathetic preganglionic fibers release the neurotransmitter acetylcholine (ACh) onto the ganglionic neurons in the...
Sympathetic preganglionic fibers release the neurotransmitter acetylcholine (ACh) onto the ganglionic neurons in the...
963
Muscles for Facial Expressions
2.1K
The craniofacial muscles are a collection of approximately 20 thin skeletal muscles situated beneath the skin of the face and scalp. These muscles, primarily responsible for the vast array of human facial expressions, originate from the bones or fibrous structures of the skull and extend outwards to connect with the skin. While most skeletal muscles in the body are enveloped in thick fascia, facial muscles generally have a more delicate fascial covering, with the buccinator muscle being a...
2.1K
Framing Effects
7.4K
Information is everywhere and its presentation—such as how and when items are presented—can impact our perceptions and decisions surrounding the info. This broad concept umbrellas framing effects—influences that occur due to the way information is framed in its appearance, whether it’s purely the order or the specific wording of a message. Let’s take a look at numerous ways in which two versions of something can objectively say the same thing, yet we respond in...
7.4K
Nonconscious Mimicry
4.6K
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
4.6K


