视听角度和语音不一致性不会影响虚拟现实中的视听语言短期记忆
Cosima A Ermert1, Manuj Yadav1, Jonathan Ehret2
1Institute for Hearing Technology and Acoustics, RWTH Aachen University, Aachen, Germany.
PloS one
|August 22, 2025
概括
虚拟现实 (VR) 使用头戴显示器 (HMD) 尽管有视听不匹配,但不会显著影响语言短期记忆. 视听语音序列回忆任务在显示类型和不一致性方面表现出强大.
科学领域:
- 认知心理学
- 虚拟现实研究
- 人与计算机的互动
背景情况:
- 虚拟现实 (VR) 环境在研究中越来越多地用于模拟现实场景.
- 虚拟现实中的视觉元素可能会影响听觉信息的处理,特别是当视听信息不一致时.
- 头戴式显示器 (HMD) 提供沉浸式虚拟现实体验,引发了对认知任务的影响的问题.
研究的目的:
- 研究虚拟现实中的视听不一致对口头短期记忆的影响.
- 使用HMD与传统计算机显示器进行口头短期记忆任务的性能比较.
- 在不同的视听条件下评估视听语音序列回忆 (avVSR) 任务的稳定性.
主要方法:
- 使用HMD和计算机显示器进行了两次实验.
- 有关角度和声音的视听不一致.
- 使用呈现数字序列的嵌入式对话代理 (ECA) 开发了一个视听语言序列回忆 (avVSR) 任务.
主要成果:
- 在HMD和计算机显示器显示器之间没有发现正确回忆数字的显著差异.
- 主观评估表明在HMD状态下存在的感觉更强.
- 在监视器上观察到极端角度不一致的微小,微不足道的回忆增加;响应时间没有受到影响.
结论:
- 视听语音串行回忆任务对HMD和计算机显示器的角度和语音视听不一致性具有稳定性.
- 在经过测试的场景中,VR显示技术,包括HMD,似乎不会对口语短期记忆性能产生负面影响.
- 虽然HMD增强了存在,但它们并没有改变通过avVSR任务测量的基本认知性能.
相关概念视频
01:17Auditory Perception
1.5K
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
1.5K
01:12Visual Agnosia
2.0K
Visual agnosia is a condition characterized by the inability to recognize visually presented objects despite having normal vision. For instance, a person with visual agnosia can describe the shape and color of an object but cannot identify or name it. This impairment does not affect their visual field, acuity, color vision, brightness discrimination, language, or memory. An example of this condition in a social setting is someone at a dinner party asking for "that silver thing with a round...
2.0K
01:22Chunking and Rehearsal in Sensory Memory
818
Improving short-term memory can be achieved through techniques like chunking and rehearsal. Chunking involves organizing information into larger, more manageable units. This technique is particularly useful for information that exceeds the typical memory span of between five and nine items. For instance, logging into an online account with a password like "ta89vq0179gz" involves grouping letters and numbers into three chunks—ta89, vq01, and 79gz. It makes large amounts of...
818
01:18Long-Term Memory
937
Long-term memory is a relatively permanent type of memory, capable of storing vast amounts of information over extended periods. Its storage capacity is generally considered unlimited.
Long-term memory can be categorized into two primary types: explicit and implicit memory. Explicit memory, also known as declarative memory, involves the conscious recollection of information that we deliberately try to remember, recall, and articulate. This type of memory encompasses specific facts, events, and...
Long-term memory can be categorized into two primary types: explicit and implicit memory. Explicit memory, also known as declarative memory, involves the conscious recollection of information that we deliberately try to remember, recall, and articulate. This type of memory encompasses specific facts, events, and...
937
01:22Eyewitness Memory
644
Eyewitness memory refers to the recollection of events by someone who has directly witnessed them, often serving as critical evidence in legal settings. This type of memory is commonly used in criminal cases where a witness describes details like a suspect's appearance, clothing, or behavior during a crime. However, despite its perceived reliability, eyewitness memory is prone to significant errors.
One such error is memory distortion, which occurs because human memory does not function...
One such error is memory distortion, which occurs because human memory does not function...
644
01:18False Memories
706
False memories represent a cognitive distortion in which individuals recall events that did not happen, or remember them in an altered form. This phenomenon highlights the brain's constructive nature in processing and recalling memories, emphasizing that memory is not a perfect representation of past events but rather a dynamic reconstruction influenced by various factors.
One primary source of false memories is misattribution, where individuals incorrectly associate external information...
One primary source of false memories is misattribution, where individuals incorrectly associate external information...
706