通过以声音为灵感的动作标题为基础增强DHH个体的视频体验 时空触角
IEEE transactions on haptics
|April 1, 2025
概括
本研究介绍了动作捕捉触觉系统 (MCHS),以提高聋人和听力障碍者 (DHH) 的视频可访问性. MCHS使用动画字幕和触觉反来传达非语言声音,改善观看体验.
科学领域:
- 人与计算机的交互
- 可访问性技术 技术可访问性
- 多媒体系统 多媒体系统
背景情况:
- 目前的视频标题主要传达语言内容,不包括对理解至关重要的非语言音频信息.
- 聋和听障 (DHH) 个体在视频中感知音乐,音效和情绪调等音色细微差别方面面临挑战.
- 对于DHH观众而言,现有的可访问性解决方案往往缺乏全面的方法来表示非听觉信息.
研究的目的:
- 设计和开发一种多式联络系统,即动作捕捉触觉系统 (MCHS),以向DHH个体传递非语言声音信息.
- 创建动画字幕和时空触觉模式,有效地代表各种音效和口语情绪.
- 评估MCHS在改善DHH用户视频观看体验方面的有效性.
主要方法:
- 设计了一个多模式系统 (MCHS),集成动画字幕和时空振动模式.
- 开发了特定的动作字幕和触觉模式,以代表声音效果和口语情感.
- 与DHH和听力参与者进行了调查,以改进动作字幕和触觉模式的设计.
- 评估了MCHS与19名DHH个人,以评估其对视频观看体验的影响.
主要成果:
- 通过集成的动画字幕和触觉反,MCHS有效地传递非语言声音信息.
- 参与者评估表明,MCHS有可能显著改善DHH个人的视频观看体验.
- 该研究确定了为DHH观众量身定制的多式联络标题系统的关键设计考虑因素.
结论:
- 动作捕捉触觉系统 (MCHS) 提供了一种有希望的方法,通过结合非语言声音线索来提高DHH个人的视频可访问性.
- 结合视觉 (动画字幕) 和触觉 (触觉反) 元素的多模式系统可以提供更具身临其境和全面的视频体验.
- 需要进一步的研究来应对设计挑战,并优化多式联运标题,以满足各种DHH用户需求.
更多相关视频
05:43Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback
Published on: May 23, 2019
5.4K
11:39Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
Published on: September 7, 2022
1.8K
相关概念视频
Perception of Sound Waves
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Sound as Pressure Waves
Sound waves, which are longitudinal waves, can be modeled as the displacement amplitude varying as a function of the spatial and temporal coordinates. As a column of the medium is displaced, its successive columns are also displaced. As the successive displacements differ relatively, a pressure difference with the surrounding pressure is created. The gauge pressure varies across the medium.
The pressure fluctuation depends on the difference in displacements between the successive points in the...
The pressure fluctuation depends on the difference in displacements between the successive points in the...
Relative Motion Analysis using Rotating Axes
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it instrumental in...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it instrumental in...
Relative Motion Analysis - Acceleration
A slider-crank mechanism converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider. The movement of the slider-crank is an example of general plane motion as the fluctuating angle between the crank and the connecting rod. Consider a segment AB where point A is at the end of the slider and point B is on the diametrically opposite end to point A, on a crack. The variance in...
Relative Motion Analysis using Rotating Axes - Acceleration
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame. The absolute velocity of point B is determined by adding the absolute velocity of point A, the relative velocity of point B in the rotating frame, and the effects caused by the angular velocity within the rotating frame.
Time differentiation is...
Time differentiation is...
Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
