走向一种统一的术语,用于 sonification 和可视化
Kajetan Enge1,2, Alexander Rind1, Michael Iber1
1Institute of Creative Media Technologies, FH St. Pölten, Campusplatz 1, St. Pölten, 3100 Austria.
概括
这项研究提出了用于视听分析的统一术语,将数据可视化和声音化联系起来. 通过将像"视觉标记"这样的可视化构造适应于声化.
科学领域:
- 数据表示和人机交互.
- 信息可视化和听觉显示.
- 多模式数据分析和感知.
背景情况:
- 声波和可视化利用人类的感知,但在数据转换方面有所不同.
- 声化领域长期以来一直在寻求整体方法,包括视听分析.
- 视听分析的统一设计理论需要一个共同的描述术语.
研究的目的:
- 为设计和分析视听数据表示建立一个共享的术语.
- 为了弥合数据可视化和声音化之间的理论差距.
- 为音视觉分析的综合设计理论提供基础.
主要方法:
- 从可视化理论中采用三个核心构造:空间基板,视觉标记和视觉通道.
- 定义时间作为 sonification 的时间基质.
- 引入听觉标志和听觉通道作为类似的概念在 sonification.
主要成果:
- 一个拟议的模型定义了定位在时间上的听觉标记和它们内编码的听觉通道.
- 新的术语允许使用一个共同的框架讨论可视化,声化和多模式设计.
- 这些定义促进了对视听分析研究的统一方法.
结论:
- 开发的术语支持视听分析,并为声化理论提供了新的视角.
- 这项工作为综合视听数据表示的整体理解奠定了基础.
- 拟议的模型增强了设计有效的多式联运数据显示器的理论基础.
相关概念视频
Ultrasonography
4.5K
Ultrasonography is an imaging technique that uses high-frequency sound waves to visualize the body's internal structures. It is a non-invasive and safe procedure that does not involve the use of ionizing radiation, making it widely used in various medical fields. Ultrasonography is used to study heart function, blood flow in the neck or extremities, certain conditions such as gallbladder disease, and fetal growth and development.
During an ultrasonography procedure, a handheld device called...
During an ultrasonography procedure, a handheld device called...
4.5K
Visual System
594
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
594
Perception of Sound Waves
4.5K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.5K
Control Volume and System Representations
1.2K
Two key frameworks are employed to analyze mass, energy, and momentum transfer: the control volume approach and the system approach. These frameworks offer different perspectives, depending on whether the focus is on a specific region in space (control volume approach) or a defined mass of fluid (system approach).
The control volume approach considers a stationary region in space through which fluid flows. This region is bounded by a control surface. For instance, in the case of water...
The control volume approach considers a stationary region in space through which fluid flows. This region is bounded by a control surface. For instance, in the case of water...
1.2K
Sound as Pressure Waves
2.4K
Sound waves, which are longitudinal waves, can be modeled as the displacement amplitude varying as a function of the spatial and temporal coordinates. As a column of the medium is displaced, its successive columns are also displaced. As the successive displacements differ relatively, a pressure difference with the surrounding pressure is created. The gauge pressure varies across the medium.
The pressure fluctuation depends on the difference in displacements between the successive points in the...
The pressure fluctuation depends on the difference in displacements between the successive points in the...
2.4K
Perceiving Loudness, Pitch, and Location
220
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
220


