Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Ultrasonography01:17

Ultrasonography

4.5K
Ultrasonography is an imaging technique that uses high-frequency sound waves to visualize the body's internal structures. It is a non-invasive and safe procedure that does not involve the use of ionizing radiation, making it widely used in various medical fields. Ultrasonography is used to study heart function, blood flow in the neck or extremities, certain conditions such as gallbladder disease, and fetal growth and development.
During an ultrasonography procedure, a handheld device called...
4.5K
Visual System01:26

Visual System

594
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
594
Perception of Sound Waves01:01

Perception of Sound Waves

4.5K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.5K
Control Volume and System Representations01:16

Control Volume and System Representations

1.2K
Two key frameworks are employed to analyze mass, energy, and momentum transfer: the control volume approach and the system approach. These frameworks offer different perspectives, depending on whether the focus is on a specific region in space (control volume approach) or a defined mass of fluid (system approach).
The control volume approach considers a stationary region in space through which fluid flows. This region is bounded by a control surface.  For instance, in the case of water...
1.2K
Sound as Pressure Waves01:17

Sound as Pressure Waves

2.4K
Sound waves, which are longitudinal waves, can be modeled as the displacement amplitude varying as a function of the spatial and temporal coordinates. As a column of the medium is displaced, its successive columns are also displaced. As the successive displacements differ relatively, a pressure difference with the surrounding pressure is created. The gauge pressure varies across the medium.
The pressure fluctuation depends on the difference in displacements between the successive points in the...
2.4K
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

220
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
220

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same authorSame journal

Parallel Chords: an audio-visual analytics design for parallel coordinates.

Personal and ubiquitous computing·2024
See all related articles

Related Experiment Video

Updated: Jul 12, 2025

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
11:54

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

4.4K

Towards a unified terminology for sonification and visualization.

Kajetan Enge1,2, Alexander Rind1, Michael Iber1

  • 1Institute of Creative Media Technologies, FH St. Pölten, Campusplatz 1, St. Pölten, 3100 Austria.

Personal and Ubiquitous Computing
|October 23, 2023
PubMed
Summary

This study proposes a unified terminology for audio-visual analysis, bridging data visualization and sonification. By adapting visualization constructs like "visual mark" to sonification

Keywords:
Audio-visual data analysisSonification theoryVisualization theory

More Related Videos

Hemi-laryngeal Setup for Studying Vocal Fold Vibration in Three Dimensions
10:13

Hemi-laryngeal Setup for Studying Vocal Fold Vibration in Three Dimensions

Published on: November 25, 2017

11.0K
fMRI Mapping of Brain Activity Associated with the Vocal Production of Consonant and Dissonant Intervals
11:15

fMRI Mapping of Brain Activity Associated with the Vocal Production of Consonant and Dissonant Intervals

Published on: May 23, 2017

7.2K

Related Experiment Videos

Last Updated: Jul 12, 2025

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
11:54

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

4.4K
Hemi-laryngeal Setup for Studying Vocal Fold Vibration in Three Dimensions
10:13

Hemi-laryngeal Setup for Studying Vocal Fold Vibration in Three Dimensions

Published on: November 25, 2017

11.0K
fMRI Mapping of Brain Activity Associated with the Vocal Production of Consonant and Dissonant Intervals
11:15

fMRI Mapping of Brain Activity Associated with the Vocal Production of Consonant and Dissonant Intervals

Published on: May 23, 2017

7.2K

Area of Science:

  • Data representation and human-computer interaction.
  • Information visualization and auditory display.
  • Multimodal data analysis and perception.

Background:

  • Sonification and visualization leverage human perception but differ in data transformation.
  • The sonification field has long sought a holistic approach, including audio-visual analysis.
  • A unified design theory for audio-visual analysis requires a common descriptive terminology.

Purpose of the Study:

  • To establish a shared terminology for designing and analyzing audio-visual data representations.
  • To bridge the theoretical gap between data visualization and sonification.
  • To provide a foundation for a comprehensive design theory of audio-visual analysis.

Main Methods:

  • Adopting three core constructs from visualization theory: spatial substrate, visual mark, and visual channel.
  • Defining time as the temporal substrate for sonification.
  • Introducing auditory marks and auditory channels as analogous concepts in sonification.

Main Results:

  • A proposed model defines auditory marks positioned in time and auditory channels encoded within them.
  • The new terminology enables discussion of visualization, sonification, and multimodal designs using a common framework.
  • The definitions facilitate a unified approach to audio-visual analytics research.

Conclusions:

  • The developed terminology supports audio-visual analytics and offers a novel perspective on sonification theory.
  • This work lays the groundwork for a holistic understanding of combined audio-visual data representation.
  • The proposed model enhances the theoretical underpinnings of designing effective multimodal data displays.