Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Perception of Sound Waves01:01

Perception of Sound Waves

4.7K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.7K
Auditory Perception01:17

Auditory Perception

1.5K
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
1.5K
Visual System01:26

Visual System

2.3K
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
2.3K
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

1.3K
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
1.3K
Perception01:28

Perception

1.8K
Perception is a fundamental psychological process that enables individuals to organize, interpret, and consciously experience sensory information. This process is crucial for understanding and interacting with the world around us. It includes both bottom-up and top-down processing, each playing a distinct role in how we perceive our environment.
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...
1.8K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Real-Time Embedded Eye Image Defocus Estimation for Iris Biometrics.

Sensors (Basel, Switzerland)·2023
Same author

Data-Driven Multiresolution Camera Using the Foveal Adaptive Pyramid.

Sensors (Basel, Switzerland)·2016
Same author

A Bayesian direction-of-arrival model for an undetermined number of sources using a two-microphone array.

The Journal of the Acoustical Society of America·2014
Same author

Combining segmentation and attention: a new foveal attention model.

Frontiers in computational neuroscience·2014
Same author

Numerical absorbing boundary conditions based on a damped wave equation for pseudospectral time-domain acoustic simulations.

TheScientificWorldJournal·2014
Same author

Perceptual organization and artificial attention for visual landmarks detection.

Cognitive processing·2013
Same journal

RETRACTED: Zhang et al. A Novel Framework for Reconstruction and Imaging of Target Scattering Centers via Wide-Angle Incidence in Radar Networks. <i>Sensors</i> 2025, <i>25</i>, 6802.

Sensors (Basel, Switzerland)·2026
Same journal

Enhancing Unsupervised Multi-Source Domain Adaptation for Person Re-Identification via Mixture of Experts and Graph-Based Relation.

Sensors (Basel, Switzerland)·2026
Same journal

Development of an Instrumented Glove for Palmar Pressure Assessment in Kayakers.

Sensors (Basel, Switzerland)·2026
Same journal

Development and Experimental Validation of an Autonomous IoT-Based Monitoring System for Real-Time Water Quality Assessment in the Amazon River.

Sensors (Basel, Switzerland)·2026
Same journal

Semi-Supervised Adversarial Learning Framework for Controller Area Network Bus Intrusion Detection.

Sensors (Basel, Switzerland)·2026
Same journal

Smart Optimization Method for Safety Signs in Innovative Manufacturing Environments Integrating Industrial Field IoT Sensors and Knowledge Graphs.

Sensors (Basel, Switzerland)·2026
See all related articles

Related Experiment Video

Updated: Apr 28, 2026

SSVEP-based Experimental Procedure for Brain-Robot Interaction with Humanoid Robots
11:01

SSVEP-based Experimental Procedure for Brain-Robot Interaction with Humanoid Robots

Published on: November 24, 2015

12.5K

Audio-visual perception system for a humanoid robotic head.

Raquel Viciana-Abad1, Rebeca Marfil2, Jose M Perez-Lorenzo3

  • 1University of Jaén, Multimedia and Multimodal Processing Group, Polytechnic School of Linares, University of Jaén Alfonso X El Sabio, 28, 23700, Linares, Spain. rviciana@ujaen.es.

Sensors (Basel, Switzerland)
|June 1, 2014
PubMed
Summary
This summary is machine-generated.

Researchers developed a novel audio-visual system for robots to track people. This approach fuses sensor data using Bayes inference, outperforming single-sensor methods in real-world interactive scenarios.

More Related Videos

Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy
13:44

Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy

Published on: August 8, 2011

15.7K
Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
09:01

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Published on: March 27, 2013

13.7K

Related Experiment Videos

Last Updated: Apr 28, 2026

SSVEP-based Experimental Procedure for Brain-Robot Interaction with Humanoid Robots
11:01

SSVEP-based Experimental Procedure for Brain-Robot Interaction with Humanoid Robots

Published on: November 24, 2015

12.5K
Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy
13:44

Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy

Published on: August 8, 2011

15.7K
Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
09:01

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Published on: March 27, 2013

13.7K

Area of Science:

  • Robotics
  • Artificial Intelligence
  • Human-Robot Interaction

Background:

  • Social robots require effective attention-directing mechanisms for interaction.
  • Current audio-visual fusion methods are often limited to fixed systems and lack real-world evaluation for interactive robots.

Purpose of the Study:

  • To demonstrate the benefits of fusing sensory information with Bayes inference for interactive robotics.
  • To present and evaluate a system for person localization using combined audio and visual data.

Main Methods:

  • Developed a system integrating audio and visual cues for person localization.
  • Evaluated system performance against unimodal (audio-only or visual-only) systems.
  • Conducted experiments considering technical limitations of individual sensor modalities.

Main Results:

  • The proposed audio-visual fusion system shows promise for proactive speaker detection and tracking.
  • The fused system demonstrated superior performance compared to unimodal approaches in interactive scenarios.
  • Bayes inference effectively integrated multi-sensory data for improved localization.

Conclusions:

  • Fusing audio-visual data with Bayes inference enhances person localization in human-robot interaction.
  • The system offers a viable solution for interactive robots needing to track speakers in real-world settings.
  • Further research can explore this approach for more sophisticated robot attention mechanisms.