Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Sensory Modalities01:15

Sensory Modalities

3.5K
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
3.5K
Design Example01:23

Design Example

469
The innovation of touch-tone telephony revolutionized the telecommunications industry by replacing the traditional rotary dial with a dual-tone multi-frequency (DTMF) signaling system. This system uses a matrix-style keypad with buttons arranged in four rows and three columns, creating 12 distinct signals each assigned to a pair of frequencies. Each button press results in a simultaneous generation of two sinusoidal tones – one from a low-frequency group (697 to 941 Hz) and one from a...
469

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Motor Imagery Acquisition Paradigms: In the Search to Improve Classification Accuracy.

Sensors (Basel, Switzerland)·2025
Same author

Defect Detection and Depth Estimation in Composite Materials for Pulsed Thermography Images by Nonuniform Heating Correction and Oriented Gradient Information.

Materials (Basel, Switzerland)·2023
Same author

SenSARS: A Low-Cost Portable Electrochemical System for Ultra-Sensitive, Near Real-Time, Diagnostics of SARS-CoV-2 Infections.

IEEE transactions on instrumentation and measurement·2022
See all related articles

Related Experiment Video

Updated: Dec 13, 2025

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
11:54

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

5.0K

Human-computer multimodal interface to internet navigation.

Jose H Mosquera-DeLaCruz1, Humberto Loaiza-Correa1, Sandra E Nope-Rodríguez1

  • 1School of Electrical and Electronic Engineering, Universidad del Valle, Cali, Colombia.

Disability and Rehabilitation. Assistive Technology
|July 31, 2020
PubMed
Summary

New multimodal interfaces enable individuals with motor impairments to naturally control popular applications like Google Chrome, Gmail, and Facebook using voice and head gestures. This technology enhances digital accessibility for those with physical limitations.

Keywords:
Human-computer interactioncomputer visioninternet vavigationspeech recognition

More Related Videos

Author Spotlight: Enhancing Neurorehabilitation Through EEG, Motor Imagery, and Virtual Reality
10:14

Author Spotlight: Enhancing Neurorehabilitation Through EEG, Motor Imagery, and Virtual Reality

Published on: May 10, 2024

1.6K
Characterization of the Sense of Agency over the Actions of Neural-machine Interface-operated Prostheses
05:21

Characterization of the Sense of Agency over the Actions of Neural-machine Interface-operated Prostheses

Published on: January 7, 2019

8.2K

Related Experiment Videos

Last Updated: Dec 13, 2025

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
11:54

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

5.0K
Author Spotlight: Enhancing Neurorehabilitation Through EEG, Motor Imagery, and Virtual Reality
10:14

Author Spotlight: Enhancing Neurorehabilitation Through EEG, Motor Imagery, and Virtual Reality

Published on: May 10, 2024

1.6K
Characterization of the Sense of Agency over the Actions of Neural-machine Interface-operated Prostheses
05:21

Characterization of the Sense of Agency over the Actions of Neural-machine Interface-operated Prostheses

Published on: January 7, 2019

8.2K

Area of Science:

  • Human-Computer Interaction
  • Rehabilitation Engineering
  • Assistive Technology

Background:

  • Traditional computer interfaces (keyboard, mouse) pose significant barriers for individuals with motor impairments and limited digital literacy.
  • There is a growing need for natural, intuitive interaction methods that leverage gestures and voice commands.
  • Existing assistive technologies often require specialized hardware, limiting accessibility and affordability.

Purpose of the Study:

  • To propose and develop novel multimodal interfaces for controlling mass-use applications.
  • To enable individuals with motor impairments to interact with common software (Google Chrome, Gmail, Facebook) using natural gestures and voice.
  • To create an accessible and low-cost solution utilizing readily available hardware like webcams and microphones.

Main Methods:

  • Developed a multimodal interface processing voice signals and head movements for gestural control.
  • The system translates voice and head gestures into mouse and keyboard commands for applications like Google Chrome, Gmail, and Facebook.
  • The interface complements, rather than replaces, traditional input methods and requires only a standard webcam and microphone.

Main Results:

  • Verbal interaction testing involved 189 voice commands (75.7% performance) and 105 dictations (81.1% performance for 13-word sentences).
  • Gestural interaction successfully activated 126 commands via a drop-down menu without errors.
  • Mouse clicks were activated 84 times with a 70.2% success rate using head movements.

Conclusions:

  • The developed multimodal interface significantly benefits individuals with motor impairments, offering an alternative to physical mouse and keyboard manipulation for popular applications.
  • The motor impairments group preferred verbal control over gestural control, highlighting the importance of voice-based interaction.
  • While young adults found the interface engaging, an adaptation period is recommended for older adults to optimize their use of the system.