Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Efficient coding in active perception: A developmental perspective on autonomous control.

Advances in child development and behavior·2026
Same author

Quantifying User Engagement During an Upper Limb Rehabilitation Task.

IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society·2025
Same author

Towards High Performance Low Complexity Calibration in Appearance Based Gaze Estimation.

IEEE transactions on pattern analysis and machine intelligence·2022
Same author

Gaze-controlled Robot-assisted Painting in Virtual Reality for Upper-limb Rehabilitation.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2021
Same author

Active head rolls enhance sonar-based auditory localization performance.

PLoS computational biology·2021
Same author

Viewing garden scenes: Interaction between Gaze Behavior and Physiological Responses.

Journal of eye movement research·2021

Related Experiment Video

Updated: Oct 10, 2025

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
08:18

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

Published on: August 15, 2020

5.1K

A Multimodal Direct Gaze Interface for Wheelchairs and Teleoperated Robots.

Isamu Poy, Liang Wu, Bertram E Shi

    Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference
    |December 11, 2021
    PubMed
    Summary
    This summary is machine-generated.

    This study introduces a novel multimodal system combining gaze tracking and push buttons for intuitive environmental control. This approach offers faster, more efficient navigation for individuals with severe motor disabilities, enhancing accessibility.

    More Related Videos

    Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy
    13:44

    Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy

    Published on: August 8, 2011

    14.1K
    Design and Use of an Apparatus for Presenting Graspable Objects in 3D Workspace
    09:11

    Design and Use of an Apparatus for Presenting Graspable Objects in 3D Workspace

    Published on: August 8, 2019

    5.8K

    Related Experiment Videos

    Last Updated: Oct 10, 2025

    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
    08:18

    WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

    Published on: August 15, 2020

    5.1K
    Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy
    13:44

    Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy

    Published on: August 8, 2011

    14.1K
    Design and Use of an Apparatus for Presenting Graspable Objects in 3D Workspace
    09:11

    Design and Use of an Apparatus for Presenting Graspable Objects in 3D Workspace

    Published on: August 8, 2019

    5.8K

    Area of Science:

    • Human-Computer Interaction
    • Assistive Technology
    • Rehabilitation Engineering

    Background:

    • Gaze-based interfaces are valuable for individuals with upper limb impairments.
    • Traditional gaze interfaces can be cognitively demanding and unsafe for real-world applications like driving.
    • A need exists for more intuitive and efficient gaze control systems.

    Purpose of the Study:

    • To develop and evaluate a cost-effective multimodal system for gaze-based control.
    • To create an intuitive "direct interface" for environmental interaction.
    • To compare the proposed system with conventional "indirect" gaze interfaces.

    Main Methods:

    • Developed a multimodal system integrating appearance-based gaze estimation from webcam images with push-button inputs.
    • Implemented an intuitive "direct interface" where gaze direction in the environment controls motion.
    • Tested the system for wheelchair control and robotic teleoperation.
    • Compared system performance against an "indirect" gaze-based command selection system.

    Main Results:

    • The "direct interface" system demonstrated faster and more efficient navigation compared to the "indirect" system.
    • The multimodal approach mitigates the risks associated with directing gaze away from the environment.
    • The system offers a more natural and affordable control method.

    Conclusions:

    • The developed multimodal gaze-based system provides a significant advancement in assistive technology.
    • It offers substantial benefits for patients with severe motor disabilities, such as Amyotrophic Lateral Sclerosis (ALS).
    • The system enhances user experience and efficiency in environmental control applications.