Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A p53-ΔNp73 signaling axis drives selective motor neuron degeneration in spinal muscular atrophy.

bioRxiv : the preprint server for biology·2026
Same author

From policy to practice: An anthropological analysis of implementing community-based healthcare reform in Catalonia.

Social science & medicine (1982)·2026
Same author

Illnesses, Violence, Forced Displacement and Differentiated Citizenship Among the Hitnü People from Arauca, Colombia.

Journal of racial and ethnic health disparities·2026
Same author

Leveraging lived experience: a qualitative study on the impact of formerly incarcerated consultants in public policy making to improve safety net services.

Harm reduction journal·2026
Same author

Cenomanian theropod teeth from Algora (central Spain), new evidence for majungasaurine abelisaurids in Europe.

Scientific reports·2026
Same author

Knowing equity, doing equity: healthcare cultures and why reforms stall in everyday care.

Frontiers in public health·2026

Related Experiment Video

Updated: Dec 8, 2025

Author Spotlight: Deciphering the Cognitive and Neural Mechanisms of Gesture in Communication
07:18

Author Spotlight: Deciphering the Cognitive and Neural Mechanisms of Gesture in Communication

Published on: January 26, 2024

1.2K

Understanding Multimodal User Gesture and Speech Behavior for Object Manipulation in Augmented Reality Using

Adam S Williams, Jason Garcia, Francisco Ortega

    IEEE Transactions on Visualization and Computer Graphics
    |September 17, 2020
    PubMed
    Summary

    This study explored user interactions in augmented reality (AR) using gesture and speech. Findings inform the design of natural, intuitive multimodal interactions for future AR devices.

    More Related Videos

    Estimation of Contact Regions Between Hands and Objects During Human Multi-Digit Grasping
    09:41

    Estimation of Contact Regions Between Hands and Objects During Human Multi-Digit Grasping

    Published on: April 21, 2023

    2.0K
    Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision
    08:15

    Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision

    Published on: March 28, 2025

    1.0K

    Related Experiment Videos

    Last Updated: Dec 8, 2025

    Author Spotlight: Deciphering the Cognitive and Neural Mechanisms of Gesture in Communication
    07:18

    Author Spotlight: Deciphering the Cognitive and Neural Mechanisms of Gesture in Communication

    Published on: January 26, 2024

    1.2K
    Estimation of Contact Regions Between Hands and Objects During Human Multi-Digit Grasping
    09:41

    Estimation of Contact Regions Between Hands and Objects During Human Multi-Digit Grasping

    Published on: April 21, 2023

    2.0K
    Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision
    08:15

    Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision

    Published on: March 28, 2025

    1.0K

    Area of Science:

    • Human-Computer Interaction
    • Augmented Reality
    • Virtual Object Manipulation

    Background:

    • Augmented reality (AR) technology is rapidly advancing, necessitating intuitive interaction methods.
    • Current interaction methods for AR often lack naturalness, hindering user experience.
    • Understanding user interaction is key to designing effective AR interfaces.

    Purpose of the Study:

    • To investigate user manipulation of virtual objects in AR using multimodal (gesture and speech) and unimodal (gesture) interactions.
    • To develop user-defined interaction sets for building tasks in 3D AR environments.
    • To inform the design of natural-feeling interactions for AR headsets.

    Main Methods:

    • An elicitation study using Wizard of Oz design with 24 participants.
    • Tested interaction modalities: gesture and speech combined, gesture only, and speech only.
    • Utilized canonical referents (translation, rotation, scale) and abstract referents (create, destroy, select).

    Main Results:

    • Identified types of gestures performed and timing between co-occurring gestures and speech (130 ms).
    • Assessed perceived workload across different modalities using NASA TLX.
    • Provided a consensus set of gestures for AR interactions.

    Conclusions:

    • Multimodal interactions, especially gesture and speech, are crucial for AR headsets.
    • Findings offer design guidelines for creating more natural and efficient AR user interfaces.
    • This research contributes to the development of pervasive AR computing.