Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Multi-input and Multi-variable systems01:22

Multi-input and Multi-variable systems

146
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
146

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Activation of KIT signaling promotes early tumorigenesis through the AP-1 pathway in APC/TP53 double-knockout human colon organoids.

Cell death & disease·2026
Same author

In situ graphene-seq: spatial transcriptomics and chronic electrophysiological characterization of tissue microenvironments.

Nature communications·2026
Same author

DeepRespNet: a hybrid attention-recurrent framework for non-contact respiratory rate estimation.

Frontiers in physiology·2026
Same author

Effects of ramped GVS parameter combinations on vestibular perception and their application in a Virtual Reality flight simulator.

Ergonomics·2026
Same author

High-strength and high-modulus silicon monoxide for high-energy-density and fast-charging lithium-ion batteries.

Nature communications·2026
Same author

Overcoming the Barrier to Intermolecular Alkoxy Radical Reactivity: Proton-Coupled Electron Transfer-Mediated Alkene Hydroetherification.

Journal of the American Chemical Society·2026

Related Experiment Video

Updated: Sep 3, 2025

Evaluating Usability Aspects of a Mixed Reality Solution for Immersive Analytics in Industry 4.0 Scenarios
06:02

Evaluating Usability Aspects of a Mixed Reality Solution for Immersive Analytics in Industry 4.0 Scenarios

Published on: October 6, 2020

2.4K

Multimodal interaction: Input-output modality combinations for identification tasks in augmented reality.

May Jorella Lazaro1, Jaeyong Lee2, Jaemin Chun2

  • 1Interdisciplinary Program in Cognitive Science, Seoul National University, Seoul, South Korea.

Applied Ergonomics
|July 22, 2022
PubMed
Summary
This summary is machine-generated.

Multimodal interaction (MMI) in augmented reality (AR) shows varied effects. Combining input and output modalities impacts performance, workload, and user preference, requiring careful system design for optimal results.

Keywords:
Augmented realityModality combinationMultimodal interactionProcessing codesSensory modalities

More Related Videos

Usability Evaluation of Augmented Reality: A Neuro-Information-Systems Study
05:43

Usability Evaluation of Augmented Reality: A Neuro-Information-Systems Study

Published on: November 30, 2022

2.4K
Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another
05:12

Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another

Published on: September 18, 2017

546.6K

Related Experiment Videos

Last Updated: Sep 3, 2025

Evaluating Usability Aspects of a Mixed Reality Solution for Immersive Analytics in Industry 4.0 Scenarios
06:02

Evaluating Usability Aspects of a Mixed Reality Solution for Immersive Analytics in Industry 4.0 Scenarios

Published on: October 6, 2020

2.4K
Usability Evaluation of Augmented Reality: A Neuro-Information-Systems Study
05:43

Usability Evaluation of Augmented Reality: A Neuro-Information-Systems Study

Published on: November 30, 2022

2.4K
Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another
05:12

Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another

Published on: September 18, 2017

546.6K

Area of Science:

  • Human-Computer Interaction
  • Augmented Reality Systems
  • Multimodal Interaction

Background:

  • Multimodal interaction (MMI) is increasingly adopted in augmented reality (AR) for more natural user experiences.
  • Limited research exists on the optimal application and combined effects of input/output modalities in AR.
  • Understanding MMI in AR is crucial for developing effective and user-friendly systems.

Purpose of the Study:

  • To investigate the independent and combined effects of various input and output modalities in MMI within AR.
  • To analyze the impact of different MMI conditions on task performance, user workload, and preferences.
  • To provide insights into the effective design of MMI for AR applications.

Main Methods:

  • A controlled experiment involving 20 young adults performing an identification task in AR.
  • Manipulation of input modalities (speech, gesture, multimodal) and output conditions (VV-VA, VV-NA, NV-VA, NV-NA).
  • Evaluation of task performance, workload, perceived appropriateness, and user preference across different conditions.

Main Results:

  • Significant differences were observed in task performance, workload, and user preference based on input and output modalities.
  • Interaction effects between input and output modalities were evident, influencing performance metrics.
  • Multimodal input is generally preferred, but its effectiveness is contingent on the system's output processing.

Conclusions:

  • The effectiveness of MMI in AR is influenced by the interplay between input and output modalities.
  • Careful consideration of system output processing is necessary when implementing multimodal input in AR.
  • This study offers novel implications for the design and application of MMI in AR systems.