Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Progress on quantum dot photocatalysts for biomass valorization.

Exploration (Beijing, China)·2024
Same author

Exploration of Positive and Negative Schizophrenia Symptom Heterogeneity and Establishment of Symptom-Related miRNA-mRNA Regulatory Network: Based on Transcriptome Sequencing Data.

Molecular neurobiology·2024
Same author

Causal association of gastroesophageal reflux disease with chronic sinusitis and chronic disease of the tonsils and adenoids.

European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery·2024
Same author

Different clinical diagnosis end up in the same pathological diagnosis of intravascular leiomyomatosis: Two case reports.

Medicine·2024
Same author

Targeting IL-6/STAT3 signaling abrogates EGFR-TKI resistance through inhibiting Beclin-1 dependent autophagy in HNSCC.

Cancer letters·2024
Same author

Fine-Tuning of Pt Dispersion on Al<sub>2</sub>O<sub>3</sub> and Understanding the Nature of Active Pt Sites for Efficient CO and NH<sub>3</sub> Oxidation Reactions.

ACS applied materials & interfaces·2023

Related Experiment Video

Updated: Jul 21, 2025

Estimation of Contact Regions Between Hands and Objects During Human Multi-Digit Grasping
09:41

Estimation of Contact Regions Between Hands and Objects During Human Multi-Digit Grasping

Published on: April 21, 2023

1.6K

A Novel Sensor Fusion Approach for Precise Hand Tracking in Virtual Reality-Based Human-Computer Interaction.

Yu Lei1, Yi Deng2, Lin Dong3

  • 1College of Humanities and Arts, Hunan International Economics University, Changsha 410012, China.

Biomimetics (Basel, Switzerland)
|July 28, 2023
PubMed
Summary

This study introduces a novel sensor fusion approach with Long Short-Term Memory (LSTM) algorithms for accurate hand tracking in Virtual Reality (VR) and Human-Computer Interaction (HCI). The system enhances immersive VR experiences by overcoming limitations of single-sensing technologies.

Keywords:
hand trackinghuman–computer interactionmulti-modal dataneural networkssensor fusion

More Related Videos

Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another
05:12

Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another

Published on: September 18, 2017

546.1K
Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision
08:15

Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision

Published on: March 28, 2025

639

Related Experiment Videos

Last Updated: Jul 21, 2025

Estimation of Contact Regions Between Hands and Objects During Human Multi-Digit Grasping
09:41

Estimation of Contact Regions Between Hands and Objects During Human Multi-Digit Grasping

Published on: April 21, 2023

1.6K
Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another
05:12

Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another

Published on: September 18, 2017

546.1K
Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision
08:15

Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision

Published on: March 28, 2025

639

Area of Science:

  • Computer Science
  • Human-Computer Interaction
  • Robotics

Background:

  • Virtual Reality (VR) and Human-Computer Interaction (HCI) demand precise hand tracking.
  • Existing single-sensing technologies face challenges with occlusions and environmental interference.
  • Robust hand tracking is crucial for intuitive and immersive VR experiences.

Purpose of the Study:

  • To develop an enhanced hand tracking system for VR-based HCI.
  • To address limitations of current single-sensing hand tracking methods.
  • To improve the accuracy and robustness of hand movement capture in VR.

Main Methods:

  • Implemented a novel sensor fusion approach combining multiple hardware inputs.
  • Utilized six Leap Motion controllers, two RealSense depth cameras, and two Myo armbands for multi-modal data capture.
  • Employed a Long Short-Term Memory (LSTM)-based algorithm for processing the rich, multi-modal data.

Main Results:

  • Achieved accurate real-time tracking of complex hand movements.
  • Demonstrated a robust solution overcoming occlusion and environmental factor limitations.
  • Validated the system's effectiveness in enhancing VR-based HCI.

Conclusions:

  • The proposed sensor fusion and LSTM approach significantly improves hand tracking accuracy in VR.
  • This system offers a powerful tool for more intuitive and immersive interactions in virtual environments.
  • The multi-modal strategy effectively overcomes the drawbacks of single-sensing modalities.