Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Association Areas of the Cortex01:21

Association Areas of the Cortex

8.9K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
8.9K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A rapid Lemna bioassay empowered by open-source image analysis.

Environmental monitoring and assessment·2026
Same author

Central sensitization in rheumatoid arthritis and psoriatic arthritis is associated with symptom burden than inflammatory activity: a cross-sectional study.

Rheumatology international·2026
Same author

Cloud-Based Control System with Sensing and Actuating Textile-Based IoT Gloves for Telerehabilitation Applications.

Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)·2025
Same author

From Knitting Technology to Robotics: Untethered Thermally Actuated Textile Exoskeleton for Dexterity Applications.

Advanced science (Weinheim, Baden-Wurttemberg, Germany)·2025
Same author

Textile-based Low-frequency RC Filter for Noise Reduction in ECG signals.

Global challenges (Hoboken, NJ)·2025
Same author

Improved BCI calibration in multimodal emotion recognition using heterogeneous adversarial transfer learning.

PeerJ. Computer science·2025

Related Experiment Video

Updated: Jan 17, 2026

Evaluating Flight Performance and Eye Movement Patterns Using Virtual Reality Flight Simulator
03:49

Evaluating Flight Performance and Eye Movement Patterns Using Virtual Reality Flight Simulator

Published on: May 19, 2023

1.5K

Emotion recognition in Virtual Reality using sensor fusion with eye tracking.

Meral Kuyucu1, Mehmet Ali Sarikaya1, Tülay Karakaş2

  • 1Department of Computer Engineering, Istanbul Technical University, Istanbul, 34469, Türkiye.

Computers in Biology and Medicine
|September 18, 2025
PubMed
Summary

This study enhances emotion recognition using Virtual Reality (VR) and multi-sensor fusion. The approach accurately predicts emotional states by integrating physiological and brain activity data.

Keywords:
EEGEmotion recognitionEye trackingPhysiological signalsSensor fusionVirtual reality

More Related Videos

Author Spotlight: Insights into the Analysis of Human Interaction with 3D Virtual Objects
06:36

Author Spotlight: Insights into the Analysis of Human Interaction with 3D Virtual Objects

Published on: October 18, 2024

1.4K
A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers
12:39

A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers

Published on: January 18, 2020

8.1K

Related Experiment Videos

Last Updated: Jan 17, 2026

Evaluating Flight Performance and Eye Movement Patterns Using Virtual Reality Flight Simulator
03:49

Evaluating Flight Performance and Eye Movement Patterns Using Virtual Reality Flight Simulator

Published on: May 19, 2023

1.5K
Author Spotlight: Insights into the Analysis of Human Interaction with 3D Virtual Objects
06:36

Author Spotlight: Insights into the Analysis of Human Interaction with 3D Virtual Objects

Published on: October 18, 2024

1.4K
A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers
12:39

A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers

Published on: January 18, 2020

8.1K

Area of Science:

  • Neuroscience
  • Computer Science
  • Human-Computer Interaction

Background:

  • Emotion recognition is crucial for various applications but faces limitations with current mobile sensor technologies.
  • Virtual Reality (VR) offers controlled environments for immersive experiences, overcoming traditional method constraints.
  • Multi-sensor fusion integrates diverse physiological and neurological data for comprehensive emotional analysis.

Purpose of the Study:

  • To develop and evaluate an enhanced emotion recognition system.
  • To integrate Virtual Reality (VR) with multi-sensor fusion for improved emotion detection.
  • To explore the efficacy of machine learning models in predicting emotional states using integrated data.

Main Methods:

  • Ninety-five participants were exposed to audiovisual stimuli in an immersive VR environment.
  • Collected physiological data included ElectroEncephaloGraphy (EEG), eye tracking, heart rate variability, ElectroDermal Activity (EDA), and body temperature.
  • Machine learning models (XGBoost, CatBoost, MLP, Gradient Boosting, LightGBM) were trained and evaluated for emotion prediction.

Main Results:

  • The VR-based multi-sensor fusion approach demonstrated robust and precise emotion recognition.
  • Evaluation metrics (accuracy, precision, recall, F1 scores) confirmed the effectiveness of the proposed method.
  • Integrated data from EEG, eye tracking, and wearable sensors significantly enhanced predictive capabilities.

Conclusions:

  • The study presents a novel, integrated approach to emotion recognition.
  • Combining VR, multi-sensor fusion, and machine learning bridges gaps in traditional emotion detection methods.
  • This research offers a promising direction for advancing emotion recognition technology in diverse fields.