Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Multimodal affective user interface using wireless devices for emotion identification.

J Zhou1, X Wang

  • 1Research Center for Learning Science, Southeast University, Nanjing, 210096 China (phone: 025-83795549; fax: 025-83795929;

Conference Proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual Conference
|February 7, 2007
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Level of retinoblastoma protein expression correlates with p16 (MTS-1/INK4A/CDKN2) status in bladder cancer.

Oncogene·1999
Same author

Concept design of computer-aided study on traditional Chinese drugs.

Journal of chemical information and computer sciences·1999
Same author

Late onset of renal and hepatic cysts in Pkd1-targeted heterozygotes.

Nature genetics·1999
Same author

delta-catenin, an adhesive junction-associated protein which promotes cell scattering.

The Journal of cell biology·1999
Same author

Numeric modeling of the cardiovascular system with a left ventricular assist device.

ASAIO journal (American Society for Artificial Internal Organs : 1992)·1999
Same author

Exon-I is involved in positive as well as negative regulation of human angiotensinogen gene expression.

Gene·1999
Same journal

Highly Articulated Robotic Probe for Minimally Invasive Surgery.

Conference proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual Conference·2010
Same journal

Combined peripheral and cortical neural stimulation in motor neurorehabilitation.

Conference proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual Conference·2008
Same journal

Embedded assessment algorithms within home-based cognitive computer game exercises for elders.

Conference proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual Conference·2008
Same journal

Digital signal processing of the wideband external pulse recorded during cuff deflation: a new way to measure blood pressure.

Conference proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual Conference·2008
Same journal

Immune cells detection of the in vivo rejecting heart in USPIO-enhanced magnetic resonance imaging.

Conference proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual Conference·2008
Same journal

wHospital: a web-based application with digital signature for drugs dispensing management.

Conference proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual Conference·2007
See all related articles

This study introduces a multimodal system for accurate emotion identification using physiological signals, facial expressions, and speech. The developed system enables real-time, synchronous data collection for advanced emotion assessment and training applications.

Area of Science:

  • Computer Science
  • Human-Computer Interaction
  • Affective Computing

Background:

  • Emotion recognition is crucial for intelligent systems.
  • Current systems often lack multimodal integration for accurate emotion identification.

Purpose of the Study:

  • To develop and evaluate a multimodal affective user interface system for precise emotion identification.
  • To explore the integration of various data streams for enhanced affective computing.

Main Methods:

  • Collected synchronous multimodal data: physiological signals (wireless sensors, Bluetooth), facial expressions (cameras), speech, and behavioral video.
  • Utilized real-time data acquisition for convenient multimodal signal analysis.
  • Developed an affective user interface for emotion identification.

Related Experiment Videos

Main Results:

  • Demonstrated the feasibility of synchronous, real-time data collection from multiple modalities.
  • Established a foundation for advanced multimodal emotion recognition.
  • Enabled convenient analysis of integrated affective data streams.

Conclusions:

  • The multimodal system offers a reliable approach to emotion identification.
  • The system has potential applications in emotion assessment, learning, and training.
  • Integrated affective computing enhances the accuracy and depth of emotion recognition.