Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Jun 27, 2026

Artificial Intelligence-Based System for Detecting Attention Levels in Students
06:37

Artificial Intelligence-Based System for Detecting Attention Levels in Students

Published on: December 15, 2023

Automatic temporal segment detection and affect recognition from face and body display.

Hatice Gunes1, Massimo Piccardi

  • 1University of Technology Sydney, Broadway, NSW 2007, Australia.

IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics : a Publication of the IEEE Systems, Man, and Cybernetics Society
|December 11, 2008
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

Association Areas of the Cortex01:21

Association Areas of the Cortex

Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Expanding the clinical and molecular spectrum of NGLY1 deficiency: A multicenter cohort.

Molecular genetics and metabolism·2026
Same author

Genotype-Phenotype Correlations in Phenylketonuria and Hyperphenylalaninemia: A Single-Center Study.

Pediatrics international : official journal of the Japan Pediatric Society·2026
Same author

Assessment of biotinidase activity changes over time in biotinidase deficient patients.

Frontiers in pediatrics·2026
Same author

Determination of the cytotoxic effects of parasporal proteins in native Bacillus thuringiensis isolates on various cancer cell lines and investigation of the apoptotic, synergistic, and angiogenic potency of the isolate Bt 5.4.

BMC biotechnology·2025
Same author

ReactFace: Online Multiple Appropriate Facial Reaction Generation in Dyadic Interactions.

IEEE transactions on visualization and computer graphics·2025
Same author

Empowering large language models for automated clinical assessment with generation-augmented retrieval and hierarchical chain-of-thought.

Artificial intelligence in medicine·2025
Same journal

Strategic Ability Updating in Concurrent Games by Coalitional Commitment.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2015
Same journal

Meta-Analysis of the First Facial Expression Recognition Challenge.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2012
Same journal

Adjustable model-based fusion method for multispectral and panchromatic images.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2012
Same journal

Face Feature Weighted Fusion Based on Fuzzy Membership Degree for Video Face Recognition.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2012
Same journal

A New Adaptive Fast Cellular Automaton Neighborhood Detection and Rule Identification Algorithm.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2012
Same journal

Human-arm-and-hand-dynamic model with variability analyses for a stylus-based haptic interface.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2012
See all related articles

This study reveals that analyzing the temporal dynamics of facial and body expressions significantly improves affect recognition. Synchronizing these modalities enhances accuracy compared to single-modality or basic fusion methods.

Area of Science:

  • Multimodal Affect Recognition
  • Human-Computer Interaction
  • Cognitive Science

Background:

  • Affective state recognition traditionally relies on single modalities like voice or face.
  • Existing multimodal systems often neglect the temporal dynamics (onset, apex, offset) of expressive modalities.
  • Understanding modality dynamics is crucial for accurate affect recognition.

Purpose of the Study:

  • To automatically detect temporal segments (phases) in affective face and body displays.
  • To investigate if phase detection enhances affect recognition accuracy.
  • To develop and evaluate a multimodal fusion approach based on phase synchronization.

Main Methods:

  • Automatic detection of temporal phases in affective face and body displays.

Related Experiment Videos

Last Updated: Jun 27, 2026

Artificial Intelligence-Based System for Detecting Attention Levels in Students
06:37

Artificial Intelligence-Based System for Detecting Attention Levels in Students

Published on: December 15, 2023

  • Comparative analysis of affect recognition using single modalities, fused modalities, and phase-synchronized fusion.
  • Feature-level and decision-level fusion strategies were explored.

    • Main Results:

    • Affective face and body displays are simultaneous but not strictly synchronous.
    • Explicit detection of temporal phases significantly improves affect recognition accuracy.
    • Multimodal fusion (face and body) outperforms single modalities.
    • Synchronized feature-level fusion yields superior results over decision-level fusion.

    Conclusions:

    • Temporal dynamics of expressive modalities are critical for accurate affect recognition.
    • Automatic phase detection and synchronized fusion are effective strategies for multimodal affect recognition.
    • This approach advances the field of human-computer interaction and affective computing.