Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

<sup>177</sup>Lu-Dotatate versus high-dose long-acting octreotide for the treatment of patients with advanced, grade 1-2, well-differentiated gastroenteropancreatic neuroendocrine tumours (XT-XTR008-3-01): an open-label, randomised, phase III trial.

Annals of oncology : official journal of the European Society for Medical Oncology·2025

Same author

NEuroMOrphic Neural-Response Decoding System for Adaptive and Personalized Neuro-Prosthetics' Control.

Biomimetics (Basel, Switzerland)·2025

Same author

Spiking Neural Networks for Multimodal Neuroimaging: A Comprehensive Review of Current Trends and the NeuCube Brain-Inspired Architecture.

Bioengineering (Basel, Switzerland)·2025

Same author

Decoding Brain Signals in a Neuromorphic Framework for a Personalized Adaptive Control of Human Prosthetics.

Biomimetics (Basel, Switzerland)·2025

Same author

A generalisability theory approach to quantifying changes in psychopathology among ultra-high-risk individuals for psychosis.

Schizophrenia (Heidelberg, Germany)·2024

Same author

A novel role for endoplasmic reticulum protein ERp72 in the pathogenesis of autoantibody-induced arthritis.

Scandinavian journal of rheumatology·2024

Same journal

Multiphysics Investigation on Thermal Characteristics of Internal Bio-Inspired V-Ribbed Cooling Channels for Outer Rotor PMSM.

Biomimetics (Basel, Switzerland)·2026

Same journal

Smart Logistics Model for Supply Chain Management via Brain-Inspired Geometric Deep Networks.

Biomimetics (Basel, Switzerland)·2026

Same journal

A Systematic Taxonomy of the Sunflower Optimization Algorithm: Variants, Hybridization Strategies, Applications, and Research Directions.

Biomimetics (Basel, Switzerland)·2026

Same journal

Toward a Compositional Theory of Trust in Embodied Intelligence: A QNLP Framework for Modeling Context, Interaction, and Trustworthiness.

Biomimetics (Basel, Switzerland)·2026

Same journal

Empirical Logic for Bio-Inspired Soft Computing: Illustrative Applications in Control Engineering and Cluster Analysis.

Biomimetics (Basel, Switzerland)·2026

Same journal

A Modified Multi-Strategy Dhole Optimization Algorithm and Its Engineering Applications.

Biomimetics (Basel, Switzerland)·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Mar 29, 2026

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury

Published on: May 15, 2016

eXCube2: Explainable Brain-Inspired Spiking Neural Network Framework for Emotion Recognition from Audio, Visual and

N K Kasabov^1,2,3, A Yang⁴, Z Wang¹

¹Knowledge Engineering and Discovery Research Institute (KEDRI), School of Engineering, Computer and Mathematical Sciences, Auckland University of Technology (AUT), WZ Building, St. Paul Street, Auckland 1010, New Zealand.

Biomimetics (Basel, Switzerland)

|March 27, 2026

Summary

This summary is machine-generated.

This study introduces brain-inspired AI (BIAI) using spiking neural networks (SNNs) for emotional recognition. The eXCube2 framework achieves high accuracy in recognizing emotions from audio-visual data, offering improved explainability and adaptability.

Keywords:

NeuCube biomimetic systems brain-inspired computation emotion recognition spiking neural networks

More Related Videos

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

Related Experiment Videos

Last Updated: Mar 29, 2026

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury

Published on: May 15, 2016

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

Area of Science:

Artificial Intelligence
Computational Neuroscience
Biomimetics

Background:

Current AI for emotional state recognition often lacks explainability and adaptability.
Spiking neural networks (SNNs) offer a biologically plausible approach for AI, mimicking brain function.
Multimodal data integration (audio-visual) can enhance the accuracy of emotional state recognition.

Purpose of the Study:

To introduce a biomimetic framework (eXCube2) with novel brain-inspired AI (BIAI) models for emotional state recognition.
To develop SNN-based BIAI models using a human brain template for enhanced data processing.
To evaluate the explainability, adaptability, and accuracy of the proposed framework on audio, visual, and multimodal data.

Main Methods:

Developed the eXCube2 framework utilizing a 3D SNN architecture (NeuCube) structured on a human brain template.
Trained BIAI models on spatio- and spectro-temporal data using brain-inspired learning rules.
Tested models on benchmark audio-visual datasets for emotional state recognition, incorporating a "don't know" output.

Main Results:

Achieved classification accuracy above 80% for single-modality data and 88.9% for multimodal audio-visual data.
Demonstrated improved explainability and adaptability compared to existing AI systems.
The brain template enabled effective tonotopic, stereo, and topographic mapping of audio-visual inputs.

Conclusions:

The eXCube2 framework offers a novel, brain-inspired approach to emotional state recognition with high accuracy and enhanced AI characteristics.
The SNN-based BIAI models show potential for applications in diverse fields, including healthcare, human-robot interaction, and gaming.
This research advances the development of brain-inspired AI systems, paving the way for more efficient and explainable AI through neuromorphic computing.