Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Neural Circuits

Neural Circuits

Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...

Neural Regulation

Neural Regulation

Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.

Multi-input and Multi-variable systems

Multi-input and Multi-variable systems

Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...

Associative Learning

Associative Learning

Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Will multimodal large language models ever achieve deep understanding of the world?

Frontiers in systems neuroscience·2025

Same author

Disentanglement of Prosody Representations via Diffusion Models and Scheduled Gradient Reversal.

IEEE transactions on neural networks and learning systems·2025

Same author

Pain recognition and pain empathy from a human-centered AI perspective.

iScience·2024

Same author

Map-based experience replay: a memory-efficient solution to catastrophic forgetting in reinforcement learning.

Frontiers in neurorobotics·2023

Same author

A Trained Humanoid Robot can Perform Human-Like Crossmodal Social Attention and Conflict Resolution.

International journal of social robotics·2023

Same author

Emphasizing unseen words: New vocabulary acquisition for end-to-end speech recognition.

Neural networks : the official journal of the International Neural Network Society·2023

Same journal

Noisy Memory Generates Value in Changing Environments.

Adaptive behavior·2025

Same journal

Mechanical Problem Solving in Goffin's Cockatoos-Towards Modeling Complex Behavior.

Adaptive behavior·2024

Same journal

What affords being creative? Opportunities for novelty in light of perception, embodied activity, and imaginative skill.

Adaptive behavior·2024

Same journal

What's a good prediction? Challenges in evaluating an agent's knowledge.

Adaptive behavior·2023

Same journal

From eye-blinks to state construction: Diagnostic benchmarks for online representation learning.

Adaptive behavior·2023

Same journal

The affordances of art for making technologies.

Adaptive behavior·2022

See all related articles

Search research articles

Related Experiment Video

Updated: Mar 12, 2026

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

Developing crossmodal expression recognition based on a deep neural model.

Pablo Barros¹, Stefan Wermter¹

¹Department of Informatics, University of Hamburg, Germany.

Adaptive Behavior

|November 18, 2016

Summary

This summary is machine-generated.

This study introduces a novel deep neural network model for robots to understand human emotions from audio-visual cues. This enables more human-like decision-making and problem-solving in human-robot interaction scenarios.

Keywords:

Crossmodal learning convolution neural network emotion expression recognition self-organizing maps

More Related Videos

Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches

Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches

Published on: December 15, 2023

Cross-Modal Multivariate Pattern Analysis

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Related Experiment Videos

Last Updated: Mar 12, 2026

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches

Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches

Published on: December 15, 2023

Cross-Modal Multivariate Pattern Analysis

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Area of Science:

Robotics
Artificial Intelligence
Cognitive Science

Background:

Human-robot interaction (HRI) benefits from robots understanding human emotions.
Initial emotion perception is innate (positive/negative) and develops through observation.
Robots need sophisticated emotion recognition for effective collaboration.

Purpose of the Study:

To propose a deep neural network model simulating innate audio-visual emotion perception in robots.
To enable robots to learn and categorize new emotion expressions.
To enhance robot decision-making by incorporating emotion recognition.

Main Methods:

A deep neural network model with a self-organizing layer was developed.
The model simulates innate emotion perception and learns new expressions.
Evaluation was performed on three diverse emotion expression corpora: SAVEE, FABO, and EmotiW.

Main Results:

The model demonstrated the ability to recognize emotional expressions across different datasets.
Performance was benchmarked against state-of-the-art research in emotion recognition.
The model successfully learned and clustered novel emotion expressions.

Conclusions:

The proposed model effectively simulates innate emotion perception and learns new expressions.
This approach enhances robot capabilities in human-robot interaction.
The findings contribute to more intuitive and effective human-robot collaboration.