Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Emotional Expression01:26

Emotional Expression

1.3K
Emotional expression encompasses how individuals convey their emotions through verbal communication and non-verbal cues. These non-verbal actions include facial expressions, body language, and physical gestures, such as frowning or smiling. Among these, facial expressions play a crucial role in emotional expression and are understood universally, indicating a biological basis for how humans communicate emotions.
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
1.3K
Facial Feedback Hypothesis01:24

Facial Feedback Hypothesis

858
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
858
Non-Verbal Cues01:29

Non-Verbal Cues

476
Non-verbal communication extends beyond gestures and facial expressions to include vocal elements known as paralanguage. Paralanguage consists of non-verbal vocal cues such as pitch, loudness, speech rate, pauses, and non-verbal vocalizations like laughter, sighs, and moans. These elements not only accompany speech but also provide critical emotional and contextual information.The Role of Paralanguage in CommunicationParalanguage adds depth to spoken language by conveying emotions and...
476
Therapeutic Communication01:30

Therapeutic Communication

10.9K
Communication is a lifelong learning process. Through therapeutic communication, nurses can collect relevant assessment data, provide education and counseling, and interact during nursing interventions. Sending and receiving messages occur through verbal and nonverbal communication techniques and can happen separately or simultaneously.
Verbal communication depends on language or a prescribed way of using words so that people can share information effectively. The critical aspects of verbal...
10.9K
Nonconscious Mimicry01:13

Nonconscious Mimicry

5.2K
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
5.2K
Impression Management Techniques III: Aligning Actions01:29

Impression Management Techniques III: Aligning Actions

210
Aligning actions are communicative strategies individuals employ to maintain social harmony and preserve personal identity in the face of potential disruptions to social norms. These actions are particularly important in managing social impressions when one's behavior might be seen as inappropriate, incompetent, or morally questionable.Types of Aligning ActionsThe three principal types of aligning actions are disclaimers, accounts, and apologies.DisclaimersDisclaimers are preventive; they are...
210

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

One-Way Street: The Efficacy of Unilateral Biliary Stenting in Patients with Malignant Hilar Biliary Obstruction.

Digestive diseases and sciences·2026
Same author

Overlap Syndromes and Associated Immunoglobulin-G4-Related Liver Diseases.

Journal of clinical and experimental hepatology·2026
Same author

Saroglitazar and vitamin E vs. lifestyle interventions in metabolic dysfunction associated steatotic liver disease: A 3-arm randomised study.

The Indian journal of medical research·2026
Same author

Saroglitazar for non-obese metabolic-dysfunction associated steatotic liver disease (MASLD): An open-label randomised controlled trial.

The Indian journal of medical research·2026
Same author

Epidemiology, Predictors of Antimicrobial Resistance and Empiric Treatment Strategies for Spontaneous Bacterial Peritonitis in Cirrhosis: A Multicentre SBP-INDIA Study.

Alimentary pharmacology & therapeutics·2026
Same author

Noncontrast abbreviated MRI demonstrates superior diagnostic accuracy compared to ultrasound for hepatocellular carcinoma detection: Interim results from a prospective surveillance trial.

Hepatology (Baltimore, Md.)·2026

Related Experiment Video

Updated: Apr 4, 2026

Virtual Agent for Real-Time Motivational Interviewing by Integrating Adaptive Nonverbal Behavior and Language Models
07:14

Virtual Agent for Real-Time Motivational Interviewing by Integrating Adaptive Nonverbal Behavior and Language Models

Published on: December 23, 2025

766

Multi-emotion and intensity-driven response generation for richer multimodal dialogue.

Apoorva Singh1, Raj Shree1, Dhirendra Pandey1

  • 1Department of Information Technology, Babasaheb Bhimrao Ambedkar University, Lucknow, India.

Scientific Reports
|April 2, 2026
PubMed
Summary

This study introduces a novel framework for AI to generate responses with multiple emotions and controlled intensity by analyzing text, audio, and visual cues. The Multimodal Multi Emotion and Intensity-leaded Deliberation Decoder (MMEI-DD) enhances natural AI-human interaction.

Keywords:
EmoticonsInter-modalityMulti emotionMultimodalitySentiments

Related Experiment Videos

Last Updated: Apr 4, 2026

Virtual Agent for Real-Time Motivational Interviewing by Integrating Adaptive Nonverbal Behavior and Language Models
07:14

Virtual Agent for Real-Time Motivational Interviewing by Integrating Adaptive Nonverbal Behavior and Language Models

Published on: December 23, 2025

766

Area of Science:

  • Artificial Intelligence
  • Human-Computer Interaction
  • Natural Language Processing

Background:

  • Human communication relies heavily on emotional expression, which is crucial for conveying meaning and intent.
  • Current AI speech agents often lack the ability to understand or generate nuanced emotional responses, limiting natural interaction.
  • There is a growing research focus on developing emotion-aware communication systems for more impactful AI interactions.

Purpose of the Study:

  • To develop an AI framework capable of generating multi-emotional responses with precisely controlled intensity.
  • To integrate multimodal information (text, audio, visual) for more accurate emotion and intensity recognition in dialogues.
  • To enhance the naturalness and impact of AI-human interactions through emotion-aware response generation.

Main Methods:

  • Designed a Multimodal Multi Emotion and Intensity-leaded Deliberation Decoder (MMEI-DD) framework.
  • Utilized Transformer networks to encode multimodal knowledge and capture inter-modality representations.
  • Implemented a two-step decoding mechanism to guide response generation with specified emotion and intensity.

Main Results:

  • The proposed MMEI-DD framework successfully generates multi-emotion and intensity-guided responses.
  • Expanding the multimodal feature set (MEIMD+) improved performance and reliability compared to existing methods.
  • Integration of multimodal knowledge significantly enhances the AI's ability to produce emotionally nuanced outputs.

Conclusions:

  • The MMEI-DD framework represents a significant advancement in generating emotionally intelligent AI responses.
  • Multimodal integration is key to achieving precise control over emotion and intensity in AI-generated dialogue.
  • The publicly available resources will facilitate further research in multimodal, emotion-aware AI communication.