Effective Emoticon Suggestion Technique Based on Active Emotional Input Using Facial Expressions and Heart Rate...

Area of Science:

• Human-Computer Interaction
• Affective Computing
• Mobile Computing

Background:

• Computer-mediated communication lacks nonverbal cues, hindering accurate emotion interpretation.
• Mobile systems need enhanced methods for understanding user emotions.

Purpose of the Study:

• To propose and evaluate a novel approach for using emotions as active input in mobile systems.
• To accurately and comprehensively assess individual emotions for mobile system integration.

Main Methods:

• Combines psychological and neuroscientific principles.
• Integrates facial and heart rate information for emotion recognition.
• Utilizes mobile device front camera and heart rate sensor.

Main Results:

• Achieved 90% accuracy for induced emotional expression and 82% for intended emotional expression.
• User evaluation confirmed the technique's efficacy and feasibility.
• Demonstrated faster and more accurate emotional expression by users.

Conclusions:

• The proposed technique effectively recognizes prime emotions using multimodal sensor data.
• This approach has significant potential to improve user experience in mobile systems.
• Enables more personalized and dynamic interactions within mobile environments.