Sensor Information Fusion by Integrated AI to Control Public Emotion in a Cyber-Physical Environment

Area of Science:

• Computer Science
• Artificial Intelligence
• Human-Computer Interaction

Background:

• Cyber-physical systems (CPS) integrate computation with physical processes, offering enhanced control over environmental uncertainties.
• Existing research aims to improve service effectiveness by inducing specific emotions within service spaces.
• The need for advanced systems to manage complex environmental interactions and emotional responses is growing.

Purpose of the Study:

• To propose a novel CPS control system designed to induce specific emotions using multi-sensor data.
• To leverage the synergy between physical and virtual spaces for expanded environmental sensing and control.
• To develop an intelligent system capable of predicting and guiding user emotions towards desired states.

Main Methods:

• The proposed system integrates physical space sensors (temperature, humidity, dust, emotion) with cyber space controls (illumination, color temperature, video, sound, volume) within a Unity 3D virtual reality environment.
• An emotion prediction module utilizes modular Bayesian networks to analyze sensor data.
• An optimal stimulus decision module employs utility theory and reinforcement learning to determine cyber space controls for achieving target emotions.

Main Results:

• The CPS effectively integrates real-world environmental data with virtual stimuli to influence user emotions.
• The emotion prediction module demonstrated accuracy in assessing current emotional states.
• The optimal stimulus decision module successfully guided the system towards inducing target emotions through controlled virtual environments.

Conclusions:

• The developed CPS offers a viable method for emotion induction by dynamically controlling virtual environments based on real-time physical data.
• This approach expands the application of CPS in fields requiring nuanced environmental and emotional management.
• Further research can explore more complex emotional states and diverse virtual reality integrations.