Game design to measure reflexes and attention based on biofeedback multi-sensor interaction

Area of Science:

• Human-Computer Interaction
• Biomedical Engineering
• Game Design

Background:

• Biofeedback offers a novel approach to human-computer interaction (HCI) by utilizing physiological signals.
• Integrating biofeedback into gaming environments can create more immersive and responsive experiences.
• Assessing physiological responses during gameplay provides insights into user engagement and stress levels.

Purpose of the Study:

• To develop and evaluate a multi-sensor biofeedback system for a car racing game.
• To investigate the impact of physiological data on game interaction and user experience.
• To analyze the correlation between specific physiological signals and game-related emotional states.

Main Methods:

• A multi-sensor system was implemented, incorporating an Eye Tracker, Kinect, pulsometer, respirometer, electromyography (EMG), and galvanic skin resistance (GSR).
• An algorithm was designed to translate sensor data into game interaction logic.
• System Usability Scale (SUS) was used for usability assessment, alongside statistical analysis of physiological data (GSR, breathing, heart rate).

Main Results:

• The system achieved a high System Usability Scale (SUS) score of 72.333.
• A significant difference (p = 0.026) was observed in galvanic skin resistance (GSR) values from the start to the end of the game.
• A notable correlation (r = 0.659, p = 0.008) was found between breathing levels and perceived energy/joy when using the Kinect sensor.

Conclusions:

• The multi-sensor biofeedback system effectively enhanced human-computer interaction within the gaming context.
• All employed sensors demonstrated a measurable impact on the overall results, underscoring their importance.
• Future research should explore refining physiological data acquisition, particularly separating breathing and cardiac signals for more granular analysis.