A Screen-Based Multimodal Virtual Classroom Interface for Understanding Behavioral Sensory Responses in Autistic...

Area of Science:

• Neuroscience
• Human-Computer Interaction
• Developmental Psychology

Background:

• Autism affects 1 in 100 children globally, with 90% experiencing sensory processing difficulties.
• Virtual Reality (VR) is a tool for studying sensory experiences, but head-mounted displays can be uncomfortable for autistic children.
• Screen-based VR presents an alternative, yet research on multimodal sensory simulation and its impact on behavior is limited.

Purpose of the Study:

• To design and evaluate a novel screen-based Multimodal Virtual Classroom Interface (MVCI) for delivering controlled sensory stimuli.
• To investigate the behavioral responses of autistic and typically developing adolescents using the MVCI system.
• To explore the correlation between behavioral patterns, sensory profiles, and ADHD symptom severity.

Main Methods:

• Development of a screen-based MVCI system simulating a classroom with visual, auditory, and tactile stimuli.
• Pilot study involving 9 autistic and 17 typically developing adolescents, assessing system acceptance.
• Quantitative behavioral analysis of eye gaze, fine motor movements, and eye-hand alignment.
• Application of a Fixation Sequence Modeling (FSM) framework for performance prediction.

Main Results:

• The MVCI system achieved 100% acceptance in all participants.
• Significant differences in eye gaze, fine motor movements, and eye-hand alignment were observed between autistic and typically developing groups (p < 0.05).
• Behavioral patterns strongly correlated with sensory profiles and ADHD symptom severity (p < 0.05, rs > 0.7).
• The FSM framework accurately predicted near-future performance (97-98% proximity).

Conclusions:

• Screen-based VR is a viable and accepted tool for studying sensory processing in autistic adolescents.
• MVCI can differentiate behavioral responses between autistic and typically developing individuals.
• Granular behavioral analysis using FSM shows promise for understanding and predicting performance in neurodevelopmental contexts.