Classroom Behavior Recognition via Transformer and Attention Mechanism: Application in Teaching Quality Evaluation...

This study introduces a Transformer-based artificial intelligence system designed for classroom behavior recognition, aimed at enhancing teaching quality assessment and mental health monitoring in medical and nursing education. The model utilizes multimodal data, specifically video, audio, and skeletal movement, to evaluate key indicators of student engagement, such as attention span, interaction frequency, and emotional fluctuations. A novel multimodal fusion strategy, combined with spatiotemporal attention mechanisms, enables the system to capture complex classroom behaviors with improved precision and robustness. Experimental results on the EduSense and SBU Kinect datasets demonstrate that the proposed method significantly outperforms traditional models in both accuracy and false alarm rate. Additionally, ablation studies confirm the contribution of spatial and temporal attention modules to the system's recognition capability. The framework supports real-time feedback and visual behavior mapping, offering practical value in experiential learning environments. This approach provides a scalable and adaptive solution for classroom behavior monitoring and supports early intervention strategies in medical education.