STEAP: Camera-Based Longitudinal Classroom Behavior Sensing and Static-Temporal Data Fusion for Academic Performance...

Predicting academic performance in face-to-face computing and software engineering courses is hindered by the limited availability of fine-grained process data. This study proposes STEAP, a camera-based static-temporal fusion framework that integrates longitudinal classroom behavior sensing with conventional educational records. Classroom videos from 375 undergraduates enrolled in four computing-related courses were collected over nine teaching weeks. Camera-derived observable behaviors were organized into student-level weekly sequences and transformed into outcome-independent longitudinal representations. Multiple machine-learning classifiers were subsequently applied to predict students' academic performance. Checkpoint-specific predictions were conducted at Weeks 3, 6, and 9, with each prediction using only the classroom behavioral information available up to the corresponding time point. Using the complete nine-week Temporal representation together with the pre-course Background variables, XGBoost achieved the strongest classification performance among the evaluated models, with an Accuracy of 0.867, a Macro F1 of 0.862, and an At-risk Recall of 0.924. The checkpoint analyses further indicated that classroom behavioral information collected during the early course stage already provided useful predictive information without incorporating behavioral observations from subsequent weeks. After further integrating pre-course background variables and regular assessment information, the final fusion model achieved an Accuracy of 0.896 and a Macro F1 of 0.895. Overall, longitudinal camera-derived classroom behavior provides complementary predictive information beyond conventional educational information and supports the feasibility of earlier academic-risk identification at different course checkpoints.