Research on the Impact of Generative Artificial Intelligence Usage Behavior on the Learning Outcomes of Higher...

Generative Artificial Intelligence (GenAI) has been increasingly integrated into vocational education teaching and students' learning. Thus, instructing higher vocational students to use GenAI effectively and improving their self-reported perceptions of learning outcomes are critical. Based on the talent development requirements of vocational education, this study developed and validated the GenAI Usage Behavior Scale and the Higher Vocational Students' Perceived Learning Outcomes Scale. Subsequently, an empirical analysis was conducted using data from 1110 valid questionnaires collected from Chinese higher vocational students. According to the descriptive statistical analysis, the overall usage behavior of higher vocational students was generally at a medium-high level. They performed relatively well in terms of usage habits, moderately in usage contexts, and showed a relatively low frequency of use. The overall evaluation for higher vocational students' perceived learning outcomes was rated as above average with competency development ranking highest, followed by skill application and knowledge mastery. As for group differences, the results of the independent samples t-test and one-way analysis of variance (ANOVA) revealed no overall significant differences in perceived learning outcomes across genders. Significant differences were only observed in the skill application dimension across grades, while all dimensions of perceived learning outcomes showed statistically significant disparities across major categories. From the perspective of the correlational mechanism, correlation and regression analyses revealed a statistically significant negative correlation between GenAI usage frequency and perceived learning outcomes. In contrast, usage habits and contexts exhibited statistically significant positive correlations. Among these factors, usage habits demonstrated stronger explanatory power. Accordingly, colleges, teachers, and students each must have clear priorities and work collaboratively to enhance students' ability to use GenAI effectively, thereby leveraging its supportive role in improving perceived learning outcomes for higher vocational students more efficiently.