Development and validation of the cognitive flexibility scale for AI-supported English language learning (CFS-AISEL)

The widespread use of AI technology in English language learning and instruction presents numerous challenges for EFL learners, which require higher levels of cognitive flexibility to address. However, existing cognitive flexibility questionnaires are insufficient to comprehensively reflect changes in cognitive flexibility within AI-supported learning environments. Therefore, this study developed the Cognitive Flexibility Scale for AI-Supported English Language Learning (CFS-AISEL) based on a systematic literature review and rigorous questionnaire development methodology. A random sampling method was employed to collect 1,093 responses for exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). Of these, 479 were used for EFA and 614 for CFA. A Delphi study was applied for scale content validation. After confirming reliability and validity, the final scale comprised 26 items across five dimensions (cognitive flexibility, tolerance for ambiguity, self-efficacy in AI interactions, emotional flexibility, and ethical flexibility). This study provides practical implications for educators to identify how EFL learners balance the use of AI tools and independent thinking, promoting the deep integration of educational assessment and AI technology.