Bringing Assessment-to-Instruction (A2i) Technology to Scale: Exploring the Process from Development to...

Area of Science:

• Educational Technology
• Literacy Intervention
• Applied Linguistics

Background:

• Implementing effective, research-based literacy interventions in diverse classrooms presents significant challenges.
• The Assessment-to-Instruction (A2i) technology, previously proven effective in research settings, was not scalable for widespread use.
• Scaling A2i for linguistically diverse student populations required significant redesign and adaptation.

Purpose of the Study:

• To explore the feasibility of scaling the Assessment-to-Instruction (A2i) technology for classroom use.
• To evaluate the impact of a scalable A2i intervention on the literacy outcomes of diverse learners in kindergarten through third grade.
• To adapt A2i algorithms and user interfaces to better support English Learners (ELs).

Main Methods:

• A two-phase study combining qualitative exploration of scalability (Phase 1) and a quasi-experiment on literacy outcomes (Phase 2).
• Integration of vocabulary, word decoding, and reading comprehension assessments into the A2i platform.
• Revision of A2i algorithms for ELs, enhancement of user interfaces, and technical improvements for stability and bandwidth.
• Quasi-experimental design to assess literacy outcomes for students whose teachers utilized the A2i technology.

Main Results:

• Mixed findings were observed, with several non-significant results across literacy measures.
• A marginally significant intent-to-treat effect on word reading was found for kindergarten and first-grade students (both monolingual and ELs).
• A significant interaction effect indicated that ELs and students with lower reading skills in second and third grade benefited most.

Conclusions:

• The redesigned Assessment-to-Instruction (A2i) technology demonstrates potential for scalable implementation in diverse educational settings.
• A2i shows promise for enhancing code-focused literacy skills, particularly for English Learners and students requiring additional reading support.
• Further research and refinement are warranted to optimize A2i's effectiveness across all student subgroups and literacy components.