Measuring incremental changes in word knowledge: experimental validation and implications for learning and assessment

Area of Science:

• Cognitive Psychology
• Educational Technology
• Applied Linguistics

Background:

• Traditional vocabulary assessment methods often lack nuanced measurement of word meaning acquisition.
• Existing techniques may not fully capture the dynamic nature of vocabulary development.
• There is a need for precise tools to evaluate how learners acquire and refine word knowledge.

Purpose of the Study:

• To evaluate a novel algorithm for scoring the accuracy of word definitions on a continuous scale.
• To assess the algorithm's sensitivity to experimental manipulations affecting vocabulary learning.
• To demonstrate the utility of this technique for measuring vocabulary development in adult learners.

Main Methods:

• Adult learners were exposed to target words in varied sentence contexts (informative and misleading).
• Participants generated definitions for target words after each contextual exposure.
• A continuous scale algorithm (Collins-Thompson & Callan, 2007) scored definition accuracy across trials.

Main Results:

• Definition accuracy showed incremental improvements over successive learning trials.
• Learning curves were influenced by the proportion of misleading contexts presented.
• The method captured effects of spaced versus massed practice and individual learner differences.

Conclusions:

• The developed definition-scoring algorithm offers a sensitive and precise measure of vocabulary development.
• This technique can effectively track the trajectory of word learning under different experimental conditions.
• Findings have implications for the measurement of meaning, vocabulary assessment, and the design of instructional strategies.