Related Experiment Video
Updated: Oct 28, 2026

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
Revisiting the interaction between word frequency and predictability in natural reading: Large-scale evidence based
Xiaoxuan Li1, Bernhard Angele2, Baoguo Chen3
1Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education, Faculty of Psychology, Beijing Normal University, Beijing, 100875, China.
Abstract:
Word predictability-that is, the predictability of a word in a sentence based on the preceding context-reliably influences processing of that word. Prior research has consistently reported additive effects of word predictability and frequency, suggesting that contextual influence may operate independently of bottom-up lexical access. We leveraged an ensemble of large language models (LLMs) to derive predictability estimates across six natural reading eye-tracking datasets in English and Chinese. Across both languages, we found that the frequency effect was attenuated with increasing word probability yet remained significant under the high predictability conditions. These findings support the interactive processing account and Chinese Reading Model, which assume that top-down preactivation reduces the demand for bottom-up lexical access, but does not fully replace it. The findings are inconsistent with the independent relationship implemented in some other computational models of eye-movement control. However, such models could readily be extended to accommodate this interaction.
Related Concept Videos
Determination of Expected Frequency
Language and Cognition
Language Development
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
Expected Frequencies in Goodness-of-Fit Tests
Language Development I: Behaviorist Perspective
Components of Language

