Validity of large-scale reading tests: A phenotypic and behaviour-genetic analysis

Area of Science:

• Educational Psychology
• Behavioral Genetics
• Literacy Assessment

Background:

• Nationwide large-scale tests in literacy and numeracy are administered annually to Australian students in grades 3, 5, 7, and 9.
• The validity of these large-scale assessments is frequently questioned by researchers and educators.

Purpose of the Study:

• To compare the performance of Grade 3 twins on nationwide large-scale reading tests with their performance on individually administered literacy tests.
• To investigate the genetic and environmental influences on performance in both types of reading assessments using a genetically sensitive design.

Main Methods:

• A genetically sensitive design comparing twins in Grade 3.
• Assessment of reading comprehension, word reading, and vocabulary using individually administered tests.
• Comparison of performance on these individual tests with scores from nationwide large-scale reading tests.

Main Results:

• Literacy skills measured by individual tests (comprehension, word reading, vocabulary) substantially explained variance in large-scale school reading tests.
• Performance on both large-scale and individually administered reading tests demonstrated moderate to substantial heritability.
• The same genetic factors were found to influence performance across both types of reading assessments.

Conclusions:

• Large-scale school reading tests validly assess literacy skills, at least partially.
• These findings support the use of large-scale tests as meaningful indicators of literacy, aligning with individually administered "gold-standard" measures.
• Genetic influences play a significant role in individual differences in reading performance across different assessment formats.