[PISA and the assessment triangle]

Area of Science:

• Educational Measurement
• Psychometrics
• International Comparative Studies

Background:

• The Program for International Student Assessment (PISA) is a high-profile international comparative study assessing student performance.
• PISA has conducted four editions since 2000, providing valuable data on educational systems globally.
• The assessment triangle framework, encompassing cognition, observation, and interpretation, is crucial for understanding assessment validity.

Purpose of the Study:

• To examine the validity of the Program for International Student Assessment (PISA) proficiency estimates.
• To analyze PISA's alignment with the three core elements of the assessment triangle: cognition, observation, and interpretation.
• To identify areas for improvement in PISA's methodology and data analysis.

Main Methods:

• Utilized the assessment triangle framework to evaluate PISA's methodology.
• Analyzed the cognitive, observational, and interpretative aspects of PISA assessments.
• Examined the psychometric properties of PISA proficiency estimates.

Main Results:

• PISA demonstrates psychometrically sound proficiency estimates, meeting high standards.
• The study confirms PISA's robust framework in cognition, observation, and interpretation.
• Identified opportunities for enhancing PISA through advanced methodologies.

Conclusions:

• PISA proficiency estimates are valid and reliable, reflecting high assessment standards.
• Cognitive diagnostic models offer potential improvements for PISA's test design and data analysis.
• Further integration of cognitive diagnostic models could strengthen future PISA assessments.