Curricular policy as a collective effects problem: A distributional approach

Area of Science:

• Education Policy
• Educational Measurement
• Quantitative Psychology

Background:

• Current US educational policies aim to increase student achievement and equity through curriculum intensification.
• California's mandate for all 8th graders to enroll in Algebra is an example of such a policy.
• Understanding population-level effects versus individual-level effects is crucial for policy evaluation.

Purpose of the Study:

• To investigate the impact of California's 8th-grade Algebra enrollment policy on the distribution of student achievement.
• To analyze collective effects where population-level outcomes differ from individual-level impacts.
• To examine how curricular intensification affects different segments of the student population.

Main Methods:

• Utilized inverse propensity score weighting to analyze distributional changes in student achievement.
• Compared achievement distributions before and after the policy implementation.
• Differentiated between "treated" (enrolled in Algebra) and "untreated" (not enrolled) individuals within the population.

Main Results:

• The policy did not lead to improvements in test scores at the lower end of the achievement distribution.
• Scores at the top of the achievement distribution were observed to decrease following the policy.
• Inverse propensity score weighting effectively revealed significant distributional shifts.

Conclusions:

• California's Algebra for all 8th graders policy did not benefit lower-achieving students and negatively impacted higher-achieving students.
• Curricular intensification policies can have unintended "collective effects" on achievement distributions.
• Inverse propensity score weighting is a valuable method for assessing policy impacts on broader population distributions.