Related Experiment Video
Updated: Mar 14, 2026

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
Informing Estimates of Program Effects for Studies of Mathematics Professional Development Using Teacher Content
Geoffrey Phelps1, Benjamin Kelcey2, Nathan Jones3
1Educational Testing Service, Princeton, NJ, USA gphelps@ets.org.
Abstract:
Mathematics professional development is widely offered, typically with the goal of improving teachers' content knowledge, the quality of teaching, and ultimately students' achievement. Recently, new assessments focused on mathematical knowledge for teaching (MKT) have been developed to assist in the evaluation and improvement of mathematics professional development. This study presents empirical estimates of average program change in MKT and its variation with the goal of supporting the design of experimental trials that are adequately powered to detect a specified program effect. The study drew on a large database representing five different assessments of MKT and collectively 326 professional development programs and 9,365 teachers. Results from cross-classified hierarchical growth models found that standardized average change estimates across the five assessments ranged from a low of 0.16 standard deviations (SDs) to a high of 0.26 SDs. Power analyses using the estimated pre- and posttest change estimates indicated that hundreds of teachers are needed to detect changes in knowledge at the lower end of the distribution. Even studies powered to detect effects at the higher end of the distribution will require substantial resources to conduct rigorous experimental trials. Empirical benchmarks that describe average program change and its variation provide a useful preliminary resource for interpreting the relative magnitude of effect sizes associated with professional development programs and for designing adequately powered trials.
More Related Videos
Related Concept Videos
Comparing Experimental Results: Student's t-Test
What are Estimates?
The estimate for the mean of a sample is denoted by ͞x, whereas the mean of the population is designated as μ. Further, parameters such...
Long-term Potentiation
Long-term Potentiation
Hebbian LTP
LTP can occur when...
Buffer Effectiveness
The buffer capacity is the amount of acid or base that can be added to a given volume...
Estimation of the Physical Quantities

