Evaluating the impact of private land conservation with synthetic control design

Programs to protect biodiversity on private land are increasingly being used worldwide. To understand the efficacy of such programs, it is important to determine their impact: the difference between the program's outcome and what would have happened without the program. Typically, these programs are evaluated by estimating the average program-level impact, which readily allows comparisons between programs or regions, but masks important heterogeneity in impact across the individual conservation interventions. We used synthetic control design, statistical matching, and time-series data to estimate the impact of individual protected areas over time and combined individual-level impacts to estimate program-level impact with a meta-analytic approach. We applied the method to private protected areas governed by conservation covenants (legally binding on-title agreements to protect biodiversity) in the Goldfields region of Victoria, Australia using woody vegetation cover as our outcome variable. We compared our results with traditional approaches to estimating program-level impact based on a subset of covenants that were the same age. Our results showed an overall program-level impact of a 0.3-0.8% increase in woody vegetation cover per year. However, there was significant heterogeneity in the temporal pattern of impact for individual covenants, ranging from -4 to +7% change in woody vegetation cover per year. Results of our approach were consistent with results based on traditional approaches to estimating program-level impact. Our study provides a transparent and robust workflow to estimate individual and program-level impacts of private protected areas.