Reliability of indicators of decline in abundance

Although there are many indicators of endangerment (i.e., whether populations or species meet criteria that justify conservation action), their reliability has rarely been tested. Such indicators may fail to identify that a population or species meets criteria for conservation action (false negative) or may incorrectly show that such criteria have been met (false positive). To quantify the rate of both types of error for 20 commonly used indicators of declining abundance (threat indicators), we used receiver operating characteristic curves derived from historical (1938-2007) data for 18 sockeye salmon (Oncorhynchus nerka) populations in the Fraser River, British Columbia, Canada. We retrospectively determined each population's yearly status (reflected by change in abundance over time) on the basis of each indicator. We then compared that population's status in a given year with the status in subsequent years (determined by the magnitude of decline in abundance across those years). For each sockeye population, we calculated how often each indicator of past status matched subsequent status. No single threat indicator provided error-free estimates of status, but indicators that reflected the extent (i.e., magnitude) of past decline in abundance (through comparison of current abundance with some historical baseline abundance) tended to better reflect status in subsequent years than the rate of decline over the previous 3 generations (a widely used indicator). We recommend that when possible, the reliability of various threat indicators be evaluated with empirical analyses before such indicators are used to determine the need for conservation action. These indicators should include estimates from the entire data set to take into account a historical baseline.