Creating a Probability Survey Panel for Population Health Research: The Experience of the NYC Health Panel

Survey panels can allow for more efficient data collection than traditional surveillance surveys both in terms of cost and operations. Seeking an alternative way to collect timely, high-quality data, the New York City (NYC) Health Department created a probability-based survey panel.

The NYC Health Panel was launched in April 2020. Over its first 2 years, the Panel recruited adults (ages 18+) in NYC from address-based lists and probabilistic surveys.

Once enrolled, panelists were invited to participate in up to 10 surveys per year. Surveys could be completed online (self-administered) or via paper or phone (computer assisted telephone interview) and were offered in 5 languages. Panelists were reconsented at the start of each survey and offered an incentive at completion. Panelists were compared to the 2017-2021 5-year American Community Survey data of NYC adults to assess representativeness. Weighting was used to adjust for these differences.

The NYC Health Department was able to successfully launch the Panel and collect survey data. In its first 2 years, the Panel enrolled approximately 13 000 adult NYC residents and conducted 18 surveys. Most surveys were completed online and in English. The Panel's size and probabilistic design allow for the creation of individual survey samples that are representative of adult NYC residents.

The NYC Health Panel is an invaluable resource in response to the COVID-19 pandemic, in assessing racial inequities, and in measuring the secondary pandemics of food insecurity, delayed primary care, and adverse mental health. It serves as a unique example of how health departments that have the necessary in-house staff resources can collect timely data.