The effect of a web-push survey on physician survey responses rates: a randomized experiment

Achieving a high response rate for physicians has been challenging, and with response rates declining in recent years, innovative methods are needed to increase rates. An emerging concept in survey methodology has been web-push survey delivery. With this delivery method, contact is made by mail to request a response by web. This study explored the feasibility of a web-push survey on a national sample of physicians.

A total of 1,000 physicians across six specialties were randomly assigned to a mail-only or web-push survey delivery. Each mode consisted of four contacts including an initial mailing, reminder postcard, and two additional follow-ups. Response rates were calculated using the American Association for Public Opinion Research's response rate 3 calculation. Data collection occurred between Febuary and April 2018; data were analyzed March 2019.

Overall reponse rates for the mail-only versus web-push survey delivery were comparable (51.2% vs. 52.8%). Higher response rates across all demographics were seen in the web-push delivery, with the exception of pulmonary/critical care and physicians over the age of 65. The web-push survey yielded a greater response after the first mailing, requiring fewer follow-up contacts resulting in a more cost-effective delivery.

A web-push mail survey is effective in achieving a comparable response rate to traditional mail-only delivery for physicians. The web-push survey was more efficient in terms of cost and in receiving responses in a more timely manner. Future research should explore the efficiency of a web-push survey delivery across various health care provider populations.