Related Experiment Video
Updated: Jul 4, 2025

'Boden Food Plate': Novel Interactive Web-based Method for the Assessment of Dietary Intake
Published on: September 18, 2018
Health estimate differences between six independent web surveys: different web surveys, different results?
Rainer Schnell1, Jonas Klingwort2
1University of Duisburg-Essen, Duisburg, Germany. rainer.schnell@uni-due.de.
None:
Most general population web surveys are based on online panels maintained by commercial survey agencies. Many of these panels are based on non-probability samples. However, survey agencies differ in their panel selection and management strategies. Little is known if these different strategies cause differences in survey estimates. This paper presents the results of a systematic study designed to analyze the differences in web survey results between agencies. Six different survey agencies were commissioned with the same web survey using an identical standardized questionnaire covering factual health items. Five surveys were fielded at the same time. A calibration approach was used to control the effect of demographics on the outcome. Overall, the results show differences between probability and non-probability surveys in health estimates, which were reduced but not eliminated by weighting. Furthermore, the differences between non-probability surveys before and after weighting are larger than expected between random samples from the same population.
Related Concept Videos
One-Way ANOVA: Equal Sample Sizes
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
What are Estimates?
The estimate for the mean of a sample is denoted by ͞x, whereas the mean of the population is designated as μ. Further, parameters such...
Surveys
One-Way ANOVA: Unequal Sample Sizes
Comparing the Survival Analysis of Two or More Groups
Regression Toward the Mean

