Related Experiment Video
Updated: Jan 7, 2026

Integrating Computerized Linguistic and Social Network Analyses to Capture Addiction Recovery Capital in an Online Community
Published on: May 31, 2019
Can social media reliably estimate unemployment?
Do Lee1, Manuel Tonneau2,3,4, Boris Sobol5
1Department of Economics, New York University, New York, NY 10012, USA.
Abstract:
Digital trace data hold tremendous potential for measuring policy-relevant outcomes in real-time, yet its reliability is often questioned. Here, we propose a principled yet simple approach: capturing individual disclosures of unemployment using a fine-tuned AI model and post-stratification adjustment using inferred user demographics. We show that our methodology consistently outperforms the industry's forecasting average and can improve the predictions of US unemployment insurance claims, up to 2 weeks in advance, at the national, state, and city levels at both turbulent and stable times. The results demonstrate the potential of combining AI models with statistical modeling to complement traditional survey methodology, and contribute to better-informed policymaking, especially at turbulent times.
Related Concept Videos
Estimating Population Mean with Unknown Standard Deviation
William S. Gosset (1876–1937) of the...
Surveys
Residuals and Least-Squares Property
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
Social Exchange Theory
Social Exchange Theory
Confidence Interval for Estimating Population Mean
A confidence interval for the mean is a range of values that provides an estimate of the population mean. As the...

