Study Design and Lessons Learned From Using Google Takeout Donations for Suicide Prevention Research: Prospective Cohort Study
Related Experiment Videos
Katherine Anne Comtois1, Payton Smythe1, Amanda Kerbrat1
1Department of Psychiatry and Behavioral Sciences, School of Medicine, University of Washington, 325 9th Avenue, Box 359911, Seattle, WA, 98104, United States, 1 206-744-1752, 1 206-744-3231.
Background:
Social media and search engine tech companies, such as Google, use the wealth of data at their disposal to create algorithms to predict suicide risk and provide interventions based on company policies and outputs from these algorithms. Neither the details of these algorithms nor their accuracy in risk prediction are shared with the public; thus, research is needed to verify whether algorithms applied to search engine data can accurately predict suicide risk in a platform user. This paper provides new information about the methodological challenges in studying the value of search engine data for suicide prediction.
Objective:
This paper describes the study methods and experiences regarding recruiting and retaining participants in a year-long, fully remote prospective cohort study of suicide prediction in people with variable risk of suicide, using Google Search data.
Methods:
We aimed to recruit 1000 United States-dwelling and English-speaking adults with current suicidal ideation who fell into 1 of 3 categories: participants with a suicide attempt in the past year, participants with a lifetime suicide attempt but not one in the past year, and participants with no suicide attempt in their lifetime. Recruitment sources included online advertisements hosted on various websites, to differing levels of success. Participants completed online surveys and an interview via Zoom to enroll in the study and then were sent follow-up surveys every 2 weeks for the year following initial enrollment. Recruitment was conducted from March 2022 to January 2024, with follow-up data being collected through February 2025.
Results:
Of 15,120 records created in our Research Electronic Data Capture (REDCap) survey system, 485 participants were eligible to participate in the prospective year of the study. Recruitment challenges were mainly due to participant dropout across all enrollment time points, with 63.7% (9636/15,120) of the prescreening sample dropping out or refusing. Other issues included the difficulty of downloading Google Search data (446/3277, 13.6%) and not having enough data to meet the inclusion criteria among those who were able to successfully donate (252/3277, 7.7%). Lastly, the study encountered fraudulent behavior, with 489 of 15,120 records (3.2%) being identified as fraudulent over the course of the study.
Conclusions:
Despite past success with remote clinical research methods, we found that recruitment can be significantly hampered by fraudulent participation, despite the use of state-of-the-art methods to mitigate this problem. Further, the ability to acquire useful Google Search data is extremely challenging and necessitates the use of technical assistance and continuous monitoring of Google Takeout data structure to ensure accurate and complete data donations. The solutions we provide for this type of research should be helpful for future endeavors. However, research is still limited by the barriers to obtaining data from technology companies. These limitations have significant implications in detecting the accuracy and utility of suicide prediction from search engine data.
Related Concept Videos
Study Designs in Epidemiology
Observational studies are those where the researcher does not intervene but rather observes natural variations. They include cross-sectional, cohort, and case-control studies.
Longitudinal Research
Observational Studies
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One example of...
Surveys
The Scientific Method
Study Design in Statistics
Does aspirin reduce the risk of heart attacks? Is one brand of fertilizer more effective at growing roses than another? Is fatigue as dangerous to a driver as the influence of alcohol? Questions like these are answered using randomized experiments with proper...