Related Experiment Video
Updated: May 9, 2026
A Novel Method for Involving Women of Color at High Risk for Preterm Birth in Research Priority Setting
Published on: January 12, 2018
Crowdsourcing--harnessing the masses to advance health and medicine, a systematic review
Benjamin L Ranard1, Yoonhee P Ha, Zachary F Meisel
1Perelman School of Medicine, University of Pennsylvania, 423 Guardian Drive, Blockley Hall, Philadelphia, PA, 19104, USA.
Objective:
Crowdsourcing research allows investigators to engage thousands of people to provide either data or data analysis. However, prior work has not documented the use of crowdsourcing in health and medical research. We sought to systematically review the literature to describe the scope of crowdsourcing in health research and to create a taxonomy to characterize past uses of this methodology for health and medical research.
Data Sources:
PubMed, Embase, and CINAHL through March 2013.
Study Eligibility Criteria:
Primary peer-reviewed literature that used crowdsourcing for health research.
Study Appraisal And Synthesis Methods:
Two authors independently screened studies and abstracted data, including demographics of the crowd engaged and approaches to crowdsourcing.
Results:
Twenty-one health-related studies utilizing crowdsourcing met eligibility criteria. Four distinct types of crowdsourcing tasks were identified: problem solving, data processing, surveillance/monitoring, and surveying. These studies collectively engaged a crowd of >136,395 people, yet few studies reported demographics of the crowd. Only one (5 %) reported age, sex, and race statistics, and seven (33 %) reported at least one of these descriptors. Most reports included data on crowdsourcing logistics such as the length of crowdsourcing (n = 18, 86 %) and time to complete crowdsourcing task (n = 15, 71 %). All articles (n = 21, 100 %) reported employing some method for validating or improving the quality of data reported from the crowd.
Limitations:
Gray literature not searched and only a sample of online survey articles included.
Conclusions And Implications Of Key Findings:
Utilizing crowdsourcing can improve the quality, cost, and speed of a research project while engaging large segments of the public and creating novel science. Standardized guidelines are needed on crowdsourcing metrics that should be collected and reported to provide clarity and comparability in methods.
Related Concept Videos
01:26Methods Of Healthcare Delivery System
Managed Care System:
The managed care system is designed to control the cost while maintaining the quality of care. The patient's care from admission to discharge is planned by the primary care provider or the case manager, also known as the gatekeeper. In a managed care system, the number of care providers is limited...
01:29Issues And Trends In Healthcare Delivery System
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
01:21Health Literacy
01:11Purpose of Health Records I
Here's a breakdown of how health records serve these purposes:
01:30Primary Healthcare Services
In 1978, international leaders convened in Alma-Ata, Kazakhstan, for what would be a pivotal event in global health. The Alma-Ata Declaration was the first to call...
01:23Investigation of Disease Outbreaks