Related Experiment Video
Updated: Jan 29, 2026

Automated, High-resolution Mobile Collection System for the Nitrogen Isotopic Analysis of NOx
Published on: December 20, 2016
A scoping review provided a framework for new ways of doing research through mobilizing collective intelligence
Van Thu Nguyen1, Mehdi Benchoufi2, Bridget Young3
1INSERM, U1153 Epidemiology and Biostatistics Sorbonne Paris Cité Research Center (CRESS), Methods of Therapeutic Evaluation of Chronic Diseases Team (METHODS), Paris, F-75014 France; Paris Descartes University, Sorbonne Paris Cité, France; Department of Health Services Research, Institute of Population Health Sciences, University of Liverpool, Liverpool L69 3GB, UK.
Objectives:
New forms of research involving collective intelligence (CI) of diverse individuals mobilized through crowdsourcing is successfully emerging in various fields. This scoping review aimed to describe these methods across different fields and propose a framework for implementation.
Study Design And Setting:
We searched seven electronic databases for reports describing projects that had mobilized CI with crowdsourcing. We used content analysis to develop themes and categories of the methods.
Results:
We identified 145 reports. CI was mobilized to generate ideas, conduct evaluations, solve problems, and create intellectual outputs. Most projects (n = 110, 76%) were open to the public without restrictions on participants' expertise. Participants contributed to projects by independent contribution (i.e., no interaction with other participants) (n = 50, 34%), collaboration (n = 41, 28%), competitions (n = 33, 23%), and playing games (n = 16, 11%). In total, 61% of articles (n = 89) reported methods to evaluate participants' contribution and decision-making process: 43% used an independent panel of experts and 18% involved end users. We identified challenges in implementation and sustainability of CI and proposed solutions.
Conclusion:
New research methods based on CI through crowdsourcing could transform clinical research. This framework facilitates the implementation of these methods.
Related Concept Videos
The Scope of Physics
Review and Preview
Percentiles are a type of fractile that partition data into...
Review and Preview
Intelligence
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Multiple Intelligences Theory

