Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

The Scientific Method

The Scientific Method

The scientific method is a detailed, empirical problem-solving process used by biologists and other scientists. This iterative approach involves formulating a question based on observation, developing a testable potential explanation for the observation (called a hypothesis), making and testing predictions based on the hypothesis, and using the findings to create new hypotheses and predictions.
Generally, predictions are tested using carefully-designed experiments. Based on the outcome of these...

The Scientific Method

The Scientific Method

Research is what makes the difference between facts and opinions. Facts are observable realities, and opinions are personal judgments, conclusions, or attitudes that may or may not be accurate. In the scientific community, facts can be established only using evidence collected through empirical research.

Scientific Nature of Social Psychology

Scientific Nature of Social Psychology

Social psychology is a scientific discipline dedicated to understanding how individuals think, feel, and behave in social contexts. Unlike common sense, which relies on anecdotal experiences and intuition, social psychology employs systematic research and empirical methods to ensure objectivity and reliability. This distinction is fundamental in distinguishing scientifically supported findings from mere speculation.Four fundamental scientific values guide a structured approach to research in...

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches

Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...

Random Sampling Method

Random Sampling Method

Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. Data are the result of sampling from a population. The sampling method ensures that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest. Among the various sampling methods used by...

Systematic Error: Methodological and Sampling Errors

Systematic Error: Methodological and Sampling Errors

In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

SPIRIT-CONSORT-ELM: Element-Level Assessment of Randomized Controlled Trial Reporting Using Large Language Models.

medRxiv : the preprint server for health sciences·2026

Same author

The Pharmacological Window Hypothesis: How Emerging Obesity Medications May Realize Decades of Plant-Forward Dietary Recommendations.

Advances in nutrition (Bethesda, Md.)·2026

Same author

Reply to Atkinson et al.

Journal of applied physiology (Bethesda, Md. : 1985)·2026

Same author

Bone Mineral Density, Bone Remodeling Biomarkers, and Hemostatic Correlates in Hemophilia and von Willebrand Disease.

Blood advances·2026

Same author

Statistical Methods in Aging Research: Improving Current Practices and Embracing Emerging Approaches.

Annual review of statistics and its application·2026

Same author

Examining widely held propositions on human dietary protein needs and benefits: a critical review of the science that shapes both the data and our understanding of an essential macronutrient.

Critical reviews in food science and nutrition·2026

Same journal

Characterization of genomic diversity in bacteriophages infecting Rhodococcus.

PloS one·2026

Same journal

Effectiveness of the Responding to Experienced and Anticipated Discrimination (READ) training on reducing stigma for medical students in Tunisia.

PloS one·2026

Same journal

Cell-cell junction gene signatures as subtype-specific prognostic biomarkers in breast cancer.

PloS one·2026

Same journal

GC-MS based tentative identification of γ-sitosterol from Brassica nigra seeds and evaluation of its anticancer potential: An integrated in vitro and in silico study.

PloS one·2026

Same journal

Ad-based social media interventions increase belief accuracy and generate pro-social opinions among non-news readers.

PloS one·2026

Same journal

Negotiating knowledge: The role of network hedging in the production of high-impact science.

PloS one·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Apr 27, 2026

Comparing Bibliometric Analysis Using PubMed, Scopus, and Web of Science Databases

Comparing Bibliometric Analysis Using PubMed, Scopus, and Web of Science Databases

Published on: October 24, 2019

Using crowdsourcing to evaluate published scientific literature: methods and example.

Andrew W Brown¹, David B Allison¹

¹Office of Energetics, Nutrition Obesity Research Center, School of Public Health, University of Alabama at Birmingham, Birmingham, Alabama, United States of America.

|July 3, 2014

Summary

This summary is machine-generated.

Crowdsourcing literature evaluation using online workers significantly reduces time and cost. This method found no link between popular opinion in nutrition-obesity studies and scientific attention received.

More Related Videos

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

Global and Current Research Trends of Single-Cell Sequencing in Cancer: A Bibliometric and Visualization Study

Global and Current Research Trends of Single-Cell Sequencing in Cancer: A Bibliometric and Visualization Study

Published on: April 18, 2025

Related Experiment Videos

Last Updated: Apr 27, 2026

Comparing Bibliometric Analysis Using PubMed, Scopus, and Web of Science Databases

Comparing Bibliometric Analysis Using PubMed, Scopus, and Web of Science Databases

Published on: October 24, 2019

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

Global and Current Research Trends of Single-Cell Sequencing in Cancer: A Bibliometric and Visualization Study

Global and Current Research Trends of Single-Cell Sequencing in Cancer: A Bibliometric and Visualization Study

Published on: April 18, 2025

Area of Science:

Nutrition Science
Obesity Research
Bibliometrics

Background:

Systematic literature evaluation is time-intensive, requiring extensive coding and rating.
Online crowdsourcing offers a scalable solution to distribute these complex tasks.

Purpose of the Study:

To assess the feasibility and cost-effectiveness of using crowdsourcing for scientific literature evaluation.
To investigate whether nutrition-obesity studies aligning with popular opinion gain more scientific attention.

Main Methods:

Utilized Amazon Mechanical Turk for microworkers to perform abstract screening, food term synthesis, and obesogenicity rating.
Microworkers extracted citation counts via Google Scholar for bibliometric analysis.
Established qualification tests and consensus mechanisms for quality control.

Main Results:

Microworkers successfully screened abstracts (96% consensus) and synthesized food terms (84% agreement).
Perceived obesogenicity ratings by microworkers aligned with expert expectations.
Analysis revealed no significant association between study conclusions' concordance with popular opinion and scientific attention (Scimago Journal Rank, citation counts).

Conclusions:

Crowdsourcing provides a reliable, cost-effective, and rapid method for evaluating scientific literature.
Popular opinion does not appear to influence the scientific attention received by nutrition-obesity studies.