Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Prediction Intervals01:03

Prediction Intervals

2.9K
The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y. 
2.9K
Accuracy and Precision01:52

Accuracy and Precision

13.6K
Scientists typically make repeated measurements of a quantity to ensure the quality of their findings and to evaluate both the precision and the accuracy of their results. Measurements are said to be precise if they yield very similar results when repeated in the same manner. A measurement is considered accurate if it yields a result that is very close to the true or the accepted value. Precise values agree with each other; accurate values agree with a true value.  Highly accurate...
13.6K
Estimating Population Mean with Unknown Standard Deviation01:22

Estimating Population Mean with Unknown Standard Deviation

8.6K
In practice, we rarely know the population standard deviation. In the past, when the sample size was large, this did not present a problem to statisticians. They used the sample standard deviation s as an estimate for σ and proceeded as before to calculate a confidence interval with close enough results. However, statisticians ran into problems when the sample size was small. A small sample size caused inaccuracies in the confidence interval.
William S. Gosset (1876–1937) of the...
8.6K
Estimating Population Mean with Known Standard Deviation01:16

Estimating Population Mean with Known Standard Deviation

9.3K
To construct a confidence interval for a single unknown population mean μ, where the population standard deviation is known, we need sample mean as an estimate for μ and we need the margin of error. Here, the margin of error (EBM) is called the error bound for a population mean (abbreviated EBM). The sample mean is the point estimate of the unknown population mean μ.
The confidence interval estimate will have the form as follows:
(point estimate - error bound, point estimate +...
9.3K
Accuracy, limits, and approximation01:28

Accuracy, limits, and approximation

970
Accuracy, limits, and approximations are common in many fields, especially in engineering calculations. These concepts are imperative for ensuring that a given value is as close as possible to its true value.
Accuracy is defined as the closeness of the measured value to the true or actual value. In engineering mechanics, repeated measurements are taken during theoretical or experimental analyses to ensure that the result is precise and accurate.
The accuracy of any solution is based on the...
970
Estimating Population Standard Deviation01:26

Estimating Population Standard Deviation

3.2K
When the population standard deviation is unknown and the sample size is large, the sample standard deviation s is commonly used as a point estimate of σ. However, it can sometimes under or overestimate the population standard deviation. To overcome this drawback, confidence intervals are determined to estimate population parameters and eliminate any calculation bias accurately. However, this only applies to random samples from normally distributed populations. Knowing the sample mean and...
3.2K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Remoteness decreases negative feelings about killing.

Cognitive research: principles and implications·2026
Same author

Symbolic show of strength: a predictor of risk perception and belief in misinformation.

The Journal of social psychology·2025
Same author

Distributing Blame Among Multiple Entities When Autonomous Technologies Cause Harm.

Personality & social psychology bulletin·2024
Same author

Personality and misinformation.

Current opinion in psychology·2023
Same author

Partisan bias in false memories for misinformation about the 2021 U.S. Capitol riot.

Memory (Hove, England)·2022
Same author

Publisher Correction: Situational factors shape moral judgements in the trolley dilemma in Eastern, Southern and Western countries in a culturally diverse sample.

Nature human behaviour·2022

Related Experiment Video

Updated: Dec 1, 2025

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
05:47

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

964

Does the "surprisingly popular" method yield accurate crowdsourced predictions?

Abraham M Rutchick1, Bryan J Ross2, Dustin P Calvillo3

  • 1California State University, Northridge, Northridge, USA. rutchick@csun.edu.

Cognitive Research: Principles and Implications
|November 11, 2020
PubMed
Summary
This summary is machine-generated.

The surprisingly popular (SP) method improves group predictions for future events, outperforming other aggregation techniques when used with expert judgments. Further research is needed to understand its full potential for crowdsourcing future outcomes.

Keywords:
CrowdsourcingForecastingPredictionSurprisingly popular methodWisdom of crowds

More Related Videos

Methods to Test Visual Attention Online
09:44

Methods to Test Visual Attention Online

Published on: February 19, 2015

12.2K

Related Experiment Videos

Last Updated: Dec 1, 2025

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
05:47

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

964
Methods to Test Visual Attention Online
09:44

Methods to Test Visual Attention Online

Published on: February 19, 2015

12.2K

Area of Science:

  • Decision Science
  • Social Psychology
  • Collective Intelligence

Background:

  • The surprisingly popular (SP) method aggregates individual judgments by leveraging metacognitive estimates.
  • Traditional crowdsourcing methods can fail when the majority is incorrect.
  • SP has shown success with factual propositions but limited application to future outcomes.

Purpose of the Study:

  • To evaluate the effectiveness of the SP method for aggregating predictions of future events.
  • To compare SP against other aggregation methods in predicting outcomes.
  • To assess SP's utility in expert crowdsourcing for future predictions.

Main Methods:

  • Three preregistered studies were conducted to compare SP with other aggregation methods.
  • Studies involved predictions of football games, US midterm elections, and basketball games.
  • The performance of SP was analyzed using objectively assessed expert judgments.

Main Results:

  • SP demonstrated slightly superior performance compared to other aggregation methods when applied to expert judgments.
  • The method showed promise in crowdsourcing predictions for future events across different domains.
  • Effectiveness of SP varied, indicating a need for further investigation into optimal conditions.

Conclusions:

  • The surprisingly popular method shows potential for improving crowdsourced predictions of future outcomes.
  • SP offers a promising alternative to traditional aggregation methods, especially with expert input.
  • Additional research is required to fully understand the conditions and limitations of SP's application.