Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Decision Making: Traditional Method01:14

Decision Making: Traditional Method

The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
Decision Making01:20

Decision Making

Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Decision Making: P-value Method01:09

Decision Making: P-value Method

The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim  is also stated. These statements can act as null and alternative hypotheses:  a null hypothesis would be a neutral statement while the alternative hypothesis can have a...
Problem-Solving01:29

Problem-Solving

Effective problem-solving consists of two steps: 1. identifying the problem and 2. selecting the appropriate problem-solving strategy (i.e., a plan of action used to find a solution). Humans use four problem-solving strategies:
Heuristics01:21

Heuristics

Heuristics are problem-solving strategies that use mental shortcuts to simplify decision-making. Unlike algorithms, which must be followed precisely to achieve a correct result, heuristics offer a general problem-solving framework. They save time and energy but can sometimes lead to less rational decisions.
People often rely on heuristics when faced with an overload of information, limited time, low importance of the decision, limited information, or when a heuristic readily comes to mind. For...
Group Design02:01

Group Design

The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between the two are due to...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Representativeness and response validity across nine opt-in online samples.

Nature human behaviour·2026
Same author

Polyomavirus-Specific T Cells in Progressive Multifocal Leukoencephalopathy: A Multicenter Retrospective Analysis.

Transplantation and cellular therapy·2026
Same author

Scientific workflow in experimental economics.

Philosophical transactions. Series A, Mathematical, physical, and engineering sciences·2026
Same author

2D:4D and Self-Employment: A Preregistered Replication Study in a Large General Population Sample.

Entrepreneurship theory and practice·2026
Same author

Publisher Correction: Reproducibility and robustness of economics and political science research.

Nature·2026
Same author

Smart flying in challenging skies: How Red Kites adjust wind turbine micro- and meso-avoidance across weather and experience.

Scientific reports·2026
Same journal

Thymidylate synthase inhibitory drugs induce p53-dependent pathways differently.

PloS one·2026
Same journal

Top-down and bottom-up attention for joint pattern classification and reconstruction.

PloS one·2026
Same journal

Short- and long-term scaling behavior of blood pressure and pulse arrival time during sleep in healthy controls and patients with obstructive sleep apnea.

PloS one·2026
Same journal

Double DQN-based secrecy energy efficiency and fairness performance in IRS-assisted NOMA systems with friendly jamming.

PloS one·2026
Same journal

10 recommendations for strengthening citizen science for improved societal and ecological outcomes: A co-produced analysis of challenges and opportunities in the 21st century.

PloS one·2026
Same journal

Paying in public: Peer effects, impression management, and willingness to pay on digital payment platforms.

PloS one·2026
See all related articles

Related Experiment Video

Updated: Jun 25, 2026

Task Interruption and Resumption Paradigm for Testing the Activation and Pursuit of an Abstract Thinking Goal
06:45

Task Interruption and Resumption Paradigm for Testing the Activation and Pursuit of an Abstract Thinking Goal

Published on: April 18, 2017

Decision-making in research tasks with sequential testing.

Thomas Pfeiffer1, David G Rand, Anna Dreber

  • 1Program for Evolutionary Dynamics, Harvard University, Cambridge, Massachusetts, United States of America. pfeiffer@fas.harvard.edu

Plos One
|February 26, 2009
PubMed
Summary
This summary is machine-generated.

Research findings become more reliable over time through sequential testing and focusing on informative tests. However, restricting publication of results can decrease research efficiency.

More Related Videos

Testing for Metacognitive Responding Using an Odor-based Delayed Match-to-Sample Test in Rats
08:06

Testing for Metacognitive Responding Using an Odor-based Delayed Match-to-Sample Test in Rats

Published on: June 18, 2018

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents
07:05

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents

Published on: September 10, 2018

Related Experiment Videos

Last Updated: Jun 25, 2026

Task Interruption and Resumption Paradigm for Testing the Activation and Pursuit of an Abstract Thinking Goal
06:45

Task Interruption and Resumption Paradigm for Testing the Activation and Pursuit of an Abstract Thinking Goal

Published on: April 18, 2017

Testing for Metacognitive Responding Using an Odor-based Delayed Match-to-Sample Test in Rats
08:06

Testing for Metacognitive Responding Using an Odor-based Delayed Match-to-Sample Test in Rats

Published on: June 18, 2018

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents
07:05

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents

Published on: September 10, 2018

Area of Science:

  • Scientific methodology
  • Research integrity

Background:

  • Concerns exist regarding the reliability of scientific research, with some arguing most published findings are false.
  • Factors like small effect sizes, error-prone tests, and publication bias can increase false positives.
  • Previous theoretical models were based on simplified scenarios of independent hypothesis testing.

Purpose of the Study:

  • To analyze more realistic research scenarios involving sequential testing.
  • To investigate the impact of selective publication on research reliability.
  • To evaluate how human subjects perform in sequential research tasks.

Main Methods:

  • Computer simulations of sequential testing scenarios.
  • Experimental approaches with human subjects performing research tasks.
  • Analysis of scenarios with selective publication of results.

Main Results:

  • Computer simulations show a declining fraction of false positives over testing rounds when using informative tests.
  • Human subjects demonstrated a tendency to select the most informative tests in experiments.
  • Experimental settings with restricted publication of results proved inefficient.

Conclusions:

  • Scientific findings tend to become more reliable over time in the studied research tasks.
  • Selective publication can hinder research efficiency.
  • Findings offer insights for optimizing research procedures and scholarly communication.