Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Surveys02:16

Surveys

Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
Reliability and Validity01:29

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
Group Design02:01

Group Design

The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between the two are due to...
Dose-Response Relationship: Selectivity and Specificity01:25

Dose-Response Relationship: Selectivity and Specificity

Drugs exert their therapeutic effects by interacting with receptors, enzymes, or ion channels that are present throughout the human body. The strength and duration of the interaction between a drug and its target receptor are characterized by the selectivity and specificity of the drug. Selectivity refers to a drug's strong preference for its intended target over other targets. For instance, isoprenaline, a non-selective β-adrenergic agonist, interacts with both β1- and β2-adrenergic receptors...
The Representativeness Heuristic02:13

The Representativeness Heuristic

The representative heuristic describes a biased way of thinking, in which you unintentionally stereotype someone or something. For example, you may assume that your professors spend their free time reading books and engaging in intellectual conversation, because the idea of them spending their time playing volleyball or visiting an amusement park does not fit in with your stereotypes of professors.
Confirmation Biases01:31

Confirmation Biases

The confirmation bias is the tendency to focus on information that confirms our existing beliefs and ignore information that is inconsistent with our expectations. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. Have you ever fallen prey to the confirmation bias, either as the source or target of such bias?

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Large language models can predict the results of social science experiments.

Nature·2026
Same author

Confident judgments of (mis)information veracity are more, rather than less, accurate.

PNAS nexus·2026
Same author

A reporting checklist for large language models in behavioural science.

Nature human behaviour·2026
Same author

Emulated trial of artificial intelligence use and subsequent depressive outcomes in a survey of US adults.

BMJ mental health·2026
Same author

Negative partisanship, positive partisanship, and variation in climate policy attitudes on the political right.

PNAS nexus·2026
Same author

Integrative experiments identify how punishment affects welfare in public goods games.

Science (New York, N.Y.)·2026

Related Experiment Video

Updated: Jun 24, 2026

Methods to Test Visual Attention Online
09:44

Methods to Test Visual Attention Online

Published on: February 19, 2015

Representativeness and response validity across nine opt-in online samples.

Michael N Stagnaro1, James N Druckman2, Adam J Berinsky3

  • 1Sloan School of Management, Massachusetts Institute of Technology, Cambridge, MA, USA. mnstag@mit.edu.

Nature Human Behaviour
|June 22, 2026
PubMed
Summary
This summary is machine-generated.

Researchers can improve online study data quality. Using demographic quotas in samples may boost representativeness but reduce response validity. Early attention checks enhance data quality without harming sample representativeness.

More Related Videos

How Virtual Celebrity Characteristics Drive Purchase Intention: Testing the Stimulus-Organism-Response Framework with Structural Equation Modeling
07:35

How Virtual Celebrity Characteristics Drive Purchase Intention: Testing the Stimulus-Organism-Response Framework with Structural Equation Modeling

Published on: March 3, 2026

Related Experiment Videos

Last Updated: Jun 24, 2026

Methods to Test Visual Attention Online
09:44

Methods to Test Visual Attention Online

Published on: February 19, 2015

How Virtual Celebrity Characteristics Drive Purchase Intention: Testing the Stimulus-Organism-Response Framework with Structural Equation Modeling
07:35

How Virtual Celebrity Characteristics Drive Purchase Intention: Testing the Stimulus-Organism-Response Framework with Structural Equation Modeling

Published on: March 3, 2026

Area of Science:

  • Psychology
  • Behavioral Science
  • Online Research Methods

Background:

  • Human behavior studies increasingly use opt-in, non-probability online data.
  • Evaluating the quality of these online data sources is crucial for research integrity.

Purpose of the Study:

  • To analyze nine opt-in online data sources (N=13,053) for researchers.
  • To assess sample response validity, population representativeness, and professionalism.
  • To provide guidance on selecting appropriate online samples for research.

Main Methods:

  • Analysis of nine opt-in online data sources.
  • Assessment of response validity (attentiveness, effort, honesty, speeding, attrition).
  • Evaluation of sample representativeness (demographics, attitude, treatment effects) and professionalism.

Main Results:

  • Substantial variation observed across samples in validity, representativeness, and professionalism.
  • Demographic quotas improved representativeness but often reduced response validity.
  • Early attention checks enhanced response validity without compromising representativeness.

Conclusions:

  • Online data sources vary significantly in quality and representativeness.
  • Strategic use of demographic quotas and attention checks can optimize online research data.
  • Researchers should carefully select online samples based on study goals and resource limitations.