Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Data Collection by Experiments01:13

Data Collection by Experiments

28.2K
Data collection is a systematic method of obtaining, observing, measuring, and analyzing accurate information. An experimental study is a standard method of data collection that involves the manipulation of the samples by applying some form of treatment prior to data collection. It refers to manipulating one variable to determine its changes on another variable. The sample subjected to treatment is known as “experimental units.”
An example of the experimental method is a public...
28.2K
Observational Studies01:11

Observational Studies

11.6K
Observational studies are a type of analytical study where researchers observe events without any interventions. In other words, the researcher does not influence the response variable or the experiment's outcome.
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One...
11.6K
Experimental Designs01:16

Experimental Designs

18.7K
An experimental design is a systematic process that allows researchers to evaluate the relationship between dependent and independent variables. There are three widely used types of experimental design - pre-experimental design, true experimental design, and quasi-experimental design. In pre-experimental design, the researcher compares the data before and after some interventions or treatments. The true-experimental design has more than one purposefully created group, a commonly measured...
18.7K
Randomized Experiments01:13

Randomized Experiments

9.4K
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
9.4K
Reliability and Validity01:29

Reliability and Validity

14.4K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
14.4K
Behavioral Genetics and Its Designs01:23

Behavioral Genetics and Its Designs

1.4K
Behavior genetics explores how genetic inheritance influences human behavior. It focuses on how genes, passed from parents to offspring, contribute to the development of behavioral traits and tendencies. This branch of genetics seeks to understand the complex interplay between inherited genetic factors and environmental influences in shaping our behaviors.
The primary methodologies used in behavior genetics include family studies, twin studies, and adoption studies, each providing unique...
1.4K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Refugee labor market integration at scale: Evidence from Germany's fast-track employment program.

Proceedings of the National Academy of Sciences of the United States of America·2026
Same author

Catheter Ablation and Oral Anticoagulation for Secondary Stroke Prevention in Atrial Fibrillation: The STABLED Randomized Clinical Trial.

JAMA neurology·2026
Same author

The socioeconomic returns to citizenship: A randomized controlled trial.

Proceedings of the National Academy of Sciences of the United States of America·2026
Same author

Incidence and clinical significance of inducible perimitral atrial tachycardia in patients with atrial fibrillation.

Heart and vessels·2026
Same author

Linking deliveries to newborns using nationwide Medicaid data.

BMC medical research methodology·2025
Same author

The impact of private hosting on the integration of Ukrainian refugees in Germany.

Nature human behaviour·2025

Related Experiment Video

Updated: Apr 17, 2026

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
08:33

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences

Published on: September 4, 2019

7.6K

Validating vignette and conjoint survey experiments against real-world behavior.

Jens Hainmueller1, Dominik Hangartner2, Teppei Yamamoto3

  • 1Department of Political Science and Graduate School of Business, Stanford University, Stanford, CA 94305-6044;

Proceedings of the National Academy of Sciences of the United States of America
|February 4, 2015
PubMed
Summary

This study validates survey experiments in social science research. Stated preferences from conjoint analysis closely matched real-world immigrant naturalization decisions in Switzerland.

Keywords:
conjointpublic opinionstated preferencessurvey methodologyvignette

More Related Videos

Validation of a Psychosocial Intervention on Body Image in Older People: An Experimental Design
07:40

Validation of a Psychosocial Intervention on Body Image in Older People: An Experimental Design

Published on: May 31, 2021

4.3K
Author Spotlight: A Novel Setup to Conduct Naturalistic Laboratory Experiments with Real Human Actors in Scenarios
07:43

Author Spotlight: A Novel Setup to Conduct Naturalistic Laboratory Experiments with Real Human Actors in Scenarios

Published on: August 4, 2023

2.9K

Related Experiment Videos

Last Updated: Apr 17, 2026

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
08:33

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences

Published on: September 4, 2019

7.6K
Validation of a Psychosocial Intervention on Body Image in Older People: An Experimental Design
07:40

Validation of a Psychosocial Intervention on Body Image in Older People: An Experimental Design

Published on: May 31, 2021

4.3K
Author Spotlight: A Novel Setup to Conduct Naturalistic Laboratory Experiments with Real Human Actors in Scenarios
07:43

Author Spotlight: A Novel Setup to Conduct Naturalistic Laboratory Experiments with Real Human Actors in Scenarios

Published on: August 4, 2023

2.9K

Area of Science:

  • Social Sciences
  • Political Science
  • Behavioral Economics

Background:

  • Survey experiments like vignette and conjoint analyses are common for studying choices.
  • External validity of these methods, comparing hypothetical to real-world choices, is under-researched.

Purpose of the Study:

  • To assess the external validity of survey experiments by comparing hypothetical choices to actual behavior.
  • To determine if immigrant attributes influencing stated preferences in surveys also drive real-world naturalization decisions.

Main Methods:

  • Compared conjoint and vignette analyses with behavioral data from a Swiss natural experiment on immigrant naturalization.
  • Utilized a representative sample and official applicant descriptions provided to voters before referendums.

Main Results:

  • Survey experiment estimates for immigrant attributes closely recovered effects observed in the behavioral benchmark.
  • The paired conjoint design demonstrated the highest external validity, with estimates within 2% of behavioral effects.

Conclusions:

  • Survey experiments, particularly the paired conjoint design, offer a valid method for understanding real-world decision-making.
  • Findings support the use of these methods for studying public opinion on immigration and naturalization.