Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

13.3K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.3K
Surveys02:16

Surveys

16.1K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
16.1K
Response Surface Methodology01:16

Response Surface Methodology

315
Response Surface Methodology (RSM) is a collection of statistical and mathematical techniques used to develop, improve, and optimize processes. It is particularly valuable when many input variables or factors potentially influence a response variable.
The process of RSM involves several key steps:
315
Statistical Analysis: Overview01:11

Statistical Analysis: Overview

9.3K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
9.3K
Self-Report Tests of Personality01:22

Self-Report Tests of Personality

495
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.
495
Measures of Intelligence01:29

Measures of Intelligence

7.9K
Psychologists measure intelligence by using standardized tests that produce a score known as the intelligence quotient or IQ. To understand IQ tests, it's important to recognize the key principles behind their construction: validity, reliability, and standardization.
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
7.9K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Correction: Detecting underreporters of abortions and miscarriages in the national study of family growth, 2011-2015.

PloS one·2024
Same author

Detecting underreporters of abortions and miscarriages in the national study of family growth, 2011-2015.

PloS one·2022
Same author

Comparing Methods for Assessing Reliability.

Journal of survey statistics and methodology·2021
Same author

Corrigendum to: Who Can You Count On? Understanding the Determinants of Reliability.

Journal of survey statistics and methodology·2021
Same author

Who Can You Count On? Understanding The Determinants of Reliability.

Journal of survey statistics and methodology·2020
Same author

Reducing speeding in web surveys by providing immediate feedback.

Survey research methods·2019
Same journal

Direct-Assisted Bayesian Unit-level Modeling for Small Area Estimation of Rare Event Prevalence.

Journal of survey statistics and methodology·2026
Same journal

Toward a Principled Workflow for Prevalence Mapping Using Household Survey Data.

Journal of survey statistics and methodology·2026
Same journal

MEETING DATA COLLECTION GOALS QUICKER: AN EXPERIMENTAL EVALUATION TO REDUCE FIELDWORK DURATION IN A MIXED-MODE PANEL STUDY.

Journal of survey statistics and methodology·2026
Same journal

COMPARATIVE EFFECTIVENESS OF PROPENSITY SCORE ESTIMATION METHODS FOR INVERSE PROBABILITY OF TREATMENT WEIGHTING ANALYSIS WITH COMPLEX SURVEY DATA: A SIMULATION STUDY.

Journal of survey statistics and methodology·2025
Same journal

Synthesizing Surveys with Multiple Units of Observation: An Application to the Longitudinal Aging Study in India.

Journal of survey statistics and methodology·2025
Same journal

Analyzing Potential Non-Ignorable Selection Bias in an Off-Wave Mail Survey Implemented in a Long-Standing Panel Study.

Journal of survey statistics and methodology·2025
See all related articles

Related Experiment Video

Updated: Oct 9, 2025

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

7.0K

Survey Reliability: Models, Methods, and Findings.

Roger Tourangeau1

  • 1is with Westat Inc., Survey Methodology Unit, USA.

Journal of Survey Statistics and Methodology
|December 16, 2021
PubMed
Summary
This summary is machine-generated.

Assessing survey data reliability is crucial but often overlooked. This study compares methods for measuring response reliability, finding consistent determinants despite methodological differences.

Keywords:
Belief-samplingMTMM experimentsQuasi-simplex modelReliabilitySimple response variance

More Related Videos

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

951
A Protocol of Manual Tests to Measure Sensation and Pain in Humans
07:28

A Protocol of Manual Tests to Measure Sensation and Pain in Humans

Published on: December 19, 2016

21.2K

Related Experiment Videos

Last Updated: Oct 9, 2025

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

7.0K
Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

951
A Protocol of Manual Tests to Measure Sensation and Pain in Humans
07:28

A Protocol of Manual Tests to Measure Sensation and Pain in Humans

Published on: December 19, 2016

21.2K

Area of Science:

  • Survey Methodology
  • Psychometrics
  • Statistical Modeling

Background:

  • Reliability is essential for survey data quality.
  • Few studies have assessed response reliability in national surveys.
  • Diverse approaches exist for measuring survey response reliability.

Purpose of the Study:

  • To contrast psychological and statistical models for estimating survey response reliability.
  • To review major findings on reliability determinants.
  • To examine the validity of different reliability estimation methods.

Main Methods:

  • Comparison of psychological theory with statistical models (reinterview, multi-trait multi-method, panel data).
  • Literature review of reliability findings.
  • Correlation analysis of reliability estimates from different methods.

Main Results:

  • Respondent and question characteristics consistently emerge as key reliability determinants across methods.
  • Sophisticated statistical models' empirical claims are not strongly supported.
  • Traditional reinterview studies show some validity support.

Conclusions:

  • Survey response reliability is an understudied but critical area.
  • Methodological differences in reliability estimation yield convergent findings on determinants.
  • Further research on survey question reliability is needed.