Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

13.3K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.3K
Statistical Analysis: Overview01:11

Statistical Analysis: Overview

9.8K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
9.8K
Systematic Error: Methodological and Sampling Errors01:15

Systematic Error: Methodological and Sampling Errors

4.6K
In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
4.6K
Comparing Experimental Results: Student's t-Test01:09

Comparing Experimental Results: Student's t-Test

2.8K
The t-test is a statistical method used to compare the sample mean with a population mean or compare two means from two data sets. The test statistic is calculated from the standard deviation, mean, and number of measurements in the data set at a selected confidence interval and then compared to a table of critical values at this confidence level. If the test statistic is smaller than the critical value, the null hypothesis is accepted. In this case, we state that the difference between the...
2.8K
Data Validation01:15

Data Validation

301
Method validation is a crucial process in analytical chemistry designed to confirm that a given method consistently produces reliable and high-quality results. This process is essential when a method is applied to different sample matrices or when procedural modifications are made, ensuring that the results meet acceptable standards across various applications.
Key parameters for method validation include:
301
Variability: Analysis01:11

Variability: Analysis

233
Measures of variability are statistical metrics that reveal the dispersion pattern within a dataset. They are pivotal in biostatistics, providing insights into the heterogeneity within health and biological data. Variability signifies the degree to which data points diverge from one another, helping researchers understand the potential range of values and associated uncertainty within the data.
The range is a simple measure of variability, indicating the difference between the highest and...
233

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Effects of SGLT-2 inhibitors and GLP-1 receptor agonists on liver function in patients with non-alcoholic fatty liver disease and type 2 diabetes.

Frontiers in endocrinology·2026
Same author

Exploring causality between peripheral blood B cell subtypes and membranous nephropathy: a two-sample Mendelian randomization study.

Archives of medical science : AMS·2026
Same author

Integrated physiological and transcriptomic analyses reveal the role of polyamines in blueberry fruit coloration.

Plant physiology and biochemistry : PPB·2026
Same author

The CD40-CD154 axis in transplantation: from immunobiology to therapeutic targeting.

Frontiers in immunology·2026
Same author

Entagenic acid targets ASCC2 to ameliorate allergic contact dermatitis via repressing NF‑κB transactivation and chemokine expression.

Phytomedicine : international journal of phytotherapy and phytopharmacology·2026
Same author

Optical convolutional spectrometer.

Nature photonics·2026
Same journal

Direct-Assisted Bayesian Unit-level Modeling for Small Area Estimation of Rare Event Prevalence.

Journal of survey statistics and methodology·2026
Same journal

Toward a Principled Workflow for Prevalence Mapping Using Household Survey Data.

Journal of survey statistics and methodology·2026
Same journal

MEETING DATA COLLECTION GOALS QUICKER: AN EXPERIMENTAL EVALUATION TO REDUCE FIELDWORK DURATION IN A MIXED-MODE PANEL STUDY.

Journal of survey statistics and methodology·2026
Same journal

COMPARATIVE EFFECTIVENESS OF PROPENSITY SCORE ESTIMATION METHODS FOR INVERSE PROBABILITY OF TREATMENT WEIGHTING ANALYSIS WITH COMPLEX SURVEY DATA: A SIMULATION STUDY.

Journal of survey statistics and methodology·2025
Same journal

Synthesizing Surveys with Multiple Units of Observation: An Application to the Longitudinal Aging Study in India.

Journal of survey statistics and methodology·2025
Same journal

Analyzing Potential Non-Ignorable Selection Bias in an Off-Wave Mail Survey Implemented in a Long-Standing Panel Study.

Journal of survey statistics and methodology·2025
See all related articles

Related Experiment Video

Updated: Oct 16, 2025

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
08:40

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Published on: June 12, 2019

7.6K

Comparing Methods for Assessing Reliability.

Roger Tourangeau1, Hanyu Sun2, Ting Yan3

  • 1Westat Inc., Methodology, Westat, 1600 Research Boulevard, Rockville, MD 20850, USA.

Journal of Survey Statistics and Methodology
|October 21, 2021
PubMed
Summary
This summary is machine-generated.

This study compared traditional survey reliability methods with advanced techniques using reinterview data. Advanced methods largely agreed with traditional measures, suggesting robust survey reliability assessments.

Keywords:
Latent class analysesMTMM experimentsQuasi-simplex modelReinterview dataSurvey reliability

More Related Videos

Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow
09:18

Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow

Published on: December 15, 2023

3.1K
Assessment of Child Anthropometry in a Large Epidemiologic Study
09:36

Assessment of Child Anthropometry in a Large Epidemiologic Study

Published on: February 2, 2017

27.3K

Related Experiment Videos

Last Updated: Oct 16, 2025

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
08:40

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Published on: June 12, 2019

7.6K
Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow
09:18

Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow

Published on: December 15, 2023

3.1K
Assessment of Child Anthropometry in a Large Epidemiologic Study
09:36

Assessment of Child Anthropometry in a Large Epidemiologic Study

Published on: February 2, 2017

27.3K

Area of Science:

  • Survey Methodology
  • Psychometrics
  • Health Surveys

Background:

  • Assessing survey data reliability is crucial for data quality.
  • Traditional methods like reinterviews and gross difference rates (GDRs) are common.
  • Sophisticated methods including longitudinal models and latent class analysis also exist.

Purpose of the Study:

  • To systematically compare various methods for assessing survey data reliability.
  • To evaluate if traditional survey approaches yield similar conclusions to more advanced techniques.
  • To examine the relationship between ex ante indicators and reliability estimates.

Main Methods:

  • Conducted the Population Assessment of Tobacco and Health Reliability and Validity (PATH-RV) Study on a national probability sample.
  • Reinterviewed respondents twice, approximately two weeks apart.
  • Compared reliability estimates derived from classic survey methods (e.g., GDRs, kappa) with those from multi-trait, multi-method experiments, longitudinal data models, and latent class analyses.

Main Results:

  • Kappa showed high correlation with both GDRs and over-time correlations.
  • GDRs and over-time correlations were less correlated, especially for adult respondents.
  • Longitudinal analyses and latent class analysis results agreed well with traditional reliability estimates.
  • Ex ante indicators, like the Question Understanding Aid, showed weak relationships with reliability estimates but predicted item nonresponse and response latencies in adults.

Conclusions:

  • Traditional survey reliability methods are largely consistent with more sophisticated approaches.
  • Advanced methods like longitudinal analysis and latent class analysis provide comparable reliability estimates.
  • Ex ante indicators may offer complementary insights into potential survey data issues.