Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Surveys02:16

Surveys

14.7K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
14.7K
Reliability and Validity01:29

Reliability and Validity

12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
Convenience Sampling Method00:55

Convenience Sampling Method

8.6K
Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. Data are the result of sampling from a population. The sampling method ensures that samples are drawn without bias and accurately represent the population.
Convenience sampling is a non-random method of sample selection; this method selects individuals that are easily accessible and may result in biased data. For example, a marketing...
8.6K
Data Collection by Survey01:07

Data Collection by Survey

6.4K
The systematic method of obtaining and analyzing accurate information of a population is called data collection. A survey is a standard method of data collection that involves collecting information from a target human population about their experience, opinion, or knowledge of a product, service, or process. The responses are recorded and interpreted. The most common survey examples are written questionnaires, face-to-face or telephonic conversations, focus groups, and electronic (e-mail or...
6.4K
Longitudinal Research02:20

Longitudinal Research

11.8K
Sometimes we want to see how people change over time, as in studies of human development and lifespan. When we test the same group of individuals repeatedly over an extended period of time, we are conducting longitudinal research. Longitudinal research is a research design in which data-gathering is administered repeatedly over an extended period of time. For example, we may survey a group of individuals about their dietary habits at age 20, retest them a decade later at age 30, and then again...
11.8K
Naturalistic Observations02:30

Naturalistic Observations

15.4K
If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...
15.4K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Shared and specific associations of amygdala nuclei volumes with PTSD symptom domains and childhood trauma: An ENIGMA-PGC PTSD mega-analysis.

Molecular psychiatry·2026
Same author

An examination of the associations between AUDIT scores, person-level differences in daily location changes, and stress among college students.

Scientific reports·2026
Same author

Peer Support for Whole Health: R esults from a mixed methods two phase pilot study.

Journal of behavioral medicine·2026
Same author

Resting-State Functional Connectivity of the Amygdala and Hippocampus in PTSD: Results From the PGC-ENIGMA PTSD Working Group.

The American journal of psychiatry·2026
Same author

Cefepime Alleviates Comorbid Pain and Depression Induced by Lipopolysaccharide in Female Mice.

Brain sciences·2026
Same author

Determining the impact of cannabis use on tobacco cessation: Results from a prospective non-randomized tobacco treatment trial.

Addiction (Abingdon, England)·2026

Related Experiment Video

Updated: Jun 5, 2025

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
00:08

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences

Published on: September 4, 2019

7.0K

Response Rates, Reliability, and Convergent Validity in Experience Sampling Data.

Jeffrey S Simons1,2, Stephen A Maisto3, Raluca M Simons1

  • 1University of South Dakota, Vermillion, USA.

Assessment
|December 10, 2024
PubMed
Summary
This summary is machine-generated.

Study findings indicate that the number of completed assessments and reliability, not just compliance, impact data quality in experience sampling method (ESM) studies. Compliance alone does not guarantee valid or reliable intoxication and negative affect measures.

Keywords:
affect regulationalcoholecological momentary assessment (EMA)intensive longitudinal designspsychometrics

More Related Videos

Measuring Engagement of Spectators of Social Digital Games
14:02

Measuring Engagement of Spectators of Social Digital Games

Published on: July 3, 2021

3.4K
The Motivation for Alcohol Reward: Predictors of Progressive-Ratio Intravenous Alcohol Self-Administration in Humans
05:40

The Motivation for Alcohol Reward: Predictors of Progressive-Ratio Intravenous Alcohol Self-Administration in Humans

Published on: April 28, 2022

3.0K

Related Experiment Videos

Last Updated: Jun 5, 2025

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
00:08

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences

Published on: September 4, 2019

7.0K
Measuring Engagement of Spectators of Social Digital Games
14:02

Measuring Engagement of Spectators of Social Digital Games

Published on: July 3, 2021

3.4K
The Motivation for Alcohol Reward: Predictors of Progressive-Ratio Intravenous Alcohol Self-Administration in Humans
05:40

The Motivation for Alcohol Reward: Predictors of Progressive-Ratio Intravenous Alcohol Self-Administration in Humans

Published on: April 28, 2022

3.0K

Area of Science:

  • Psychological Science
  • Methodology
  • Data Science

Background:

  • Experience sampling method (ESM) is widely used to study psychological phenomena in daily life.
  • Assessing the reliability and validity of ESM data is crucial for accurate research findings.
  • Compliance with ESM protocols can influence data quality, but its precise impact is debated.

Purpose of the Study:

  • To examine the associations between compliance rates and the reliability and convergent validity of intoxication and negative affect assessments in ESM data.
  • To investigate these associations across diverse populations: Veterans, Sexual Minority Men, and College Students.
  • To determine if a specific compliance threshold reliably predicts data validity.

Main Methods:

  • Utilized data from three distinct samples (Veterans, Sexual Minority Men, College Students).
  • Operationalized convergent validity as within-person associations between in situ and retrospective assessments, and transdermal alcohol measures.
  • Assessed reliability using intraclass correlation (ICC) and the number of completed assessments.

Main Results:

  • Reliability of ESM aggregates (e.g., daily means) depends more on the number of completed assessments and ICC than mere compliance.
  • Convergent validity showed a correlation with compliance rate, but associations were weak.
  • No clear compliance threshold (e.g., 80%) emerged to distinguish between good and poor data validity.

Conclusions:

  • Compliance rate is not the sole determinant of data reliability or validity in ESM studies.
  • Researchers should consider the number of assessments and ICC for reliability, and acknowledge that high compliance does not always equate to high validity.
  • Findings suggest a nuanced view of compliance in ESM research, applicable across different demographic groups.