Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Naturalistic Observations02:30

Naturalistic Observations

If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Capturing Heterogeneity in Levels, Variability, and Couplings across Persons and Time with a Hierarchical Time-Varying Coefficient Formulation of the Multivariate Normal.

Psychometrika·2026
Same author

Remembering affect between moments: assessing peak-end effects in continuous affect measures.

Cognition & emotion·2026
Same author

Love in motion: Bringing temporal and interpersonal dynamics into the formula of love.

The Behavioral and brain sciences·2026
Same author

Evaluating Model Predictive Performance in Confirmatory Factor Analysis with Binary Outcomes Using the InterModel Vigorish.

Multivariate behavioral research·2026
Same author

The distracted participant? Experience sampling response behavior and participant disturbance in social situations.

Psychological assessment·2026
Same author

Transdiagnostic Network Mapping of Psychopathology in Daily Life: Rationale and Research Protocol.

Clinical psychology in Europe·2026

Related Experiment Video

Updated: Jul 15, 2026

Using Rapid Serial Visual Presentation to Measure Set-Specific Capture, a Consequence of Distraction While Multitasking
05:58

Using Rapid Serial Visual Presentation to Measure Set-Specific Capture, a Consequence of Distraction While Multitasking

Published on: August 29, 2018

Identifying careless responding in ecological momentary assessment: Inconsistent signals from different detection

Leonie V D E Vogelsmeier1, Björn S Siepe2, Esther Ulitzsch3

  • 1Department of Methodology and Statistics, Tilburg University.

Psychological Methods
|July 13, 2026
PubMed
Summary

Detecting careless responding in intensive longitudinal data is crucial for psychological science. This study compares 13 methods, finding significant variation and highlighting the need for further empirical validation of these important tools.

More Related Videos

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats
09:12

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats

Published on: March 17, 2019

Design and Analysis for Fall Detection System Simplification
08:05

Design and Analysis for Fall Detection System Simplification

Published on: April 6, 2020

Related Experiment Videos

Last Updated: Jul 15, 2026

Using Rapid Serial Visual Presentation to Measure Set-Specific Capture, a Consequence of Distraction While Multitasking
05:58

Using Rapid Serial Visual Presentation to Measure Set-Specific Capture, a Consequence of Distraction While Multitasking

Published on: August 29, 2018

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats
09:12

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats

Published on: March 17, 2019

Design and Analysis for Fall Detection System Simplification
08:05

Design and Analysis for Fall Detection System Simplification

Published on: April 6, 2020

Area of Science:

  • Psychological science
  • Methodology
  • Data quality

Background:

  • Intensive longitudinal data, such as ecological momentary assessment (EMA), are vital for understanding psychological dynamics.
  • Careless responding in EMA studies can significantly degrade data quality and invalidate research findings.
  • Existing data-driven methods for detecting careless responding are numerous and complex, posing a challenge for researchers.

Purpose of the Study:

  • To summarize, apply, and compare 13 distinct methods for flagging careless responses in intensive longitudinal data.
  • To provide a practical guide and supplementary tutorials for researchers to evaluate and report careless responding in their own EMA data.
  • To assess the current state of methods for detecting careless responding and identify promising approaches.

Main Methods:

  • Comparison of 13 data-driven methods for detecting careless responding.
  • Application of these methods to a large ecological momentary assessment (EMA) dataset from the WARN-D study (n = 1,194 participants, 206,318 observations).
  • Evaluation of the consistency and divergence of results across the different detection methods.

Main Results:

  • Significant variability was observed in the results produced by the 13 compared methods for flagging careless responses.
  • The effectiveness and agreement between different careless responding detection approaches varied considerably.
  • The study underscores that methods for detecting careless responding are still in early developmental stages.

Conclusions:

  • The current landscape of careless responding detection methods is diverse but lacks consensus, producing highly divergent results.
  • Researchers are provided with recommendations on the most promising methods based on the study's findings.
  • Further empirical validation is essential for advancing the reliability and utility of careless responding detection techniques in psychological research.