Related Experiment Video
Updated: Jan 9, 2026

Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
Published on: September 27, 2020
Examining intra-individual variability of ecological momentary assessment with multilevel modeling: A systematic
Catherine Luna1, Shenghai Dai2, Carolyn Pagan1
1Department of Psychology, Washington State University, Pullman, Washington, USA.
Abstract:
Objective: Ecological momentary assessment (EMA) is a popular method for analyzing intra-individual variability (IIV) of psychological constructs, including cognition. Multilevel modeling (MLM) is a widely used method for analyzing EMA data in intensive longitudinal designs. This systematic review examines how psychologists use and report MLM in EMA studies. It evaluates (1) adherence to the Checklist for Reporting EMA Studies (CREMAS) guidelines, (2) common factors reported in addition to the CREMAS guidelines, and (3) consistency in reporting MLM to analyze EMA data, aiming to improve research design and reporting consistency in the field. Method: Phase 1 searched research databases to explore the commonly used statistical analyses for EMA data. Subsequently, a systematic review was conducted of psychological research articles published between January 2021 and February 2023 which used MLM as the primary method to analyze EMA data. Phase 2 comprised an updated systematic review of articles published from November 2024 to April 2025 to examine whether reporting patterns improved across time. Results: Phase 1 confirmed MLM is the most often statistical procedure used to analyze EMA. 43 articles were reviewed and found (1) generally strong adherence to the CREMAS guidelines, (2) additional components commonly reported, and (3) varied reporting of MLM data preparation and analysis. Phase 2 reviewed 14 articles and found similar results as Phase 1. Conclusions: To further increase transparency and standardize reporting, we recommend several additions to the CREMAS guidelines and a set of Reporting MLM in EMA studies (REMMES) guidelines for future research.
Related Concept Videos
Mechanistic Models: Compartment Models in Individual and Population Analysis
Strategies of Self-Presentation III: Self-Monitoring
Noncompartmental Analysis: Statistical Moment Theory
Naturalistic Observations
Self-Evaluation Maintenance Model
Variability: Analysis
The range is a simple measure of variability, indicating the difference between the highest and...

