Related Experiment Video
Updated: Oct 26, 2025

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
Published on: September 4, 2019
Influence of ecological momentary assessment study design features on reported willingness to participate and
Joshua M Smyth1, Dusti R Jones2, Cheng K F Wen3
1Biobehavioral Health and Medicine, Penn State University Park, University Park, Pennsylvania, USA jms1187@psu.edu.
Objective:
Intensive ambulatory assessment, such as ecological momentary assessment (EMA), is increasingly used to capture naturalistic patient-reported outcomes. EMA design features (eg, study duration, prompt frequency) vary widely between studies, but it is not known if such design decisions influence potential subjects' willingness to participate in a study. We hypothesise that intentions to participate will be higher in studies that are less burdensome and have higher reward (eg, compensation).
Design:
This experimental study examined if four EMA study design features (study duration, prompt frequency, prompt length, compensation) affected intentions to participate in a hypothetical EMA study and participation appraisals (eg, participation effort). Participants were randomly assigned to conditions (reflecting a fully crossed design of the four features, each with two levels). Each condition presented a vignette describing a study (each a unique combination of design features) and asked them to report on likelihood of participating and study appraisals.
Participants:
A convenience sample of participants (n=600; 46% female, Mage=40.39) were recruited using an online service.
Primary And Secondary Outcome Measures:
Primary outcomes were willingness to participate (No/Yes) and reported participation likelihood (0-100 scale). Secondary outcomes included appraisals of interest, enjoyment, effort, and if the study makes a valuable contribution to science.
Results:
We examined main effects, and two-way interactions for participation likelihood, across study design features. Overall, reported willingness to participate and participation likelihood were high (89%, M=83.90, respectively). Shorter study duration, fewer prompts, shorter prompts and higher compensation increased willingness to participate and elicited higher participation likelihood (each associated with ~6%-8% increases). Findings suggested that more intensive studies were judged as somewhat less interesting and enjoyable, and requiring more effort.
Conclusion:
Hypotheses were generally supported. Design features influence behavioural intentions to participate in, and appraisals of, EMA studies. Implications for participant recruitment and generalisability, and remaining research questions, are discussed.
More Related Videos
06:58An Application for Pairing with Wearable Devices to Monitor Personal Health Status
Published on: February 3, 2022
06:39Electroencephalographic, Heart Rate, and Galvanic Skin Response Assessment for an Advertising Perception Study: Application to Antismoking Public Service Announcements
Published on: August 28, 2017
Related Concept Videos
Naturalistic Observations
Group Design
Study Designs in Epidemiology
Observational studies are those where the researcher does not intervene but rather observes natural variations. They include cross-sectional, cohort, and...
Ethics in Research
Surveys
Observational Studies
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One...