Related Experiment Video
Updated: May 24, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
Fine-tuning Large Language Models in Behavioral Psychology for Scalable Physical Activity Coaching
Sriya Mantena1, Anders Johnson1, Marily Oppezzo2,3
1Division of Cardiovascular Medicine, Department of Medicine, Stanford University School of Medicine, Stanford, CA, 94305, USA.
A new AI coach, MHC-Coach, provides personalized messages to encourage physical activity. Users preferred AI messages over human ones, showing potential for long-term behavior change and reduced cardiovascular disease risk.
Area of Science:
- Digital Health
- Behavioral Science
- Artificial Intelligence
Background:
- Smartphone-based coaching enhances physical activity but often uses static, non-personalized messages.
- Behavioral science frameworks, like the Transtheoretical Model of Change, offer theoretical underpinnings for behavior modification.
Purpose of the Study:
- To introduce and evaluate MHC-Coach, a large language model-based system for personalized health coaching.
- To assess the efficacy of AI-generated, psychologically tailored messages in promoting long-term physical activity.
Main Methods:
- Developed MHC-Coach by fine-tuning a large language model on the Transtheoretical Model of Change.
- Conducted a study with 632 participants comparing MHC-Coach messages to human-expert messages for physical activity promotion.
- Collected participant preference data and expert ratings on message effectiveness and theoretical alignment.
Main Results:
- 68.0% of participants preferred MHC-Coach-generated messages when matched to their stage of change (P < 0.001).
- Blinded experts rated MHC-Coach messages higher for perceived effectiveness (4.4 vs. 2.8) and Transtheoretical Model alignment (4.1 vs. 3.5).
Conclusions:
- Large language models can effectively operationalize behavioral science frameworks for personalized health coaching.
- MHC-Coach demonstrates potential for fostering sustained physical activity behavior change.
- This approach may contribute to reducing cardiovascular disease risk at scale through accessible digital interventions.
More Related Videos
Related Concept Videos
Modeling in Therapy
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
Behavioral Genetics and Its Designs
The primary methodologies used in behavior genetics include family studies, twin studies, and adoption studies, each providing unique...
Behavior Modification
A real-world application of operant conditioning principles is applied...
Behaviorism
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
Improving Translational Accuracy
Regression Toward the Mean

