Usability Testing of a Social Media Chatbot for Increasing Physical Activity Behavior

Area of Science:

• Digital Health
• Behavioral Science
• Human-Computer Interaction

Background:

• Digital interventions, particularly social media-based ones, are effective for promoting physical activity.
• Chatbots (conversational agents) are emerging as a key tool in digital health interventions for adults.

Purpose of the Study:

• To explore user experiences with a social media chatbot designed to increase physical activity.
• To evaluate the usability and user perception of the MYA chatbot prototype.

Main Methods:

• MYA chatbot concept and prototype developed through requirement analysis, concept development, and implementation.
• Usability study involving participants completing the Chatbot Usability Questionnaire (CUQ).
• MYA incorporates behavior change techniques to promote physical activity.

Main Results:

• The overall mean CUQ score (below 68) indicated usability below the average benchmark.
• Participants believing MYA could increase physical activity reported higher usability (mean CUQ 64.5).
• Older adults (50-69 years) reported the lowest usability (mean CUQ 40.6); technical issues were identified.

Conclusions:

• MYA was perceived as welcoming, easy to use, realistic, engaging, and informative.
• Addressing technical issues is crucial for enhancing user interaction and promoting prolonged chatbot use.
• A positive and varied user experience is key to the success of digital interventions like MYA.