Evaluating the Usability of an HIV Prevention Artificial Intelligence Chatbot in Malaysia: National Observational

Zhao Ni1,2, Sunyoung Oh1, Rumana Saifi3,4

  • 1School of Nursing, Yale University, 400 West Campus Drive, Orange, CT, 06477-3646, United States, 1 2037373039.

JMIR Human Factors
|July 15, 2025
PubMed
Abstract

Insights

A web-based AI chatbot effectively promoted HIV testing among men who have sex with men (MSM) in Malaysia, providing self-testing kits and health information. Further development is needed for personalized interactions and integration with healthcare systems.

Area of Science:

  • Digital Health
  • Public Health
  • Artificial Intelligence

Background:

  • Malaysia faces an HIV epidemic primarily transmitted sexually among men who have sex with men (MSM).
  • A web-based AI chatbot was developed to address HIV testing needs in this vulnerable population.

Purpose of the Study:

  • To evaluate the usability of an AI chatbot in promoting HIV testing among MSM in Malaysia.
  • To assess the chatbot's effectiveness in delivering health information and resources.

Main Methods:

  • An observational study involving 334 MSM was conducted from August 2023 to March 2024.
  • Participants were recruited via community outreach and social media; chatbot interactions were documented and analyzed.
  • Data analysis utilized R software based on predefined metrics.

Main Results:

  • The AI chatbot successfully assisted 334 participants, providing HIV self-testing kits, information on HIV and PrEP, and clinic details.
  • Over 393 interactions, the chatbot accurately answered 92.1% of questions about HIV and PrEP.
  • Some interactions (31) involved questions beyond the chatbot's programmed algorithms, leading to unanswered queries.

Conclusions:

  • The AI chatbot demonstrated high usability for delivering HIV self-testing kits and clinical information.
  • Enhancements for personalized health information and integration with healthcare systems are recommended for future AI chatbot implementation.
  • Addressing stigma and discrimination is crucial for effective AI chatbot deployment in community and clinical settings.