Related Experiment Video
Updated: Jun 22, 2025
Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
Published on: September 27, 2020
The "Flapbot": A Global Perspective on the Validity and Usability of a Flap Monitoring Chatbot
Hamza Ejaz1,2, Stephen R Ali1,2, Juan E Berner3,4
1Reconstructive Surgery and Regenerative Medicine Research Centre (ReconRegen), Institute of Life Sciences, Swansea University Medical School, Swansea, United Kingdom.
Background:
The Flapbot chatbot assists in free-flap monitoring, emphasizing accessibility, user-friendliness, and global reliability. This study assesses Flapbot's worldwide validity and usability and uses qualitative analysis to identify areas for future enhancement.
Methods:
Flapbot, built on Google's DialogFlow, was evaluated by international plastic surgeons. Invitations were sent to the International Lower Limb Reconstruction Collaborative (INTELLECT), International Confederation of Plastic Surgery Societies (ICOPLAST), and the International Microsurgery Club. Out of the 42 surgeons who agreed to participate, 21 tested the Flapbot and completed an online survey on its validity and usability. The survey had 13 validity items and 10 usability items. Data analysis involved computing the individual content validity index (I-CVI) and scale-wide content validity index (S-CVI) for validity, and the system usability score (SUS) for usability. Thematic analysis distilled free-text responses to identify key themes.
Results:
Nine of 13 items had an I-CVI over 0.78, denoting significant relevance. The S-CVI score stood at 0.82, indicating high relevance. The SUS score was 68, representing average usability. Themes highlighted issues with the current model, development suggestions, and surgeons' concerns regarding growing reliance on digital tools in health care.
Conclusion:
Flapbot is a promising digital aid for free-flap monitoring. While it showcases notable validity and usability, improvements in functionality, usability, and accessibility are needed for broader global use.
