Quality of Information in Gallstone Disease Videos on TikTok: Cross-sectional Study

TikTok was an important channel for consumers to access and adopt health information. But the quality of health content in TikTok remains underinvestigated.

Our study aimed to identify upload sources, contents, and feature information of gallstone disease videos on TikTok and further evaluated the factors related to video quality.

We investigated the first 100 gallstone-related videos on TikTok and analyzed these videos' upload sources, content, and characteristics. The quality of videos was evaluated using quantitative scoring tools such as DISCERN instrument, the Journal of American Medical Association (JAMA) benchmark criteria, and Global Quality Scores (GQS). Moreover, the correlation between video quality and video characteristics, including duration, likes, comments, and shares, was further investigated.

According to video sources, 81% of the videos were posted by doctors. Furthermore, disease knowledge was the most dominant video content, accounting for 56% of all the videos. The mean DISCERN, JAMA, and GQS scores of all 100 videos are 39.61 (SD 11.36), 2.00 (SD 0.40), and 2.76 (SD 0.95), respectively. According to DISCERN and GQS, gallstone-related videos' quality score on TikTok is not high, mainly at fair (43/100, 43%,) and moderate (46/100, 46%). The total DISCERN scores of doctors were significantly higher than that of individuals and news agencies, surgery techniques were significantly higher than lifestyle and news, and disease knowledge was significantly higher than news, respectively. DISCERN scores and video duration were positively correlated. Negative correlations were found between DISCERN scores and likes and shares of videos. In GQS analysis, no significant differences were found between groups based on different sources or different contents. JAMA was excluded in the video quality and correlation analysis due to a lack of discrimination and inability to evaluate the video quality accurately.

Although the videos of gallstones on TikTok are mainly provided by doctors and contain disease knowledge, they are of low quality. We found a positive correlation between video duration and video quality. High-quality videos received low attention, and popular videos were of low quality. Medical information on TikTok is currently not rigorous enough to guide patients to make accurate judgments. TikTok was not an appropriate source of knowledge to educate patients due to the low quality and reliability of the information.