Quality and Reliability of Liver Cancer–Related Short Chinese Videos on TikTok and Bilibili: Cross-Sectional Content Analysis Study (Preprint)

Abstract

Liver cancer incidence has been increasing in China in the recent years, leading to increased public concern regarding the burden of this disease. Short videos on liver cancer are disseminated through TikTok and Bilibili apps, which have gained popularity in recent years as an easily accessible source of health information. However, the credibility, quality, and usefulness of the information in these short videos and the professional knowledge of the individuals uploading health information–based videos in these platforms have not yet been evaluated.

Our study aims to assess the quality of the information in Chinese short videos on liver cancer shared on the TikTok and Bilibili short video–sharing platforms.

In March 2023, we assessed the top 100 Chinese short videos on liver cancer in TikTok and Bilibili (200 videos in total) for their information quality and reliability by using 2 rating tools, namely, global quality score (GQS) and the DISCERN instrument. Correlation and Poisson regression analyses were applied to discuss the factors that could impact video quality.

Compared to Bilibili, TikTok is more popular, although the length of the videos on TikTok is shorter than that of the videos on Bilibili (<i>P</i>&lt;.001). The quality of the short videos on liver cancer in TikTok and Bilibili was not satisfactory, with median GQS of 3 (IQR 2-4) and 2 (IQR 1-5) and median DISCERN scores of 5 (IQR 4-6) and 4 (IQR 2-7), respectively. In general, the quality of videos sourced from professional institutions and individuals was better than that of those sourced from nonprofessionals, and videos involving disease-related knowledge were of better quality than those covering news and reports. No significant differences were found in the quality of videos uploaded by individuals from different professions, with the exception of those uploaded by traditional Chinese medicine professionals, which demonstrated poorer quality. Only video shares were positively correlated with the GQS (<i>r</i>=0.17, <i>P</i>=.01), and no video variables could predict the video quality.

Our study shows that the quality of short videos on health information related to liver cancer is poor on Bilibili and TikTok, but videos uploaded by health care professionals can be considered reliable in terms of comprehensiveness and content quality. Thus, short videos providing medical information on TikTok and Bilibili must be carefully considered for scientific soundness by active information seekers before they make decisions on their health care management.