Quality and reliability of type 1 diabetes mellitus -related short videos on Bilibili and TikTok: A cross-sectional assessment study.
Short-form videos are an increasingly important source of health information for individuals with type 1 diabetes mellitus (T1DM), yet their quality is unverified.
This study aimed to evaluate and compare the quality, reliability, and engagement of T1DM-related videos on Bilibili and TikTok.
We conducted a cross-sectional analysis of the top 100 T1DM-related videos from Bilibili and TikTok (N=200). Videos were systematically evaluated using four validated instruments: the Global Quality Scale (GQS), Journal of the American Medical Association (JAMA) criteria, Video Information and Quality Index (VIQI), and modified DISCERN (mDISCERN). Engagement metrics were extracted, and Spearman correlations and a multivariable negative binomial regression were performed to identify predictors of video 'likes'. A comprehensive sensitivity analysis, including Principal Component Analysis (PCA), was conducted to ensure robustness.
TikTok videos achieved significantly higher user engagement than those on Bilibili (median views: 88,089 vs. 3,418). In terms of quality, TikTok scored higher on the VIQI (median: 12.0 vs. 9.0, P < 0.001), while Bilibili scored higher on the JAMA criteria (median: 2.0 vs. 0.0, P < 0.001). No significant platform differences were found for GQS or mDISCERN. In the adjusted regression model, VIQI score was a strong positive predictor of likes (RR=1.66, 95% CI 1.32-2.13), whereas a higher GQS score was a negative predictor (RR=0.24, 95% CI 0.13-0.45). These findings were robust across all sensitivity analyses.
T1DM-related short videos on Bilibili and TikTok exhibit substantial variability in quality and reliability. TikTok demonstrates stronger audiovisual quality, whereas Bilibili shows better transparency (JAMA). Engagement was driven more by production quality than informational accuracy. These findings suggest that optimizing content strategies and strengthening professional participation may be beneficial for digital diabetes education.
This study aimed to evaluate and compare the quality, reliability, and engagement of T1DM-related videos on Bilibili and TikTok.
We conducted a cross-sectional analysis of the top 100 T1DM-related videos from Bilibili and TikTok (N=200). Videos were systematically evaluated using four validated instruments: the Global Quality Scale (GQS), Journal of the American Medical Association (JAMA) criteria, Video Information and Quality Index (VIQI), and modified DISCERN (mDISCERN). Engagement metrics were extracted, and Spearman correlations and a multivariable negative binomial regression were performed to identify predictors of video 'likes'. A comprehensive sensitivity analysis, including Principal Component Analysis (PCA), was conducted to ensure robustness.
TikTok videos achieved significantly higher user engagement than those on Bilibili (median views: 88,089 vs. 3,418). In terms of quality, TikTok scored higher on the VIQI (median: 12.0 vs. 9.0, P < 0.001), while Bilibili scored higher on the JAMA criteria (median: 2.0 vs. 0.0, P < 0.001). No significant platform differences were found for GQS or mDISCERN. In the adjusted regression model, VIQI score was a strong positive predictor of likes (RR=1.66, 95% CI 1.32-2.13), whereas a higher GQS score was a negative predictor (RR=0.24, 95% CI 0.13-0.45). These findings were robust across all sensitivity analyses.
T1DM-related short videos on Bilibili and TikTok exhibit substantial variability in quality and reliability. TikTok demonstrates stronger audiovisual quality, whereas Bilibili shows better transparency (JAMA). Engagement was driven more by production quality than informational accuracy. These findings suggest that optimizing content strategies and strengthening professional participation may be beneficial for digital diabetes education.