Dynamic temporal partitioning enhanced transformer for pediatric viral load forecasting

Sai Li1, Zhengqiu Li1, Yi Mo1

  • 1Department of Clinical Laboratory, The Affiliated Children's Hospital of Xiangya School of Medicine, Central South University, Hunan Children's Hospital, Changsha, China.

Insights

This study introduces DTR-Former, a novel model for predicting viral load in children. DTR-Former improves accuracy and stability in forecasting, outperforming existing time-series methods.

Area of Science:

  • Biomedical Informatics
  • Computational Biology
  • Machine Learning

Background:

  • Viral infectious diseases are common in children, making accurate viral load prediction crucial for effective clinical management and public health.
  • Current time-series models struggle with complex data challenges like long-range dependencies, multi-scale features, noise, and missing clinical information.

Purpose of the Study:

  • To develop an advanced model for accurate viral load prediction in pediatric populations.
  • To address the limitations of existing time-series models in handling complex clinical data.

Main Methods:

  • Proposed DTR-Former (Dynamic Temporal Partitioning-enhanced Transformer) utilizing wavelet packet decomposition for adaptive temporal partitioning and multi-scale feature extraction.
  • Employed sparse self-attention to minimize redundancy and improve long-sequence modeling.
  • Integrated a residual convolutional decoder with a gating mechanism for feature refinement and noise suppression.

Main Results:

  • Achieved Mean Squared Error (MSE) of 0.16 and Mean Absolute Error (MAE) of 0.27 with an R-squared (R²) of 0.88 on the dbEBV dataset.
  • Obtained MSE = 0.18, MAE = 0.30, and R² = 0.86 on the NCBI dataset.
  • Demonstrated robust multi-step prediction stability and resilience to missing data.

Conclusions:

  • DTR-Former surpasses state-of-the-art methods in predictive accuracy, stability, and efficiency.
  • Presents a viable solution for pediatric viral load forecasting and other time-series analysis tasks.
Abstract