A Feasibility Study of Hybrid Deep-Learning Prediction with Online Adaptation of Breathing Irregularities for...

IntroductionAlthough long short-term memory (LSTM) networks have been tested to predict short-term respiratory motion, their performance in long-term forecasting under breathing irregularities must be assessed. We aim to evaluate and enhance the long-term prediction of internal motion from an external surrogate using subject-specific LSTM models through a hybrid, adaptive approach.MethodsConcurrent internal navigator and external bellows respiratory-motion waveforms were acquired for ten volunteers during two four-dimensional magnetic resonance imaging (4DMRI) scans lasting 3-10 min each. Approximately 20 min intervened between the first (mid-term) and second (long-term) scan. After training on the first half of the mid-term data, subject-specific LSTM models were applied to the remaining mid-term and entire long-term datasets to predict internal waveforms. The accuracy of a model's prediction was assessed with Pearson's correlation (C), referenced to the native waveforms, maximized through the time-domain cross-correlation (TCC), and enhanced by correcting residual phase shifts in the LSTM models using a hybrid (LSTM-TCC) approach. Hyperparameter selection by minimizing the root mean square error (RMSE) to identify high-performance (C ≥ 0.8) LSTM models was evaluated by the area under the receiver operating characteristic curve (AUROC). The temporal accuracy of inspiratory-peak predictions was characterized.ResultsCompared to the native waveforms (C = 0.42 ± 0.28) and TCC method (C = 0.77 ± 0.09), the LSTM models yielded more accurate predictions (C = 0.89 ± 0.07) in the mid-term scans. Over 20-30 min, LSTM predictions faltered (C < 0.80) in two subjects but were rescued by LSTM-TCC (C = 0.90 ± 0.09). The temporal error in predicting inspiratory peaks was smaller for LSTM-TCC (Δt = 0.15 ± 0.11sec) than LSTM (Δt = 0.18 ± 0.15sec). RMSE reliably identified high-performance models: $AURO{C}_{LSTM}^{mid-term}=0.82$, $AURO{C}_{LSTM}^{long-term}=0.74$, and $AURO{C}_{hybrid}^{long-term}=0.83$.ConclusionThe feasibility of a novel adaptive subject-specific LSTM-TCC modeling was tested in 10 subjects, demonstrating that high accuracy of external-to-internal motion predictions in 3-10 min can be extended to 30 min overcoming breathing irregularities without remodeling. Further investigations of the adaptive LSTM-TCC model are warranted as a potential clinical solution.