Related Experiment Video
Updated: Sep 8, 2025

A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images
Published on: April 21, 2023
A long-term prediction model for key water quality based on transformer with parallel attention mechanism and
Lu Liu1,2, Xiaodong Ji1,2, Bentao Duan3
1School of Computer Science and Technology, Shandong Technology and Business University, Yantai, 264005, Shandong, China.
Abstract:
Accurate prediction of water quality parameters such as dissolved oxygen, temperature, salinity and pH is essential to ensure healthy marine ecosystems and sustainable aquaculture management. Water quality parameters reflect the ecological status and biogeochemical evolution of marine systems, serving as critical indicators for water quality regulation and health risk assessment. However, under the influence of global climate change and anthropogenic disturbances, the complexity of multivariable interactions and temporal dependencies in these high-dimensional, non-stationary datasets has increased significantly, making long-term forecasting a persistent challenge. However, global climate change and anthropogenic disturbances have exacerbated the complexity of multivariate interactions and temporal dependencies in these high-dimensional, non-stationary datasets, making long-term prediction particularly challenging. To address these challenges, we propose a Transformer-based model for long-term multivariate time series forecasting. First, an adaptive spectral enhancement module (ASEM) is introduced to dynamically suppress noise in the frequency domain while preserving critical information. Second, to better capture inter-variable correlations, the model incorporates a multi-source representation and intra-token parallel attention (MSR-TPA) mechanism, which dynamically adjusts feature importance and enhances local feature extraction. Furthermore, a multi-scale gating and inter-token parallel attention (MSG-TPA) mechanism is designed to simultaneously model multi-scale local features within variables and long-range dependencies across tokens. The model has been validated using eight real marine ranching datasets. On the Shandong Liugong Island dataset, it reduces the mean absolute error by 25.93%, the root mean square error by 40.78%, the R by 29.09%, and the Kling-Gupta efficiency by 12.77% compared to existing methods. These results demonstrate the model's excellent accuracy and generalization ability, providing strong technical support for marine ecological protection and water quality management of marine ranching systems.
Related Concept Videos
Transformers with Off-Nominal Turns Ratios
Three-Winding Transformers
In the per-unit equivalent circuit of a grounded Y-Y three-phase...

