Towards bridging the synthetic-to-real gap in quantitative photoacoustic tomography via unsupervised domain
Zeqi Wang1, Wei Tao1,2, Zhuang Zhang3,4
1School of Sensing Science and Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China.
Abstract:
The difficulty of obtaining absorption coefficient annotations hinders the practical application of deep learning in quantitative photoacoustic tomography. While training on synthetic data is easy to implement, the synthetic-to-real domain gap poses a significant challenge to model generalization. To address this, we propose a Decoder-enhanced unsupervised Domain Adaptation (DDA) framework to enable knowledge transfer from synthetic data to an unlabeled target domain. Experimental results show that DDA significantly improves estimation performance on target images and surpasses competing methods in quantitative evaluation and visual comparison. Additionally, we investigate the effect of cross-domain label distribution similarity on domain adaptation and recommend an effective approach for data synthesis. To mitigate the effect of absorption property mismatch, we propose fine-tuning the affine parameters of normalization layers, which significantly improves estimation accuracy using labeled multi-wavelength photoacoustic images from as few as two target samples.


