Optical signal detection in turbid water using multidimensional integral imaging with deep learning

Area of Science:

• Optics and Photonics
• Computer Vision
• Machine Learning

Background:

• Optical signal detection is hindered by light scattering and attenuation in turbid, occluded environments.
• Three-dimensional (3D) integral imaging offers a promising solution by integrating multi-perspective images for enhanced visualization.
• Deep learning models show potential for complex signal processing and pattern recognition.

Purpose of the Study:

• To develop and evaluate a novel approach for detecting optical signals in challenging underwater conditions.
• To leverage multidimensional integral imaging combined with temporal encoding and deep learning for improved signal detection.
• To compare the performance of the proposed method against conventional 2D imaging and existing detection models.

Main Methods:

• Temporally encoding optical signals using gold code transmitted through turbid water via an LED.
• Capturing multi-perspective videos using a camera array for 3D signal reconstruction.
• Utilizing a convolutional neural network-based bidirectional Long Short-Term Network (CNN-BiLSTM) trained on clear water data for signal classification.

Main Results:

• The proposed 3D integral imaging approach with CNN-BiLSTM significantly outperformed previous correlation-based methods.
• Multidimensional integral imaging demonstrated superior performance compared to conventional 2D imaging for signal detection.
• The method successfully detected temporally encoded optical signals in turbid water with partial occlusion.

Conclusions:

• This work presents the first application of multidimensional integral imaging with deep neural networks for underwater optical signal detection.
• The developed deep learning strategy combined with 3D integral imaging offers a robust solution for challenging underwater communication and sensing scenarios.
• The findings highlight the potential of advanced imaging and AI techniques for overcoming limitations in optical signal transmission through scattering media.