Fourier Lightfield Multiview Stereoscope for Large Field-of-View 3D Imaging in Microsurgical Settings

Area of Science:

• Biomedical Imaging
• Optical Engineering
• Computer Vision

Background:

• Accurate 3D visualization is crucial for micro-surgical procedures and biological research.
• Existing 3D imaging techniques often face limitations in resolution, field-of-view, or speed.

Purpose of the Study:

• To introduce a novel imaging device, the Fourier Lightfield Multi-view Stereoscope (FiLM-Scope).
• To enable high-resolution 3D video capture over large fields-of-view for advanced visualization applications.

Main Methods:

• The FiLM-Scope utilizes a 48-camera array behind a primary lens for simultaneous multi-view image acquisition.
• A self-supervised algorithm is employed for reconstructing 3D height maps from the captured images.
• The system achieves a lateral resolution of 22 μm and height accuracy of 11 μm.

Main Results:

• The system captures 48 unique 12.8 MP images over a 28 × 37 mm field-of-view with a 21° × 29° angular range.
• Demonstrated 3D reconstruction accuracy down to 11 μm.
• Successfully performed tool tracking on ex-vivo rat skulls and visualized 3D deformation in human skin at up to 100 fps.

Conclusions:

• The FiLM-Scope offers a powerful new tool for high-resolution, large-field-of-view 3D video capture.
• The system's capabilities show significant potential for enhancing 3D visualization in various micro-surgical settings.
• This technology advances the field of 3D imaging for intricate biological and medical applications.