Synchronising an IMX219 image sensor and AS7265x spectral sensor to make a novel low-cost spectral camera

Area of Science:

• Optics and Photonics
• Biomedical Engineering
• Robotics and Automation

Background:

• Standard RGB imaging captures limited light spectrum information.
• Near-infrared spectroscopy (NIRS) offers valuable spectral data but often requires expensive equipment.
• Integrating spectral sensors with imaging systems can augment visual data with spectral insights.

Purpose of the Study:

• To develop a low-cost spectral camera by synchronizing an image sensor with a spectral sensor.
• To demonstrate the camera's capability in characterizing biological samples.
• To explore potential applications in agriculture and remote sensing.

Main Methods:

• A novel spectral camera was constructed using a Jetson Nano, a Sony IMX219 NOIR image sensor, an AMS AS7265x spectral sensor, and Osram SFH 4737 infrared LEDs.
• The image and spectral sensors were synchronized to capture augmented image data, including light distribution information.
• The spectral camera was utilized to examine the dorsal surface of juvenile lobsters for pre-moult detection.

Main Results:

• The synchronized image and spectral data allowed for the characterization of the post-moult dorsal surface of juvenile lobsters with 86.7% accuracy.
• This represents the first time such characterization has been achieved using combined imaging and spectral data.
• The system demonstrated the potential to function as a low-cost hyperspectral snapshot camera, adaptable for daylight use.

Conclusions:

• The developed low-cost spectral camera successfully integrates imaging and spectral information, enhancing analytical capabilities.
• The camera achieved high accuracy in identifying pre-moult lobsters, indicating its utility in biological assessments.
• Future applications include low-cost drone deployment for precision agriculture and environmental monitoring.