A Multimodal Sensing CMOS Imager Based on Dual-Focus Imaging

Area of Science:

• Materials Science
• Sensor Technology
• Micro-engineering

Background:

• Advanced machine intelligence relies on computational power and multimodal sensors.
• Current sensor integration often leads to bulky systems and complex data processing.

Purpose of the Study:

• To develop a compact multimodal sensing platform using a single complementary metal-oxide-semiconductor (CMOS) imager.
• To demonstrate the capability of detecting visual information, chemicals, temperature, and humidity simultaneously on one chip.

Main Methods:

• Dual-focus imaging combining lens-based and lensless techniques.
• Integration of a CMOS imager with micro-vehicle and endoscopic platforms.

Main Results:

• Successful transformation of a CMOS imager into a compact multimodal sensing platform.
• Demonstration of multimodal environmental sensing and mapping on a micro-vehicle.
• Achieved simultaneous imaging and chemical profiling using a multimodal endoscope in a porcine digestive tract.

Conclusions:

• The developed multimodal CMOS imager is compact, versatile, and extensible.
• This technology offers wide applicability in microrobots, in vivo medical devices, and other micro-devices.
• Dual-focus imaging provides an efficient method for multimodal sensing integration.