Random access vision: an imaging method to observe arbitrary and multiple gaze directions in frame-by-frame manner

Area of Science:

• Robotics
• Computer Vision
• Sensor Technology

Background:

• Robot vision systems often require capturing areas larger than a camera's field of view.
• Traditional pan/tilt platforms introduce response time delays incompatible with high frame rates.
• Existing methods struggle with real-time, multi-directional gaze control in dynamic environments.

Purpose of the Study:

• To develop a new method for arbitrary and multi-directional gaze control in robot vision.
• To overcome the limitations of mechanical pan/tilt systems in terms of response time.
• To enable frame-by-frame observation of multiple gaze directions within a single frame.

Main Methods:

• Utilizing a resonant mirror to oscillate the gaze direction.
• Employing a lock-in pixel image sensor with short exposure times (nanoseconds).
• Synchronizing image sensor exposure with the resonant mirror's passage through desired gaze directions.

Main Results:

• A prototype system demonstrated arbitrary gaze direction control on a frame-by-frame basis.
• The system successfully captured four simultaneous images from different, arbitrary gaze directions.
• The resonant mirror operated at a 12 kHz frequency, enabling rapid directional changes.

Conclusions:

• The proposed resonant mirror and lock-in sensor method offers a viable solution for real-time, multi-directional gaze control in robot vision.
• This approach overcomes the speed limitations of conventional mechanical platforms.
• The system facilitates simultaneous image acquisition from multiple, dynamically controlled viewpoints.