Related Experiment Video
Updated: Jun 26, 2026
07:09
Gaze in Action: Head-mounted Eye Tracking of Children's Dynamic Visual Attention During Naturalistic Behavior
Published on: November 14, 2018
Flexible artificial compound eye cameras for ultrawide continuous tracking in mixed reality
Heng Jiang1,2, Chi Chung Tsoi1,2, Yu Du3
1Photonics Research Institute (PRI), The Hong Kong Polytechnic University, Hong Kong, China.
Nature Communications
|June 24, 2026
Summary
Researchers developed a flexible artificial compound eye camera inspired by fruit flies. This biomimetic system integrates panoramic imaging, active tracking, and AI for dynamic scene reconstruction, advancing wearable tech and metaverse applications.
Area of Science:
- Biomimicry and Robotics
- Computer Vision and Artificial Intelligence
- Optics and Photonics
Background:
- Fruit flies (Drosophila) possess a sophisticated three-level vision system for panoramic perception, tracking, and dynamic scene processing.
- Replicating this natural vision system in artificial technologies presents significant challenges, despite advancements in artificial compound eyes.
Purpose of the Study:
- To present a flexible artificial compound eye camera that emulates the three-level synergistic vision of fruit flies.
- To explore applications in bioinspired wearable technologies and vision-based metaverse systems.
Main Methods:
- Constructed an artificial compound eye using plastic optical fibers and curved microlens arrays for panoramic imaging.
- Integrated tethers to simulate head muscle movements for a 270° field of view and continuous tracking.
- Employed an artificial intelligence algorithm to mimic neural processing for scene reconstruction.
Main Results:
- Achieved real-time panoramic imaging with a wide field of view.
- Enabled continuous tracking of weak signals and dynamic scene reconstruction at high frame rates (up to 7000 fps).
- Demonstrated a framework integrating sensing, active tracking, and neural-like processing.
Conclusions:
- The developed artificial compound eye successfully mimics the synergistic vision of fruit flies.
- This technology offers a promising framework for advanced metaverse applications and bioinspired wearable devices.
