A Single-Pixel Event Photoactive Device for Real-Time, In-Sensor Spatiotemporal Optical Information Processing

The increasing demand for energy-efficient, sophisticated optical sensing technologies in various applications, from machine vision to optical communication, highlights the necessity for innovations in spatiotemporal information sensing and processing at a nearly single-pixel scale. Traditional methods, including multi-pixel photodetector arrays and event-based camera systems, often fail to provide rapid, real-time detection and processing of dynamic events within the sensor. This shortcoming is particularly notable in handling high-dimensional spatiotemporal data, where the dependency on sequential data input and external processing tools leads to latency, reduced throughput, and heightened energy consumption, thereby impeding real-time parallel data processing capabilities. Here, a carrier-selective, single-pixel, position-sensitive planar photoactive device that integrates spatiotemporal event sensing with inherent short-term memory capabilities is introduced. The proof-of-concept single-pixel event photoactive device enables in-sensor spatiotemporal parallel optical information processing, efficiently managing multibit (>4 bit) data simultaneously and facilitating ultrafast (≈0.4 µs) recognition of input patterns with low energy consumption (25 femtojoules). Additionally, by adjusting the operating speed from continuous to pulsed light illumination, the sensor array can detect trajectories and absolute position of events, offering in-sensor optical flow detection. This single-pixel event photodetector marks significant advancement toward developing compact, energy-efficient, ultrafast sensors suitable for a wide range of in sensor-based photonic applications.