Electrically programmable organic in-display neuromorphic computing

The scale-up of AI models and data makes smart edge devices (e.g. smartphones and AR/VR glasses) face increasing challenges in energy consumption, latency and hardware costs. These challenges are due to their physically separated memory, processing and display units. Collocating the functions of these units into a single device for in-display neuromorphic computing (IDNC) shows great promise in overcoming these challenges. Herein, we report an all-in-one electrically programmable IDNC (EP-IDNC) device that leverages the electrochromism of organic semiconductors. The electrochromism empowers the EP-IDNC device with synaptic and neural behaviors (e.g. multi-terminal operability, multi-level weight update, spatiotemporal information encoding), as well as the capability to visually display computing results through color changes. The IDNC functions are validated on tasks such as noise reduction and motion object perception using a prototype 3 × 3 EP-IDNC device array. We ultimately showcase the integration of neuromorphic and display functions for car steering reminders.