A Machine Learning-Based Decoder Framework for the Cortical Voltage-Sensitive Dye Responses to Retinal Neuromorphic...

Intracortical microstimulation (ICMS) is a promising approach for visual prostheses. We recently proposed using retinal neuromorphic spike trains derived from visual images as ICMS pulse sequences, and preliminarily recorded cortical voltage-sensitive dye (VSD) responses to such stimulation. To examine whether these cortical responses contain image information, we explore the feasibility of machine-learning-based decoding. However, constructing such a decoder requires large-scale datasets linking visual images, spike trains, and cortical responses, which are not yet experimentally available. Therefore, we generated surrogate data with a Wiener-system model that simulates VSD responses of the visual cortex to ICMS pulse trains. A convolutional neural network trained on these synthetic datasets successfully reconstructed images from the simulated cortical responses. This simulation work serves as a proof-of-concept study, demonstrating the computational feasibility of estimating visual information contained in neuromorphic ICMS-evoked cortical activity and providing a foundation for future physiological validation.