Brainstem inhibitory neurons enhance behavioral feature selectivity by sharpening the tuning of excitatory neurons

The brainstem is a hub for sensorimotor integration, which mediates crucial innate behaviors. This brain region is characterized by a rich population of GABAergic inhibitory neurons, required for the proper expression of these innate behaviors. However, what roles these inhibitory neurons play in innate behaviors and how they function are still not fully understood. Here, we show that inhibitory neurons in the nucleus of the optic tract and dorsal-terminal nuclei (NOT-DTN) of the mouse can modulate the innate eye movement optokinetic reflex (OKR) by shaping the tuning properties of excitatory NOT-DTN neurons. Specifically, we demonstrate that although these inhibitory neurons do not directly induce OKR, they enhance the visual feature selectivity of OKR behavior, which is mediated by the activity of excitatory NOT-DTN neurons. Moreover, consistent with the sharpening role of inhibitory neurons in OKR behavior, they have broader tuning relative to excitatory neurons. Last, we demonstrate that inhibitory NOT-DTN neurons directly provide synaptic inhibition to nearby excitatory neurons and sharpen their tuning in a sustained manner, accounting for the enhanced feature selectivity of OKR behavior. In summary, our findings uncover a fundamental principle underlying the computational role of inhibitory neurons in brainstem sensorimotor circuits.