Integration of electrocardiogram and skin conductivity sensors in virtual reality controllers: an open-source...

This paper presents the Nervous toolkit, an open-source hardware and software initiative to integrate physiological sensors into Virtual Reality (VR) controllers. The toolkit includes electrocardiogram (ECG) and skin conductivity (EDA) sensors designed to assess cardiac and electrodermal activity. Both sensors use a wireless communication and are intended for an easy use in VR experimentations involving physiological data acquisition. An integration into Valve Index controllers is proposed by designing a clip-on accessory, with electrodes placed on the palm and forearm, and a Python package developed to facilitate data collection and streaming. The signal quality was assessed during VR activities, thus revealing an accurate detection of R-peaks on the ECG. However, the EDA integration presented movement-related noise. This variability is dependent on the type of movement, thus providing valuable insights into how different movements affect the signal for further experiments. The study highlights a promising system for non-intrusive, transparent physiological monitoring during VR experiences.Clinical relevanceThis work is intended to provide tools for physiological monitoring in virtual reality, which can be useful for applications such as stress and mental workload assessment in training, rehabilitation contexts, or during psychopysiological studies conducted in virtual environments.