An adaptive protocol to assess physiological responses as a function of task demand in speech-in-noise testing

Acoustic challenges impose demands on cognitive resources, known as listening effort (LE), which can substantially influence speech perception and communication. Standardized assessment protocols for monitoring LE are lacking, hindering the development of adaptive hearing assistive technology.

We employed an adaptive protocol, including a speech-in-noise test and personalized definition of task demand, to assess LE and its physiological correlates. Features extracted from electroencephalogram, galvanic skin response, electrocardiogram, respiration, pupil dilation, and blood volume pulse responses were analyzed as a function of task demand in 21 healthy participants with normal hearing.

Heightened sympathetic response was observed with higher task demand, evidenced by increased heart rate, blood pressure, and breath amplitude. Blood volume amplitude and breath amplitude exhibited higher sensitivity to changes in task demand.

Notably, galvanic skin response showed higher amplitude during low task demand phases, indicating increased attention and engagement, aligning with findings from electroencephalogram signals and Lacey's attention theory.

The analysis of a range of physiological signals, spanning cardiovascular, central, and autonomic domains, demonstrated effectiveness in comprehensively examining LE. Future research should explore additional levels and manipulations of task demand, as well as the influence of individual motivation and hearing sensitivity, to further validate these outcomes and enhance the development of adaptive hearing assistive technology.