Cognitive Response Efficiency Under Varying Audiovisual Display Modalities of Flight Deck Warnings

Warning information is mainly transmitted to pilots through visual and auditory forms in flight, with only a small portion transmitted through vibration. Poorly designed flight deck warnings have negative effects on pilot performance and safety. This study aimed to give insights into how different encoding forms of warnings act on pilot performance from a cognitive modeling perspective.

Four encoding forms were designed using voice prompts and flashing messages. An Adaptive Control of Thought-Rational based model was built to simulate the perception process. Flight simulator tests were carried out with four types of warnings triggered randomly for comparison with simulation results and thereby performed model validation. Statistical tests were performed to examine the significant differences and effect sizes.

Both cognitive models (response time 0.82 ± 0.06 s with voice vs. 1.37 ± 0.09 s without voice in static forms; 1.35 ± 0.56 s with voice vs. 1.83 ± 0.32 s without voice in flashing forms) and subjects' response time (1.42 ± 0.37 s with voice vs. 1.53 ± 0.42 s without voice in static forms; 1.43 ± 0.44 s with voice vs. 1.65 ± 0.43 s without voice in flashing forms) suggest the benefits of using voice prompts to improve performance, while flashing forms of warnings may impose an extra burden on cognition even though they bring the benefit of attracting attention.

By carrying out a joint analysis with cognitive modeling and flight simulator tests, this work shows that designers can make use of alternative sensory channels for achieving a timely transfer of attention, but with a risk of increasing cognitive load. Zhang X, Li C, Sun Y, Yan C. Cognitive response efficiency under varying audiovisual display modalities of flight deck warnings. Aerosp Med Hum Perform. 2025; 96(4):279-286.