Related Experiment Video
Updated: Sep 25, 2025

03:49
Evaluating Flight Performance and Eye Movement Patterns Using Virtual Reality Flight Simulator
Published on: May 19, 2023
1.1K
Performance Index Based on Predicted Auditory Reaction Time Analysis for the Evaluation of Human-Machine Interface in
Weiwei Yu1, Dian Jin1, Xinliang Yang2
1School of Mechanical Engineering, Northwestern Polytechnical University, Xi'an, 710072, China.
Computational and Mathematical Methods in Medicine
|April 25, 2022
Summary
This study introduces predicted auditory reaction time to evaluate human-machine interface design in aviation. This method uses eye-tracking to measure pilot reaction times in real flight scenarios, improving interface effectiveness evaluation.
Area of Science:
- Human-Computer Interaction
- Aerospace Engineering
- Cognitive Psychology
Background:
- Effective human-machine interface (HMI) design is crucial for complex systems like aircraft.
- Traditional HMI evaluation often focuses on cumulative interaction effects, neglecting instantaneous pilot responses.
- Real-world flight scenarios and vast voice command sets pose challenges for traditional experimental evaluations.
Purpose of the Study:
- To introduce predicted auditory reaction time as a novel index for evaluating HMI design effectiveness in aviation.
- To address limitations of existing methods in capturing pilot's instantaneous reactions and simulating diverse flight conditions.
- To develop a method for assessing HMI design efficiency that is applicable in real flight tasks and accounts for numerous voice commands.
Main Methods:
- Utilizing eye movement tracking to measure pilots' auditory reaction times during flight tasks.
- Developing a prediction model to estimate pilot reaction times for a broader range of voice commands using limited data.
- Implementing a non-intrusive measurement technique that minimizes interference with ongoing flight operations.
Main Results:
- The proposed method allows for the measurement of auditory reaction time directly within flight task scenarios.
- Eye-tracking provides a non-interfering means to collect reaction time data from pilots.
- The prediction model enables estimation of reaction times for generalized voice commands from a small sample set, enhancing evaluation scope.
Conclusions:
- Predicted auditory reaction time, measured via eye-tracking, offers a viable and effective index for HMI design evaluation in aviation.
- This approach overcomes limitations of lab-based simulations and allows for data collection in ecologically valid flight environments.
- The predictive modeling component extends the utility of the method, enabling broader assessment of HMI performance under various voice command conditions.

