Detecting a Single Automation Failure: The Impact of Expected (But Not Experienced) Automation Reliability
Vanessa K Bowden1, Natalie Griffiths1, Luke Strickland2
1The University of Western Australia, Crawley.
Objective:
Examine the impact of expected automation reliability on trust, workload, task disengagement, nonautomated task performance, and the detection of a single automation failure in simulated air traffic control.
Background:
Prior research has focused on the impact of experienced automation reliability. However, many operational settings feature automation that is reliable to the extent that operators will seldom experience automation failures. Despite this, operators must remain aware of when automation is at greater risk of failing.
Method:
Participants performed the task with or without conflict detection/resolution automation. Automation failed to detect/resolve one conflict (i.e., an automation miss). Expected reliability was manipulated via instructions such that the expected level of reliability was (a) constant or variable, and (b) the single automation failure occurred when expected reliability was high or low.
Results:
Trust in automation increased with time on task prior to the automation failure. Trust was higher when expecting high relative to low reliability. Automation failure detection was improved when the failure occurred under low compared with high expected reliability. Subjective workload decreased with automation, but there was no improvement to nonautomated task performance. Automation increased perceived task disengagement.
Conclusions:
Both automation reliability expectations and task experience played a role in determining trust. Automation failure detection was improved when the failure occurred at a time it was expected to be more likely. Participants did not effectively allocate any spared capacity to nonautomated tasks.
Applications:
The outcomes are applicable because operators in field settings likely form contextual expectations regarding the reliability of automation.
Related Concept Videos
Distribution Reliability and Automation
Types of Errors: Detection and Minimization
Absolute error in a measurement is the numerical difference from the true or central value. Relative error is the ratio between absolute error and the true or central value, expressed as a percentage.
Errors can be classified by source, magnitude, and sign. There are three types of errors: systematic, random, and gross.
Systematic or...
Uncertainty in Measurement: Accuracy and Precision
Control Systems
At the heart...
Determination of Expected Frequency
Random and Systematic Errors


