Related Experiment Video
Updated: Jun 14, 2025

Characterization of the Sense of Agency over the Actions of Neural-machine Interface-operated Prostheses
Published on: January 7, 2019
The existence of manual mode increases human blame for AI mistakes
Mads N Arnestad1, Samuel Meyers2, Kurt Gray3
1Department of Leadership and Organization, BI Norwegian Business School, Norway.
Abstract:
People are offloading many tasks to artificial intelligence (AI)-including driving, investing decisions, and medical choices-but it is human nature to want to maintain ultimate control. So even when using autonomous machines, people want a "manual mode", an option that shifts control back to themselves. Unfortunately, the mere existence of manual mode leads to more human blame when AI makes mistakes. When observers know that a human agent theoretically had the option to take control, the humans are assigned more responsibility, even when agents lack the time or ability to actually exert control, as with self-driving car crashes. Four experiments reveal that though people prefer having a manual mode, even if the AI mode is more efficient and adding the manual mode is more expensive (Study 1), the existence of a manual mode increases human blame (Studies 2a-3c). We examine two mediators for this effect: increased perceptions of causation and counterfactual cognition (Study 4). The results suggest that the human thirst for illusory control comes with real costs. Implications of AI decision-making are discussed.
Related Concept Videos
Stereotype Content Model
Fundamental Attribution Error
Decision Making
Automatic decision-making is fast, intuitive, and relies on gut feelings...
High-Level and Low-Level Awareness
Reason and Intuition
Introduction to Cognitive Psychology
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...

