Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Using PPT to analyze suboptimal human-automation performance.

Stephen Rice1, David Trafimow, Gayle Hunt

  • 1New Mexico State University, USA. sc_rice@yahoo.com

The Journal of General Psychology
|August 20, 2010
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

Mechanical Efficiency of Real Machines01:14

Mechanical Efficiency of Real Machines

The mechanical efficiency of a machine is a fundamental concept that describes how effectively a machine can convert input work into output work. According to this concept, the efficiency of a machine is equal to the ratio of the output work to the input work. An ideal machine, meaning a machine that has no energy losses, has an efficiency of one. This implies that the input work and the output work are equal.
However, in reality, no machine can be truly ideal, and all of them experience some...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

More Guidance Needed in Approaches to Calculate Transition Probabilities in Health Economic Decision Models: An External Assessment Group Perspective.

PharmacoEconomics·2026
Same author

Accounting for Oral Corticosteroids Tapering and Reduction in Adverse Effect Burden in Health Economic Evaluations: External Assessment Group Perspective.

PharmacoEconomics·2026
Same author

Binomial effect size displays and gain-probability: Alternative ways to interpret hierarchical regression findings, with tutorial.

Psychological methods·2026
Same author

Response to Comment on "The Importance of Structured Expert Elicitation to Inform Outcomes Following Treatment Discontinuation: Evidence Assessment Group Perspective".

PharmacoEconomics·2026
Same author

The Importance of Structured Expert Elicitation to Inform Outcomes Following Treatment Discontinuation: Evidence Assessment Group Perspective.

PharmacoEconomics·2026
Same author

A systematic review and meta-analysis to identify behavioural content and active ingredients of antimicrobial stewardship education and training interventions in hospital-based care settings.

Antimicrobial resistance and infection control·2025
Same journal

Cognitive and emotional benefits of piano training: effects on working memory and psychological well-being.

The Journal of general psychology·2026
Same journal

The efficacy of mindfulness based interventions in mitigating stress and fostering enhanced mindfulness among higher education students.

The Journal of general psychology·2026
Same journal

Age and gender differences in the factor structure of cognitive monitoring.

The Journal of general psychology·2026
Same journal

How social context modulates the roles of fairness, reciprocity, and empathy on advantageous inequity aversion.

The Journal of general psychology·2026
Same journal

Predicting a few or many friends in schoolchildren: a machine learning approach.

The Journal of general psychology·2026
Same journal

Can Psychological Capital Enhance Innovation? A three-wave intervention and the role of consideration of future consequences.

The Journal of general psychology·2026
See all related articles

This study examines why humans using automated diagnostic tools sometimes perform worse than the tools themselves. By applying a specific mathematical framework, the researchers identify that human inconsistency, rather than poor decision-making strategies, is the primary cause of this performance gap.

Area of Science:

  • Human factors engineering and Potential Performance Theory applications
  • Cognitive psychology and decision-making research

Background:

Diagnostic automation tools aim to boost human accuracy during complex event detection duties. Despite these goals, human-automation systems often fail to meet expected performance standards. This discrepancy frequently emerges when the automated aid maintains high reliability. In such scenarios, the human-machine team performs worse than the autonomous system acting alone. Prior research has shown that these outcomes remain poorly understood by current psychological models. That uncertainty drove a need for more precise analytical frameworks. No prior work had resolved the specific mechanisms behind these persistent performance deficits. This study addresses the lack of clear explanations for why human-automation synergy remains suboptimal.

Purpose Of The Study:

The primary aim of this study is to determine why human-automation performance frequently remains suboptimal. Researchers seek to resolve the ambiguity surrounding the causes of these performance deficits. This investigation addresses the gap in understanding why humans augmented with diagnostic aids often perform worse than the automation alone. The authors intend to apply a new mathematical framework to clarify these complex interactions. This motivation stems from the need to improve system reliability in high-stakes event detection tasks. The study explores whether poor strategy selection or other factors drive these failures. By utilizing a formal theory, the team hopes to provide a definitive explanation for the observed performance gaps. This work establishes a foundation for identifying how to effectively eliminate suboptimal outcomes in future human-machine systems.

Keywords:
human factors engineeringdiagnostic automation aidsdecision-making modelstask performance analysis

Frequently Asked Questions

The researchers propose that inconsistency is the primary mechanism causing suboptimal performance. While previous models blamed poor strategy selection, this framework identifies human variability as the culprit behind the performance decrement observed when humans use highly reliable diagnostic aids.

Potential Performance Theory (PPT) is the mathematical framework used to analyze task performance. Unlike traditional models, this tool allows investigators to calculate the precise contribution of inconsistency to the total performance gap between human-augmented systems and standalone automation.

The researchers indicate that highly reliable automation is a necessary condition for observing this specific type of suboptimal performance. In these instances, the human operator's inconsistency becomes the limiting factor, causing the combined system to perform worse than the autonomous aid alone.

Related Experiment Videos

Main Methods:

The investigators employed a theoretical modeling approach to evaluate human-machine interaction. They utilized the framework established by Trafimow and Rice to dissect task outcomes. This methodology focuses on isolating variables that contribute to performance decrements. The research team applied these mathematical principles to analyze existing data on diagnostic aid usage. They compared the accuracy of human-augmented systems against the performance of standalone automation. This review approach enabled the precise identification of inconsistency as a major factor. The study design avoids reliance on subjective interpretations of operator behavior. Instead, it provides a rigorous, objective method for quantifying the sources of suboptimal results.

Main Results:

The study reveals that inconsistency is the primary culprit behind suboptimal human-automation performance. This finding contradicts earlier assumptions that poor strategy selection was the main cause of these deficits. The analysis demonstrates that human variability accounts for a significant portion of the observed performance gap. By applying the mathematical model, the researchers determined the exact magnitude of the performance loss. The results indicate that human-augmented systems frequently perform worse than the automation itself when the aid is highly reliable. This quantitative evidence highlights the specific impact of inconsistency on task outcomes. The findings provide a clear explanation for why previous attempts to resolve these issues remained ambiguous. The data confirm that addressing human variability is essential for improving system effectiveness.

Conclusions:

The authors propose that inconsistency serves as the primary driver for suboptimal human-automation outcomes. Their analysis suggests that performance decrements are not merely the result of flawed strategy choices. By utilizing the proposed framework, researchers can now quantify the exact impact of human variability. This approach offers a way to isolate specific factors that hinder effective human-machine collaboration. The findings imply that addressing inconsistency is necessary to improve overall system reliability. Future efforts should focus on mitigating these fluctuations to enhance operator performance. The study provides a formal method to evaluate why human-augmented systems sometimes underperform. These insights clarify the underlying causes of observed performance gaps in automated environments.

The authors utilize data regarding task accuracy and consistency to quantify performance decrements. This quantitative approach allows them to distinguish between errors caused by poor strategy versus those resulting from inherent human variability during event detection tasks.

The study measures the performance gap between a human-augmented system and the automation acting independently. This phenomenon occurs when the human operator fails to match the reliability of the diagnostic aid, leading to a net decrease in overall system accuracy.

The researchers suggest that their framework provides a clear path to eliminate suboptimal performance. By identifying inconsistency as the root cause, they imply that interventions targeting operator stability could effectively bridge the gap between human-augmented systems and autonomous diagnostic tools.