Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Nonconscious Mimicry01:13

Nonconscious Mimicry

4.7K
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
4.7K
Modeling and Similitude01:12

Modeling and Similitude

360
Scaled modeling is a fundamental technique in engineering, enabling the study of large and complex systems by creating smaller, manageable replicas that recreate critical characteristics of the original. In hydrology and civil infrastructure, for example, scaled models of dams help analyze water flow, turbulence, and pressure. This method allows for accurate predictions of real-world behavior within a controlled environment, significantly reducing the cost and time involved in full-scale...
360
Mechanistic Models: Compartment Models in Individual and Population Analysis01:23

Mechanistic Models: Compartment Models in Individual and Population Analysis

92
Mechanistic models are utilized in individual analysis using single-source data, but imperfections arise due to data collection errors, preventing perfect prediction of observed data. The mathematical equation involves known values (Xi), observed concentrations (Ci), measurement errors (εi), model parameters (ϕj), and the related function (ƒi) for i number of values. Different least-squares metrics quantify differences between predicted and observed values. The ordinary least...
92
Multi-input and Multi-variable systems01:22

Multi-input and Multi-variable systems

185
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
185
Mechanistic Models: Overview of Compartment Models01:21

Mechanistic Models: Overview of Compartment Models

183
Mechanistic models, a category encompassing both physiological and compartmental modeling, differ from empirical models' approaches to incorporating known factors about the systems being modeled. Empirical models describe data with minimal assumptions, while mechanistic models aim to provide a robust description of available data by specifying assumptions and integrating known factors about the system. Compartmental analysis is a key example of a mechanistic model in pharmacokinetics and...
183
Stereotype Content Model02:16

Stereotype Content Model

14.9K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.9K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Deep Continuous-Time State-Space Models for Marked Event Sequences.

Advances in neural information processing systems·2026
Same author

Fair Survival Time Prediction via Mutual Information Minimization.

Proceedings of machine learning research·2024
Same author

Likelihood ratios for changepoints in categorical event data with applications in digital forensics.

Journal of forensic sciences·2024
Same author

A cell-level discriminative neural network model for diagnosis of blood cancers.

Bioinformatics (Oxford, England)·2023
Same author

Differentiating mental models of self and others: A hierarchical framework for knowledge assessment.

Psychological review·2023
Same author

Author Correction: Climate-driven changes in the predictability of seasonal precipitation.

Nature communications·2023
Same journal

In This Issue.

Proceedings of the National Academy of Sciences of the United States of America·2026
Same journal

Correction for Otsuki et al., Extracellular sulfatases support cartilage homeostasis by regulating BMP and FGF signaling pathways.

Proceedings of the National Academy of Sciences of the United States of America·2026
Same journal

Hive mind: Microbial communities and the making of memory.

Proceedings of the National Academy of Sciences of the United States of America·2026
Same journal

Targets for disease modification in schizophrenia: New findings add to evidence for the involvement of the immune complement system.

Proceedings of the National Academy of Sciences of the United States of America·2026
Same journal

Correction for Wang et al., The role of reduced aerosol masking from air pollutant emission reductions in recent global warming acceleration (2013-2023).

Proceedings of the National Academy of Sciences of the United States of America·2026
Same journal

Correction for Mishra, Ecology is not yet ready for AI-and why that matters.

Proceedings of the National Academy of Sciences of the United States of America·2026
See all related articles

Related Experiment Video

Updated: Sep 30, 2025

One Dimensional Turing-Like Handshake Test for Motor Intelligence
14:05

One Dimensional Turing-Like Handshake Test for Motor Intelligence

Published on: December 15, 2010

27.8K

Bayesian modeling of human-AI complementarity.

Mark Steyvers1, Heliodoro Tejeda1, Gavin Kerrigan2

  • 1Department of Cognitive Sciences, University of California, Irvine, CA 92697-5100; and.

Proceedings of the National Academy of Sciences of the United States of America
|March 11, 2022
PubMed
Summary
This summary is machine-generated.

This article explores how to best combine human and artificial intelligence predictions. By using a mathematical framework based on probability, the authors examine how to improve decision-making in hybrid systems. The study highlights the importance of understanding how humans and machines express confidence differently. These insights help design more effective collaborative tools for real-world tasks.

Keywords:
Bayesian modelingartificial intelligencehuman–AI complementarityimage classificationprobabilistic frameworkcollaborative decision-makingmachine classifierspredictive accuracy

Frequently Asked Questions

More Related Videos

Perceptual and Category Processing of the Uncanny Valley Hypothesis' Dimension of Human Likeness: Some Methodological Issues
07:34

Perceptual and Category Processing of the Uncanny Valley Hypothesis' Dimension of Human Likeness: Some Methodological Issues

Published on: June 3, 2013

17.5K
Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

704

Related Experiment Videos

Last Updated: Sep 30, 2025

One Dimensional Turing-Like Handshake Test for Motor Intelligence
14:05

One Dimensional Turing-Like Handshake Test for Motor Intelligence

Published on: December 15, 2010

27.8K
Perceptual and Category Processing of the Uncanny Valley Hypothesis' Dimension of Human Likeness: Some Methodological Issues
07:34

Perceptual and Category Processing of the Uncanny Valley Hypothesis' Dimension of Human Likeness: Some Methodological Issues

Published on: June 3, 2013

17.5K
Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

704

Area of Science:

  • Computational statistics within Bayesian modeling research
  • Human-computer interaction studies in artificial intelligence

Background:

No prior work has fully resolved how to integrate human and machine predictions within a unified probabilistic framework. Researchers often struggle to reconcile disparate confidence signals from these two distinct sources. Prior research has shown that combining multiple machine classifiers improves overall accuracy. That uncertainty drove the need to investigate how human input fits into these hybrid models. Existing literature focuses heavily on algorithmic performance rather than human-AI collaboration. This gap motivated a deeper look at the unique ways people express certainty. The current study addresses how these differences impact collective decision-making outcomes. Understanding these dynamics remains a challenge for modern system design.

Purpose Of The Study:

The aim of this study is to investigate the factors influencing the performance of hybrid human-AI systems. Researchers seek to understand how to effectively combine predictions from these two distinct sources. The motivation stems from the increasing prevalence of machine classifiers in real-world decision-making environments. The authors address the challenge of integrating human judgment with algorithmic outputs. They focus on the unique ways that confidence is expressed by both humans and machines. This problem requires a systematic examination of how these signals impact overall accuracy. The study explores whether a probabilistic framework can enhance the complementarity of these hybrid combinations. This work intends to provide a clearer picture of how to optimize collaborative systems.

Main Methods:

The review approach involves applying a probabilistic framework to analyze collaborative decision-making. Investigators examine how different classifiers contribute to overall system accuracy. They assess the influence of confidence signals on the final output. The team evaluates various combinations of human and algorithmic predictions. This strategy focuses on the mathematical representation of uncertainty. Researchers compare these hybrid configurations against baseline models. The methodology emphasizes the systematic investigation of performance factors. This approach provides a rigorous basis for understanding human-AI interaction.

Main Results:

Key findings from the literature demonstrate that hybrid systems outperform individual classifiers when confidence is properly integrated. The results indicate that accounting for human-specific confidence expressions significantly improves collective decision accuracy. The study shows that simple combinations often fail to capture the nuances of human input. The researchers observe that Bayesian frameworks successfully align disparate confidence signals. Their analysis reveals that the performance of hybrid combinations depends on the calibration of these sources. The data suggest that human-AI complementarity is highly sensitive to how certainty is communicated. The findings highlight the importance of weighting predictions based on their source-specific reliability. This evidence supports the use of probabilistic models for optimizing collaborative tasks.

Conclusions:

The authors propose that Bayesian frameworks effectively bridge the gap between human and machine inputs. Their synthesis suggests that accounting for confidence calibration improves hybrid system performance. This review implies that human-AI complementarity depends on how individuals communicate their subjective certainty. The findings indicate that simple averaging of predictions may overlook critical differences in source reliability. The researchers conclude that modeling these distinct confidence signals enhances overall decision accuracy. Their work suggests that future hybrid systems should prioritize these probabilistic adjustments. The evidence supports the integration of human-specific confidence metrics into algorithmic architectures. This synthesis underscores the potential for improved collaboration through structured mathematical approaches.

The researchers propose a Bayesian framework that integrates human and machine predictions by accounting for their unique confidence expressions. This approach improves decision-making by weighting inputs based on their reliability, rather than relying on simple averaging of the two distinct sources.

The authors utilize a Bayesian modeling framework to systematically investigate performance factors. This statistical tool allows for the incorporation of subjective human confidence alongside objective algorithmic outputs, providing a structured way to evaluate how different sources contribute to the final decision.

A probabilistic approach is necessary because humans and machines express confidence in fundamentally different ways. The researchers argue that ignoring these distinct communication styles leads to suboptimal integration, whereas a Bayesian model allows for the calibration of these disparate signals into a unified prediction.

The study relies on confidence data from both human participants and machine classifiers. This information acts as a weight, determining how much influence each source has on the final hybrid output, which is critical for optimizing the accuracy of the combined system.

The researchers measure the performance of hybrid combinations by comparing them against individual predictions. They observe that systematically accounting for the unique confidence expressions of each source leads to better outcomes than treating human and machine inputs as equivalent.

The authors propose that their model provides a foundation for designing better collaborative tools. They suggest that future systems should explicitly account for the distinct ways humans communicate certainty to maximize the benefits of human-AI complementarity in real-world applications.