人类对齐影响了人工智能辅助决策的实用性
Nina L Corvelo Benz1,2, Manuel Gomez Rodriguez3
1Max Planck Institute for Software Systems, Kaiserslautern, 67663, Germany. ninacobe@mpi-sws.org.
Scientific reports
|August 9, 2025
概括
人工智能 (AI) 的信心值与用户信心之间的对齐提高了AI辅助决策的实用性. 通过诸如多校准等方法来改善这种对齐,可以提高信任和有效性.
科学领域:
- 决策科学 决策科学 决策科学
- 人与计算机的交互
- 人工智能的人工智能
背景情况:
- 人工智能模型在人工智能辅助决策中提供了对预测的信心值.
- 决策者很难有效地信任基于信任值的AI预测.
- 人工智能信心和用户信心之间的对齐被理论化为有限的决策实用性.
研究的目的:
- 实证地研究人工智能信心与用户信心之间的对齐对人工智能辅助决策的实用性的影响.
- 探索后处理人工智能信心值是否可以改善对齐和实用性.
主要方法:
- 进行了一项大规模的人体受试者研究.
- 参与者在人工智能协助下完成了一项决策任务 (在线卡牌游戏).
- 人工智能模型在人工智能和用户信心之间具有可控的调整程度.
主要成果:
- 在调整程度和人工智能辅助决策的实用性之间发现了积极的关联.
- 在后处理人工智能多校准的置信值增加了对齐.
- 多度校准也提高了人工智能辅助决策的整体实用性.
结论:
- 人工智能信心与用户信心之间的一致程度显著影响了人工智能辅助决策的实用性.
- 人工智能信任值的多度校准是一种可行的策略,可以改善对齐和决策实用性.
- 这些发现支持了将对齐与有效的人工智能合作联系起来的理论框架.
相关概念视频
Decision Making
231
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Automatic decision-making is fast, intuitive, and relies on gut feelings...
231
Issues And Trends In Healthcare Delivery System
5.8K
The issues and trends in healthcare delivery are constantly changing. The COVID-19 pandemic is one recent issue that wreaked havoc on healthcare systems, causing a shortage of healthcare workers, high demand for medicines and supplies, and increased medical expenditure due to a lack of insurance. Other issues include rising healthcare costs and care fragmentation.
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
5.8K
Decision Making: Traditional Method
4.1K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.1K
Non-equilibrium in the Cell
4.8K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
4.8K
Reason and Intuition
6.9K
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
6.9K
Stereotype Content Model
14.9K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.9K


