人工智能能帮助人类做出更好的决定吗? 实验和观察研究的统计评估框架
Eli Ben-Michael1, D James Greiner2, Melody Huang3,4
1Department of Statistics & Data Science and Heinz College of Information & Systems Public Policy, Carnegie Mellon University, Pittsburgh, PA 15213.
人工智能 (AI) 不能提高司法决策准确性. 单独使用人工智能系统,包括大型语言模型,表现比人类法官差.
科学领域:
- 决策科学科学 决策科学
- 人工智能的人工智能是人工智能.
- 法律技术 法律技术
背景情况:
- 数据驱动的算法,包括人工智能 (AI),在社会中越来越多地使用.
- 人类经常保留最终决策权,特别是在高风险的情况下.
- 人工智能在增强人类决策的有效性仍然是一个关键问题.
研究的目的:
- 为实证评估人工智能对人类决策的影响引入一个方法框架.
- 为了比较人类单独,人与人工智能和人工智能单独决策系统的性能.
- 确定AI建议是否提高决策准确性以及何时遵循它们.
主要方法:
- 开发了一个使用标准分类指标和潜在结果的框架.
- 采用单盲,无误的治疗分配用于AI建议.
- 将该方法应用于涉及法官和审前风险评估仪器的随机对照试验.
主要成果:
- 人工智能驱动的风险评估建议没有提高法官在决定现金保释时的准确性.
- 仅基于人工智能的系统,包括风险评估得分和大型语言模型,其分类性能低于人类评审员.
- 该研究提供了对人工智能在人类决策过程中最佳使用的见解.
结论:
- 人工智能产生的建议并没有提高审判前风险评估中的司法准确性.
- 用人工智能系统取代人类法官,包括大型语言模型,导致分类性能下降.
- 这些发现表明,在没有严格的经验验验证的情况下,在部署人工智能进行高风险的法律决策时应该谨慎.
更多相关视频
07:42An Automated T-maze Based Apparatus and Protocol for Analyzing Delay- and Effort-based Decision Making in Free Moving Rodents
Published on: August 2, 2018
10:26Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
相关概念视频
Study Design in Statistics
Does aspirin reduce the risk of heart attacks? Is one brand of fertilizer more effective at growing roses than another? Is fatigue as dangerous to a driver as the influence of alcohol? Questions like these are answered using randomized experiments with proper...
What is an Experiment?
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Statistical Hypothesis Testing
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
Study Designs in Epidemiology
Observational studies are those where the researcher does not intervene but rather observes natural variations. They include cross-sectional, cohort, and...
Experimental Designs
