インテリジェント・マシンの望ましくない行動の防止
Philip S Thomas1, Bruno Castro da Silva2, Andrew G Barto3
1University of Massachusetts, Amherst, MA, USA. pthomas@cs.umass.edu.
Science (New York, N.Y.)
|November 23, 2019
まとめ
機械学習 (ML) アルゴリズムを設計するための 新しいフレームワークを開発し 望ましくない ML 行動の規制を簡素化しました このアプローチは,実験的な機械学習システムにおける危険な動作を成功裏に防止し,より安全なAIアプリケーションを促進しました.
科学分野:
- 人工知能
- 機械学習エンジニアリング
背景:
- インテリジェントな機械と機械学習 (ML) アルゴリズムは,データ分析から複雑なタスクの実行まで,さまざまなアプリケーションでますます普及しています.
- MLシステムが有害なまたは望ましくない行動を示さないことを保証することは,AI開発における重要な課題です.
研究 の 目的:
- 望ましくない行動の仕様と規制を簡素化する ML アルゴリズムを設計するための一般的で柔軟な枠組みを提案する.
- このフレームワークの実用性を実証し,より安全な ML システムを構築します.
主な方法:
- MLアルゴリズムの設計のための新しいフレームワークの開発.
- 提案されたフレームワークに基づいてMLアルゴリズムの実装
- 設計されたMLアルゴリズムと標準アルゴリズムの実験的な評価は,危険な行動の排除を評価します.
主要な成果:
- 提案された枠組みは,望ましくないML行動の定義と制御のプロセスを効果的に簡素化します.
- このフレームワークを使用して設計されたMLアルゴリズムは,実験中に標準的なMLアルゴリズムで観察された危険な行動を成功裏に排除しました.
- このフレームワークは,より安全な ML アプリケーションの作成に有効であることが示されました.
結論:
- 開発されたフレームワークは,責任ある安全な機械学習アルゴリズムの設計に合理的なアプローチを提供します.
- この研究は,望ましくない行動に関連するリスクを軽減する方法を提供することによって,機械学習の安全で責任ある適用に貢献します.
関連する概念動画
02:16Stereotype Content Model
15.3K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
15.3K
01:22Machines: Problem Solving I
642
A toggle clamp is a mechanical device commonly used for holding and clamping objects in various applications, such as woodworking, metalworking, and assembly operations. Consider a toggle clamp subjected to a force of 200 N at the handle. The vertical clamping force can be calculated, provided the dimensions of the toggle clamp are known.
The toggle clamp system is a machine structure consisting of movable, pin-connected multi-force members that form a stabilized system to transmit forces. The...
The toggle clamp system is a machine structure consisting of movable, pin-connected multi-force members that form a stabilized system to transmit forces. The...
642
01:30Machines: Problem Solving II
612
Machines are complex structures consisting of movable, pin-connected multi-force members that work together to transmit forces. Consider a lifting tong carrying a 100 kg load. It comprises movable sections DAF and CBG linked together with member AB.
612
01:21Behavior Modification
498
Behavioral approaches have often been criticized for ignoring mental processes and focusing solely on observable behavior. However, these approaches provide an optimistic perspective for individuals seeking to change their behaviors. Rather than concentrating on intrinsic personality traits, behavioral approaches suggest that even longstanding habits can be modified by changing the reward contingencies that maintain them.
A real-world application of operant conditioning principles is applied...
A real-world application of operant conditioning principles is applied...
498
01:16Non-equilibrium in the Cell
5.2K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
5.2K
01:20Introduction to Cognitive Psychology
2.1K
Cognitive psychology is the field of psychology dedicated to examining how people think. It attempts to explain how and why we think the way we do by studying the interactions among human thinking, emotion, creativity, language, and problem-solving, as well as other cognitive processes. Cognitive psychology studies how information is processed and manipulated in remembering, thinking, and knowing.
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
2.1K