机器学习模型对具有许多特征的数据集的解释,使用特征重要性
1Department of Applied Chemistry, School of Science and Technology, Meiji University, 1-1-1 Higashi-Mita, Tama-ku, Kawasaki, Kanagawa 214-8571, Japan.
ACS omega
|July 3, 2023
概括
本研究引入了一种新的方法,通过分析特征的重要性和相似性来解释机器学习模型. 这种方法通过更有效地识别关键驱动因素,提高了模型的解释性,特别是许多特征.
科学领域:
- 机器学习 机器学习
- 数据科学数据科学数据科学
- 计算化学/材料科学 计算化学/材料科学
背景情况:
- 特性重要性 (FI) 对于解释机器学习模型 (y = f (x)) 是至关重要的.
- 当特征具有相似的重要程度时,仅基于FI的多个特征的解释模型变得效率低下.
研究的目的:
- 开发一种用于增强机器学习模型解释的新方法.
- 解决传统FI方法在处理多线性和众多特征时的无效性.
主要方法:
- 使用交叉验证的变换特征重要性 (CVPFI) 作为主要的FI指标.
- 使用绝对相关性和最大信息系数来量化特征相似性.
- 开发了基于帕雷托前线的解释策略,优先考虑高CVPFI和低特征相似性.
主要成果:
- 拟议的方法通过整合特征重要性和相似性,有效地解释机器学习模型.
- 确定了帕雷托前线作为模型解释的最佳区域,平衡高特征重要性与低特征冗余.
- 在现实世界的分子和材料数据集上证明了该方法的有效性.
结论:
- 这种新的方法显著提高了机器学习模型的可解释性.
- 这种方法提供了一个更强大的解释框架,特别是对于具有多对线性复杂数据集.
- 这些发现通过分子和材料科学数据分析的实际应用来验证.
更多相关视频
04:09Predicting Treatment Response to Image-Guided Therapies Using Machine Learning: An Example for Trans-Arterial Treatment of Hepatocellular Carcinoma
Published on: October 10, 2018
8.3K
07:15Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model
Published on: August 16, 2020
6.9K
相关概念视频
Weighted Mean
5.2K
While taking the arithmetic, geometric, or harmonic mean of a sample data set, equal importance is assigned to all the data points. However, all the values may not always be equally important in some data sets. An intrinsic bias might make it more important to give more weightage to specific values over others.
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
5.2K
Outliers and Influential Points
4.1K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
4.1K
Survival Tree
117
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
117
Expected Frequencies in Goodness-of-Fit Tests
2.6K
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n) to the number of categories (k).
2.6K
Machines
305
Machines are complex structures consisting of movable, pin-connected multi-force members that work together to transmit forces. One example of a machine is the cutting plier, which is used to cut wires by applying forces to its handles. When equal and opposite forces are exerted on the handles of the cutting plier, they cause the cutting edges to come together and apply equal and opposite reaction forces on the wire, which are greater than the applied forces.
A free-body diagram of the...
A free-body diagram of the...
305
Machines: Problem Solving I
357
A toggle clamp is a mechanical device commonly used for holding and clamping objects in various applications, such as woodworking, metalworking, and assembly operations. Consider a toggle clamp subjected to a force of 200 N at the handle. The vertical clamping force can be calculated, provided the dimensions of the toggle clamp are known.
The toggle clamp system is a machine structure consisting of movable, pin-connected multi-force members that form a stabilized system to transmit forces. The...
The toggle clamp system is a machine structure consisting of movable, pin-connected multi-force members that form a stabilized system to transmit forces. The...
357
