机器学习中的基于排名的可分解损失:一项调查
概括
本调查介绍了机器学习中的基于等级的可分解损失,区分了个人和总体损失. 它提供了一个新的分类学,并将这些必不可少的损失函数分类为更好的模型设计.
科学领域:
- 机器学习 机器学习
- 人工智能的人工智能
- 计算机科学 计算机科学
背景情况:
- 最近的研究强调了机器学习中个体和总损失函数之间的区别.
- 这两种损失类型都涉及将单个值汇总成一个单一的数值输出.
- 单个值的排名顺序对于设计有效的损失函数至关重要.
研究的目的:
- 在机器学习中系统地审查基于等级的可分解损失函数.
- 引入一种新的分类学来根据总和个体视角对损失函数进行分类.
- 确定用于构建这些损失的关键组件,特别是聚合器函数.
主要方法:
- 该研究提供了对基于等级的可分解损失的综合文献综述.
- 提出了一个新的分类学,将损失分为八个不同的组.
- 描述了基于等级的总和个人损失的一般公式.
主要成果:
- 损失函数根据其总和单个组件进行分类.
- 确定了聚合函数 (一种类型的集合函数) 的作用.
- 现有研究与拟议的分类学和框架相连.
结论:
- 基于等级的可分解损失为组织和设计机器学习模型提供了一个重要的范式.
- 拟议的分类学提供了该领域的结构化概述.
- 确定了未来的研究方向,解决了该领域尚未探索和新出现的问题.
相关概念视频
Ranks
265
Unlike parametric methods, nonparametric statistics are ideal for nominal and ordinal data, requiring fewer assumptions about the population's nature or distribution. This makes nonparametric methods easier to apply and interpret, as they do not depend on parameters like mean or standard deviation. One common approach in nonparametric analysis is to sort data according to a specific criterion. For instance, we might arrange weather data from hottest to coldest days in a month or rank cities...
265
Aggregates Classification
348
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
348
Survival Tree
115
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
115
Reducing Line Loss
174
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
174
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
81
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
81
Weighted Mean
5.2K
While taking the arithmetic, geometric, or harmonic mean of a sample data set, equal importance is assigned to all the data points. However, all the values may not always be equally important in some data sets. An intrinsic bias might make it more important to give more weightage to specific values over others.
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
5.2K


