关于多个内核集群的一致性和大规模扩展
概括
本研究分析了多个内核聚类 (MKC) 算法的内核权重的一致性,并介绍了一个可扩展的单值分解 (SVD) 方法. 新方法提高了理论理解,并有效地处理大型数据集.
科学领域:
- 机器学习 机器学习
- 数据挖掘 数据挖掘
- 计算统计学 计算统计学
背景情况:
- 多重内核聚类 (MKC) 算法面临着对大型数据集内核重量一致性和计算复杂性的理论分析的挑战.
- 现有的MKC方法往往缺乏严格的理论保证,特别是关于已学习的内核重量的趋同和稳定性.
- 高计算复杂性限制了当前MKC算法的适用于大规模数据集的适用性,阻碍了实际采用.
研究的目的:
- 为多个内核k-Means (简单MKKM) 中的内核权重的一致性提供理论分析.
- 开发一个MKC算法的计算效率高的扩展,用于处理大规模数据集.
- 通过经验评估来验证所提出方法的理论发现和实际性能.
主要方法:
- 简单MKKM内核权重的一致性分析,确定学习和预期权重之间的差异的上限 (~O(1/√n)).
- 基于一致性分析的过度集群风险的推导.
- 修改SimpleMKKM,用Singular Value Decomposition (SVD) 取代固有分解,以将计算复杂度降低到O(n).
主要成果:
- 为SimpleMKKM建立了内核重量一致性的理论界限,为理解其行为提供了基础.
- 证明基于SVD的扩展显著降低了计算复杂性,使大数据集具有可扩展性.
- 实验结果证实,基于SVD的MKC方法在理论性质和实际性能方面优于现有方法.
结论:
- 提出的理论分析为MKC算法中内核权重的一致性提供了新的见解.
- 基于SVD的MKC方法有效地解决了可扩展性问题,使高级集群技术适用于更大的数据集.
- 结合理论和实践的进步使新方法成为复杂的集群任务的有希望的解决方案.
相关概念视频
Cluster Sampling Method
11.9K
Appropriate sampling methods ensure that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
11.9K
Multiple Regression
3.0K
Multiple regression assesses a linear relationship between one response or dependent variable and two or more independent variables. It has many practical applications.
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
3.0K
Kendall's Coefficient of Concordance
330
Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects...
330
Distribution Reliability and Automation
107
Distribution reliability in electrical power systems is critical for ensuring an uninterrupted power supply to consumers at minimal cost. According to IEEE Standard Terms, reliability is the probability that a device will function without failure over a specified time period or amount of usage. For electric power distribution, this translates to maintaining continuous power supply and addressing customer concerns over power outages. Several indices, as defined by IEEE Standard 1366-2012, are...
107
Classification of Systems-II
144
Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,
144
Multicompartment Models: Overview
139
Multicompartment models are mathematical constructs that depict how drugs are distributed and eliminated within the body. They segment the body into several compartments, symbolizing various physiological or anatomical areas connected through drug transfer processes such as absorption, metabolism, distribution, and elimination.
These models offer a more comprehensive representation of drug behavior in the body than one-compartment models. They accommodate the complexity of drug distribution,...
These models offer a more comprehensive representation of drug behavior in the body than one-compartment models. They accommodate the complexity of drug distribution,...
139


