学习自我成长地图,用于快速准确的不平衡流数据集群
概括
本研究引入了一种新的流数据集群方法,有效地处理动态集群不平衡. 自成长地图引导的层次融合 (SOHI) 方法确保准确有效地分析不断变化的数据分布.
科学领域:
- 数据挖掘 数据挖掘
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 流数据分析由于动态集群不平衡而带来挑战,集群不平衡比率 (IR) 随着时间的推移而变化.
- 这种不平衡可能会对传统流数据集群算法的准确性和效率产生负面影响.
- 现有的方法很难适应不断变化的数据分布,并保持性能.
研究的目的:
- 开发一个准确和高效的流数据集群方法,适应动态和不平衡的集群分布.
- 解决当前方法在处理不断变化的数据和保持性能方面的局限性.
- 提出一种能够逐步适应和准确识别不平衡集群的新算法.
主要方法:
- 一个自我生长的地图 (SGM) 旨在根据局部数据分布动态地排列神经元,从而实现快速的增量适应.
- SGM利用密度敏感的神经元来捕捉全球分布,并防止在不平衡的数据集中省略小集群.
- 开发了一种快速的等级合并 (HM) 策略,利用SGM有效地检索集群内部分布对,避免计算上昂贵的全球搜索.
主要成果:
- 拟议的SGM展示了在流媒体环境中对新数据块的增量适应能力.
- 不平衡数据集群 (SOHI) 方法的自我增长地图引导的等级合并有效地确定了不平衡集群的真实数量.
- 广泛的实验证实,SOHI在探索流数据的集群分布方面实现了高效率和准确性.
结论:
- 在实时流媒体场景中,SGM有效地管理不断变化的数据分布.
- SOHI提供了一个强大的解决方案,可以准确有效地聚类不平衡的流媒体数据.
- 开发的方法显著推进了动态和不平衡数据集的数据挖掘领域.
相关概念视频
Cluster Sampling Method
11.6K
Appropriate sampling methods ensure that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
11.6K
Survival Tree
48
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
48
Time-Series Graph
4.3K
A time-series graph is a line graph with repeated measurements taken at successive intervals of time. It is also called a time series chart. To construct a time-series graph, one must look at both pieces of a paired data set. The horizontal axis is used to plot the time increments, and the vertical axis is used to plot the values of the variable that one is measuring. By using the axes in this way, each point on the graph will correspond to time and a measured quantity. The points on the graph...
4.3K
Outliers and Influential Points
3.9K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
3.9K
Scatter Plot
6.7K
The most common and easiest way to display the relationship between two variables, x and y, is a scatter plot. A scatter plot shows the direction of a relationship between the variables. A clear direction happens when there is either:
6.7K
Kaplan-Meier Approach
71
The Kaplan-Meier estimator is a non-parametric method used to estimate the survival function from time-to-event data. In medical research, it is frequently employed to measure the proportion of patients surviving for a certain period after treatment. This estimator is fundamental in analyzing time-to-event data, making it indispensable in clinical trials, epidemiological studies, and reliability engineering. By estimating survival probabilities, researchers can evaluate treatment effectiveness,...
71


