减少老化的小批量K-Means.
概括
减少老化的小批量k-means (srmbatch km) 提供了比标准的小批量k-means更快的融合和更高质量的集群. 这种新的算法实现了低计算成本,同时保持了出色的集群性能.
科学领域:
- 计算机科学 计算机科学
- 数据科学数据科学数据科学
- 机器学习 机器学习
背景情况:
- K-means (km) 是一个受欢迎的集群算法,以其简单性和质量而闻名.
- 标准公里面临着高计算复杂性和长时间处理的挑战.
- 迷你批量公里 (mbatch km) 通过使用数据子集来提高速度,但可以减少因代老化而导致的融合质量.
研究的目的:
- 为了引入一个新的算法,衰老减小批量k-means (srmbatch km).
- 将mbatch km的计算效率与标准km的高集群质量相结合.
- 开发一个适合多核CPU和多核GPU的可扩展算法.
主要方法:
- 拟议的衰老降低迷你批次k-means (srmbatchkm) 算法.
- 实现利用大规模并行性,在多核CPU和GPU上高效执行.
- 与标准k-平均值和小批量k-平均值进行比较分析.
主要成果:
- 与标准公里相比,srmbatch km显著降低了计算成本.
- srmbatch km显示了更快的收,比mbatch km提高了40x-130x的速度,相当于目标损失.
- 与mbatch km相比,srmbatch km实现了较低的最终损失 (0.2%-1.7%),这表明集群质量得到了改善.
结论:
- srmbatch km有效地解决了小型批量k-means中的速度和质量之间的权衡.
- 该算法为现代硬件上的大规模集群任务提供了实用解决方案.
- srmbatch km代表了高效和高质量的集群的重大进步.
相关概念视频
Cluster Sampling Method
12.0K
Appropriate sampling methods ensure that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
12.0K
One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation
587
This lesson introduces two critical methods in pharmacokinetics, the Wagner-Nelson and Loo-Riegelman methods, used for estimating the absorption rate constant (ka) for drugs administered via non-intravenous routes. The Wagner-Nelson method relates ka to the plasma concentration derived from the slope of a semilog percent unabsorbed time plot. However, it is limited to drugs with one-compartment kinetics and can be impacted by factors like gastrointestinal motility or enzymatic degradation.
On...
On...
587
Stratified Sampling Method
12.1K
Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. The sampling method ensures that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a stratified sample, divide the population into groups called strata and then take a...
To choose a stratified sample, divide the population into groups called strata and then take a...
12.1K
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
84
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
84
Noncompartmental Analysis: Mean Residence Time
202
According to statistical moment theory, mean residence time (MRT) is an important measure in pharmacokinetics. MRT can be defined as the expected mean of a probability density function distribution. It provides valuable insights into drug disposition in the body.
After the administration of a drug through intravenous bolus injection, the drug molecules are distributed throughout the body and remain there for varying periods. The MRT represents the average time these drug molecules stay in the...
After the administration of a drug through intravenous bolus injection, the drug molecules are distributed throughout the body and remain there for varying periods. The MRT represents the average time these drug molecules stay in the...
202
One-Way ANOVA: Equal Sample Sizes
3.3K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
3.3K


