DH-MSVM:一种混合算法,用于在分布式学习中寻找质量支持向量
Jiawen Gong1, Beihao Xia1, Qinmu Peng1
1School of Electronic Information and Communications, Huazhong University of Science and Technology, Wuhan, 430074, China.
概括
本研究介绍了用于支持矢量机器 (DH-SVM) 的新型分布式混合学习方法,以解决机器学习中的数据异质性. 增强的DH-MSVM算法改善了支矢量选择和决策边界适应,以获得更好的性能.
科学领域:
- 机器学习 机器学习
- 分布式计算 (Distributed Computing) 是一种分布式计算.
- 数据科学数据科学数据科学
背景情况:
- 数据异质性在分布式机器学习中是一个重大挑战.
- 现有的分布式支持向量机器 (DSVM) 难以在各种数据结构中识别最佳支持向量,阻碍了动态决策边界调整.
研究的目的:
- 提出基于支持矢量机器 (DH-SVM) 的新型分布式混合学习,以解决数据异质性问题.
- 通过马尔科夫采样来增强DH-SVM算法,以提高计算效率和稳定性 (DH-MSVM).
主要方法:
- 利用全球预学习来捕获数据结构信息以指导本地学习.
- 整合马尔科夫抽样 (DH-MSVM) 来管理分布式学习中的计算开销.
- 使用均的ergodic马尔科夫链样本来理论推导泛化边界.
主要成果:
- 拟议的DH-SVM和DH-MSVM算法有效地识别了更高质量的支持向量.
- 实现了决策边界的自适应性改进,改善了模型性能.
- 理论分析证实了快速的学习速度,证明了强度和可扩展性.
结论:
- DH-SVM 方法,特别是 DH-MSVM 增强,为处理分布式机器学习中的数据异质性提供了优质的解决方案.
- 这些算法展示了通过对现实世界数据集的广泛实证实验验证的改进的性能和可扩展性.
相关概念视频
01:21Distributed Loads: Problem Solving
1.1K
Beams are structural elements commonly employed in engineering applications requiring different load-carrying capacities. The first step in analyzing a beam under a distributed load is to simplify the problem by dividing the load into smaller regions, which allows one to consider each region separately and calculate the magnitude of the equivalent resultant load acting on each portion of the beam. The magnitude of the equivalent resultant load for each region can be determined by calculating...
1.1K
01:20Cluster Sampling Method
14.0K
Appropriate sampling methods ensure that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
14.0K
01:29Distance Problem
32
When an object's velocity changes over time, the total distance traveled can be determined by summing small displacement intervals over short increments. This approach approximates the true distance through numerical summation and the use of integral calculus. An estimate of the total displacement can be obtained by measuring velocity at regular intervals and multiplying each value by the corresponding time step.If a runner accelerates over the first three seconds of a race, speed measurements...
32
01:25Distribution Reliability and Automation
498
Distribution reliability in electrical power systems is critical for ensuring an uninterrupted power supply to consumers at minimal cost. According to IEEE Standard Terms, reliability is the probability that a device will function without failure over a specified time period or amount of usage. For electric power distribution, this translates to maintaining continuous power supply and addressing customer concerns over power outages. Several indices, as defined by IEEE Standard 1366-2012, are...
498
01:08Vector Algebra: Method of Components
18.8K
It is cumbersome to find the magnitudes of vectors using the parallelogram rule or using the graphical method to perform mathematical operations like addition, subtraction, and multiplication. There are two ways to circumvent this algebraic complexity. One way is to draw the vectors to scale, as in navigation, and read approximate vector lengths and angles (directions) from the graphs. The other way is to use the method of components.
In many applications, the magnitudes and directions of...
In many applications, the magnitudes and directions of...
18.8K
01:19Distributed Loads
950
Distributed loads are a common type of load that engineers and scientists encounter in various practical situations. Distributed loads often refer to a type of load spread over a surface or a structure and can be modeled as continuous force per unit area.
For example, consider a bookshelf filled with books stacked vertically adjacent to each other. The weight of the books is evenly distributed over the length of the shelf. As a result, the pressure at different locations on the surface of the...
For example, consider a bookshelf filled with books stacked vertically adjacent to each other. The weight of the books is evenly distributed over the length of the shelf. As a result, the pressure at different locations on the surface of the...
950