相关实验视频
Updated: Jul 13, 2025

04:48
Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique
Published on: July 5, 2024
439
在资源受限制的联合学习系统中,分化和征服NAS拼图
Yeshwanth Venkatesha1, Youngeun Kim1, Hyoungseob Park1
1Department of Electrical Engineering, Yale University, New Haven, CT, USA.
概括
联合学习 (FL) 使用DC-NAS有效地设计神经架构. 这种方法可以减少50%的资源需求,同时在分布式机器学习系统中保持高精度.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 分布式系统 分布式系统
背景情况:
- 联合学习 (FL) 能够在边缘设备上实现保护隐私的机器学习.
- 在FL系统中设计高效的神经架构仍然是一个挑战.
- 当前的方法往往忽视了联邦神经架构搜索中的整体系统效率.
研究的目的:
- 提出DC-NAS,一种新的分裂与征服方法,用于在联合环境中高效的神经架构搜索 (NAS).
- 引入多元化的采样策略,平衡勘探和开发,以系统地搜索空间采样.
- 通过通道修剪,减少边缘设备的计算复杂性.
主要方法:
- 在一个联合系统中实现基于超级网络的NAS.
- 使用一种新的多元化采样策略,可以动态调整采样距离.
- 应用通道修剪来降低设备上的训练复杂性.
- 在CIFAR10,CIFAR100,EMNIST和TinyImagenet基准上评估业绩.
主要成果:
- DC-NAS的性能优于现有的采样策略,包括哈达马德采样.
- 展示了FL中可扩展性和非IID数据处理的全面分析.
- 与全规模的联合NAS相比,实现了接近单独的准确性.
- 减少了50%的资源需求.
结论:
- 在联合学习中,DC-NAS为神经架构设计提供了一个高效的解决方案.
- 拟议的采样策略和道修剪显著提高了系统效率.
- 这种方法为在资源有限的联合环境中部署NAS提供了一种实用的方法.
相关概念视频
Distributed Loads: Problem Solving
652
Beams are structural elements commonly employed in engineering applications requiring different load-carrying capacities. The first step in analyzing a beam under a distributed load is to simplify the problem by dividing the load into smaller regions, which allows one to consider each region separately and calculate the magnitude of the equivalent resultant load acting on each portion of the beam. The magnitude of the equivalent resultant load for each region can be determined by calculating...
652
Machines: Problem Solving II
316
Machines are complex structures consisting of movable, pin-connected multi-force members that work together to transmit forces. Consider a lifting tong carrying a 100 kg load. It comprises movable sections DAF and CBG linked together with member AB.
316
Extraction: Partition and Distribution Coefficients
2.5K
The distribution law or Nernst's distribution law is the law that governs the distribution of a solute between two immiscible solvents. This law, also known as the partition law, states that if a solute is added to the mixture of two immiscible solvents at a constant temperature, the solute is distributed between the two solvents in such a way that the ratio of solute concentrations in the solvents remains constant at equilibrium.
For extracting a solute from an aqueous phase into an...
For extracting a solute from an aqueous phase into an...
2.5K
Machines: Problem Solving I
337
A toggle clamp is a mechanical device commonly used for holding and clamping objects in various applications, such as woodworking, metalworking, and assembly operations. Consider a toggle clamp subjected to a force of 200 N at the handle. The vertical clamping force can be calculated, provided the dimensions of the toggle clamp are known.
The toggle clamp system is a machine structure consisting of movable, pin-connected multi-force members that form a stabilized system to transmit forces. The...
The toggle clamp system is a machine structure consisting of movable, pin-connected multi-force members that form a stabilized system to transmit forces. The...
337
Collisions in Multiple Dimensions: Problem Solving
4.2K
In multiple dimensions, the conservation of momentum applies in each direction independently. Hence, to solve collisions in multiple dimensions, we should write down the momentum conservation in each direction separately. To help understand collisions in multiple dimensions, consider an example.
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
4.2K
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
62
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
62

