基于多目标进化神经架构的轻量级扩散模型
Yu Xue1, Chunxiao Jiao1, Yong Zhang2
1School of Computer and Software, Nanjing University of Information Science and Technology, Nanjing 210044, P. R. China.
International journal of neural systems
|August 29, 2025
概括
我们开发了基于多目标进化搜索 (LDMOES) 的轻量级扩散模型, 以创建高效的扩散模型. 在保持或提高图像生成质量的同时,LDMOES显著降低了计算成本.
科学领域:
- 人工智能
- 计算机视觉
- 机器学习
背景情况:
- 扩散模型在图像生成方面表现出色,但其计算成本高,推断时间长.
- 现有的加速方法主要集中在推断步骤上,忽视扩散模型架构优化.
- 优化扩散模型架构对于开发计算高效的生成模型至关重要.
研究的目的:
- 提出LDMOES (基于多目标进化搜索的轻量级扩散模型),这是设计高效的基于UNet的扩散模型的新框架.
- 利用多目标进化神经架构搜索和知识蒸来优化扩散模型架构.
- 在不影响图像生成质量的情况下降低扩散模型的计算复杂性.
主要方法:
- 实现了一个框架,将多目标进化神经架构的搜索与知识蒸结合起来.
- 在LDMOES中使用模块化搜索空间来解架构组件并提高搜索效率.
- 在CIFAR-10,Tiny-ImageNet,CelebA-HQ和LSUN-church等多种数据集上验证了拟议的方法.
主要成果:
- LDMOES在像素空间中的多重积累操作 (MAC) 减少了约40%,超过了教师模型.
- 在Tiny-ImageNet数据集上,该模型产生了高质量的图像,具有4.16的竞争性FID分数,显示出强烈的概括性.
- 在隐藏空间中,MAC减少了50%的性能损失,在LSUN-church上,计算成本减少了近60%.
结论:
- 通过多目标进化搜索和知识提炼,LDMOES有效设计了轻量级和高效的基于UNet的传播模型.
- 拟议的方法在像素和隐藏空间中显著降低了计算成本 (MAC),同时保持或提高了生成质量.
- LDMOES在各种数据集中表现出强大的有效性和可转移性,为高效的生成人工智能提供了有希望的方向.
相关概念视频
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
100
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
100
Multi-input and Multi-variable systems
149
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
149
Multicompartment Models: Overview
252
Multicompartment models are mathematical constructs that depict how drugs are distributed and eliminated within the body. They segment the body into several compartments, symbolizing various physiological or anatomical areas connected through drug transfer processes such as absorption, metabolism, distribution, and elimination.
These models offer a more comprehensive representation of drug behavior in the body than one-compartment models. They accommodate the complexity of drug distribution,...
These models offer a more comprehensive representation of drug behavior in the body than one-compartment models. They accommodate the complexity of drug distribution,...
252
Physiological Pharmacokinetic Models: Blood Flow-Limited Versus Diffusion-Limited Models
140
Physiological pharmacokinetic models, often called flow-limited or perfusion models, typically assume a swift drug distribution between tissue and venous blood, creating a rapid drug equilibrium. This premise is based on the idea that drug diffusion is extremely fast, and the cell membrane presents no barrier to drug permeation. In this scenario, where no drug binding occurs, the drug concentration in the tissue equals that of the venous blood leaving the tissue. This greatly simplifies the...
140
Maxwell-Boltzmann Distribution: Problem Solving
1.7K
Individual molecules in a gas move in random directions, but a gas containing numerous molecules has a predictable distribution of molecular speeds, which is known as the Maxwell-Boltzmann distribution, f(v).
This distribution function f(v) is defined by saying that the expected number N (v1,v2) of particles with speeds between v1 and v2 is given by
This distribution function f(v) is defined by saying that the expected number N (v1,v2) of particles with speeds between v1 and v2 is given by
1.7K
One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation
708
This lesson introduces two critical methods in pharmacokinetics, the Wagner-Nelson and Loo-Riegelman methods, used for estimating the absorption rate constant (ka) for drugs administered via non-intravenous routes. The Wagner-Nelson method relates ka to the plasma concentration derived from the slope of a semilog percent unabsorbed time plot. However, it is limited to drugs with one-compartment kinetics and can be impacted by factors like gastrointestinal motility or enzymatic degradation.
On...
On...
708


