DyDiT++:具有时间步和空间动态的扩散变压器,用于高效的视觉生成
IEEE transactions on pattern analysis and machine intelligence
|January 15, 2026
概括
动态扩散变压器 (DyDiT) 通过动态调整计算来降低视觉生成中的计算成本. 这种新的方法加速了像DiT这样的扩散模型,提高了包括文本到图像和视频生成在内的任务的效率.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 扩散模型,特别是扩散变压器 (DiT),在视觉生成方面表现出色,但会产生高的计算成本.
- 当前模型中的静态推理导致跨时间阶段和空间区域的冗余计算.
研究的目的:
- 开发一个动态扩散变压器 (DyDiT),优化视觉生成中的计算效率.
- 在时间和空间两个维度上引入计算的动态调整方法.
主要方法:
- 提议的时间步骤智能动态宽度 (TDW) 根据生成时间步骤调整模型宽度.
- 引入了空间智能动态令牌 (SDT),以消除不必要的空间区域中的冗余计算.
- 开发了DyDiT++,包括流量匹配,视频生成,文本到图像生成和参数有效训练 (TD-LoRA).
主要成果:
- 通过减少冗余计算,DyDiT显著加快了生成过程.
- 通过加速流量匹配生成和增强复杂的视觉任务,DyDiT++展示了多功能性.
- 使用TD-LoRA进行参数高效的微调,可以实现显著的FLOP减少 (<3%的微调代) 和DiT XL的硬件加快 (1.73x),具有竞争力的FID分数 (2.07在ImageNet上).
结论:
- DyDiT和DyDiT++为基于扩散的视觉生成提供了大量的计算节省和加快速度.
- 动态方法在各种视觉生成任务和模型架构中提高了效率.
- 参数效率培训民主化了对先进视觉生成技术的访问.
相关概念视频
01:27Transformers in Distribution System
498
Transformers in distribution systems can be broadly categorized into distribution substation transformers and other distribution transformers. They are crucial for stepping down high transmission voltages to levels suitable for distribution and end-user applications.
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
498
01:24Fast Decoupled and DC Powerflow
726
The fast decoupled power flow method addresses contingencies in power system operations, such as generator outages or transmission line failures. This method provides quick power flow solutions, essential for real-time system adjustments. Fast decoupled power flow algorithms simplify the Jacobian matrix by neglecting certain elements, leading to two sets of decoupled equations:
726
01:12Diffusion
216.3K
Diffusion is the passive movement of substances down their concentration gradients—requiring no expenditure of cellular energy. Substances, such as molecules or ions, diffuse from an area of high concentration to an area of low concentration in the cytosol or across membranes. Eventually, the concentration will even out, with the substance moving randomly but causing no net change in concentration. Such a state is called dynamic equilibrium, which is essential for maintaining overall...
216.3K
01:24Rapidly Varying Flow
451
Rapidly varying flow (RVF) in open channels is characterized by abrupt changes in flow depth over a short distance, with the rate of depth change relative to distance often approaching unity. These flows are inherently complex due to their transient and multi-dimensional nature, making exact analysis difficult. However, approximate solutions using simplified models provide valuable insights into their behavior.Key Features of Rapidly Varying FlowRVF is commonly observed in scenarios involving...
451
01:25Transformers with Off-Nominal Turns Ratios
523
In scenarios involving parallel transformers with disparate ratings, developing per-unit models requires accommodating off-nominal turns ratios. This situation arises when the selected base voltages are not proportional to the transformer’s voltage ratings. Consider a transformer where the rated voltages are related by the term a. If the chosen voltage bases satisfy a relationship involving term b, term c is defined as the ratio of these bases. This ratio is then substituted into the...
523
01:18Uniform Depth Channel Flow: Problem Solving
434
To calculate the flow rate for a trapezoidal channel, first, identify the bottom width, side slope, and flow depth of the channel. The cross-sectional area (A) corresponding to the depth of flow (y), channel bottom width (B), and side slope (θ) is determined by:Next, calculate the wetted perimeter, which includes the bottom width and the sloped side lengths in contact with the water. Using the values of the cross-sectional area and the wetted perimeter, determine the hydraulic radius by...
434