使用运动线性扩散变压器进行一致和可控制的图像动画
IEEE transactions on pattern analysis and machine intelligence
|February 12, 2026
概括
MiraMo通过使用高效的线性注意力和运动残留学习来增强图像动画,以获得更流,更一致的视频. 这一框架加快了产生的速度,同时保持了高质量和控制.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 扩散模型具有先进的图像动画,但在外观一致性和运动平滑性方面仍然存在挑战.
- 当前的图像动画方法经常使用U-Net扩散模型,这些模型不如基于变压器的文本到视频 (T2V) 模型先进.
- 在"变形金刚"中,香草的自我注意力导致了高的计算成本,限制了图像动画的效率.
研究的目的:
- 介绍MiraMo,一个用于高效,一致和流的图像动画的框架.
- 解决现有的扩散模型在外观一致性和运动控制方面的局限性.
- 为了提高图像动画生成的计算效率.
主要方法:
- 采用文本到视频架构,以高效的线性注意力而不是香草的自我注意力.
- 引入了一种运动残留学习范式,以建模运动动态,以获得更好的时间一致性.
- 利用基于DCT的噪音精细化策略和动态控制模块来抑制工件和运动控制.
主要成果:
- 与最先进的方法相比,MiraMo在生成一致和流的动画方面表现出卓越的性能.
- 该框架实现了加速推断速度,减少了计算开销.
- 实验证实了MiraMo在移动传输和视频编辑任务中的有效性.
结论:
- 米拉莫为高质量的图像动画提供了一种高效和有效的解决方案.
- 该框架成功地提高了外观的一致性,运动流性和可控性.
- MiraMo代表了基于扩散的图像动画技术的重大进步.
相关概念视频
01:26Application of Antiderivatives: Linear Motion
65
A derivative describes how one quantity changes with respect to another, such as how velocity changes over time. The reverse process, which recovers a quantity from its rate of change, is known as integration. In physics, integration is fundamental because it links related physical quantities, allowing acceleration, velocity, and displacement to be understood as connected aspects of motion.Consider a car traveling at a steady speed of 20 meters per second when an obstacle appears 800 meters...
65
01:13Linear Momentum in Control Volume
1.3K
Newton's second law is applied to obtain the linear momentum in a control volume in a fluid system. According to this law, the rate of change of linear momentum is equal to the sum of external forces acting on the system. When a control volume matches the fluid system at a specific moment, the forces acting on both are identical. Reynolds transport theorem helps explain this by breaking down the system's linear momentum into two components: the rate of change of linear momentum within...
1.3K
01:12Diffusion
222.0K
Diffusion is the passive movement of substances down their concentration gradients—requiring no expenditure of cellular energy. Substances, such as molecules or ions, diffuse from an area of high concentration to an area of low concentration in the cytosol or across membranes. Eventually, the concentration will even out, with the substance moving randomly but causing no net change in concentration. Such a state is called dynamic equilibrium, which is essential for maintaining overall...
222.0K
01:21Diffusion
6.7K
Diffusion is a type of passive transport. In passive transport, a substance tends to move from an area of high concentration to an area of low concentration until the concentration is equal across the space. For example, take the diffusion of substances through the air. When someone opens a perfume bottle in a room filled with people, the perfume is at its highest concentration in the bottle and is at its lowest at the edges of the room. The perfume vapor will diffuse, or spread away, from the...
6.7K
01:33Bacterial Transformation
60.2K
In 1928, bacteriologist Frederick Griffith worked on a vaccine for pneumonia, which is caused by Streptococcus pneumoniae bacteria. Griffith studied two pneumonia strains in mice: one pathogenic and one non-pathogenic. Only the pathogenic strain killed host mice.
Griffith made an unexpected discovery when he killed the pathogenic strain and mixed its remains with the live, non-pathogenic strain. Not only did the mixture kill host mice, but it also contained living pathogenic bacteria that...
Griffith made an unexpected discovery when he killed the pathogenic strain and mixed its remains with the live, non-pathogenic strain. Not only did the mixture kill host mice, but it also contained living pathogenic bacteria that...
60.2K
01:27Linear Equations
503
Linear equations form the foundation of many algebraic and real-world applications, characterized by their simplicity and utility. A linear equation is an algebraic statement in which each term is either a constant or a product of a constant and a single variable. These equations represent straight lines when plotted on a Cartesian coordinate plane, reflecting a constant rate of change between two quantities.A typical linear equation in one variable has the form: ax + b = c, where a, b, and c...
503