扩散概率模型用于视频生成
Ruihan Yang1, Prakhar Srivastava1, Stephan Mandt1
1Department of Computer Science, University of California, Irvine, CA 92697, USA.
Entropy (Basel, Switzerland)
|October 28, 2023
概括
否认扩散的概率模型现在产生高质量的视频,优于以前的方法. 这种新模型可以提高序列视频生成和预测准确度,以增强视觉内容.
科学领域:
- 人工智能的人工智能
- 计算机视觉 计算机视觉
- 机器学习 机器学习
背景情况:
- 否认扩散概率模型 (DDPMs) 代表了生成建模的重大进步,特别是在高保真图像合成方面.
- 现有的生成模型在准确预测视频序列中的未来时面临挑战.
研究的目的:
- 引入和评估一个自行回归的,端到端优化的视频传播模型,用于连续的视频生成.
- 为了提高产生的视频的感知质量和概率预测准确性.
主要方法:
- 拟议的模型通过通过反向扩散过程的随机余量来改进决定性预测来生成未来的视频.
- 这种方法受到神经视频压缩技术近期创新的启发.
- 该模型在四个不同的数据集上进行了训练和评估,包括自然和基于模拟的视频.
主要成果:
- 在所有测试的数据集中,视频传播模型在与六种已确定的基线方法相比显示出更高的性能.
- 在生成的视频的感知质量和其概率框架预测能力方面都观察到显著的改进.
- 该模型在关键的感知和概率预测指标方面成功超越了先前的方法.
结论:
- 拟议的自回归视频传播模型为高质量,顺序的视频生成提供了一种强大的新方法.
- 这种方法推进了视频预测和生成建模的最新技术,显示了各种应用的前景.
- 这些发现突出了扩散模型在复杂的视频合成任务中的潜力.
更多相关视频
00:10Single-Molecule Tracking Microscopy - A Tool for Determining the Diffusive States of Cytosolic Molecules
Published on: September 5, 2019
8.3K
12:15Image Processing Protocol for the Analysis of the Diffusion and Cluster Size of Membrane Receptors by Fluorescence Microscopy
Published on: April 9, 2019
8.8K
相关概念视频
Diffusion
193.0K
Diffusion is the passive movement of substances down their concentration gradients—requiring no expenditure of cellular energy. Substances, such as molecules or ions, diffuse from an area of high concentration to an area of low concentration in the cytosol or across membranes. Eventually, the concentration will even out, with the substance moving randomly but causing no net change in concentration. Such a state is called dynamic equilibrium, which is essential for maintaining overall...
193.0K
Poisson Probability Distribution
8.2K
A Poisson probability distribution is a discrete probability distribution. It gives the probability of a number of events occurring in a fixed interval of time or space if these events happen at a known average rate and independently of the time since the last event. For example, a book editor might be interested in the number of words spelled incorrectly in a particular book. It might be that, on average, there are five words spelled incorrectly in 100 pages. The interval is 100 pages.
The...
The...
8.2K
Probability Distributions
7.2K
The probability of a random variable x is the likelihood of its occurrence. A probability distribution represents the probabilities of a random variable using a formula, graph, or table. There are two types of probability distribution– discrete probability distribution and continuous probability distribution.
A discrete probability distribution is a probability distribution of discrete random variables. It can be categorized into binomial probability distribution and Poisson...
A discrete probability distribution is a probability distribution of discrete random variables. It can be categorized into binomial probability distribution and Poisson...
7.2K
Random Variables
12.3K
A random variable is a single numerical value that indicates the outcome of a procedure. The concept of random variables is fundamental to the probability theory and was introduced by a Russian mathematician, Pafnuty Chebyshev, in the mid-nineteenth century.
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...
12.3K
Distribution and Dispersion
21.8K
To understand intra-specific interactions in populations, scientists measure the spatial arrangement of species individuals. This geographic arrangement is known as the species distribution or dispersion. Highly territorial species exhibit a uniform distribution pattern, in which individuals are spaced at relatively equal distances from one another. Species that are highly tied to particular resources, such as food or shelter, tend to concentrate around those resources, and thus exhibit a...
21.8K
Mutation, Gene Flow, and Genetic Drift
58.5K
In a population that is not at Hardy-Weinberg equilibrium, the frequency of alleles changes over time. Therefore, any deviations from the five conditions of Hardy-Weinberg equilibrium can alter the genetic variation of a given population. Conditions that change the genetic variability of a population include mutations, natural selection, non-random mating, gene flow, and genetic drift (small population size).
58.5K
