GammaGAN:用于条件视频生成的玛级类嵌入
Minjae Kang1, Yong Seok Heo1,2
1Department of Electrical and Computer Engineering, Ajou University, Suwon 16499, Republic of Korea.
Sensors (Basel, Switzerland)
|October 14, 2023
概括
GammaGAN通过投影和规范化有效使用类标签来改善条件视频生成. 这种新的方法可以从单个图像中提高视频质量,优于现有的方法.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 从带有类标签的单个图像生成有条件的视频具有挑战性.
- 传统的条件生成对抗网络 (cGAN) 难以有效地利用类标签.
研究的目的:
- 提出GammaGAN,一种用于改进条件视频生成的新型模型.
- 增强类标签在生成对抗网络中的使用,用于视频合成.
主要方法:
- 开发了两个流的GammaGAN:一个类嵌入流和一个数据流.
- 采用投影方法,以有效地利用类标签.
- 引入了类嵌入的缩放和数据流输出的规范化,以平衡特征向量和类信息.
主要成果:
- 与之前的模型相比,GammaGAN显示了更好的视频质量.
- 在MUG面部表情数据集上,在PSNR实现了1.61%,在SSIM达到1.66%,在LPIPS达到0.36%的相对改善.
- 规范化技术有效地平衡了特征向量和类嵌入的影响.
结论:
- 拟议的GammaGAN模型显著推进了条件视频生成.
- 该方法对未来研究产生高质量的视频从类条件输入有希望.
- 有效的类标签集成对于可信的视频合成至关重要.
相关概念视频
01:29Aggregates Classification
329
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
329
01:09Random Variables
12.3K
A random variable is a single numerical value that indicates the outcome of a procedure. The concept of random variables is fundamental to the probability theory and was introduced by a Russian mathematician, Pafnuty Chebyshev, in the mid-nineteenth century.
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...
12.3K
01:03Prediction Intervals
2.3K
The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
2.3K
01:12Observational Learning
190
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
190
01:22Force Classification
1.2K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.2K
01:26Per-Unit Sequence Models
78
An ideal Y-Y transformer, grounded through neutral impedances, displays per-unit sequence networks akin to those of a single-phase ideal transformer when subjected to balanced positive- or negative-sequence currents. These currents do not produce neutral currents, and their associated voltage drops.
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
78