基于变压器的多元化图像完成,减少了信息丢失
概括
本研究介绍了PUT,这是一个用于图像绘制的新型变压器框架. 它通过使用补丁令牌和未定量化特征来解决信息丢失,显著提高图像保真性和多样性.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
背景情况:
- 基于变压器的方法主导着绘画中的图像.
- 现有的方法由于下方采样和像素值量化而遭受信息损失.
研究的目的:
- 提出一个新的变压器框架,PUT,以减轻图像绘制中的信息丢失.
- 为了提高图像恢复任务中的图像保真性,多样性和可控性.
主要方法:
- 引入了基于补丁的自动编码器 (P-VQVAE) 来将图像转换为补丁令牌,避免了降低样本.
- 采用一个非量子化变压器,直接处理P-VQVAE编码器特征,绕过量子化.
- 嵌入了指导绘画的语义和结构条件.
主要成果:
- 在图像保真方面,PUT显著优于现有的基于变压器的方法.
- 与最先进的多元化 inpainting 方法相比,在像 ImageNet.Net 这样的大规模数据集上实现了优越的多样性和真实性.
结论:
- 拟议的PUT框架有效地解决了基于变压器的图像绘制中的信息丢失问题.
- PUT为高保真度图像恢复和生成提供了更强大,更可控的解决方案.
相关概念视频
Transformers
A device that transforms voltages from one value to another using induction is called a transformer. A transformer consists of two separate coils, or windings, wrapped around the same soft iron core. However, they are electrically insulated from each other.
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
Types Of Transformers
Transformers can provide desired voltages to a circuit by modifying the number of turns in the secondary windings.
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
Energy Losses in Transformers
In an ideal transformer, it is assumed that there are no energy losses, and, hence, all the power at the primary winding is transferred to the secondary winding. However, in reality, the transformers always have some energy losses, and, hence, the output power obtained at the secondary winding is less than the input power at the primary winding due to energy losses.
There are four main reasons for energy losses in transformers.
The first cause can be the high resistance of the copper windings...
There are four main reasons for energy losses in transformers.
The first cause can be the high resistance of the copper windings...
Reducing Line Loss
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss in...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss in...
Equivalent Circuits for Practical Transformers
The practical equivalent circuits of single-phase two-winding transformers exhibit significant deviations from their idealized versions due to the inherent properties of winding resistance and finite core permeability. These properties result in real and reactive power losses, affecting the transformer's performance. Understanding these deviations is crucial for designing more efficient transformers.
In a practical transformer, each winding exhibits resistance and leakage reactance. The winding...
In a practical transformer, each winding exhibits resistance and leakage reactance. The winding...
Transformers with Off-Nominal Turns Ratios
In scenarios involving parallel transformers with disparate ratings, developing per-unit models requires accommodating off-nominal turns ratios. This situation arises when the selected base voltages are not proportional to the transformer’s voltage ratings. Consider a transformer where the rated voltages are related by the term a. If the chosen voltage bases satisfy a relationship involving term b, term c is defined as the ratio of these bases. This ratio is then substituted into the rated...


