使用增强的GAN生成文本到图像:使用RNN和CNN弥合语义差距
Sadia Ramzan1, Hafiz Arslan Ramzan2, Tehmina Kalsum3
1Department of Computer Science, Emerson University, Multan, Pakistan.
PloS one
|January 21, 2026
概括
本研究介绍了一种用于文本到图像生成的新型神经网络模型,利用生成对抗网络 (GAN) 与循环神经网络 (RNN) 和卷积神经网络 (CNN) 来从文本描述中创建现实的图像.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 文本到图像生成旨在从文本描述中创建现实的图像.
- 在生成的图像中实现一致的现实主义仍然是一个重大挑战.
研究的目的:
- 提出一种基于神经网络的模型,用于从文本中生成高质量的图像.
- 评估模型在标准和修改数据集上的性能.
主要方法:
- 采用了生成对抗网络 (GAN) 框架,整合了用于文字处理的循环神经网络 (RNN) 和用于图像特征提取的卷积神经网络 (CNN).
- 该模型在牛津102花数据集和修改版牛津102花 (β) 上进行了训练,分辨率高达256x256.
- 计算了发电机和区分器的损失,并使用Inception Score和峰值信号对噪声比 (PSNR) 来评估性能.
主要成果:
- 该模型在原始数据集上获得了4.15 (64x64分辨率) 的初始分数,在修改后的数据集上获得了3.97 (128x128分辨率).
- 在原始和注释数据集上分别记录了28.25 dB和30.12 dB的PSNR值.
- 与现有模型相比,拟议的方法表明了优越的性能.
结论:
- 开发的神经网络模型有效地从文本描述中生成现实的图像.
- 该模型在标准和增强数据集上都显示出有希望的结果,性能优于现有方法.
- 进一步的研究可以探索更高分辨率和多样化的数据集.
更多相关视频
08:17A Semantic Priming Event-related Potential ERP Task to Study Lexico-semantic and Visuo-semantic Processing in Autism Spectrum Disorder
Published on: April 12, 2018
11.1K
10:32Using Q Suture to Enhance Resistance to Gap Formation and Tensile Strength of Repaired Flexor Tendons
Published on: June 3, 2020
6.3K
相关概念视频
Design Example: Strain Gauge Bridge or Wheatstone Bridge
977
The utilization of strain gauges as transducers for converting mechanical strain into electrical signals is a common practice in various engineering applications. These strain gauges are frequently integrated into Wheatstone bridge circuits to accurately measure parameters such as force or pressure. Within this context, each element within the circuit exhibits a resistance that undergoes subtle variations when subjected to mechanical strain. The primary objective is to convert minuscule...
977
Bridge rectifier
1.5K
The bridge rectifier is essential in electronics for efficiently converting alternating current (AC) to direct current (DC). Comprised of four diodes configured in a bridge layout, this rectifier effectively processes both the positive and negative halves of the AC waveform, making it superior to half-wave and full-wave center-tapped rectifiers in terms of voltage regulation and output stability.
Operationally, the bridge rectifier allows current flow through two of its diodes during each...
Operationally, the bridge rectifier allows current flow through two of its diodes during each...
1.5K
Wheatstone Bridge
1.2K
An ohmmeter is a resistance-measuring device. It works by applying a voltage to a resistor of unknown resistance and measuring the current across the resistor. The resistance value is deduced using Ohm's law. Usually, the standard configuration of an ohmmeter comprises a voltmeter or an ammeter. However, such configurations are limited in accuracy because the meters alter the voltage applied to the resistor and the current that flows through it.
Thus, for accurate resistance measurements, a...
Thus, for accurate resistance measurements, a...
1.2K
Gap Junctions
57.0K
Multicellular organisms employ a variety of ways for cells to communicate with each other. Gap junctions are specialized proteins that form pores between neighboring cells in animals, connecting the cytoplasm between the two, and allowing for the exchange of molecules and ions. They are found in a wide range of invertebrate and vertebrate species, mediate numerous functions including cell differentiation and development, and are associated with numerous human diseases, including cardiac and...
57.0K
Gap Junctions
9.4K
The cytoplasm of adjacent animal cells can exchange small molecules, ions, and secondary messengers via the communication channels which form the gap junctions. These junctions comprise a few hundred to thousands of molecular channels, each made of two halves, called the connexon hemichannel. A connexon is a hexamer of six transmembrane connexin proteins, which assemble radially, thus forming a pore or channel in the center. One connexon hemichannel docks with a corresponding connexon on the...
9.4K
Cross-bridge Cycle
122.4K
As muscle contracts, the overlap between the thin and thick filaments increases, decreasing the length of the sarcomere—the contractile unit of the muscle—using energy in the form of ATP. At the molecular level, this is a cyclic, multistep process that involves binding and hydrolysis of ATP, and movement of actin by myosin.
122.4K
