Related Experiment Video
Updated: Jul 1, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
Diffusion models in text generation: a survey
Qiuhua Yi1, Xiangfan Chen1, Chenwei Zhang2
1College of Computer Science and Technology, Zhejiang University of Technology, HangZhou, China.
Abstract:
Diffusion models are a kind of math-based model that were first applied to image generation. Recently, they have drawn wide interest in natural language generation (NLG), a sub-field of natural language processing (NLP), due to their capability to generate varied and high-quality text outputs. In this article, we conduct a comprehensive survey on the application of diffusion models in text generation. We divide text generation into three parts (conditional, unconstrained, and multi-mode text generation, respectively) and provide a detailed introduction. In addition, considering that autoregressive-based pre-training models (PLMs) have recently dominated text generation, we conduct a detailed comparison between diffusion models and PLMs in multiple dimensions, highlighting their respective advantages and limitations. We believe that integrating PLMs into diffusion is a valuable research avenue. We also discuss current challenges faced by diffusion models in text generation and propose potential future research directions, such as improving sampling speed to address scalability issues and exploring multi-modal text generation. By providing a comprehensive analysis and outlook, this survey will serve as a valuable reference for researchers and practitioners interested in utilizing diffusion models for text generation tasks.
Related Concept Videos
Theories of Dissolution: Diffusion Layer Model
This process starts with a thin layer, saturated with the drug, forming at the interface between the solid and liquid. The solute then diffuses from this layer into the main solution. The Noyes-Whitney equation suggests that the rate of dissolution relies on the diffusion...
Diffusion
Behavior of Gas Molecules: Molecular Diffusion, Mean Free Path, and Effusion
Passive Diffusion: Overview and Kinetics
When administered orally, drugs establish a substantial concentration gradient between the gastrointestinal (GI) lumen and the bloodstream, expediting...
Assessment of Diffusion and Perfusion
The Role of Diffusion in Respiration
Diffusion is the process by which molecules move from an area of higher concentration to an area of lower concentration. In the respiratory system, this...
Facilitated Diffusion
In this process, substrates such as organic compounds and ions interact with a transporter on one side, triggering conformational changes in proteins that enable...

