SketchRefiner:通过隐性扩散模型进行文本引导的草图精细化
IEEE transactions on visualization and computer graphics
|September 23, 2025
概括
SketchRefiner使用文本指导将粗略的草图改进为抛光版本. 这种人工智能生成的内容方法通过使草图更清晰,更美观地增强了沟通.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
背景情况:
- 自由手的草图对于创造力和沟通至关重要,但对于未经训练的人来说很难完善.
- 用文本指导优化草图可以显著提高思想传递和沟通效率.
- 尽管人工智能生成内容 (AIGC) 取得了进展,但利用人工智能优化自由手绘素描的研究是有限的.
研究的目的:
- 介绍SketchRefiner,这是一种新的方法,可以使用文本提示程序将粗略的草图改进为优化的版本.
- 为了改善沟通,提高自由手草图的清晰度和美学质量.
主要方法:
- 使用与ControlNet集成的隐性扩散模型来指导可差分的拉斯特化器.
- 优化贝齐尔曲线,以提升草图的精度.
- 扩展分数蒸采样 (SDS) 损失,并引入用于文本草图对齐的联合语义损失.
- 采用融合注意力地图冲击初始化策略,以提高草图质量.
主要成果:
- 展示了精确而美观的精细草图的生成.
- 在精细的草图,输入文本提示和原始自由手草图之间实现了密切的对齐.
- 为用户提供了对基于文本的草图改进的精细控制.
结论:
- SketchRefiner有效地将粗略的草图精制成精致的,以文本为导向的输出.
- 该方法增强了草图作为沟通工具的实用性.
- 为研究人工智能辅助创意内容生成提供了一个有前途的方向.
相关概念视频
Assessment of Diffusion and Perfusion
1.5K
Understanding and evaluating diffusion and perfusion is critical in assessing a patient's respiratory and circulatory health. These processes play key roles in maintaining the body's internal environment, ensuring that tissues receive adequate oxygen while waste products are efficiently removed.
The Role of Diffusion in Respiration
Diffusion is the process by which molecules move from an area of higher concentration to an area of lower concentration. In the respiratory system, this...
The Role of Diffusion in Respiration
Diffusion is the process by which molecules move from an area of higher concentration to an area of lower concentration. In the respiratory system, this...
1.5K
Guidelines for Sketching a Curve
51
Curve sketching is a systematic method for understanding the overall behavior of a function by analyzing its key mathematical features. A function defines a curve on the coordinate plane, where the horizontal axis represents the input variable and the vertical axis represents the output. The process begins by determining the domain, which specifies the set of input values for which the function is defined and establishes the horizontal extent of the graph.Intercepts with the horizontal and...
51
Diffusion
216.4K
Diffusion is the passive movement of substances down their concentration gradients—requiring no expenditure of cellular energy. Substances, such as molecules or ions, diffuse from an area of high concentration to an area of low concentration in the cytosol or across membranes. Eventually, the concentration will even out, with the substance moving randomly but causing no net change in concentration. Such a state is called dynamic equilibrium, which is essential for maintaining overall...
216.4K
Curve Sketching and Derivatives
24
Understanding the behavior of a function through its first and second derivatives is essential for analyzing its graph. Derivatives provide insight into where a function increases or decreases, where it attains local maxima or minima, and how its curvature behaves across different intervals.The first derivative of a function reveals the slope of the tangent line at any given point. Points where the derivative is zero or undefined are considered critical, as they often indicate potential extrema...
24
Modeling and Similitude
617
Scaled modeling is a fundamental technique in engineering, enabling the study of large and complex systems by creating smaller, manageable replicas that recreate critical characteristics of the original. In hydrology and civil infrastructure, for example, scaled models of dams help analyze water flow, turbulence, and pressure. This method allows for accurate predictions of real-world behavior within a controlled environment, significantly reducing the cost and time involved in full-scale...
617
Physiological Pharmacokinetic Models: Blood Flow-Limited Versus Diffusion-Limited Models
335
Physiological pharmacokinetic models, often called flow-limited or perfusion models, typically assume a swift drug distribution between tissue and venous blood, creating a rapid drug equilibrium. This premise is based on the idea that drug diffusion is extremely fast, and the cell membrane presents no barrier to drug permeation. In this scenario, where no drug binding occurs, the drug concentration in the tissue equals that of the venous blood leaving the tissue. This greatly simplifies the...
335


