交互式视觉评估用于文本到图像生成模型
IEEE transactions on visualization and computer graphics
|January 28, 2026
概括
一个新的框架DyEval通过使用LLMs进行动态,交互式评估来增强视觉生成模型评估. 它有助于识别比传统方法更多的失败和复杂的模式.
科学领域:
- 计算机图形 计算机图形
- 人工智能的人工智能
- 人与计算机的交互
背景情况:
- 视觉生成模型显示进展,但面临现实世界的部署挑战.
- 目前的评估方法受到固定覆盖范围,不断变化的难度和数据泄露的限制.
- 复杂的生成模型需要更有效的评估策略.
研究的目的:
- 提出DyEval,一个动态的,互动的视觉评估框架,用于文本到图像系统.
- 解决传统孤立评估框架的局限性.
- 改进视觉生成模型的综合评估.
主要方法:
- DyEval使用大型语言模型 (LLM) 驱动的框架进行协作的人类-人工智能评估.
- 一个直观的界面允许交互式探索和分析模型行为.
- 根据用户反,各种文本输入的自适应生成探测模型能力边界.
- 一个上下文反射模块使用LLM推理分析故障触发器和模式.
主要成果:
- 与传统方法相比,DyEval发现了多达2.56倍的发电故障.
- 该框架揭示了复杂而罕见的失败模式,包括代词和文化背景生成问题.
- 定性和定量实验验证实了DyEval的有效性.
结论:
- DyEval为视觉生成模型评估提供了一种新的方法,提高了可靠性.
- 该框架为改善生成模型提供了有价值的见解.
- DyEval对于在各个领域推进视觉生成系统具有广泛的意义.
相关概念视频
Predator-Prey Interactions
21.5K
Predators consume prey for energy. Predators that acquire prey and prey that avoid predation both increase their chances of survival and reproduction (i.e., fitness). Routine predator-prey interactions elicit mutual adaptations that improve predator offenses, such as claws, teeth, and speed, as well as prey defenses, including crypsis, aposematism, and mimicry. Thus, predator-prey interactions resemble an evolutionary arms race.
21.5K
piRNA - Piwi-interacting RNAs
7.6K
PIWI-interacting RNAs, or piRNAs, are the most abundant short non-coding RNAs. More than 20,000 genes have been found in humans that code for piRNAs while only 2000 genes have been found for miRNAs. piRNAs can act at the transcriptional and post-transcriptional levels and have a vital role in silencing transposable elements present in germ cells. They are also involved in epigenetic silencing and activation. Previously, they were thought to function only in germ cells but new evidence suggests...
7.6K
Van der Waals Interactions
71.3K
Atoms and molecules interact with each other through intermolecular forces. These electrostatic forces arise from attractive or repulsive interactions between particles with permanent, partial, or temporary charges. The intermolecular forces between neutral atoms and molecules are ion–dipole, dipole–dipole, and dispersion forces, collectively known as van der Waals forces.
71.3K
Visual System
1.8K
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
1.8K
Visual Agnosia
1.1K
Visual agnosia is a condition characterized by the inability to recognize visually presented objects despite having normal vision. For instance, a person with visual agnosia can describe the shape and color of an object but cannot identify or name it. This impairment does not affect their visual field, acuity, color vision, brightness discrimination, language, or memory. An example of this condition in a social setting is someone at a dinner party asking for "that silver thing with a round...
1.1K
Drug-Receptor Interactions
7.4K
Drug-receptor interaction describes the binding of receptors by drugs, but not all drug-receptor interactions result in activation and tissue response. For instance, the binding of agonists activates the receptor to generate a cellular reaction, while antagonists bind to receptors without causing their activation.
Several parameters, such as the drug's affinity for its receptor and its efficacy, which is its ability to activate the receptor, determine the drug's effect on the tissue....
Several parameters, such as the drug's affinity for its receptor and its efficacy, which is its ability to activate the receptor, determine the drug's effect on the tissue....
7.4K


