DKMap:通过动态内核增强投影在多模式嵌入中的视觉语言对齐的交互探索
IEEE transactions on visualization and computer graphics
|January 28, 2026
概括
本研究介绍了DKMap,这是一种用于多式联运嵌入的新可视化工具. DKMap准确地绘制了跨模式对齐,改善了人工智能模型对复杂数据集的探索.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 数据可视化 数据可视化
背景情况:
- 多模式嵌入对于人工智能任务,如生成模型评估至关重要.
- 现有的缩小维度 (DR) 方法与交叉模式对齐可视化作斗争.
- 问题包括点遮蔽,不准确的轮图和缺乏多尺度探索.
研究的目的:
- 介绍DKMap,一个新的DR可视化技术用于多式联运嵌入.
- 解决现有的DR方法在可视化交叉模式对齐方面的局限性.
- 为了实现高维多方式数据的准确,多层次的交互式探索.
主要方法:
- 引入了核心回归监督的t-SNE,将轮映射集成到投影学习中.
- 综合验证受制于α精细化,具有通用的t-kernel和四树多重分辨率.
- 开发DKMap作为一个多平台工具,具有Web系统和Python包.
主要成果:
- DKMap准确地绘制了跨模式对齐指标,性能优于基线DR技术.
- 在处理不同指标和过度聚合问题方面表现出优越性.
- 在大规模数据集 (百万级和十亿级) 上验证了概括性和可扩展性.
结论:
- DKMap提供了可视化和探索多式联运嵌入的卓越方法.
- 该技术增强了对AI视觉语言对齐的理解.
- DKMap适用于各种应用,包括模型评估和大数据集分析.
相关概念视频
Language
908
Language is a unique communication system that uses words and systematic rules to organize and transmit information. Unlike other forms of communication, which may involve postures, movements, odors, or vocalizations, language relies on symbols and grammar. This makes human communication distinct from that of other species, who also communicate but do not use language in the same way humans do.
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
908
Vision
60.0K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
60.0K
Fischer Projections
16.5K
Learning to draw Fischer projections of molecules and understanding their relevance plays a crucial role in the visual depiction of organic molecules. A Fischer projection is a two-dimensional projection on a planar surface to simplify the three-dimensional wedge–dash representation of molecules. This is especially helpful in the case of molecules with multiple chiral centers that can be difficult to draw. Here, all the bonds of interest are represented as horizontal or vertical lines. While...
16.5K
Color Vision
1.5K
Color perception begins in the retina, the light-sensitive layer at the back of the eye. Two main theories explain how colors are seen: the trichromatic theory and the opponent-process theory. The trichromatic theory, proposed by Thomas Young in 1802 and extended by Hermann von Helmholtz in 1852, suggests that color vision is based on three types of cone receptors in the retina. These cones are sensitive to different but overlapping ranges of wavelengths corresponding to red, blue, and green.
1.5K
Components of Language
815
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
815
Language Development
908
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
908


