一个轻量级的模型,通过隐性先验来进行感知图像压缩.
Hao Wei1, Yanhui Zhou1, Yiwen Jia1
1Xi'an Jiaotong University, No.28, West Xianning Road, Xi'an, Shaanxi, 710049, China.
概括
本研究介绍了一种使用隐式语义先验 (ICISP) 的轻量级感知图像压缩方法. 对于移动设备来说,ICISP在低比特率下实现了具有竞争力的视觉质量,并显著降低了复杂性.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 图像处理 图像处理
背景情况:
- 与传统方法相比,感知图像压缩在低比特率下提供了优越的视觉质量.
- 现有的方法通常依赖于明确的语义特征,增加模型复杂性和限制移动应用.
研究的目的:
- 开发一种轻量级的感知图像压缩方法,可以降低模型复杂性,同时保持高视觉质量.
- 为了利用隐含的语义先验,在资源有限的设备上进行高效的图像压缩.
主要方法:
- 提出了一种使用隐含语义先验 (ICISP) 的轻量级感知图像压缩方法.
- 开发了一个增强的视觉状态空间块,用于利用空间依赖性和减少冗余性.
- 引入了一个频率分解调制块,用于自适应频率信息保存.
- 使用语义信息区分器,从DINOv2编码器中隐含先验,以提高感知质量.
主要成果:
- ICISP 方法在标准基准上证明了具有竞争力的压缩性能.
- 与最先进的方法相比,实现了显著减少的网络参数和浮点运算.
- 这种方法有效地平衡了压缩效率和感知质量.
结论:
- ICISP为移动设备上高质量的感知图像压缩提供了一个实用的解决方案.
- 隐含的语义先验为减少模型复杂性的显式特征提供了一个有效的替代方案.
- 提出的方法推进了高效和视觉优化的图像压缩领域.
相关概念视频
Implicit Personality Theories
323
Implicit personality theory explains how individuals make assumptions about the relationships between personality traits, behaviors, and character types. When people learn that someone possesses a particular trait, they tend to infer the presence of other related characteristics, forming a cohesive impression. This cognitive shortcut plays a crucial role in social interactions and interpersonal judgments.Central Traits and Their InfluenceSolomon Asch's seminal 1946 study highlighted the power...
323
Perceptual Constancy
1.2K
Perceptual constancy is the ability to recognize that objects remain consistent and unchanged even when their appearance varies due to changes in sensory input. There are four main types of perceptual constancy: size constancy, shape constancy, color constancy, and brightness constancy.
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
1.2K
Downsampling
590
When considering a sampled sequence with zero values between sampling instants, one can replace it by taking every N-th value of the sequence. At these integer multiples of N, the original and sampled sequences coincide. This process, known as decimation, involves extracting every N-th sample from a sequence, thereby creating a more efficient sequence.
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
590
Upsampling
571
Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
571
Gestalt Principles of Perception
1.0K
Gestalt principles provide a framework for understanding how humans perceive objects as unified wholes within their context. These principles are essential in explaining the cognitive processes that make sense of complex visual stimuli by organizing them into coherent groups. One fundamental principle is proximity, which posits that objects located close to each other are perceived as a collective group. For instance, when dots are positioned near one another, the visual system interprets them...
1.0K
Light Acquisition
9.3K
In order to produce glucose, plants need to capture sufficient light energy. Many modern plants have evolved leaves specialized for light acquisition. Leaves can be only millimeters in width or tens of meters wide, depending on the environment. Due to competition for sunlight, evolution has driven the evolution of increasingly larger leaves and taller plants, to avoid shading by their neighbors with contaminant elaboration of root architecture and mechanisms to transport water and nutrients.
9.3K


