用光学矩阵向量乘法器实现的图像处理用于编码和解码任务
Minjoo Kim1, Yelim Kim1, Won Il Park2
1Division of Materials Science and Engineering, Hanyang University, Seoul, Republic of Korea.
Light, science & applications
|July 22, 2025
概括
本研究介绍了一种光学神经网络 (ONN) 自动编码器,用于高效的图像处理. ONN系统为实时,低功耗的应用,如医疗成像和自动驾驶汽车提供了卓越的能源效率.
科学领域:
- 光电学是指光电子产品.
- 人工智能的人工智能
- 图像处理 图像处理
背景情况:
- 传统的电子系统在复杂的图像处理任务中面临能源效率的限制.
- 光学神经网络 (ONN) 为高速,低功耗计算提供了一个有希望的替代方案.
- 在图像分析中,自动编码器对于缩小维度和特征提取至关重要.
研究的目的:
- 开发一款基于光学神经网络 (ONN) 的高效自动编码器,用于先进的图像处理.
- 提高ONN的解码能力,以产生更高维度的输出.
- 展示ONN在图像处理方面的能源效率方面超越电子系统的潜力.
主要方法:
- 在自动编码器中使用专用光学矩阵向量乘法器进行编码和解码.
- 实现了标量乘法来优化输出处理以提高解码性能.
- 采用系统上的代调整来减轻硬件缺陷和噪音,提高重建准确度.
- 探索了ONN自动编码器与降噪和光学图像生成模型的集成.
主要成果:
- 通过代调和降噪实现了接近数字的图像重建质量.
- 证明了 ONN 自动编码器支持 denoising,变化和生成对抗网络模型的能力.
- 与传统的电子系统相比,在能源效率方面取得了显著的改进.
- 验证了实时,低功耗图像处理的潜力.
结论:
- 基于ONN的自动编码器为复杂的图像处理任务提供了可行且高能效的解决方案.
- 提出的方法可以实现高保真图像重建,并支持先进的生成模型.
- ONN系统非常适合用于功率受限的应用,例如医疗成像,自动驾驶汽车和边缘计算.
相关概念视频
01:18Imaging Biological Samples with Optical Microscopy
5.4K
Optical microscopy uses optic principles to provide detailed images of samples. Antonie van Leeuwenhoek designed the first compound optical microscope in the 17th century to visualize blood cells, bacteria, and yeast cells. In 1830, Joseph Jackson Lister created an essentially modern light microscope. The 20th century saw the development of microscopes with enhanced magnification and resolution.
In optical microscopy, the specimen to be viewed is placed on a glass slide and clipped on the stage...
In optical microscopy, the specimen to be viewed is placed on a glass slide and clipped on the stage...
5.4K
01:08Vector Algebra: Method of Components
15.5K
It is cumbersome to find the magnitudes of vectors using the parallelogram rule or using the graphical method to perform mathematical operations like addition, subtraction, and multiplication. There are two ways to circumvent this algebraic complexity. One way is to draw the vectors to scale, as in navigation, and read approximate vector lengths and angles (directions) from the graphs. The other way is to use the method of components.
In many applications, the magnitudes and directions of...
In many applications, the magnitudes and directions of...
15.5K
01:24Convolution: Math, Graphics, and Discrete Signals
416
In any LTI (Linear Time-Invariant) system, the convolution of two signals is denoted using a convolution operator, assuming all initial conditions are zero. The convolution integral can be divided into two parts: the zero-input or natural response and the zero-state or forced response, with t0 indicating the initial time.
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
416
01:22Multi-input and Multi-variable systems
150
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
150
01:24Vision
55.4K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
55.4K
01:20Vector Operations
1.5K
Vectors are physical quantities that have both magnitude and direction. The vector operations include addition, subtraction, and scalar multiplication.
A vector multiplied by a scalar value is called scalar multiplication. The result obtained is a new vector with a different magnitude. If the scalar is positive, the direction of the vector remains the same, but if it is negative, the direction of the vector is reversed. For example, the product of the mass and velocity yields the momentum.
A vector multiplied by a scalar value is called scalar multiplication. The result obtained is a new vector with a different magnitude. If the scalar is positive, the direction of the vector remains the same, but if it is negative, the direction of the vector is reversed. For example, the product of the mass and velocity yields the momentum.
1.5K