EPCNet:实施"人工焦点"以实现更有效的监控,使用基于事件的和基于的摄像头的传感器融合
Orla Sealy Phelan1,2, Dara Molloy3, Roshan George1,2
1Department of Electrical and Electronic Engineering, University of Galway, University Road, H91 TK33 Galway, Ireland.
Sensors (Basel, Switzerland)
|August 14, 2025
概括
这项研究将基于事件和RGB相机融合在一起,以实现高效的物体检测. 将这些传感器结合起来可以提高准确性,并减少像自动驾驶这样的实时应用中的延迟.
科学领域:
- 计算机视觉 计算机视觉
- 机器人技术 机器人技术 机器人技术
- 传感器融合式传感器
背景情况:
- 高分辨率的RGB摄像头提供了精度,但增加了延迟和功耗.
- 卷积神经网络 (CNN) 的下方采样图像会导致信息丢失.
- 基于事件的摄像头提供高时间分辨率和低功耗,但缺乏空间细节.
研究的目的:
- 为了减轻时间分辨率和对象检测准确度之间的权衡.
- 为了尽量减少实时监控系统的延迟和功耗.
- 提出一种新的多模态立体视觉系统,将事件和RGB摄像头融合在一起.
主要方法:
- 校准事件和RGB摄像头,以创建一个多模态立体视觉系统.
- 事件和RGB相机图像平面之间的投影像素坐标.
- 用事件摄像机为区域提案,为CNNs提供剪裁的RGB.
主要成果:
- 自行车的平均精度 (AP) 从21.08提高到57.38.
- 所有班级的总体AP从37.93增加到46.89.
- 拟议的方法实现了比基线系统延迟的78%改善.
结论:
- 基于事件和RGB相机的融合提高了对象检测的准确性和效率.
- 拟议的系统有效地减少了实时应用程序的延迟和功耗.
- 活动摄像头可以作为区域提案网络,优化CNN的性能.
相关概念视频
Association Areas of the Cortex
6.3K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
6.3K
Vision
55.3K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
55.3K
Depth Perception and Spatial Vision
909
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
909
Focusing of Light in the Eye
3.2K
Light rays enter the eye through the cornea, a transparent dome-shaped tissue that is the eye's outermost layer. The cornea bends or refracts, light rays traveling to the pupil. The shape of the cornea determines how much of the light is bent and whether the image will be focused correctly on the retina at the back of the eye. Once the light has passed through both refraction layers, it converges into a single focal point onto a small area. This is where photoreceptors start transforming...
3.2K
Light Acquisition
8.6K
In order to produce glucose, plants need to capture sufficient light energy. Many modern plants have evolved leaves specialized for light acquisition. Leaves can be only millimeters in width or tens of meters wide, depending on the environment. Due to competition for sunlight, evolution has driven the evolution of increasingly larger leaves and taller plants, to avoid shading by their neighbors with contaminant elaboration of root architecture and mechanisms to transport water and nutrients.
8.6K
Anatomy of the Eyeball
7.6K
The eye is a spherical, hollow structure composed of three tissue layers. The outer layer — the fibrous tunic, comprises the sclera — a white structure — and the cornea, which is transparent. The sclera encompasses some of the ocular surface, most of which is not visible. However, the 'white of the eye' is distinctively visible in humans compared to other species. The cornea, a clear covering at the front of the eye, enables light penetration. The eye's middle...
7.6K


