一个整合机器视觉与物联网传感的框架.
Gift Nwatuzie1, Hassan Peyravi1
1Department of Computer Science, Kent State University, Kent, OH 44240, USA.
Sensors (Basel, Switzerland)
|December 11, 2025
概括
本研究提出了一个统一的边缘云框架,将摄像头集成到物联网网络中,用于环境监测. 它通过同步的数据融合和高效的跨模式学习实现了强大的,背景感知.
科学领域:
- 计算机科学 计算机科学
- 环境科学 环境科学
- 电气工程 电气工程
背景情况:
- 自动监控系统经常难以整合各种传感源,如物联网传感器和机器视觉.
- 现有的多式联通融合框架缺乏紧密的同步和高效的跨式联通学习,限制了连贯的环境解释.
- 摄像头和物联网传感器提供互补数据 (空间上下文与点测量),但通常独立运行.
研究的目的:
- 引入一个统一的边缘云框架,将摄像头深度集成为物联网网络中的主动传感节点.
- 为了实现视觉和物联网数据流之间的紧密时间同步,以增强环境解释.
- 促进资源有限的边缘设备的高效跨模式学习和模型培训.
主要方法:
- 开发了一个统一的边缘云框架,在视觉和物联网数据流之间进行紧密的时间同步.
- 采用跨模式知识蒸,以在边缘设备上提供高效的模型培训.
- 使用了多任务学习设置,具有动态调整的损失权重,结合了EfficientNet,Vision Transformers和U-Net衍生品.
主要成果:
- 在环境监测任务中实现了94.8%的分类准确度和87.6%的细分质量 (mIoU).
- 在紧的边缘硬件 (Jetson Nano,Coral TPU) 上持续的次秒推断延迟.
- 在分类,细分和异常检测方面证明了框架的稳定性.
结论:
- 拟议的同步,知识驱动的融合框架提供了更具适应性,背景意识和部署准备的传感解决方案.
- 在物联网 (IoT) 生态系统中显著推进机器视觉的实际集成.
- 强调深度整合和高效的跨模式学习对环境监测的有效性.
相关概念视频
Vision
59.2K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
59.2K
Light Acquisition
9.3K
In order to produce glucose, plants need to capture sufficient light energy. Many modern plants have evolved leaves specialized for light acquisition. Leaves can be only millimeters in width or tens of meters wide, depending on the environment. Due to competition for sunlight, evolution has driven the evolution of increasingly larger leaves and taller plants, to avoid shading by their neighbors with contaminant elaboration of root architecture and mechanisms to transport water and nutrients.
9.3K
Imaging Biological Samples with Optical Microscopy
8.7K
Optical microscopy uses optic principles to provide detailed images of samples. Antonie van Leeuwenhoek designed the first compound optical microscope in the 17th century to visualize blood cells, bacteria, and yeast cells. In 1830, Joseph Jackson Lister created an essentially modern light microscope. The 20th century saw the development of microscopes with enhanced magnification and resolution.
In optical microscopy, the specimen to be viewed is placed on a glass slide and clipped on the stage...
In optical microscopy, the specimen to be viewed is placed on a glass slide and clipped on the stage...
8.7K
Visual System
1.6K
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
1.6K
Infrared (IR) Spectroscopy: Overview
4.6K
When electromagnetic radiation passes through a material, atoms or molecules transition from a lower to a higher energy state by absorbing radiation corresponding to the energy difference between the two states. The absorption of infrared (IR) radiation causes transitions between vibrational energy levels in a molecule. Therefore, IR spectroscopy is a useful analytical tool for determining the molecular structure of molecules.
Different compounds display unique properties due to their...
Different compounds display unique properties due to their...
4.6K
Machines
538
Machines are complex structures consisting of movable, pin-connected multi-force members that work together to transmit forces. One example of a machine is the cutting plier, which is used to cut wires by applying forces to its handles. When equal and opposite forces are exerted on the handles of the cutting plier, they cause the cutting edges to come together and apply equal and opposite reaction forces on the wire, which are greater than the applied forces.
A free-body diagram of the...
A free-body diagram of the...
538

