立体视觉用于密集场景中的植物检测
Thijs Ruigrok1, Eldert J van Henten1, Gert Kootstra1
1Farm Technology, Department of Plant Sciences, Wageningen University and Research, 6700 AA Wageningen, The Netherlands.
Sensors (Basel, Switzerland)
|March 28, 2024
概括
将色彩和深度数据与转移学习相结合,可以改善精准农业的植物检测模型. 然而,深度数据并没有在密集的甜菜作物中增强杂草检测.
科学领域:
- 农业机器人农业机器人
- 计算机视觉 计算机视觉
- 机器学习 机器学习
背景情况:
- 自动杂草控制依赖于准确的作物和杂草视觉歧视.
- 目前的深度学习模型在密集,封闭的农业场景中难以检测杂草.
- 在农业深度学习中,色彩 (RGB) 和深度 (D) 数据的整合未得到充分利用.
研究的目的:
- 评估结合RGB和D数据在农业中检测植物的有效性.
- 引入和评估使用RGB-D数据的新型深度学习模型.
- 研究数据增强和转移学习对RGB-D植物检测模型的影响.
主要方法:
- 收集了一个新的RGB-D数据集,其中包含了不同杂草密度的甜菜作物.
- 开发了D模型 (深度数据) 和CD模型 (颜色和深度数据) 用于植物检测.
- 将深度数据转换为彩色编码的2D图像,以便与现有架构兼容.
- 使用数据增强和转移学习技术评估模型.
主要成果:
- 在RGB和RGB-D模型中,几何数据增强和转移学习被证明是有效的.
- 通过整合彩色编码的深度数据,CD模型表现出更好的性能.
- 尽管有了改进,但深度数据并没有提高志愿者在密集的甜菜田中发现土豆的效果.
结论:
- 将彩色编码的深度数据与数据增强和转移学习相结合,可以增强植物检测模型.
- 对于杂草检测的深度数据的实用性取决于上下文,特别是在高密度植被中.
- 需要进一步的研究来优化RGB-D融合,以应对具有挑战性的农业场景.
相关概念视频
02:00Photoreceptors and Plant Responses to Light
20.3K
Light plays a significant role in regulating the growth and development of plants. In addition to providing energy for photosynthesis, light provides other important cues to regulate a range of developmental and physiological responses in plants.
20.3K
01:15Depth Perception and Spatial Vision
644
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
644
01:24Vision
53.2K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
53.2K