适应性视觉触觉融合识别,用于机器人操作多材料系统
Zihao Ding1, Guodong Chen1, Zhenhua Wang1
1The Jiangsu Provincial Key Laboratory of Advanced Robotics, Soochow University, Suzhou, China.
Frontiers in neurorobotics
|July 6, 2023
概括
机器人现在可以通过结合视觉和触摸数据更好地识别物体. 这种多模式方法克服了仅视觉系统的局限性,将机器人的识别精度提高到99.3%.
科学领域:
- 机器人技术 机器人技术 机器人技术
- 人工智能的人工智能
- 传感器融合式传感器
背景情况:
- 机器人需要精确的对象识别来完成复杂的任务,特别是使用各种材料.
- 当前的机器人视觉系统缺乏触觉信息,导致对象认知不完全.
- 多模式信息融合对于推进机器人识别能力至关重要.
研究的目的:
- 开发一种用于融合视觉和触觉数据的新方法,以增强机器人对象识别.
- 为了应对跨式交通信息交换和数据不稳定的挑战.
- 提高机器人感知系统的准确性和稳定性.
主要方法:
- 开发了一种将触觉数据序列转换为图像的技术.
- 设计了一个视觉触觉融合网络框架,其中包含了一个自适应性丢失算法.
- 为整合视觉和触觉信息建立了最佳的联合机制.
主要成果:
- 拟议的方法有效地克服了触摸数据中的噪声和不稳定性.
- 融合框架成功地平衡了视觉和触觉信息,避免了传统的限制.
- 实验结果显示,机器人识别能力显著提高.
结论:
- 开发的多模式融合方法大大提高了机器人对象识别.
- 该系统实现了99.3%的分类准确率,展示了其有效性.
- 这项研究为更智能,更精确的机器人系统铺平了道路.
相关概念视频
Tactile and Chemical Senses
328
Tactile senses encompass touch, temperature, and pain, each mediated by specific receptors. Touch receptors detect mechanical energy or pressure against the skin. Sensory fibers from these receptors enter the spinal cord and relay information to the brain stem. Here, most fibers cross over to the opposite side of the brain. The touch information then moves to the thalamus, which projects a map of the body's surface onto the somatosensory areas of the parietal lobes in the cerebral cortex.
328
Three-Dimensional Force System:Problem Solving
695
A three-dimensional force system refers to a scenario in which three forces act simultaneously in three different directions. This type of problem is commonly encountered in physics and engineering, where it is necessary to calculate the resultant force on the system, which can then be used to predict or analyze the behavior of the object or structure under consideration.
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
695
Support Reactions in Three Dimensions
998
Support reactions in three dimensions help maintain the stability and equilibrium of various structures and systems. These reactions prevent the system from translating and rotating, ensuring the design can withstand external forces and perform its intended function efficiently and safely. Some of the supports providing support reactions in three dimensions are discussed below:
Ball and Socket Joint is one of the supports allowing free rotation about any axis. This freedom of rotation is...
Ball and Socket Joint is one of the supports allowing free rotation about any axis. This freedom of rotation is...
998
Design Example: Resistive Touchscreen
358
A device engineer plays a crucial role in designing user interfaces for mobile devices. One such interface is the resistive touchscreen, which fundamentally consists of two metallic layers: a flexible upper layer and a rigid lower layer, separated by a narrow gap. The high resistance between these two layers is a key characteristic of this design.
When a user touches the screen, the two layers make contact at a specific point known as the touchpoint. This contact reduces the resistance between...
When a user touches the screen, the two layers make contact at a specific point known as the touchpoint. This contact reduces the resistance between...
358


