灵活材料的视觉和相应的触觉数据集用于机器人和交叉模式感知
Shuchang Xu1, Haohao Xu1, Fangtao Mao2
1School of Information Science and Technology, Hangzhou Normal University, Hangzhou, Zhejiang 311121, China.
Data in brief
|September 12, 2024
概括
这项研究引入了一个新的数据集,将视觉和触觉皮革数据联系起来. 这个资源使得探索跨模式融合能够改善对象感知和缺陷检测.
科学领域:
- 计算机视觉 计算机视觉
- 材料科学 材料科学 材料科学
- 人与计算机的交互
背景情况:
- 人类依靠视觉和触觉感官来进行对象交互和质量评估.
- 像皮革这样的柔性材料需要集成的视觉和触觉数据进行全面分析.
- 现有的数据集缺乏综合的视觉和触觉信息,阻碍了跨模式的研究.
研究的目的:
- 创建一个数据集,对灵活的物体进行视觉和触觉信息的相关联,重点是皮革.
- 促进跨模式数据融合研究,以提高感知和缺陷检测.
- 为涉及材料质量评估的计算机视觉应用提供资源.
主要方法:
- 从皮革样本收集的配对视觉图像和3D触觉数据 (X,Y,Z轴).
- 将触觉数据与视觉数据对齐并使用插值对其进行可视化.
- 在视觉触觉样本中手动注释缺陷区域.
- 开发了一个包含687条记录的数据集,其中包括视觉图像,触觉图像和缺陷细分面具.
主要成果:
- 建立了一个数据集,与皮革的同步视觉和触觉信息.
- 证明了将视觉外观与触觉特性相关联的潜力.
- 为训练计算机视觉模型提供手动标记的缺陷数据.
结论:
- 拟议的数据集允许在材料分析的交叉模式数据融合方面进行新型研究.
- 该资源可以推进计算机视觉系统的自动化质量控制和皮革缺陷识别.
- 未来的工作可以探索先进的融合技术,并将数据集扩展到其他灵活材料.
相关概念视频
Three-Dimensional Force System:Problem Solving
656
A three-dimensional force system refers to a scenario in which three forces act simultaneously in three different directions. This type of problem is commonly encountered in physics and engineering, where it is necessary to calculate the resultant force on the system, which can then be used to predict or analyze the behavior of the object or structure under consideration.
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
656
Two-Dimensional Force System: Problem Solving
552
Solving problems related to two-dimensional force systems is an essential aspect of mechanics and engineering. By applying the principles of vector analysis and force equilibrium, one can determine the effect of multiple forces acting on an object in a two-dimensional space.
The first step to solving a two-dimensional force system problem is to draw a free-body diagram of the object under consideration. This diagram helps identify all the external forces acting on the object, including their...
The first step to solving a two-dimensional force system problem is to draw a free-body diagram of the object under consideration. This diagram helps identify all the external forces acting on the object, including their...
552
Design Example: Resistive Touchscreen
293
A device engineer plays a crucial role in designing user interfaces for mobile devices. One such interface is the resistive touchscreen, which fundamentally consists of two metallic layers: a flexible upper layer and a rigid lower layer, separated by a narrow gap. The high resistance between these two layers is a key characteristic of this design.
When a user touches the screen, the two layers make contact at a specific point known as the touchpoint. This contact reduces the resistance between...
When a user touches the screen, the two layers make contact at a specific point known as the touchpoint. This contact reduces the resistance between...
293
Three-Dimensional Force System
2.0K
In mechanical engineering, a three-dimensional force system is a system of forces acting in three dimensions, with forces applied along the x, y, and z coordinate axes. The three-dimensional force system is an important concept in mechanical engineering, as it allows engineers to understand and analyze the behavior of objects and structures in three dimensions. By understanding the forces acting on a system, engineers can design more efficient and effective mechanical systems that can withstand...
2.0K
Two-Dimensional Force System
888
A two-dimensional system in mechanical engineering involves the analysis of motion and forces in a plane. A two-dimensional force vector can be resolved into its components as:
888
Virtual Work for a System of Connected Rigid Bodies
374
Virtual work is a powerful method used to solve problems involving several connected rigid bodies. When the system is in equilibrium, virtual work is zero. This allows the calculation of the resulting forces when a system undergoes a virtual displacement. When attempting to analyze such a system, first, use a free-body diagram, where an independent coordinate represents the configuration of the links, and mark its deflected position resulting from the positive virtual displacement.
Next,...
Next,...
374


