多式联动触觉与视觉融合为灵巧的机器人家政服务
Qian Mao1, Zijian Liao1, Jinfeng Yuan1
1State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing, China.
Nature communications
|August 10, 2024
概括
研究人员为机器人开发了一种灵活的触觉传感器,使其能够实现先进的多式联络感知,包括敏感的滑动检测. 这项技术增强了机器人的抓取能力和对象识别能力,用于清洁和处理脆弱物品等任务.
科学领域:
- 机器人和人工智能 机器人和人工智能
- 材料科学与工程 材料科学与工程
- 传感器技术 传感器技术
背景情况:
- 机器人越来越需要类似人类的能力来完成日常任务,推动了多式联络传感技术的进步.
- 当前的机器人感知技术面临着在家庭环境中的多感官集成,快速响应和敏感感知方面的挑战.
- 敏捷的抓取需要复杂的触觉反,特别是用于检测滑动以防止对象损坏或丢失.
研究的目的:
- 开发一种灵活的触觉传感器,能够进行多式感知 (压力,温度,热特性,纹理,滑动).
- 创建一个机器人触觉视觉融合架构,以加强决策和控制.
- 为了证明传感器在智能抓取策略和复杂任务对象识别中的实用性.
主要方法:
- 使用薄膜热敏电阻制造灵活的触觉传感器,用于多式联络数据采集.
- 实现超灵敏和超快的滑动传感 (0.05 mm/s, 4 ms响应时间).
- 开发一种触觉视觉融合架构,将传感器数据与机器人决策集成在一起.
主要成果:
- 触觉传感器成功实现了多模式感知,包括高度敏感和快速的滑动检测.
- 触觉视觉融合架构使智能抓取策略能够实现快速滑动反控制.
- 机器人表现出敏捷的抓取和精确的日常物体识别,成功地处理诸如抓住装满液体的杯子和执行自主桌面清洁等任务.
结论:
- 开发的灵活触觉传感器显著提升了机器人的多式联络感知,特别是在滑动检测方面.
- 触觉视觉融合架构在复杂的环境中促进了机器人的灵巧操纵和对象识别.
- 这项技术在智能清洁和其他家庭应用中增强机器人的能力方面非常有前途.
相关概念视频
Somatosensation
The somatosensory system relays sensory information from the skin, mucous membranes, limbs, and joints. Somatosensation is more familiarly known as the sense of touch. A typical somatosensory pathway includes three types of long neurons: primary, secondary, and tertiary. Primary neurons have cell bodies located near the spinal cord in groups of neurons called dorsal root ganglia. The sensory neurons of ganglia innervate designated areas of skin called dermatomes.
Sensory Functions of the Skin
The skin is the largest organ of the human body and plays a crucial role in our sensory perception. It contains a vast network of sensory receptors that contribute to the skin's protective function by perceiving physical, biological, and environmental cues and generating relevant responses.
There are two main categories of receptors on the skin: capsulated and non-capsulated. The non-capsulated ones are mainly the pain receptors. The capsulated ones can be further categorized based on the...
There are two main categories of receptors on the skin: capsulated and non-capsulated. The non-capsulated ones are mainly the pain receptors. The capsulated ones can be further categorized based on the...
Sensory Modalities
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
Design Example: Resistive Touchscreen
A device engineer plays a crucial role in designing user interfaces for mobile devices. One such interface is the resistive touchscreen, which fundamentally consists of two metallic layers: a flexible upper layer and a rigid lower layer, separated by a narrow gap. The high resistance between these two layers is a key characteristic of this design.
When a user touches the screen, the two layers make contact at a specific point known as the touchpoint. This contact reduces the resistance between...
When a user touches the screen, the two layers make contact at a specific point known as the touchpoint. This contact reduces the resistance between...
Mechanical Systems
Mechanical systems are analogous to to electrical networks where springs and masses play similar roles to inductors and capacitors, respectively. A viscous damper in mechanical systems functions similarly to a resistor in electrical networks, dissipating energy. The forces acting on a mass in such systems include an applied force in the direction of motion, counteracted by forces from the spring, a viscous damper, and the mass's acceleration. This interplay of forces is mathematically described...
Tactile and Chemical Senses
Tactile senses encompass touch, temperature, and pain, each mediated by specific receptors. Touch receptors detect mechanical energy or pressure against the skin. Sensory fibers from these receptors enter the spinal cord and relay information to the brain stem. Here, most fibers cross over to the opposite side of the brain. The touch information then moves to the thalamus, which projects a map of the body's surface onto the somatosensory areas of the parietal lobes in the cerebral cortex. This...


