Related Experiment Video
Updated: Jul 6, 2026
19:44
A Tactile Automated Passive-Finger Stimulator TAPS
Published on: June 3, 2009
13.7K
A Multifunctional Tactile Sensory System for Robotic Intelligent Identification and Manipulation Perception
Yue Jiang1,2,3, Lin Fan1, Xilong Sun3
1Key Laboratory of Optoelectronic Devices and Systems of Ministry of Education and Guangdong Province, College of Physics and Optoelectronic Engineering, Shenzhen University, Shenzhen, 518060, China.
Advanced Science (Weinheim, Baden-Wurttemberg, Germany)
|September 9, 2024
Summary
This study introduces a novel multimodal tactile sensory system for robots, enhancing their ability to perceive and interact with objects. The system achieves high-precision recognition of object properties, improving robot manipulation capabilities.
Area of Science:
- Robotics
- Materials Science
- Sensor Technology
Background:
- Human object manipulation relies on rich tactile feedback.
- Current robotic sensors lack the ability to capture complex interaction states.
- This limits service robots' perception and analytical capabilities for intricate tasks.
Purpose of the Study:
- To develop a multimodal tactile sensory system for robots.
- To enable in situ simultaneous sensing during object approach, touch, and manipulation.
- To enhance robots' human-like perception and analytical skills.
Main Methods:
- Integration of a sensitive capacitive sensor (1.11E-2 pF mm⁻¹).
- Incorporation of a fast-response triboelectric nanogenerator (30 ms).
- Utilization of a 3D force-detecting pressure sensor array.
- Application of transfer learning models to fuse multimodal data.
Main Results:
- Achieved high-precision (up to 95%) recognition of multi-featured targets.
- Successfully identified object properties like hardness and texture under varied conditions.
- Demonstrated robust performance with random grasp forces and velocities.
Conclusions:
- The developed sensory system significantly enhances robotic tactile perception.
- It improves the intelligent recognition and behavior-planning of autonomous robots.
- Enables complex task execution in undefined environments.
Related Concept Videos
01:31What is a Sensory System?
Sensory systems detect stimuli—such as light and sound waves—and transduce them into neural signals that can be interpreted by the nervous system. In addition to external stimuli detected by the senses, some sensory systems detect internal stimuli—such as the proprioceptors in muscles and tendons that send feedback about limb position.
01:33Somatosensation
The somatosensory system relays sensory information from the skin, mucous membranes, limbs, and joints. Somatosensation is more familiarly known as the sense of touch. A typical somatosensory pathway includes three types of long neurons: primary, secondary, and tertiary. Primary neurons have cell bodies located near the spinal cord in groups of neurons called dorsal root ganglia. The sensory neurons of ganglia innervate designated areas of skin called dermatomes.
01:16Sensory Functions of the Skin
The skin is the largest organ of the human body and plays a crucial role in our sensory perception. It contains a vast network of sensory receptors that contribute to the skin's protective function by perceiving physical, biological, and environmental cues and generating relevant responses.
There are two main categories of receptors on the skin: capsulated and non-capsulated. The non-capsulated ones are mainly the pain receptors. The capsulated ones can be further categorized based on the...
There are two main categories of receptors on the skin: capsulated and non-capsulated. The non-capsulated ones are mainly the pain receptors. The capsulated ones can be further categorized based on the...
01:11Sensory Perception: Organization of the Somatosensory System
The somatosensory system is the central and peripheral nervous system component that senses and processes touch, pressure, pain, temperature, and body position or proprioception. The process of sensation takes place at three levels:
The receptor level:
The receptor level is the first stage of sensation. It involves the detection of a stimulus by specialized sensory receptors. The stimulus must arrive within the receptor's receptive field. Next, the receptor converts the energy of the stimulus...
The receptor level:
The receptor level is the first stage of sensation. It involves the detection of a stimulus by specialized sensory receptors. The stimulus must arrive within the receptor's receptive field. Next, the receptor converts the energy of the stimulus...
01:26Introduction to Special Senses
Sensory receptors play an integral part in comprehending our external and internal environments. They receive diverse stimuli, converting them into the nervous system's electrochemical signals. This conversion occurs as the stimulus alters the sensory neuron's cell membrane potential, instigating the generation of an action potential. This action potential is subsequently transmitted to the central nervous system (CNS), which integrates with other sensory data or higher cognitive functions.
01:27Tactile and Chemical Senses
Tactile senses encompass touch, temperature, and pain, each mediated by specific receptors. Touch receptors detect mechanical energy or pressure against the skin. Sensory fibers from these receptors enter the spinal cord and relay information to the brain stem. Here, most fibers cross over to the opposite side of the brain. The touch information then moves to the thalamus, which projects a map of the body's surface onto the somatosensory areas of the parietal lobes in the cerebral cortex. This...