Related Experiment Video
Updated: Aug 8, 2025

SSVEP-based Experimental Procedure for Brain-Robot Interaction with Humanoid Robots
Published on: November 24, 2015
Soft Robotic Perception System with Ultrasonic Auto-Positioning and Multimodal Sensory Intelligence
Qiongfeng Shi1,2,3,4, Zhongda Sun2,3,4, Xianhao Le2,3,4
1Joint International Research Laboratory of Information Display and Visualization, School of Electronic Science and Engineering, Southeast University, Nanjing 210096, China.
This study introduces a novel soft robotic perception system using ultrasonic and flexible triboelectric sensors for enhanced object identification. The integrated system offers precise positioning and multimodal sensing, improving robotic manipulation capabilities.
Area of Science:
- Robotics
- Materials Science
- Sensor Technology
Background:
- Flexible electronics and tactile cognitive sensors are crucial for soft robotic manipulators, mimicking human-skin perception.
- Conventional guiding systems using cameras or optical sensors have limitations in adaptability, data complexity, and cost-effectiveness for object positioning.
- An integrated guiding system is essential for soft robotic manipulators to achieve accurate positioning of randomly distributed objects.
Purpose of the Study:
- To develop a soft robotic perception system integrating ultrasonic and flexible triboelectric sensors.
- To enable remote object positioning and multimodal cognition capabilities for soft robotic manipulators.
- To overcome the limitations of conventional guiding systems in terms of environment adaptability, data complexity, and cost.
Main Methods:
- Integration of an ultrasonic sensor with flexible triboelectric sensors to create a multimodal perception system.
- Utilizing reflected ultrasound from the ultrasonic sensor for object shape and distance detection.
- Capturing multimodal sensory information (profile, size, shape, hardness, material) during object grasping using both sensor types.
Main Results:
- The developed system enables remote object positioning for robotic manipulators.
- Multimodal sensory data fusion with deep-learning analytics achieved highly accurate object identification (approximately 100%).
- The system effectively integrates positioning and multimodal cognitive intelligence in soft robotics.
Conclusions:
- The proposed perception system offers a facile, low-cost, and effective solution for enhancing soft robotic functionalities.
- This methodology significantly expands the capabilities and adaptability of soft robotic systems in various applications.
- The integration of ultrasonic and triboelectric sensors provides a robust approach for advanced robotic perception and manipulation.
Related Concept Videos
What is a Sensory System?
Sensory Perception: Organization of the Somatosensory System
The receptor level:
The receptor level is the first stage of sensation. It involves the detection of a stimulus by specialized sensory receptors. The stimulus must arrive within the receptor's receptive field. Next, the receptor converts the energy of the...
Perception
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...

