Related Experiment Video
Updated: Jan 29, 2026
05:43
Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback
Published on: May 23, 2019
5.8K
Enhancing Robotic Grasping Detection Using Visual-Tactile Fusion Perception
Dongyuan Zheng1,2, Yahong Chen1
1School of Artificial Intelligence, Lishui University, Lishui 323000, China.
Sensors (Basel, Switzerland)
|January 28, 2026
Summary
This study introduces a new robotic grasping detection method using combined visual and tactile perception. The novel approach significantly improves grasping accuracy by predicting grasp stability.
Area of Science:
- Robotics and Artificial Intelligence
- Sensor Fusion and Perception
Background:
- Tactile perception is increasingly integrated into robotics for tasks like object recognition and grasp assessment.
- Current methods often limit tactile perception's role, overlooking its potential for enhancing grasp detection.
- Rethinking the synergy between visual and tactile data is crucial for advancing robotic manipulation.
Purpose of the Study:
- To propose a novel robotic grasping detection method leveraging both visual and tactile perception.
- To enhance the accuracy of robotic grasping detection through a fused perception approach.
- To introduce a Grasp Stability Prediction Module (GSPM) for improved grasp stability assessment.
Main Methods:
- Construction of a visual-tactile dataset incorporating grasp stability for potential grasping positions.
- Development of a Grasp Stability Prediction Module (GSPM) to generate grasp stability probability maps.
- Fusion of the grasp stability map with corresponding color images as input for the grasp detection network.
Main Results:
- The visual-tactile fusion method significantly enhances robotic grasping detection accuracy.
- The Grasp Stability Prediction Module provides valuable prior knowledge for grasp detection.
- Experimental validation confirms the effectiveness of the proposed approach.
Conclusions:
- Combining visual and tactile perception offers a superior approach to robotic grasping detection.
- The novel method, integrating a GSPM, demonstrates a significant improvement in grasping accuracy.
- This research opens new avenues for advanced robotic manipulation through enhanced perception.
Related Concept Videos
02:45Nuclear Fusion
33.8K
The process of converting very light nuclei into heavier nuclei is also accompanied by the conversion of mass into large amounts of energy, a process called fusion. The principal source of energy in the sun is a net fusion reaction in which four hydrogen nuclei fuse and ultimately produce one helium nucleus and two positrons.
A helium nucleus has a mass that is 0.7% less than that of four hydrogen nuclei; this lost mass is converted into energy during the fusion. This reaction produces about...
A helium nucleus has a mass that is 0.7% less than that of four hydrogen nuclei; this lost mass is converted into energy during the fusion. This reaction produces about...
33.8K
01:15Subliminal Perception
782
Subliminal perception refers to the processing of sensory information that occurs below the level of conscious awareness. Researchers study subliminal perception by presenting a stimulus, such as a word or image, very quickly, typically around 50 milliseconds. This rapid presentation is often followed by another stimulus, such as a pattern of dots or lines, which blocks further mental processing of the initial stimulus. As a result, if participants cannot identify the initial stimulus better...
782
01:25Factors Affecting Perception
2.7K
Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
An illustrative example of a perceptual set is the scenario where an airline pilot told...
2.7K
03:00Self-Evaluation: Self-Enhancement and Self-Verification
5.8K
Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
5.8K
01:27Tactile and Chemical Senses
791
Tactile senses encompass touch, temperature, and pain, each mediated by specific receptors. Touch receptors detect mechanical energy or pressure against the skin. Sensory fibers from these receptors enter the spinal cord and relay information to the brain stem. Here, most fibers cross over to the opposite side of the brain. The touch information then moves to the thalamus, which projects a map of the body's surface onto the somatosensory areas of the parietal lobes in the cerebral cortex.
791
01:28Perception
1.1K
Perception is a fundamental psychological process that enables individuals to organize, interpret, and consciously experience sensory information. This process is crucial for understanding and interacting with the world around us. It includes both bottom-up and top-down processing, each playing a distinct role in how we perceive our environment.
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...
1.1K