3D Contact Position Estimation of Image-Based Areal Soft Tactile Sensor with Printed Array Markers and Image Sensors

Area of Science:

• Robotics
• Sensor Technology
• Human-Machine Interaction

Background:

• Tactile sensors are crucial for medical and industrial applications, with growing use in interactive robotics.
• Soft, customizable, and inexpensive tactile sensors are needed for safe human-machine interaction.

Purpose of the Study:

• To develop and validate a novel image-based areal soft tactile sensor (IASTS).
• To estimate the 3D contact position of the IASTS using printed array markers and multiple cameras.

Main Methods:

• Designed a prototype IASTS with a soft material, printed array markers, and multiple cameras with LEDs.
• Developed an image processing algorithm for contact position estimation using marker analysis and Gaussian fitting.
• Implemented a Kalman filter to enhance the stability of estimated contact positions.

Main Results:

• Verified the effectiveness of the IASTS hardware and estimation software through basic experiments.
• Demonstrated reasonable error values in estimating contact positions on the soft tactile sensor.
• Showcased the potential for soft haptic applications.

Conclusions:

• The proposed IASTS effectively estimates 3D contact positions for soft haptic applications.
• The system offers a promising approach for developing advanced interactive robots and human-machine interfaces.