Development of an Aerial Manipulation System Using Onboard Cameras and a Multi-Fingered Robotic Hand with Proximity...

Area of Science:

• Robotics and Automation
• Computer Vision
• Aerospace Engineering

Background:

• Aerial manipulation using unmanned aerial vehicles (UAVs) is crucial for tasks like object transport and placement.
• Accurate object localization and precise UAV control are essential for successful grasping in real-world applications.
• Existing systems often struggle with precise positioning in GPS-denied environments.

Purpose of the Study:

• To develop an integrated aerial manipulation system for autonomous object grasping.
• To enhance UAV navigation and target localization accuracy, particularly in GPS-denied conditions.
• To achieve precise UAV hovering within the grasping tolerance of a robotic hand.

Main Methods:

• Development of an aerial manipulation system comprising a UAV, dual onboard cameras (tracking and depth), and a multi-fingered robotic hand with proximity sensors.
• Implementation of an object detection algorithm combining data from both cameras for precise target localization.
• Experimental determination of optimal camera mount orientation and UAV attitude sampling rates to minimize position error.

Main Results:

• The developed system successfully achieved autonomous navigation and object detection in a GPS-denied environment.
• The integrated object detection algorithm significantly improved target localization accuracy.
• Experimental optimizations reduced UAV position error to within the robotic hand's 50 mm grasping tolerance.

Conclusions:

• The developed aerial manipulation system demonstrates the feasibility of precise, autonomous object grasping using UAVs.
• The combination of advanced vision algorithms and optimized UAV control enables reliable aerial manipulation.
• This research contributes to the advancement of autonomous robotic systems for complex real-world tasks.