Fast 3D Rotation Estimation of Fruits Using Spheroid Models

Area of Science:

• Computer Vision
• Agricultural Technology
• Robotics

Background:

• Automated fruit inspection traditionally analyzes each camera view independently.
• Matching defects across views is crucial for accurate global fruit quality assessment and to avoid redundant defect counting.
• Existing methods lack efficient 3D rotation estimation for comprehensive surface examination.

Purpose of the Study:

• To develop a method for estimating 3D fruit rotation from a single camera using geometric modeling.
• To enable accurate defect matching and create a topographic map of the entire fruit surface.
• To significantly improve the speed and efficiency of automated fruit inspection systems.

Main Methods:

• Modeling fruit geometry as a 3D spheroid.
• Estimating spheroid size and pose from silhouettes across multiple views.
• Calculating single 3D rotations between sequential views using the fitted geometric model.

Main Results:

• Successfully estimated 3D fruit rotations for defect matching and topographic map generation.
• Achieved rapid rotation estimation, with execution times under 0.5 ms per rotation on a standard CPU.
• Demonstrated the potential to analyze a single topographic map instead of numerous individual views.

Conclusions:

• The proposed spheroid modeling and 3D rotation estimation method significantly enhances automated fruit inspection.
• The speed and accuracy of the method open possibilities for real-time, comprehensive fruit quality analysis.
• This approach facilitates defect propagation and the creation of detailed fruit surface topographic maps.