Related Experiment Video
Updated: Jul 12, 2025

Longitudinal Intravital Imaging Through Clear Silicone Windows
Published on: January 5, 2022
[Recognizing transparent objects for laboratory automation]
Markus Vincze1, Jean-Baptiste Weibel1, Stefan Thalhammer1
1Automatisierungs- und Regelungstechnik Institut, TU Wien, Gusshausstr. 27/376, 1040 Wien, Österreich.
Abstract:
While matte objects can be visually recognized well and grasped with robots, transparent objects pose new challenges. Modern color and depth cameras (RGB-D) do not deliver correct depth data but distorted images of the background. In this paper, we show which methods are suitable to detect transparent objects in color images only and to determine their pose. Using a robotic system, views of the targeted object are generated and annotated to learn methods and to obtain data for evaluation. We also show that by using an improved method for fitting the 3D pose, a significant improvement in the accuracy of pose estimation is achieved. Thus, false detections can be eliminated and for correct detections the accuracy of pose estimation is improved. This makes it possible to grasp transparent objects with a robot.

