Surgical fiducial segmentation and tracking for pose estimation based on ultrasound B-mode images

Doppler ultrasound is a non-invasive diagnostic tool for the quantitative measurement of blood flow. However, given that it provides velocity data that is dependent on the location and angle of measurement, repeat measurements to detect problems over time may require an expert to return to the same location. We therefore developed an image-guidance system based on ultrasound B-mode images that enables an inexperienced user to position the ultrasound probe at the same site repeatedly in order to acquire a comparable time series of Doppler readings. The system utilizes a bioresorbable fiducial and complementing software composed of the fiducial detection, key points tracking, probe pose estimation, and graphical user interface (GUI) modules. The fiducial is an echogenic marker that is implanted at the surgical site and can be detected and tracked during ultrasound B-mode screening. The key points on the marker can next be used to determine the pose of the ultrasound probe with respect to the marker. The 3D representation of the probe with its position and orientation are then displayed in the GUI for the user guidance. The fiducial detection has been tested on the data sets collected from three animal studies. The pose estimation algorithm was validated by five data sets collected by a UR5 robot. We tested the system on a plastisol phantom and showed that it can detect and track the fiducial marker while displaying the probe pose in real-time.