Coaxial projective imaging system for surgical navigation and telementoring

A coaxial projective imaging (CPI) module acquires surgical scene images from the local site of surgery, transfers them wirelessly to the remote site, and projects instructive annotations to the surgical field. At the remote site, the surgical scene images are displayed, and the instructive annotations from a surgical specialist are wirelessly transferred back to the local site in order to guide the surgical intervention by a less experienced surgeon. The CPI module achieves seamless imaging of the surgical field and accurate projection of the instructive annotations, by a coaxial optical path design that couples the imaging arm with the projection arm and by a color correction algorithm that recovers the true color of the surgical scene. Our benchtop study of tele-guided intervention verifies that the proposed system has a positional accuracy of better than 1 mm at a working distance ranging from 300 to 500 mm. Our in vivo study of cricothyrotomy in a rabbit model proves the concept of tele-mentored surgical navigation. This is the first report of tele-guided surgery based on CPI. The proposed technique can be potentially used for surgical training and for telementored surgery in resource-limited settings.