Objective evaluation of three-dimensional image registration algorithms--tools for optimization and evaluation

The registration of medical volume data sets plays an important role when different images or modalities are used during computer-assisted surgical procedures. Nevertheless, it is often questionable how robust and accurate the underlying algorithms really are. Therefore, the goal is to foster the establishment of methods for an objective evaluation.

To reliably calculate the accuracy of registration algorithms, a reference transformation must be known. Due to the unknown perfect registration for real clinical data, the simulation of realistic data and successive affine transformations are employed. The simulation is based on models of the respective imaging modality where the dominant physical effects are taken into account. This gives the user full control over all simulation and transformation parameters. Finally, suitable quality measures are applied which allow a systematic evaluation of image registration accuracy by comparing the known theoretical result and the transformation calculated by the algorithm under investigation.

During the development of a new registration algorithm, the presented method proved to be a very valuable tool for optimization and evaluation of registration accuracy, since it allows objective numerical comparison of the calculated results.

The presented method can be used during the development of algorithms for optimization and for quantitative comparison of different registration schemes. The respective software tool can automatically generate and transform simulated but realistic data. Employing suitable numerical quality measures, an objective evaluation of registration results can be easily obtained. Still, the validity of the relatively simple models has to be verified to draw reliable conclusions with respect to real data.