Combining 3D models with 2D infrared images for medical applications

Infrared images are very useful for providing physiological information, although the representation is two-dimensional. On the other hand, a 3D scanning system is able to generate precise 3D spatial models of the area under study. This paper presents a methodology for combining both imaging modalities into a single representation. The Structure from Motion (SfM) technique is used in order to find the correct infrared camera's positioning and rotations in the space. Then, those 2D infrared images generate a 3D SfM model. Following this stage, the SfM model is replaced by an accurate 3D model from a scanning system, which is wrapped around by the infrared images. The experiments performed with a volunteer's face have shown that the proposed methodology successfully reconstruct a unique 3D surface model, which is able to deliver potential clinical applications.