Automated 3D thorax model generation using handheld video-footage

For the visualization of pulmonary ventilation with Electrical Impedance Tomography (EIT) most devices use standard reconstruction models, featuring common thorax dimensions and predetermined electrode locations. Any discrepancies between the available model and the patient in terms of body shape and electrode position lead to incorrectly displayed impedance distributions. This work addresses that problem by presenting and evaluating a method for 3D model generation of the thorax and any affixed electrodes based on handheld video-footage.

Therefore, a process was developed, providing users with the ability to capture a patient's chest and the attached electrodes via smartphone. Once data is collected, extracted images are used to generate a 3D model with a structure from motion approach and locate electrodes with ArUco markers. For the evaluation of the developed method, multiple tests were performed in laboratory environments, which were compared with manually created reference models and differences quantified based on mean distance, standard deviation, and maximum distance.

The implemented workflow allows for automated model reconstruction based on videos or selected images captured with a handheld device. It generates sparse point clouds from which a surface mesh is reconstructed and returns relative coordinates of any identified ArUco marker. The average value for the mean distance error of two model generations was 5.4 mm while the mean standard deviation was 6.0 mm. The average runtime of twelve reconstructions was 5:17 min, with a minimal runtime of 3:22 min and a maximal runtime of 7:29 min.

The presented methods and results show that model reconstruction of a patient's thorax and applied electrodes at an emergency site is feasible with already available devices. This is a first step toward the automated generation of patient-specific reconstruction models for Electrical Impedance Tomography based on images recorded with handheld devices.