Image content extraction: application to MR images of the brain

A system for automatically extracting image content features was developed that combines registration to a labeled atlas with natural language processing of free-text radiology reports. The system was then tested with T1-weighted, spoiled gradient-echo magnetic resonance (MR) imaging studies of the brain performed in nine patients. The locations of 599 structures were visually assessed by an experienced radiologist and compared with the locations indicated by automated output. The in-plane accuracy of the contours was subjectively evaluated as either good, moderate, or poor. The criterion for classifying a structure as correctly located was that 90% or more of all the images containing the structure had to be correctly identified. For 98% of the structures, the images identified by the automated algorithm agreed with those identified by the radiologist, and in 83% of cases, image contours showed a good in-plane overlap. The results of this validation study demonstrate that this combination of registration and natural language processing is accurate in identifying relevant images from brain MR imaging studies. However, the range of applicability of this technique has yet to be determined by applying the technique to a large number of studies.