Content-based image retrieval in picture archiving and communications systems

We propose the concept of content-based image retrieval (CBIR) and demonstrate its potential use in picture archival and communication system (PACS). We address the importance of image retrieval in PACS and highlight the drawbacks existing in traditional textual-based retrieval. We use a digital mammogram database as our testing data to illustrate the idea of CBIR, where retrieval is carried out based on object shape, size, and brightness histogram. With a user-supplied query image, the system can find images with similar characteristics from the archive, and return them along with the corresponding ancillary data, which may provide a valuable reference for radiologists in a new case study. Furthermore, CBIR can perform like a consultant in emergencies when radiologists are not available. We also show that content-based retrieval is a more natural approach to man-machine communication.