Medical image retrieval using deep convolutional neural network
A. Qayyuma, S. Anwarb c✉, Muhammad Awaisd e, Muhammad Majida c
- aDepartment of Computer Engineering, University of Engineering and Technology, Taxila, Pakistan
- bDepartment of Software Engineering, University of Engineering and Technology, Taxila, Pakistan
- cSignal, Image, Multimedia Processing and Learning (SIMPLE) Group, University of Engineering and Technology, Taxila, Pakistan
- dCenter for Vision, Speech and Signal Processing, University of Surrey, Surrey, UK
- eCerebrai Artificial Intelligence, Surrey, UK
- ✉Corresponding author
Papers open inside SciRah from the original publisher or repository; SciRah never hosts them.
Abstract
Abstract With a widespread use of digital imaging data in hospitals, the size of medical image repositories is increasing rapidly. This causes difficulty in managing and querying these large databases leading to the need of content based medical image retrieval (CBMIR) systems. A major challenge in CBMIR systems is the semantic gap that exists between the low level visual information captured by imaging devices and high level semantic information perceived by human. The efficacy of such systems is more crucial in terms of feature representations that can characterize the high-level information completely. In this paper, we propose a framework of deep learning for CBMIR system by using deep convolutional neural network (CNN) that is trained for classification of medical images. An intermodal dataset that contains twenty-four classes and five modalities is used to train the network. The learned features and the classification results are used to retrieve medical images. For retrieval, best results are achieved when class based predictions are used. An average classification accuracy of 99.77% and a mean average precision of 0.69 is achieved for retrieval task. The proposed method is best suited to retrieve multimodal medical images for different body organs.
TL;DRThis paper proposes a framework of deep learning for CBMIR system by using deep convolutional neural network (CNN) that is trained for classification of medical images that is best suited to retrieve multimodal medical images for different body organs. (Semantic Scholar)