Efficient Pneumonia Detection in Chest Xray Images Using Deep Transfer Learning

Mohammad Farukh Hashmi; Satyarth Katiyar; Avinash G Keskar; Neeraj Dhanraj Bokde; Zong Woo Geem

doi:10.3390/diagnostics10060417

journal article Open Access Jun 19, 2020

Efficient Pneumonia Detection in Chest Xray Images Using Deep Transfer Learning

Mohammad Farukh Hashmi

Satyarth Katiyar Avinash G Keskar Neeraj Dhanraj Bokde

Zong Woo Geem

Diagnostics Vol. 10 No. 6 pp. 417 · MDPI AG

View at Publisher Save 10.3390/diagnostics10060417

Abstract

Pneumonia causes the death of around 700,000 children every year and affects 7% of the global population. Chest X-rays are primarily used for the diagnosis of this disease. However, even for a trained radiologist, it is a challenging task to examine chest X-rays. There is a need to improve the diagnosis accuracy. In this work, an efficient model for the detection of pneumonia trained on digital chest X-ray images is proposed, which could aid the radiologists in their decision making process. A novel approach based on a weighted classifier is introduced, which combines the weighted predictions from the state-of-the-art deep learning models such as ResNet18, Xception, InceptionV3, DenseNet121, and MobileNetV3 in an optimal way. This approach is a supervised learning approach in which the network predicts the result based on the quality of the dataset used. Transfer learning is used to fine-tune the deep learning models to obtain higher training and validation accuracy. Partial data augmentation techniques are employed to increase the training dataset in a balanced way. The proposed weighted classifier is able to outperform all the individual models. Finally, the model is evaluated, not only in terms of test accuracy, but also in the AUC score. The final proposed weighted classifier model is able to achieve a test accuracy of 98.43% and an AUC score of 99.76 on the unseen data from the Guangzhou Women and Children’s Medical Center pneumonia dataset. Hence, the proposed model can be used for a quick diagnosis of pneumonia and can aid the radiologists in the diagnosis process.

Topics

No keywords indexed for this article. Browse by subject →

References

68

[1]

Johns Hopkins Medicine (2019, December 31). Pneumonia. Available online: https://www.hopkinsmedicine.org/health/conditions-and-diseases/pneumonia.

[2]

Johnson, S., Wells, D., and Healthline (2019, December 31). Viral Pneumonia: Symptoms, Risk Factors, and More. Available online: https://www.healthline.com/health/viral-pneumonia.

[3]

(2019, December 31). Healthcare, University of Utah. Pneumonia Makes List for Top 10 Causes of Death. Available online: https://healthcare.utah.edu/the-scope/shows.php?shows=0_riw4wti7.

[4]

WHO (2019, December 31). Pneumonia is the Leading Cause of Death in Children. Available online: https://www.who.int/maternal_child_adolescent/news_events/news/2011/pneumonia/en.

[5]

Rudan "Global estimate of the incidence of clinical pneumonia among children under five years of age" Bull. World Health Organ. (2004)

[6]

(2019, December 31). Pneumonia. Available online: https://www.radiologyinfo.org/en/info.cfm?pg=pneumonia.

[7]

World Health Organization (2001). Standardization of Interpretation of Chest Radiographs for the Diagnosis of Pneumonia in Children, World Health Organization. Technical Report.

[8]

Cherian "Standardized interpretation of paediatric chest radiographs for the diagnosis of pneumonia in epidemiological studies" Bull. World Health Organ. (2005)

[9]

Franquet "Imaging of pneumonia: Trends and algorithms" Eur. Respir. J. (2001) 10.1183/09031936.01.00213501

[10]

Tahir, A.M., Chowdhury, M.E., Khandakar, A., Al-Hamouz, S., Abdalla, M., Awadallah, S., Reaz, M.B.I., and Al-Emadi, N. (2020). A systematic approach to the design and characterization of a smart insole for detecting vertical ground reaction force (vGRF) in gait analysis. Sensors, 20. 10.3390/s20040957

[11]

Chowdhury, M.E., Alzoubi, K., Khandakar, A., Khallifa, R., Abouhasera, R., Koubaa, S., Ahmed, R., and Hasan, A. (2019). Wearable real-time heart attack detection and warning system to reduce road accidents. Sensors, 19. 10.3390/s19122780

[12]

Chowdhury, M.E.H., Khandakar, A., Alzoubi, K., Mansoor, S., Tahir, A.M., Reaz, M.B.I., and Al-Emadi, N. (2019). Real-time smart-digital stethoscope system for heart diseases monitoring. Sensors, 19. 10.3390/s19122781

[13]

Kallianos "How far have we come? Artificial intelligence for chest radiograph interpretation" Clin. Radiol. (2019) 10.1016/j.crad.2018.12.015

[14]

Liu "Exploiting convolutional neural networks with deeply local description for remote sensing image classification" IEEE Access (2018) 10.1109/access.2018.2798799

[15]

Artificial intelligence in radiology

Ahmed Hosny, Chintan Parmar, John Quackenbush et al.

Nature Reviews Cancer 2018 10.1038/s41568-018-0016-5

[16]

Naicker "Shortage of healthcare workers in developing countries–Africa" Ethn. Dis. (2009)

[17]

Douarre, C., Schielein, R., Frindel, C., Gerth, S., and Rousseau, D. (2018). Transfer learning from synthetic data applied to soil–root segmentation in x-ray tomography images. J. Imaging, 4. 10.3390/jimaging4050065

[18]

Zhang, Y., Wang, G., Li, M., and Han, S. (2018). Automated classification analysis of geological structures based on images data and deep learning model. Appl. Sci., 8. 10.3390/app8122493

[19]

Ship Classification in High-Resolution SAR Images Using Deep Learning of Small Datasets

Yuanyuan Wang, Chao Wang, Hong Zhang

Sensors 10.3390/s18092929

[20]

Sun, C., Yang, Y., Wen, C., Xie, K., and Wen, F. (2018). Voiceprint identification for limited dataset using the deep migration hybrid model based on transfer learning. Sensors, 18. 10.3390/s18072399

[21]

Chen, Z., Zhang, Y., Ouyang, C., Zhang, F., and Ma, J. (2018). Automated landslides detection for mountain cities using multi-temporal remote sensing imagery. Sensors, 18. 10.3390/s18030821

[22]

Razzak, M.I., Naz, S., and Zaib, A. (2018). Deep learning for medical image processing: Overview, challenges and the future. Classification in BioApps, Springer. 10.1007/978-3-319-65981-7_12

[23]

Deep Learning in Medical Image Analysis

Dinggang Shen, Guorong Wu, Heung-Il Suk

Annual Review of Biomedical Engineering 2017 10.1146/annurev-bioeng-071516-044442

[24]

Dermatologist-level classification of skin cancer with deep neural networks

Andre Esteva, Brett Kuprel, Roberto A. Novoa et al.

Nature 2017 10.1038/nature21056

[25]

V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation

Fausto Milletari, Nassir Navab, Seyed-Ahmad Ahmadi

2016 Fourth International Conference on 3D Vision... 10.1109/3dv.2016.79

[26]

Grewal, M., Srivastava, M.M., Kumar, P., and Varadarajan, S. (2018, January 4–7). Radnet: Radiologist level accuracy using deep learning for hemorrhage detection in ct scans. Proceedings of the 2018 IEEE 15th International Symposium on Biomedical Imaging, Washington, DC, USA. 10.1109/isbi.2018.8363574

[27]

Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs

Varun Gulshan, Lily Peng, Marc Coram et al.

JAMA 2016 10.1001/jama.2016.17216

[28]

Bar, Y., Diamant, I., Wolf, L., Lieberman, S., Konen, E., and Greenspan, H. (2015, January 16–19). Chest pathology detection using deep learning with non-medical training. Proceedings of the 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI), New York, NY, USA. 10.1109/isbi.2015.7163871

[29]

Avni "X-ray categorization and retrieval on the organ and pathology level, using patch based visual words" IEEE Trans. Med. Imaging (2010) 10.1109/tmi.2010.2095026

[30]

Melendez "A novel multiple-instance learning based approach to computer-aided detection of tuberculosis on chest x-rays" IEEE Trans. Med. Imaging (2014) 10.1109/tmi.2014.2350539

[31]

Jaeger "Automatic tuberculosis screening using chest radiographs" IEEE Trans. Med. Imaging (2013) 10.1109/tmi.2013.2284099

[32]

Hermann, S. (2014, January 23–28). Evaluation of scan-line optimization for 3D medical image registration. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA. 10.1109/cvpr.2014.393

[33]

Nasrullah, N., Sang, J., Alam, M.S., Mateen, M., Cai, B., and Hu, H. (2019). Automated Lung Nodule Detection and Classification Using Deep Learning Combined with Multiple Strategies. Sensors, 19. 10.3390/s19173722

[34]

Yao, L., Poblenz, E., Dagunts, D., Covington, B., Bernard, D., and Lyman, K. (2017). Learning to diagnose from scratch by exploiting dependencies among labels. arXiv.

[35]

Khatri, A.A.R.J., Vashista, H., Mittal, N., Ranjan, P., and Janardhanan, R. (2020). Pneumonia Identification in Chest X-Ray Images Using EMD. Trends in Communication, Cloud, and Big Data, Springer. 10.1007/978-981-15-1624-5_9

[36]

Abiyev "Deep convolutional neural networks for chest diseases detection" J. Healthc. Eng. (2018) 10.1155/2018/4168538

[37]

Stephen "An efficient deep learning approach to pneumonia classification in healthcare" J. Healthc. Eng. (2019) 10.1155/2019/4180949

[38]

Cohen, J.P., Bertin, P., and Frappier, V. (2019). Chester: A Web Delivered Locally Computed Chest X-Ray Disease Prediction System. arXiv.

[39]

Rajaraman, S., Candemir, S., Kim, I., Thoma, G., and Antani, S. (2018). Visualization and interpretation of convolutional neural network predictions in detecting pneumonia in pediatric chest radiographs. Appl. Sci., 8. 10.3390/app8101715

[40]

Sirazitdinov "Deep neural network ensemble for pneumonia localization from a large-scale chest x-ray database" Comput. Electr. Eng. (2019) 10.1016/j.compeleceng.2019.08.004

[41]

Lakhani "Deep learning at chest radiography: Automated classification of pulmonary tuberculosis by using convolutional neural networks" Radiology (2017) 10.1148/radiol.2017162326

[42]

Rajpurkar, P., Irvin, J., Ball, R.L., Zhu, K., Yang, B., Mehta, H., and Duan, T. (2018). Deep learning for chest radiograph diagnosis: A retrospective comparison of the CheXNeXt algorithm to practicing radiologists. PLoS Med., 15. 10.1371/journal.pmed.1002686

[43]

Ho, T.K.K., and Gwak, J. (2019). Multiple feature integration for classification of thoracic disease in chest radiography. Appl. Sci., 9. 10.3390/app9194130

[44]

Saraiva, A., Santos, D., Costa, N.J.C., Sousa, J.V.M., Ferreira, N.F., Valente, A., and Soares, S. (2020, June 18). Models of Learning to Classify X-ray Images for the Detection of Pneumonia using Neural Networks. Available online: https://www.semanticscholar.org/paper/Models-of-Learning-to-Classify-X-ray-Images-for-the-Saraiva-Santos/0b8f202505b3d49c42fd45d86eca5dbd0b76fded?p2df.

[45]

Ayan, E., and Ünver, H.M. (2019, January 2–26). Diagnosis of Pneumonia from Chest X-Ray Images Using Deep Learning. Proceedings of the 2019 Scientific Meeting on Electrical-Electronics & Biomedical Engineering and Computer Science (EBBT), Istanbul, Turkey. 10.1109/ebbt.2019.8741582

[46]

Rahman, T., Chowdhury, M.E., Khandakar, A., Islam, K.R., Islam, K.F., Mahbub, Z.B., Kadir, M.A., and Kashem, S. (2020). Transfer Learning with Deep Convolutional Neural Network (CNN) for Pneumonia Detection using Chest X-ray. Appl. Sci., 10. 10.3390/app10093233

[47]

Xiao, Z., Du, N., Geng, L., Zhang, F., Wu, J., and Liu, Y. (2019). Multi-scale heterogeneous 3D CNN for false-positive reduction in pulmonary nodule detection, based on chest CT images. Appl. Sci., 9. 10.3390/app9163261

[48]

Xu "CXNet-m1: Anomaly detection on chest X-rays with image based deep learning" IEEE Access (2018) 10.1109/access.2018.2885997

[49]

Jaiswal "Identifying pneumonia in chest X-rays: A deep learning approach" Measurement (2019) 10.1016/j.measurement.2019.05.076

[50]

Jung, H., Kim, B., and Lee, I. (2018). Classification of lung nodules in CT scans using three-dimensional deep convolutional neural networks with a checkpoint ensemble method. BMC Med. Imaging, 18. 10.1186/s12880-018-0286-0

Showing 50 of 68 references

Cited By

286

Application of machine learning in polymer additive manufacturing: A review

Tahamina Nasrin, Farhad Pourkamali‐Anaraki · 2023

Journal of Polymer Science

Pediatric pneumonia diagnosis using stacked ensemble learning on multi-model deep CNN architectures

J Arun Prakash, CR Asswin · 2022

Multimedia Tools and Applications

Customized VGG19 Architecture for Pneumonia Detection in Chest X-Rays

Nilanjan Dey, Yu-Dong Zhang · 2021

Pattern Recognition Letters

A comparative study of multiple neural network for detection of COVID-19 on chest X-ray

Anis Shazia, Tan Zi Xuan · 2021

EURASIP Journal on Advances in Sign...

Metrics

286

Citations

68

References

Details

Published: Jun 19, 2020
Vol/Issue: 10(6)
Pages: 417
License: View

Authors

M

Mohammad Farukh Hashmi

Department of Electronics and Communication Engineering, National Institute of Technology, Warangal 506004, India

S

Satyarth Katiyar

Department of Electronics and Communication Engineering, Harcourt Butler Technical University, Kanpur 208002, India

A

Avinash G Keskar

Department of Electronics and Communication Engineering, Visvesvaraya National Institute of Technology, Nagpur 440010, India

N

Neeraj Dhanraj Bokde

Department of Engineering-Renewable Energy and Thermodynamics, Aarhus University, 8000 Aarhus, Denmark

Z

Zong Woo Geem

Department of Energy IT, Gachon University, Seongnam 13120, Korea

Funding

National Research Foundation of Korea Award: 2020R1A2C1A01011131

Cite This Article

Mohammad Farukh Hashmi, Satyarth Katiyar, Avinash G Keskar, et al. (2020). Efficient Pneumonia Detection in Chest Xray Images Using Deep Transfer Learning. Diagnostics, 10(6), 417. https://doi.org/10.3390/diagnostics10060417

Efficient Pneumonia Detection in Chest Xray Images Using Deep Transfer Learning

You May Also Like