The Investigation of Deep Convolutional Neural Network for Diagnosing Breast Cancer in Thermographic Images

Document Type : Original Article


1 Assistant Professor, Department of Electrical Engineering, Vali-e-Asr University of Rafsanjan.

2 Assistant Professor of Biomedical Engineering , Department of Electrical Engineering , Vali-e-Asr University of Rafsanjan, Rafsanjan, Iran

3 Assistant Professor of control Engineering, Dept. of Electrical Engineering,Faculty of Engineering, Vali-E-Asr University of Rafsanjan, Rafsanjan, Iran.

4 Associate Professor of Radiology Department of Radiology, School of Medicine Advanced Diagnostic and Interventional Radiology Research Center, Tehran, Iran.


Background and Objectives: Computer-aided design diagnostic systems are widely used in the differential diagnosis of breast cancer. Therefore, improving the accuracy of a CAD system has become an important field of research. In this paper, we investigated CAD systems based on deep neural networks of convolution type to detect breast cancer in thermographic images.
Materials and Methods: For analyzing the proposed model, the DMR database has been used. The number of the participants examined were 196, including 41 cases of cancer and 155 healthy subjects. Each person had 10 images of thermography. The total number of the analyzed images included 1960 images of thermography. The classification of thermal images including cancerous and healthy images is based on three types of deep convolution neural networks including google net, resnet18 and vgg16.
Results: The accuracy and specificity of the results using a neural network models of deep pre-training on google-net, resnet18 and vgg16 is 85.03%-89.7%, 83.8% -91.9% and 85.03% -91,01% respectively. The proposed model is capable of providing a significant response to the different breast tissue morphologies.
Conclusion: The model of deep artificial neural network can be used as an efficient and intelligent way to detect cancer in original thermal images without extracting features. However, more studies are needed to design other models of artificial neural networks based on deep learning to detect malignant or benign cancer in thermal imagery.


1-Prabha S, Sujatha C. Proposal of index to estimate breast similarities in thermograms using fuzzy C means and anisotropic diffusion filter based fuzzy C means clustering. Infrared Physics & Technology. 2018;93:316-25.
2-Díaz-Cortés M-A, Ortega-Sánchez N, Hinojosa S, Oliva D, Cuevas E, Rojas R, et al. A multi-level thresholding method for breast thermograms analysis using Dragonfly algorithm. Infrared Physics & Technology. 2018;93:346-61.
3-Suganthi S, Ramakrishnan S. Anisotropic diffusion filter based edge enhancement for segmentation of breast thermogram using level sets. Biomedical Signal Processing and Control. 2014;10:128-36.
4-Kandlikar SG, Perez-Raya I, Raghupathi PA, Gonzalez-Hernandez J-L, Dabydeen D, Medeiros L, et al. Infrared imaging technology for breast cancer detection–Current status, protocols and new directions. International Journal of Heat and Mass Transfer. 2017;108:2303-20.
5-Ng E-K. A review of thermography as promising non-invasive detection modality for breast tumor. International Journal of Thermal Sciences. 2009;48(5):849-59.
6-Kuhl CK, Schrading S, Leutner CC, Morakkabati-Spitz N, Wardelmann E, Fimmers R, et al. Mammography, breast ultrasound, and magnetic resonance imaging for surveillance of women at high familial risk for breast cancer. Journal of clinical oncology. 2005;23(33):8469-76.
7-Lahiri B, Bagavathiappan S, Jayakumar T, Philip J. Medical applications of infrared thermography: a review. Infrared Physics & Technology. 2012;55(4):221-35.
8-Ghafarpour A, Zare I, Zadeh HG, Haddadnia J, Zadeh FJS, Zadeh ZE, et al. A review of the dedicated studies to breast cancer diagnosis by thermal imaging in the fields of medical and artificial intelligence sciences. Biomedical Research. 2016;27(2).
9-            Keyserlingk J, Ahlgren P, Yu E, Belliveau N, Yassa M. Functional infrared imaging of the breast. IEEE Engineering in Medicine and Biology Magazine. 2000;19(3):30-41.
10-Gogoi UR, Bhowmik MK, Bhattacharjee D, Ghosh AK. Singular value based characterization and analysis of thermal patches for early breast abnormality detection. Australasian physical & engineering sciences in medicine. 2018;41(4):861-79.
11-Borchartt TB, Conci A, Lima RC, Resmini R, Sanchez A. Breast thermography from an image processing viewpoint: A survey. Signal Processing. 2013;93(10):2785-803.
12-Borchartt TB, Resmini R, Conci A, Martins A, Silva AC, Diniz EM, et al., editors. Thermal feature analysis to aid on breast disease diagnosis. Proceedings of 21st Brazilian Congress of Mechanical Engineering—COBEM22 ; 2011.
13-Acharya UR, Ng EY-K, Tan J-H, Sree SV. Thermography based breast cancer detection using texture features and support vector machine. Journal of medical systems. 2012;36(3):1503-10.
14-Nicandro C-R, Efrén M-M, María Yaneli A-A, Enrique M-D-C-M, Héctor Gabriel A-M, Nancy P-C, et al. Evaluation of the diagnostic power of thermography in breast cancer using bayesian network classifiers. Computational and mathematical methods in medicine. 2013;2013.
15-Pramanik S, Bhattacharjee D, Nasipuri M, editors. Wavelet based thermogram analysis for breast cancer detection. Advanced Computing and Communication (ISACC), 2015 International Symposium on; 2015: IEEE.
16-Schaefer G, Závišek M, Nakashima T. Thermography based breast cancer analysis using statistical features and fuzzy classification. Pattern Recognition. 2009;42(6):1133-7.
17-Ng E, Kee E. Integrative computer-aided diagnostic with breast thermogram. Journal of Mechanics in Medicine and Biology. 2007;7(01):1-10.
18-Mookiah MRK, Acharya UR, Ng E. Data mining technique for breast cancer detection in thermograms using hybrid feature extraction strategy. Quantitative InfraRed Thermography Journal. 2012;9(2):151-65.
19-Francis SV, Sasikala M, Saranya S. Detection of breast abnormality from thermograms using curvelet transform based feature extraction. Journal of medical systems. 2014;38(4):23.
20-Araújo MC, Lima RC, De Souza RM. Interval symbolic feature extraction for thermography breast cancer detection. Expert Systems with Applications. 2014;14(15):6728-37.
21-Haddadnia J, Hashemian M, Hassanpour K. Diagnosis of breast cancer using a combination of genetic algorithm and artificial neural network in medical infrared thermal imaging. Iranian Journal of Medical Physics. 2012;9(4):265-74.
22-Sathish D, Kamath S, Prasad K, Kadavigere R, Martis RJ. Asymmetry analysis of breast thermograms using automated segmentation and texture features. Signal, Image and Video Processing. 2017;11(4):745-52.
23-Lashkari A, Pak F, Firouzmand M. Full intelligent cancer classification of thermal breast images to assist physician in clinical diagnostic applications. Journal of medical signals and sensors. 2016;6(1):12.
24-Zadeh HG, Haddadnia J, Montazeri A. A model for diagnosing breast cancerous tissue from thermal images using active contour and Lyapunov exponent. Iranian journal of public health. 2016;45(5):657.
25-Ghayoumi Zadeh H, Montazeri A, Abaspur Kazerouni I, Haddadnia J. Clustering and screening for breast cancer on thermal images using a combination of SOM and MLP. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization. 2017;5(1):68-76.
26-PROENG. Image Processing and Image Analyses Applied to Mastology, 2012,
27-Motta L, Conci A, Lima R, Diniz E, Luís S, editors. Automatic segmentation on thermograms in order to aid diagnosis and 2D modeling. Proc of 10th Workshop em Informática Médica; 2010.
28-Chambolle A, De Vore RA, Lee N-Y, Lucier BJ. Nonlinear wavelet image processing: variational problems, compression, and noise removal through wavelet shrinkage. IEEE Transactions on Image Processing. 1998;7(3):319-35.
29-Fernández-Ovies FJ, Alférez-Baquero ES, de Andrés-Galiana EJ, Cernea A, Fernández-Muñiz Z, Fernández-Martínez JL, editors. Detection of Breast Cancer Using Infrared Thermography and Deep Neural Networks. International Work-Conference on Bioinformatics and Biomedical Engineering; 2019: Springer.
30-Albelwi S, Mahmood A. A framework for designing the architectures of deep convolutional neural networks. Entropy. 2017;19(6):242.
31-Spanhol FA, Oliveira LS, Petitjean C, Heutte L, editors. Breast cancer histopathological image classification using convolutional neural networks. 2016 international joint conference on neural networks (IJCNN); 2016: IEEE.
32-Wakankar AT, Suresh G, editors. Automatic diagnosis of breast cancer using thermographic color analysis and SVM classifier. The International Symposium on Intelligent Systems Technologies and Applications; 2016: Springer.
33-Bianco S, Cadene R, Celona L, Napoletano P. Benchmark Analysis of Representative Deep Neural Network Architectures. IEEE Access. 2018;6:64270-7.
34-Szegedy C, Ioffe S, Vanhoucke V, Alemi AA, editors. Inception-v4, inception-resnet and the impact of residual connections on learning. Thirty-First AAAI Conference on Artificial Intelligence; 2017.