The International Arab Journal of Information Technology (IAJIT)

..............................
..............................
..............................


A Comparative Study of Different Pre-Trained Deep Learning Models and Custom CNN for Pancreatic Tumor Detection

Artificial Intelligence and its sub-branches like Machine Learning (ML) and Deep Learning (DL) applications have the potential to have positive effects that can directly affect human life. Medical imaging is briefly making the internal structure of the human body visible with various methods. With deep learning models, cancer detection, which is one of the most lethal diseases in the world, can be made possible with high accuracy. Pancreatic Tumor detection, which is one of the cancer types with the highest fatality rate, is one of the main targets of this project, together with the data set of computed tomography images, which is one of the medical imaging techniques and has an effective structure in Pancreatic Cancer imaging. In the field of image classification, which is a computer vision task, the transfer learning technique, which has gained popularity in recent years, has been applied quite frequently. Using pre-trained models were previously trained on a fairly large dataset and using them on medical images is common nowadays. The main objective of this article is to use this method, which is very popular in the medical imaging field, in the detection of PDAC, one of the deadliest types of pancreatic cancer, and to investigate how it per- forms compared to the custom model created and trained from scratch. The pre-trained models which are used in this project are VGG-16 and ResNet, which are popular Convolutional Neutral Network models, for Pancreatic Tumor Detection task. With the use of these models, early diagnosis of pancreatic cancer, which progresses insidiously and therefore does not spread to neighboring tissues and organs when the treatment process is started, may be possible. Due to the abundance of medical images reviewed by medical professionals, which is one of the main causes for heavy workload of healthcare systems, this application can assist radiologists and other specialists in Pancreatic Tumor detection by providing faster and more accurate method.

[1] Albawi S., Mohammed T., and Al-Zawi S., “Understanding of a Convolutional Neural Network,” in Proceedings of International Conference on Engineering and Technology, Antalya, pp. 1-6, 2017. DOI: 10.1109/ICEngTechnol.2017.8308186.

[2] Alves N., Schuurmans M., Litjens G., Bosma J. S., Hermans J. and Huisman H., “Fully Automatic Deep Learning Framework for Pancreatic Ductal Adenocarcinoma Detection on Computed Tomography,” Cancers, vol. 14, no. 2, pp. 376, 2022. https://doi.org/10.3390/cancers14020376

[3] Baraniuk R., Donoho D., and Gavish M., “The Science of Deep Learning,” Proceedings of the National Academy of Sciences, vol. 117, no. 48. pp. 30029-30032, 2020. DOI: https://doi.org/10.1073/pnas.202059611.

[4] Cai S., Shu Y., Chen G., Ooi B., Wang W., and Zhang M., “Effective and Efficient Dropout for Deep Convolutional Neural Networks,” arXiv preprint arXiv:1904.03392, 2019. https://doi.org/10.48550/arXiv.1904.03392

[5] Cardoza I., Garc´ıa-Va´zquez J., D´ıaz-Ram´ırez A., and Quintero-Rosas V., “Convolutional Neural Networks Hyperparameter Tunning for Classifying Firearms on Images,” Applied Artificial Intelligence, vol. 36, no. 1, 2022. https://doi.org/10.1080/08839514.2022.2058165.

[6] Chen P., Wu T., Wang P., Chang D., Liu K., Wu M., Roth H., Lee P., Liao W., and Wang W., “Pancreatic Cancer Detection on CT Scans with Deep Learning: A Nationwide Population-Based Study,” Radiology, vol. 306, no. 1, pp.172-182, 2023. https://doi.org/10.1148/radiol.220152.

[7] England J. and Cheng P., “Artificial Intelligence for Medical Image Analysis: A Guide for Authors and Reviewers,” American Journal of Roentgenology, vol. 212, no. 3, pp. 513-519, 2019. doi: 10.2214/ajr.18.20490.

[8] Erickson B.J., Korfiatis P., Akkus Z., and Kline T., “Machine Learning for Medical Imaging,” RadioGraphics, vol. 37, no. 2, pp. 505-515, 2017. DOI: https://doi.org/10.1148/rg.2017160130. A Comparative Study of Different Pre-Trained Deep Learning Models and Custom CNN for ... 525

[9] Francis I., “Role of CT and MR in Detection and Staging of Pancreatic Adenocarcinoma,” Cancer Imaging, vol. 4, no. 1, pp. 10-14, 2003. DOI: 10.1102/1470-7330.2003.0026.

[10] Gupta A., Koul A., and Kumar Y., “Pancreatic Cancer Detection Using Machine and Deep Learning Techniques,” in Proceedings of the 2nd International Conference on Innovative Practices in Technology and Management (ICIPTM), Gautam Buddha Nagar, pp. 151-155, 2022. DOI: 10.1109/ICIPTM54933.2022.9754010.

[11] Hao W., Yizhou W., Yaqin L., and Zhili S., “The Role of Activation Function in CNN,” in Proceedings of 2nd International Conference on Information Technology and Computer Application, Guangzhou, pp. 429-432, 2020. DOI: 10.1109/ITCA52113.2020.00096.

[12] Hassanpour S. and Dehghani M., “Review of Cancer from Perspective of Molecular,” Journal of Cancer Research and Practice, vol. 4, no. 4, pp. 127-129, 2017. https://doi.org/10.1016/j.jcrpr.2017.07.001.

[13] Hussein S., Kandel P., Bolan C., Wallace M. B. and Bagci U., “Lung and Pancreatic Tumor Characterization in the Deep Learning Era: Novel Supervised and Unsupervised Learning Approaches,” IEEE Transactions on Medical Imaging, vol. 38, no. 8, pp. 1777-1787, 2019. DOI: 10.1109/TMI.2019.2894349.

[14] Indolia S., Goswami A., Mishra S., and Asopa P., “Conceptual Understanding of Convolutional Neural Network-A Deep Learning Approach,” Procedia Computer Science, vol. 132, pp. 679- 688, 2018. https://doi.org/10.1016/j.procs.2018.05.069

[15] LeCun Y., Bengio Y., and Hinton G., “Deep Learning,” Nature, vol. 521, no. 7553, pp. 436-444, 2015. https://doi.org/10.1038/nature14539.

[16] Lee J. and Yoon J., “Imaging Diagnosis of Pancreatic Cancer: CT and MRI,” Pancreatic Cancer. Springer Berlin Heidelberg, pp. 95-114, 2017. DOI: 10.1007/978-3-662-47181-4_7.

[17] Ma H., Liu Z., Zhang J., Wu F., Xu C., Shen Z., Yu C., and Li Y., “Construction of A Convolutional Neural Network Classifier Developed by Computed Tomography Images for Pancreatic Cancer Diagnosis,” World Journal of Gastroenterology, vol. 26, no. 34, pp. 5156-5168, 2020. doi: 10.3748/wjg.v26.i34.5156

[18] McGuigan A., Kelly P., Turkington R., Jones C., Coleman H., and McCain R., “Pancreatic Cancer: a Review of Clinical Diagnosis, Epidemiology, Treatment and Outcomes,” World Journal of Gastroenterology, vol. 24, no. 43, pp. 4846-4861, 2018. doi: 10.3748/wjg.v24.i43.4846

[19] Mishra C. and Gupta D., “Deep Machine Learning and Neural Networks: An Overview,” IAES International Journal of Artificial Intelligence (IJ- AI), vol. 6, no. 2, pp. 66-73, 2017. DOI: 10.11591/ijai.v6.i2.pp66-73.

[20] Miura F., Takada T., Amano H., Yoshida M., Furui S., and Takeshita K., “Diagnosis of Pancreatic Cancer,” HPB, vol. 8, no. 5, pp. 337-342, 2006. https://doi.org/10.1080/13651820500540949.

[21] Neary P., “Automatic Hyperparameter Tuning in Deep Convolutional Neural Networks Using Asynchronous Reinforcement Learning,” in Proceedings of IEEE International Conference on Cognitive Computing, CA, pp. 73-77, 2018. DOI: 10.1109/ICCC.2018.00017.

[22] Orth M., Metzger P., Gerum S., Mayerle J., Schneider G., Belka C., Schnurr M., and Lauber K., “Pancreatic Ductal Adenocarcinoma: Biological Hallmarks, Current Status, and Future Perspectives of Combined Modality Treatment Approaches,” Radiation Oncology, vol. 14, no. 1, pp. 1-20, 2019.

[23] Sekaran K., Chandana P., Krishna N., and Kadry S., “Deep Learning Convolutional Neural Network (CNN) with Gaussian Mixture Model for Predicting Pancreatic Cancer,” Multimedia Tools and Applications, vol. 79, no. 15-16, pp. 10233- 10247, 2020.

[24] Shah J., Surve S., and Turkar V., “Pancreatic Tumor Detection Using Image Processing,” Procedia Computer Science, vol. 49, pp. 11-16, 2015. https://doi.org/10.1016/j.procs.2015.04.221.

[25] Si K., Xue Y., Yu X., Zhu X., Li Q., Gong W., Liang T., and Duan S., “Fully End-To-End Deep- Learning-Based Diagnosis of Pancreatic Tumors,” Theranostics, vol. 11, no. 4, pp. 1982-1990, 2021. doi: 10.7150/thno.52508

[26] Singh A. and Bhadani R., Mobile Deep Learning with Tensorflow Lite, ML Kit and Flutter: Build Scalable Real-World Projects to Implement End- To-End Neural Networks on Android and IOS, Packt Publishing, 2020.

[27] Tecuci G., “Artificial Intelligence,” WIREs Computational Statistics, vol. 4, no. 2, pp. 168- 180, 2012. https://doi.org/10.1002/wics.200

[28] Vaiyapuri T., Dutta A., Punithavathi I., Duraipandy P., Alotaibi S., Alsolai H., Mohamed A., and Mahgoub H., “Intelligent Deep-Learning- Enabled Decision-Making Medical System for Pancreatic Tumor Classification on ct Images,” Healthcare, vol. 10, no. 4, 2022. https://doi.org/10.3390/healthcare10040677.

[29] Wang Y., Li Y., Song Y., and Rong X., “The Influence of the Activation Function in a Convolution Neural Network Model of Facial Expression Recognition,” Applied Sciences, vol. 10, no. 5, 2020. https://doi.org/10.3390/app10051897.

[30] Yamashita R., Nishio M., Do R., and Togashi K., 526 The International Arab Journal of Information Technology, Vol. 20, No. 3A, Special Issue 2023 “Convolutional Neural Networks: An Overview and Application in Radiology,” Insights into Imaging, vol. 9, pp. 611-629, 2018. DOI: 10.1007/s13244-018-0639-9.

[31] Yoon H., Jeong Y., Kang H., Jeong J., and Kang D., “Medical Image Analysis Using Artificial Intelligence,” Progress in Medical Physics, vol. 30, no. 2, pp. 49-58, 2019. DOI: https://doi.org/10.14316/pmp.2019.30.2.49.

[32] Zhang Y., Gorriz J., and Dong Z., “Deep Learning in Medical Image Analysis,” Journal of Imaging, vol. 7, no. 4, 2021. https://doi.org/10.3390/jimaging7040074.

[33] Zhang Z., Li S., Wang Z., and Lu Y., “A Novel and Efficient Tumor Detection Framework for Pancreatic Cancer via CT Images,” in Proceedings of 42nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Montreal, pp. 1160-1164, 2020. DOI: 10.1109/EMBC44109.2020.9176172.