The International Arab Journal of Information Technology (IAJIT)

..............................
..............................
..............................


Spatial Pyramid Pooling and Adaptively Feature Fusion based Yolov3 for Traffic Sign Detection

Traffic sign detection is a key part of intelligent assisted driving, but also a challenging task due to the small size and different scales of objects in foreground and closed range. In this paper, we propose a new traffic sign detection scheme: Spatial Pyramid Pooling and Adaptively Spatial Feature Fusion based Yolov3 (SPP and ASFF-Yolov3). In order to integrate the target detail features and environment context features in the feature extraction stage of Yolov3 network, the Spatial Pyramid Pooling module is introduced into the pyramid network of Yolov3. Additionally, Adaptively Spatial Feature Fusion module is added to the target detection phase of the pyramid network of Yolov3 to avoid the interference of different scale features with the process of gradient calculation. Experimental results show the effectiveness of the proposed SPP and ASFF-Yolov3 network, which achieves better detection results than the original Yolov3 network. It can archive real-time inference speed despite inferior to the original Yolov3 network. The proposed scheme will add an option to the solutions of traffic sign detection with real-time inference speed and effective detection results.

[1] Avramović A., Sluga D., Tabernik D., Skočaj D., Stojnić V., and Ilc N., “Neural-Network-Based Traffic Sign Detection and Recognition in High- Definition Images Using Region Focusing and Parallelization,” IEEE Access, vol. 8, pp. 189855- 189868, 2020. DOI: 10.1109/ACCESS.2020.3031191

[2] Dhia H. and Ghani R., “A Proposed Method for Scale Drawing Calculating Depending on Line Detector and Length Detector,” Iraqi Journal for Computer Science and Mathematics, vol. 2, no. 2, pp. 6-17, 2021. DOI: https://doi.org/10.52866/ijcsm.2021.02.02.0 02

[3] Dinh V., Lee Y., Choi H., and Jeon M., “Real- Time Traffic Sign Recognition,” in Proceedings of IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia), JeJu, pp. 206-212, 2018. DOI: 10.1109/ICCE-ASIA.2018.8552110

[4] Greenhalgh J. and Mirmehdi M., “Real-Time Detection and Recognition of Road Traffic Signs,” IEEE Transactions on Intelligent Transportation Systems, vol. 13, no. 4, pp. 1498- 1506, 2012. DOI: 10.1109/TITS.2012.2208909

[5] Han C., Gao G., and Zhang Y., “Real-Time Small Traffic Sign Detection with Revised Faster- RCNN,” Multimedia Tools and Applications, vol. 78, no. 4, pp. 13263-13278, 2019. DOI:10.1007/s11042-018-6428-0

[6] He K., Zhang X., Ren S., and Sun J., “Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 37, no. 9, pp. 1904-1916, 2015. DOI: 10.1109/TPAMI.2015.2389824

[7] Karimi M., Khandaghi Z., and Shahipour M., “Designing an Intelligent System to Detect Stress Levels During Driving,” The International Arab Journal of Information Technology, vol. 19, no. 1, pp. 81-89, 2022. https://doi.org/10.34028/iajit/19/1/10

[8] Liang M., Yuan M., Hu X., Li J., and Liu H., “Traffic Sign Detection by ROI Extraction and Histogram Features-Based Recognition,” The International Joint Conference on Neural Networks, Dallas, pp. 1-8, 2013. DOI: 10.1109/IJCNN.2013.6706810

[9] Liu L., Wang Y., Li K., and Li J., “Focus First: 598 The International Arab Journal of Information Technology, Vol. 20, No. 4, July 2023 Coarse-To-Fine Traffic Sign Detection with Stepwise Learning,” IEEE Access, vol. 8, pp. 171170-171183, 2020. 10.1109/ACCESS.2020.3024583

[10] Liu S., Huang D., and Wang Y., “Learning Spatial Fusion for Single-Shot Object Detection,” arXiv preprint arXiv:1911.09516, 2019. https://doi.org/10.48550/arXiv.1911.09516

[11] Nguyen H., “Fast Traffic Sign Detection Approach Based on Lightweight Network and Multilayer Proposal Network,” Journal of Sensors, vol. 2020, pp. 1-1, 2020. DOI:10.1155/2020/8844348

[12] Redmon J. and Farhadi A., “YOLO9000: Better, Faster, Stronger,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, pp. 7263-7271, 2017. DOI:10.1109/CVPR.2017.690

[13] Redmon J. and Farhadi A., “Yolov3: An Incremental Improvement,” arXiv Preprint arXiv:1804.02767, 2018. http://arxiv.org/abs/1804.02767

[14] Shan H. and Zhu W., “A Small Traffic Sign Detection Algorithm Based on Modified Ssd,” IOP Conference Series: Materials Science and Engineering, vol. 646, no. 1, pp. 012006, 2019. DOI 10.1088/1757-899X/646/1/012006

[15] Shufang Z., Qinyu W, Tong Z., and Yuhong L., “Detection and Classification of Small Traffic Signs Based on Cascade Network,” Chinese Journal of Electronics, vol. 30, no. 4, pp. 719-726, 2021. https://doi.org/10.1049/cje.2021.05.014

[16] Sichkar V. and Kolyubin S., “Real Time Detection and Classification of Traffic Signs Based on Yolo Version 3 Algorithm,” Journal Scientific and Technical of Information Technologies, Mechanics and Optics, vol. 20, no. 3, pp. 418-424, 2020. 10.17586/2226-1494-2020-20-3-418-424

[17] Sun C., Ai Y., Wang S., and Zhang W., “Dense- Refinedet for Traffic Sign Detection and Classification,” Sensors, vol. 20, no. 22, pp. 6570, 2020. https://doi.org/10.3390/s20226570

[18] Tian Z., Shen C., Chen H., and He T., “Fcos: Fully Convolutional One-Stage Object Detection,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 9627-9636, 2019.

[19] William M., Zaki P., Soliman B., Alexsan K., Mansour M., El-Moursy M., and Khalil K., “Traffic Signs Detection and Recognition System Using Deep Learning,” in Proceedings of 9th International Conference on Intelligent Computing and Information Systems, Cairo, pp. 160-166, 2019. DOI: 10.1109/ICICIS46948.2019.9014763

[20] Xiong S., Li B., and Zhu S., “DCGNN: A Single- Stage 3D Object Detection Network Based on Density Clustering and Graph Neural Network,” Complex and Intelligent Systems, pp. 1-10, 2022. DOI:10.1007/s40747-022-00926-z

[21] Yang Y., Luo H., Xu H., and Wu F., “Towards Real-Time Traffic Sign Detection and Classification,” IEEE Transactions on Intelligent Transportation Systems, vol. 17, no. 7, pp. 2022- 2031, 2015. DOI: 10.1109/TITS.2015.2482461

[22] Zhang H., Qin L., Li J., Guo Y., Zhou Y., Zhang J., and Xu Z., “Real-Time Detection Method for Small Traffic Signs Based on Yolov3,” IEEE Access, vol. 8, pp. 64145-64156, 2020. DOI: 10.1109/ACCESS.2020.2984554

[23] Zhang J., Huang M., Jin X., and Li X., “A Real- Time Chinese Traffic Sign Detection Algorithm

[24] Based on Modified Yolov2,” Algorithms, vol. 10, no. 4, p. 127, 2017. DOI:10.3390/a10040127

[25] Zhou X., Zhuo J., and Krahenbuhl P., “Bottom-Up Object Detection by Grouping Extreme and Center Points,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 850-859, 2019.

[26] Zhu Y., Liao M., Yang M., and Liu W., “Cascaded Segmentation-Detection Networks for Text-Based Traffic Sign Detection,” IEEE Transactions on Intelligent Transportation Systems, vol. 19, no. 1, pp. 209-219, 2017. DOI:10.1109/TITS.2017.2768827