The International Arab Journal of Information Technology (IAJIT)

..............................
..............................
..............................


Image Segmentation with Multi-feature Fusion in Compressed Domain based on Region-Based Graph

Image segmentation plays a significant role in image processing and scientific research. In this paper, we develop a novel approach, which provides effective and robust performances for image segmentation based on the region-based (block- based) graph instead of pixel-based graph. The modified Discrete Cosine Transform (DCT) is applied to obtain the Square Block Structures (DCT-SBS) of the image in the compressed domain together with the coefficients, due to its low memory requirement and high processing efficiency on extracting the block feature. A novel weight computation approach focusing on multi-feature fusion from the location, texture and RGB-color information is employed to efficiently obtain weights between the DCT-SBS. The energy function is redesigned to meet the region-based requirement and can be easily transformed into the traditional Normalized cuts (Ncuts). The proposed image segmentation algorithm is applied to the salient region detection database and Corel1000 database. The performance results are compared with the state-of-the-art segmentation algorithms. Experimental results clearly show that our method outperforms other algorithms, and demonstrate good segmentation precision and high efficiency.

 


[1] Andrew A., “Multiple View Geometry in Computer Vision,” Kybernetes, vol. 30, no. 9/10, pp. 1333-1341, 2001.

[2] Achanta R., Hemami S., Estrada F., Susstrunk S., “Frequency-Tuned Salient Region Detection,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Miami, pp. 1597-1604 2009.

[3] Alpert S., Galun M., Brandt A., and Basri R., “Image Segmentation by Probabilistic Bottom- Up Aggregation and Cue Integration,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, no. 2, pp. 315-327, 2012.

[4] Alom M., Hasan M., Yakopcic C., Taha T., Asari and V., “Improved Inception-Residual Convolutional Neural Network for Object Recognition,” Neural Computing and Applications, vol. 32, pp. 279-293, 2020.

[5] Boykov Y. and Funka-Lea G., “Graph Cuts and Efficient N-D Image Segmentation,” International Journal of Computer Vision, vol. 70, no. 2, pp. 109-131, 2006.

[6] Birchfield S., Natarajan B., and Tomasi C., “Correspondence as Energy-Based Segmentation,” Image and Vision Computing, vol. 25, no. 8, pp. 1329-1340, 2007.

[7] Burdescu D., Stanescu L., Brezovan M., and Spahiu C., “Efficient Volumetric Segmentation Method,” in Proceedings of Federated Conference on Computer Science and Information Systems, Warsaw, pp. 659- 668, 2014.

[8] Belalia A., Belloulata K., and Kpalma K., “Region-Based Image Retrieval using Shape- Adaptive DCT,” International Journal of Multimedia Information Retrieval, vol. 4, pp. 1- 16, 2015.

[9] Bargoti S. and Underwood J., “Image Segmentation for Fruit Detection and Yield Estimation in Apple Orchards,” Journal of Field Robotics, vol. 34, no. 6, pp.1039-1060, 2017.

[10] Bai X., Zhang Y., Liu H., and Chen Z., “Similarity Measure-Based Possibilistic FCM With Label Information for Brain Mri Segmentation,” IEEE Transactions on Cybernetics, vol. 49, no. 7, pp. 2618-2630, 2019.

[11] Cherri A. and Karim M., “Optical Symbolic Substitution: Edge Detection using Prewitt, Sobel, and Roberts Operators,” Applied Optics, vol. 28, no. 21, pp. 4644-4648, 1989.

[12] Comaniciu D. and Meer P., “Mean Shift: A Robust Approach toward Feature Space Analysis,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 603-619, 2002.

[13] Choong M., Kow W., Chin Y., Angeline L., and Teo K., “Image Segmentation Via Normalised Cuts and Clustering Algorithm,” in Proceedings of IEEE International Conference on Control System, Computing and Engineering, Penang, pp. 430-435, 2012.

[14] Cheng M., Mitra N., Huang X., Torr P., and Hu S., “Global Contrast Based Salient Region Detection,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 37, no. 3, pp. 569-582, 2015.

[15] Chen T., Chuang K., Wu W., and Lu Y., “Compressed Medical Image Quality Determination Using The Kolmogorov- Smirnov Test,” Current Medical Imaging Reviews, vol. 12, no. 999, pp. 1-1, 2017.

[16] Dabbaghchian S., Ghaemmaghami M., and Aghagolzadeh A., “Feature Extraction Using Discrete Cosine Transform and Discrimination Power Analysis with A Face Recognition Technology,” Pattern Recognition, vol. 43, no. 4, pp. 1431-1440, 2010.

[17] Ding K., Xiao L., and Weng G., “Active Contours Driven by Region-Scalable Fitting and Optimized Laplacian of Gaussian Energy for Image Segmentation,” Signal Processing, vol. 134, pp. 224-233, 2017.

[18] Ding K., Xiao L., and Weng G., “Active Contours Driven by Local Pre-Fitting Energy for Fast Image Segmentation,” Pattern Recognition Letters, vol. 104, pp. 29-36, 2018.

[19] Falco A., Udupa J., and Flvio K., “An Ultra-Fast User-Steered Image Segementation Paradigm: Live-Wire-On-The-Fly,” IEEE Transactions on Medical Imaging, vol. 19, no. 1, pp. 55-62, 2000.

[20] Feng G. and Jiang J., “JPEG Compressed Image Retrieval via Statistical Features,” Pattern Recognition, vol. 36, no. 4, pp. 977-985, 2003.

[21] Felzenszwalb P. and Huttenlocher D., “Efficient Graph-Based Image Segmentation,” International Journal of Computer Vision, vol. 59, no. 2, pp. 167-181, 2004.

[22] Fan J., Zeng G., Body M., and Hacid M., “Seeded Region Growing: an Extensive and Comparative Study,” Pattern Recognition Letters, vol. 26, no. 8, pp. 1139-1156, 2017.

[23] Gijsenij A., Geversa T., and Lucassen M., “A Perceptual Comparison of Distance Measures for Color Constancy Algorithms,” in Proceedings of European Conference on Computer Vision, Marseille, pp. 12-18, 2008.

[24] Gallivanone F., Interlenghi M., Canervari C., and Castiglioni I., “A Fully Automatic, Threshold- Based Segmentation Method for the Estimation of the Metabolic Tumor Volume from PET Images: Validation on 3D Printed Anthropomorphic Oncological Lesions,” Journal 168 The International Arab Journal of Information Technology, Vol. 20, No. 2, March 2023 of Instrumentation, vol. 11, no. 01, pp. 01022- 01022, 2016.

[25] Garcia-Lamont F., Cervantes J., López A., and Rodriguez L., “Segmentation of Images by Color Features: A Survey,” Neurocomputing, vol. 292, pp. 1-27, 2018.

[26] Guo B., Zhang Y., Zhang D., and Wang Z.,, “Special Issue on Device-Free Sensing for Human Behavior Recognition,” Personal and Ubiquitous Computing, vol. 23, no. 1, pp. 1-2, 2019.

[27] Haut J., Paoletti M., Plaza J., and Plaza A., “Cloud Implementation of the K-Means Algorithm for Hyperspectral Image Analysis,” The Journal of Supercomputing, vol. 73, no. 1, pp. 514-529, 2017.

[28] Jiang H., Wang J., Yuan Z., Liu T., Zheng N., and Li S., “Automatic Salient Object Segmentation Based on Context and Shape Prior,” in Proceedings of the British Machine Vision Conference, pp. 1-15, 2011.

[29] Javed M., Nagabhushan P., and Chaudhuri B., “A Review on Document Image Analysis Techniques Directly in the Compressed Domain,” Artificial Intelligence Review, vol. 50, no. 4, pp. 539-568, 2017.

[30] Kim H., Lee J., Ahn E., Cho S., Shin M., and Sim S., “Concrete Crack Identification using A UAV Incorporating Hybrid Image Processing,” Sensors, vol. 17, no. 9, pp. 2052, 2017.

[31] Khadidos A., Sanchez V., and Li C., “Weighted Level Set Evolution Based on Local Edge Features for Medical Image Segmentation,” IEEE Transactions on Image Processing, vol. 26, no. 4, pp. 1979-1991, 2017.

[32] Li J. and Wang J., “Automatic Linguistic Indexing of Pictures by A Statistical Modeling Approach,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 9, pp. 1075-1088, 2003.

[33] Li C., Lin L., Zuo W., Wang W., and Tang J., “An Approach to Streaming Video Segmentation with Sub-Optimal Low-Rank De-Composition,” IEEE Transactions on Image Processing, vol. 25, no. 5, pp. 1947-1960, 2016.

[34] Litjens G., Kooi T., Bejnordi B., Setio A., Ciompi F., Ghafoorian M., Laak J., Ginneken B., and Sánchez C., “A Survey on Deep Learning in Medical Image Analysis,” Medical Image Analysis, vol. 42, no. 9, pp. 60-88, 2017.

[35] Li J. and Wang Z., “Real-Time Traffic Sign Recognition Based on Efficient Cnns in the Wild,” IEEE Transactions on Intelligent Transportation Systems, vol. 20, no. 3, pp. 975- 984, 2019.

[36] Liu X., Dong Z., and Yang Y., “Recent Progress in Semantic Image Segmentation,” Artificial Intelligence Review, vol. 52, pp. 1089-1106, 2019.

[37] Maire E. and Withers P., “Quantitative X-Ray Tomography,” International Materials Reviews, vol 59, no. 1, pp. 1-43, 2017.

[38] Maier O., Menze B., Gablentz J., Häni L., Heinrich M., and et al, “ISLES 2015-A Public Evaluation Benchmark for Ischemic Stroke Lesion Segmentation from Multispectral MRI,” Medical Image Analysis, vol. 35, pp. 250-269, 2016.

[39] Mary M., Padma L., and John M., “Modified Image Segmentation Method Based on Region Growing and Region Merging,” The International Arab Journal of Information Technology, vol. 13, no. 64, pp. 899-907, 2016.

[40] Ngo T., Lu Z., and Carneiro G., “Combining Deep Learning and Level Set for the Automated Segmentation of the Left Ventricle of the Heart from Cardiac Cine Magnetic Resonance,” Medical Image Analysis, vol. 35, pp. 159-171, 2017.

[41] Nie G., Fu Y., Zheng Y., and Huang H., “Image Restoration from Patch-Based Compressed Sensing Measurement,” arXiv preprint arXiv:1706.00597, 2017.

[42] Niu S., Chen Q., Sisternes L., Ji Z., Zhou Z., and Rubin D., “Robust Noise Region-Based Active Contour Model Via Local Similarity Factor for Image Segmentation,” Patter Recognition, vol. 61, pp. 104-119, 2017.

[43] Parameswaran V. and Shukla A., “Processing and Characterization of A Model Functionally Gradient Material,” Journal of Materials Science, vol. 35, no. 1, pp. 21-29, 2000.

[44] Prabhakar R., “Evaluation of The Gaussian Blob Model for Coarse-Graining Hydrodynamic Interactions in Isolated Polymer Molecules,” in Proceedings of The XV International Congress on Rheology: The Society of Rheology 80th Annual Meeting; Albert Co, and Gary L. Leal; AIP Conference Proceedings 1027, Monterey, pp. 309-311, 2008.

[45] Rother C., Kolmogorov V., and Blake A., ““Grabcut”: Interactive Foreground Extraction Using Iterated Graph Cuts,” Acm Trans Graph, vol. 23, no. 3, pp. 309-314, 2004.

[46] Rahtu E., Kannala J., Salo M., and Heikkilä J., “Segmenting Salient Objects from Images and Videos,” in Proceedings of European Conference on Computer Vision, pp. 366-379, 2010.

[47] Rezvanifar A. and Khosravifard M., “Including The Size of Regions in Image Segmentation by Region-Based Graph,” IEEE Transactions on Image Processing, vol. 23, no. 2, pp. 635-44, 2014.

[48] Rashno A., Nazari B., Koozekanani D., Drayna P., Sadri S., Rabbani H., and Parhi K., “Fully- Automated Segmentation of Fluid Regions in Image Segmentation with Multi-feature Fusion in Compressed Domain based ... 169 Exudative Age-Related Macular Degeneration Subjects: Kernel Graph Cut in Neutrosophic Domain,” PLoS ONE, vol. 12, no. 10, pp. e0186949, 2017.

[49] Shi J. and Malik J., “Normalized Cuts and Image Segmentation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 888-905, 2000.

[50] Son L. and Thong P., “Some Novel Hybrid Forecast Methods Based on Picture Fuzzy Clustering for Weather Nowcasting from Satellite Image Sequences,” Applied Intelligence, vol. 46, no. 1, pp. 1-15, 2017.

[51] Subudhi A., Jena S., and Sabut S., “Delineation of the Ischemic Stroke Lesion Based on Watershed and Relative Fuzzy Connectedness in Brain MRI,” Medical and Biological Engineering and Computing, vol. 56, no. 5, pp. 795-807, 2018.

[52] Satapathy S., Raja N., Rajinikanth V., Ashour A., and Dey N., “Multi-Level Image Thresholding Using Otsu And Chaotic Bat Algorithm,” Neural Computing and Applications, vol. 29, pp. 1285- 1307, 2018.

[53] Singh C. and Bala A., “A DCT-Based Local and Non-Local Fuzzy C-Means Algorithm for Segmentation of Brain Magnetic Resonance Images,” Applied Soft Computing, vol. 68, pp. 447-457, 2018.

[54] Vincent L. and Soille P., “Watersheds in Digital Spaces: an Efficient Algorithm Based on Immersion Simulations,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 13, no. 6, pp. 583-598, 1991.

[55] Wu Z. and Leahy R., “An Optimal Graph Theoretic Approach to Data Clustering: Theory and its Application to Image Segmentation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 15, no. 11, pp. 1101- 1113, 1993.

[56] Wang B., Gao X., Tao D., and Li X., “A Nonlinear Adaptive Level Set for Image Segmentation,” IEEE Transactions on Cybernetics, vol. 44, no. 3, pp. 418-428, 2017.

[57] Xu Z., Huang T., Wang H., and Wang C., “Variant of the Region-Scalable Fitting Energy for Image Segmentation,” Journal of the Optical Society of America A, vol. 32, no. 3, pp. 463, 2015.

[58] Yang C., Liu S., and Yang M., “Hallucinating Compressed Face Images,” International Journal of Computer Vision, vol. 126, no. 9, pp. 1-18, 2017.

[59] Zhao C., “Image Segmentation Based on Fast Normalized Cut,” Open Cybernetics and Systemics Journal, vol. 9, no. 1, pp. 28-31, 2015.

[60] Zhang C., Xie Y., Liu D., and Wang L., “Fast Threshold Image Segmentation Based On 2D Fuzzy Fisher and Random Local Optimized QPSO,” IEEE Transactions on Image Processing, vol. 26, no. 3, pp. 1355-1362, 2017.

[61] Zhao Y., Xu J. Q., Li H. W., Zhang P., “Edge Information Diffusion based Reconstruction (EIDR) for Cone Beam Computed Laminography,” IEEE Transactions on Image Processing, vol. 27, no. 9, pp. 4663-4675, 2018.

[62] Zhang Q., Lin J., Tao Y., Shi Y., “Salient Object Detection Via Color nd Texture Cues,” Neuro Computing, vol. 243, pp. 35-48, 2017. Hong-Chuan Luo is a researcher at the Postgraduate Admission Office of Graduate School in Southwest University, Chongqing, China. He obtained his Master degree in Computer Science and Technology at the College of Computer and Information Science in Southwest University. His research area includes computer vision, and machine learning for various applications. Bo Sun is an associate professor at the Department of Civil Engineering in Zhejiang University of Technology, Hangzhou, China. He obtained his Ph.D. degree in Bridge and Tunnel Engineering at the Department of Civil Engineering in Tongji University, Shanghai, China. His research interests focus on the application of computer vision and image technique in engineering problems and practices. Hang-Kai Zhou is a postgraduate student at the Department of Civil Engineering in Zhejiang University of Technology, Hangzhou, China. His research area focuses on information processing by different computer techniques. Wen-Sen Cao is a postgraduate student at the Department of Civil Engineering in Zhejiang University of Technology, Hangzhou, China. His research areas include machine learning, data processing and reliability analysis.