The International Arab Journal of Information Technology (IAJIT)

..............................
..............................
..............................


Saliency Detection for Content Aware Computer Vision Applications

In recent years, there has been an increased scope for intelligent computer vision systems, which analyse the content of multimedia data. These systems are expected to process a huge quantum of image/data with high speed and without compromising on effectiveness. Such systems are benefited by reducing the amount of visual information by selectively processing only a relevant portion of the input data. The core issue in building these systems is to reduce irrelevant information and retain only a relevant subset of the input visual information. To address this issue, we propose a region-based computational visual attention model for saliency detection in images. The proposed model determines the salient object or part of the salient object without prior knowledge of its shape and color. The proposed framework has three components. First, the input image is segmented into homogeneous regions and then smaller regions are merged with neighbouring regions based on color and spatial distance between them. Second, three attributes such as spatial position, color contrast and size of each region are evaluated to distinguish salient object/parts of salient object. Finally, irrelevant background regions are suppressed and the region level saliency map is generated based on the three attributes. The generated saliency map preserves the shape and precise location of salient regions and hence it can be used to create high quality segmentation masks for high- level machine vision applications. Experimental results show that our proposed approach qualitatively better than the state-of- the-art approaches and quantitatively comparable to human perception.

 


[1] Achanta R., Hemami S., Estrada F., and Susstrunk S., “Frequency-Tuned Salient Region Detection,” in Proceeding of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1597-1604, 2009. a) b) c) d) e) f) ();( ) ( ) ( ) ' A GT SMQ GT SMA GT A SM A GT SM    ]1,0

[]100,0

[)(xp Saliency Detection for Content Aware Computer Vision Applications 533

[2] Avidan S. and Shamir A., “Seam Carving for Content-Aware Image Resizing,” ACM Transactions on Graphics, vol. 26, no. 3, 2007.

[3] Begum M. and Karray F., “Visual Attention for Robotic Cognition: A Survey,” IEEE Transactions on Autonomous Mental Development, vol. 3, no. 1, pp. 92-105, 2011.

[4] Bruce N. and Tsotsos J., “Saliency, Attention, and Visual Search: An Information Theoretic Approach,” Journal of Vision, vol. 9, no. 3, pp. 1-24, 2009.

[5] Cheng M., Zhang G., Mitra N., Huang X., and Hu S., “Global Contrast Based Salient Region Detection,” in Proceeding of IEEE Computer Conference Computer Vision and Pattern Recognition, Colorado Springs, pp. 409-416, 2011.

[6] Ge F., Wang S., and Liu T., “Image- Segmentation Evaluation From the Perspective of Salient Object Extraction,” in Proceeding of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New York, pp. 1146-1153, 2006.

[7] Goferman S., Zelnik-Manor L., and Tal A., “Context-Aware Saliency Detection,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, no. 10, pp. 1915-1926, 2012.

[8] Hoffman D. and Singh M., “Salience of Visual Parts,” Cognition, vol. 63, no. 1, pp. 29-78, 1997.

[9] Hou X. and Zhang L., “Saliency Detection: A Spectral Residual Approach,” in Proceeding of IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, pp. 1-8, 2007.

[10] Itti L., Koch C., and Neibur E., “A Model of Saliency-Based Visual Attention for Rapid Scene Analysis,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, no. 11, pp. 1254-1259, 1998.

[11] Judd T., Ehinger K., Durand F., and Torralba A., “Learning to Predict Where Humans Look,” in Proceeding of IEEE 12th International Conference on Computer Vision, Kyoto, pp. 2106-2113, 2009.

[12] Koch C. and Ullman S., “Shifts in Selective Visual Attention: Towards the Underlying Neural Circuitry,” Human Neurobiology, vol. 4, no. 4, pp. 219-227, 1985.

[13] Liu T., Yuan Z., Sun J., Wang J., Zheng N., Tang X., and Shum H., “Learning to Detect a Salient Object,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 2, pp. 353- 367, 2011.

[14] Rehman A. and Saba T., “An Intelligent Model for Visual Scene Analysis and Compression,” The International Arab Journal of Information Technology, vol. 10, no. 2, pp. 126-136, 2013.

[15] Scholl B., “Objects and Attention: The State of the Art,” Cognition, vol. 80, no. 1-2, pp. 1-46, 2001.

[16] Treisman A. and Gelade G., “A Feature- Integration Theory of Attention,” Cognitive Psychology, vol. 12, no. 1, pp. 97-136, 1980.

[17] Zhang Q., Gu G., and Xiao H., “Image Segmentation Based on Visual Attention Mechanism,” Journal of Multimedia, vol. 4, no. 6, pp. 363-370, 2009. Manipoonchelvi Pandivalavan received the bachelor of engineering degree in computer science and engineering from Bharathidasan University, Tamilnadu, India, in 1997, and the master of engineering degree in computer science and engineering from the Regional Engineering College, Tamilnadu, India, in 2001. She joined HCL Technologies, India, as Member Technical Staff in 2001 and left the company as Associate Project Manager in 2010. During her tenure at HCL Technologies she worked on image registration, rear view aid system for automobiles and traffic signal detection system. She is currently, pursuing Ph.D. degree at Department of Computer Science and Engineering in Mepco Schlenk Engineering College, India, affiliated to Anna University. Her current research interests include semantics based image segmentation, object tracking and, computer vision applications. Muneeswaran Karuppiah received the bachelor of engineering degree in Electronics and Communication engineering from Madurai Kamarajar University, Tamilnadu, India in 1984 and the master of engineering in computer science and engineering from Bharathiyar University, Tamilnadu, India, in 1990. In 2006, he received the Ph.D. degree in computer science engineering from M.S. University, Tamilnadu, India. He is in teaching and research for the past 28 years and 12 years respectively and currently, he is working as professor in Computer Science and Engineering Department at Mepco Schlenk Engineering College, Tamilnadu. His research interests are image processing, neural networks, and semantics analysis. He has authored or co-authored about 75 publications in journal/conference level and one book on compiler design.