The International Arab Journal of Information Technology (IAJIT)

..............................
..............................
..............................


Interactive Video Retrieval Using Semantic Level Features and Relevant Feedback

Recent years, many literatures presents a lot of work for content-based video retrieval using different set of feature. But, most of the works are concentrated on extracting features low level features. But, the relevant videos can be missed out if the interactive with the users are not considered. Also, the semantic richness is needed further to obtain most relevant videos. In order to handle these challenges, we propose an interactive video retrieval system. The proposed system consists of following steps: 1) Video structure parsing, 2) Video summarization and 3) Video Indexing and Relevance Feedback. At first, input videos are divided into shots using shot detection algorithm. Then, three features such as color, texture and shape are extracted from each frame in video summarization process. Once the video is summarized with the feature set, index table is constructed based on these features to easily match the input query. In matching process, query video is matched with index table using semantic matching distance to obtain relevant video. Finally, in relevance feedback phase, once we obtain relevant video, it is given to identify whether it is relevant for the user. If it is relevant, more videos relevant to that video is given to the user. The evaluation of the proposed system is evaluated in terms of precision, recall and f-measure. Experiments results show that our proposed system is competitive in comparison with standard method published in the literature.


[1] Anh T., Bao P., Khanh T., Thao B., Tuan T., and Nhut N., Video Retrieval using Histogram and Sift Combined with Graph-based Image Segmentation, Journal of Computer Science, vol. 8, no. 6, pp. 853-858, 2012.

[2] Bole R., Yeo B., and Yeung M., Video Query: Research Directions, IBM Journal of Research and Development, vol. 42, no. 2, pp. 233-252, 1998.

[3] Bourke P., http://local.wasp.uwa.edu.au/~pbourke/miscell aneous/ correlate/, Last Visited 1996.

[4] Chang S., Chen W., Meng H., and Sundaram H., and Zhong D., An Automated Content based Video Search System using Visual Cues, in Proceeding of the 5th ACM (16) RP PRmeasureF *2 772 The International Arab Journal of Information Technology, Volume 14, No. 5, September 2017 International Conference on Multimedia, Washington, pp. 313-324, 1997.

[5] Cotsaces C., Nikolaidis N., and Pitas I., Face- Based Digital Signatures for Video Retrieval, IEEE Transactions on Circuits and Systems for Video Technology, vol. 18, no. 4, pp. 549-553, 2008.

[6] Dimitrova N., Zhang H., Shahrara B., Sezan I., Huang T., and Zakhor A., Applications of Video-Content Analysis and Retrieval, IEEE Multimedia, vol. 9, no. 3, pp. 42-55, 2002.

[7] Geetha P. and Narayanan V., A Survey of Content-Based Video Retrieval, Journal of Computer Science, vol. 4, no. 6, pp. 474-486, 2008.

[8] Ghodeswar S. and Meshram B., Content Based Video Retrieval, in Proceeding of International Symposium on Computer Engineering and technology, Punjab, 2010.

[9] Hanjalic A., Shot-Boundary Detection: Unraveled and Resolved, IEEE Transactions on Circuits and Systems for Video Technology, vol. 12, no. 2, pp. 90-105, 2002.

[10] Hauptmann A., Ng T., and Jin R., Video Retrieval Using Speech and Image Information, in proceeding of Electronic Imaging Conference, Storage and Retrieval for Multimedia Databases, Santa Clara, 2003.

[11] Hauptman A., Ng T., Baron R., Lin W., Chen M., Derthick M., Christel M., Jin R., and Yan, R., Video Classification and Retrieval with the Informedia Digital Video Library System, in proceeding of Text Retrieval Conference, Gaithersburg, 2002.

[12] Lee J., Oh J., and Hwang S., Strg-index: spatio-temporal region graph indexing for large video databases, in Proceeding of the ACM SIGMOD International Conference on Management of Data, Maryland, pp. 718-729, 2005.

[13] Lew M., Sebe N., and Gardner P., Video Indexing and Understanding, Springer, 2001.

[14] Liu F., Zhuang Y., Wu F., and Pan Y., 3D Motion Retrieval with Motion Index Tree, Computer Vision and Image Understanding, vol. 92, no. 2, pp. 265-284, 2003.

[15] Luan H., Zheng Y., Wang M., and Chua T., VisionGo: Towards Video Retrieval with Joint Exploration of Human and Computer, Journal of Information Science, vol. 181, no. 19, pp. 4197-4213, 2011.

[16] Malik F. and Baharudin B., The Statistical Quantized Histogram Texture Features Analysis for Image Retrieval Based on Median and Laplacian Filters in the DCT Domain, The International Arab Journal of Information Technology, vol. 10, no. 6, pp. 616-624, 2013.

[17] Misra C. and Sural S., Computer Vision- ACCV2006, Springer Link, 2006.

[18] Mittal A., An Overview of Multimedia Content-Based Retrieval Strategies, Informatica, vol. 30, pp. 347-356, 2006.

[19] Patel B., Meshram B., Shah and Kutchhi A., Content Based Video Retrieval Systems , International Journal of UbiComp, vol. 3, no. 2, pp. 13-30, 2012.

[20] Petkovic M. and Jonker W., Content-Based Video Retrieval by Integrating Spatio- Temporal and Stochastic Recognition of Events, in proceeding of IEEE International Workshop on Detection and Recognition of Events in Video, Vancouver, pp. 75-82, 2001.

[21] Petkovic M., Content-based Video Retrieval, in proceeding of the PhD Workshop on EDBT, Konstanz, 2000.

[22] Ramya S. and Rangarajan P., Knowledge Based methods for Video Data Retrieval, International Journal of Computer Science and Information Technology, vol. 3, no. 5, pp. 165- 172, 2011.

[23] Rooij O. and Worring M., Active Bucket Categorization for High Recall Video Retrieval, IEEE Transactions on Multimedia, vol. 15, no. 4, pp. 898-907, 2013.

[24] Rooij, O. and Worring, M., Active Bucket Categorization for High Recall Video Retrieval, IEEE Transactions on Multimedia, vol. 15, no. 4, pp. 898-907, 2013.

[25] Sebe N., Lew M., and Smeulders A., Video Retrieval and Summarization: Editorial Introduction, Computer Vision and Image Understanding, vol. 92, no. 2-3., pp. 141-146, 2003.

[26] Sivic J. and Zisserman A., Text retrieval approach to object matching in videos, in Proceeding of 9th IEEE International Conference on Computer Vision, Washington, pp. 1470-1477, 2003.

[27] Subramanian M. and Sathappan S., An Efficient Content Based Image Retrieval Using Advanced Filter Approaches, The International Arab Journal of Information Technology, vol. 12, no. 3, pp.229-236, 2015.

[28] Su C., Liao H., Tyan H., Lin C., Chen D., and Fan K., Motion Flow-Based Video Retrieval, IEEE Transactions on Multimedia, vol. 9, no. 6, pp. 105-112 2007.

[29] Sze K., Lam K., and Qiu G., A New Key Frame Representation for Video Segment Retrieval, IEEE Transactions on Circuits and Systems for Video Technology, vol. 15, no. 9, pp. 1148-1155 2005.

[30] http://www.open-video.org/, Last Visited 2013.

[31] Thornley C., McLoughlin S., Johnson A., and Smeaton A., A Bibliometric study of Video Retrieval Evaluation Benchmarking (TRECVid): a Methodological Analysis, Interactive Video Retrieval Using Semantic Level Features and Relevant Feedback 773 Journal of Information Science, vol. 37, no. 6, pp. 1-19, 2011.

[32] Xu L. and Wang K., Extracting Text Information for Content-Based Video Retrieval, in Proceeding of the 14th international Conference on Advances in Multimedia Modeling, Kyoto, pp. 58-69, 2008.

[33] Yoshitaka A. and Ichikawa T., A Survey on Content-Based Retrieval for Multimedia Databases, IEEE Transactions on Knowledge and Data Engineering, vol. 11, no. 1, pp. 81- 93, 1999.

[34] Zhai Y., Liu J., Cao X., Basharat A., Hakeem A., Ali S., and Shah M., Video understanding and content-based retrieval, TREC Video Retrieval Evaluation, 2005.

[35] Zhaoming L., Xiangming W., Xinqi L., and Wei Z., A Video Retrieval Algorithm Based on Affective Features, in proceeding with the 9th IEEE International Conference on Computer and Information Technology, Larnaca, pp. 134-138, 2009.

[36] Zhu G., Zhang S., Zeng Q., and Wang C., Boundary-based Image Segmentation using Binary Level Set Method, Optical Engineering, vol. 46, no. 5, pp. 050501, 2007. Sadagopan Padmakala has received the B.E Degree, from the Department of Computer Science ,Bharath Institute of Technology, University of Chennai, Chennai, India and M.E degree from the Department of Computer Science Anna university, Chennai, in 1997 and 2006 respectively. She is currently pursuing the Ph.D degree in Anna university, Chennai, working closely with Dr.G.S.Anandha Mala. Presently, she is working as Associate Professor, at St.Josephs s Institute of Technology, Chennai, India. Ganapathy AnandhaMala received B.E degree from Bharathidhasan University in Computer Science & Engineering in 1992, M.E degree in University of Madras in 2001 and Ph.D degree from Anna University in 2007. Currently she is working as Professor in Easwari Engineering College, Chennai, India, and heading the department of Computer Science and Engineering. She has published more than 40 technical papers in various international journal / conferences. She has 20 years of teaching experience on graduate level. Her area of interest includes Image Processing and Grid Computing.