The International Arab Journal of Information Technology (IAJIT)

..............................
..............................
..............................


Using Total Probability in Image Template

Matching,
Image template matching is a main task in photogrammetry and computer vision. The matching can be used to automatically determine the 3D coordinates of a point. A firstborn image matching method in fields of photogrammetry and computer vision is area-based matching, which is based on correlation measuring that uses normalised cross-correlation. However, this method fails at a discontinuous edge and at the area of low illumination or at geometric distortion because of changes in imaging location. Thus, these points are considered outliers. The proposed method measures correlations, which is based on normalised cross-correlation, at each point by using various sizes of window and then considering the probability of correlations for each window. Thereafter, the determined probability values are integrated. On the basis of a specific threshold value, the point of maximum total probability correlation is recognised as a corresponding point. The algorithm is applied to aerial images for Digital Surface Model (DSM) generation. Results show that the corresponding points are identified successfully at different locations, especially at a discontinuous point, and that a Digital Surface Model of high resolution is generated.


[1] An R., Gong P., Wang H., Feng X., Xiao P., Chen Q., Zhang Q., Chen C., and Yan P., “A Modified PSO Algorithm for Remote Sensing Image Template Matching,” Photogrammetric Engineering and Remote Sensing, vol. 76, no. 4, pp. 379-389, 2010.

[2] Blum R. and Liu Z., Multi-Sensor Image Fusion and its Applications, CRC Press, 2005.

[3] Burger W. and Burge M., Principles of Digital Image Processing, Springer, 2013.

[4] Chen L., Lee L., and Lee S., “DTM Generation Using SPOT Digital Data,” in Proceedings of ISPRS Commission III, Kyoto, pp. 100-109, 1988.

[5] Chen Y., Tseng Y., Hsieh C., Wang P., and Tsai P., “Object-Space Multi-Image Matching of Mobile-Mapping Image Sequences,” in Proceedings of International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Melbourne, pp. 465-470, 2012.

[6] Dall'Asta E. and Roncella R., “A Comparison of Semiglobal and Local Dense Matching Algorithms for Surface Reconstruction,” in Proceedings of International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Riva del Garda, pp. 187- 194, 2014.

[7] Debella-Gilo M. and Kaab A., “Locally Adaptive Template Sizes for Matching Repeat Images of Earth Surface Mass Movements,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 69, pp. 10-28, 2012.

[8] Detchev I., Habib A., and Rau J., “Image Matching for 3D Photogrammetric Reconstruction,” in Proceedings of the 32nd Asian Conference on Remote Sensing, Taipei, pp. 247-252, 2011.

[9] Di-Rita M., Nascetti A., and Crespi M., “Open Source Tool for Dsms Generation from High Resolution Optical Satellite Imagery: Development and Testing of an OSSIM Plug- in,” International Journal of Remote Sensing, vol. 38, no. 7, pp. 1788-1808, 2017.

[10] Doxygen., “Harris Corner Detector,” Available from: http://docs.opencv.org/3.1.0/d4/d7d/tutorial_harr is_detector.html, Last Visited, 2018.

[11] Gesto-Diaz M., Tombari F., Gonzalez-Aguilera D., Lopez-Fernandez L., and Rodriguez- Gonzalvez P., “Feature Matching Evaluation for Multimodal Correspondence,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 129, pp. 179-188, 2017.

[12] Gruen A., “Adaptive Least Squares Correlation: A Powerful Image Matching Technique,” South African Journal of Photogrammetry, Remote Sensing and Cartography, vol. 14, no. 3, pp. 175-187, 1985.

[13] Gruen A., “Development and Status of Image Matching in Photogrammetry,” The Photogrammetric Record, vol. 27, no. 137, pp. 36-57, 2012.

[14] Guerrero M., “A Comparative Study of Three Image Matcing Algorithms: Sift, Surf, and Fast,” MSc Thesis, Utah State University, 2011.

[15] Harris C. and Stephens M., “A Combined Corner and Edge Detector,” in Proceedings of the 4th Alvey Vision Conference, Manchester, pp. 147- 151, 1988.

[16] Hashemi N., Aghdam R., Ghiasi A., and Fatemi P., “Template Matching Advances and Applications in Image Analysis,” American Scientific Research Journal for Engineering, Technology, and Sciences, vol. 26, no. 3, 2016.

[17] Hirschmuller H., “Stereo Processing By Semiglobal Matching and Mutual Information,” IEEE Transactions on Pattern Analysis and 356 The International Arab Journal of Information Technology, Vol. 17, No. 3, May 2020 Machine Intelligence, vol. 30, no. 2, pp. 328-41, 2008.

[18] Höhle J. and Potuckova M., “Assessment of the Quality of Digital Terrain Models,” European Spatial Data Research (EuroSDR), 2011.

[19] Hong G. and Zhang Y., “Wavelet-Based Image Registration Technique for High-Resolution Remote Sensing Images,” Computers and Geosciences, vol. 34, no. 12, pp. 1708-1720, 2008.

[20] Jin X. and Davis C., “Automated Building Extraction from High-Resolution Satellite Imagery in Urban Areas Using Structural, Contextual, and Spectral Information,” EURASIP Journal on Advances in Signal Processing, vol. 14, pp. 2196-2206, 2005.

[21] Joglekar J. and Gedam S., “Area Based Stereo Image Matching Technique Using Hausdorff Distance and Texture Analysis,” in Proceedings of International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Munich, pp. 109-114, 2011.

[22] Koh A., Schonermark M., and Theuwisse A., “Detectors and Sensors,” in Manual of Photogrammetry, 2013.

[23] Kraus K., Photogrammetry: Geometry from Images and Laser Scans, De Gruyter, 2007.

[24] Mayer H., Sester M., and Vosselman G., “Basic Computer Vision Techniques,” in Manual of Photogrammetry, 2013.

[25] Mikhail E., Bethel J., and McGlone J., Introduction to Modern Photogrammetry, Wiley, 2001.

[26] Oh J., “Novel Approach to Epipolar Resampling of HRSI and Satellite Stereo Imagery-based Georeferencing of Aerial Images,” PhD Thesis, The Ohio State University, 2011.

[27] Oh J., Toth C., and Grejner-Brzezinska D., “Automatic Georeferencing of Aerial Images Using Stereo High-Resolution Satellite Images” Photogrammetric Engineering and Remote Sensing, vol. 77, no. 11, pp. 1157-1168, 2011.

[28] Papoulis, A. and Pillai, S., Probability, Random Variables, and Stochastic Processes, Tata McGraw-Hill Education, 2002.

[29] Qin X., Li L., and Tian S., “A New Image Matching Algorithm with Modified Greedy Algorithm For Remote Sensing Imagery,” in Proceedings of ISPRS Workshop on Service and Application of Spatial Data Infrastructure. Hangzhou, pp. 113-120, 2003.

[30] Qiu C., Schmitt M., and Zhu X., “A Tie Point Matching Strategy For Very High Resolution Sar- Optical Stereogrammety over Urban Areas,” in Proceedings of International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Hannover, pp. 55-61, 2017.

[31] Roma N., Santos-Victor J., and Tomé J., Empirical Evaluation Methods in Computer Vision, World Scientific, 2002.

[32] Singh P. and Agarwal S., “A Region Adaptive Robust Watermarking Scheme Based on Homogeneity Analysis,” The International Arab Journal of Information Technology, vol. 13, no. 5, pp. 517-522, 2016.

[33] Sirguey P., Cullen N., and Santos J., “The New Digital Orthometric Elevation Model of Kilimanjaro,” in Proceedings of Research Locate, Canberra, pp. 108-117, 2014.

[34] Sonka M., Hlavac V., and Boyle R., Image Processing, Analysis, and Machine Vision, Cengage Learning, 2014.

[35] Tachikawa T., Kaku M., and Iwasaki A., “Aster GDEM Version 2 Validation Report,” Report to the ASTER GDEM Version 2, University of Tokyo, 2011.

[36] Wang R., Ma J., Huang H., and Shi W., “Improved Nonsubsampled Contourlet Transform for Multi-Sensor Image Registration,” Photogrammetric Engineering and Remote Sensing, vol. 79, no. 7, pp. 51-66 2013.

[37] Weeks A., Fundamentals of Electronic Image Processing, Wiley-IEEE Press, 1996.

[38] Wen G., Lv J., and Yu W., “A High- Performance Feature-Matching Method for Image Registration By Combining Spatial And Similarity Information,” IEEE Transactions on Geoscience and Remote Sensing, vol. 46, no. 4, pp. 1266-1277, 2008.

[39] Wolf P., DeWitt B., and Wilkinson B., Elements of Photogrammetry with Application in GIS, McGraw-Hill Education, 2014.

[40] Xie P., “A Web-based 3D Visualization Prototype System for High-resolution Satellite Colour Stereo Images,” Tecnical Report, University of New Brunswick, 2004.

[41] Yang W., Zhang Z., Wang X., Moran B., Wheaton A., and Cooley N., Image Fusion and its Applications, InTech, 2011.

[42] Zebedin L., Klaus A., Gruber-Geymayer B., and Karner K., “Towards 3D Map Generation From Digital Aerial Images,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 60, no. 6, pp. 413-427, 2006.

[43] Zhang B., “Automatic Spatial Modeler (ASM): Elevation by innovation,” Tecnical Report, in Geospatial EXploitation Products, 2014.

[44] Zhang B., Miller S., DeVenecia K., and Walker S., “Automatic Terrain Extraction Using Multiple Image Pair and Back Matching,” in Proceedings of ASPRS Annual Conference, Reno, 2006.

[45] Zhang B., Miller S., Walker S., and Devenecia K., “Next Generation Automatic Terrain Extraction Using Microsoft Ultracam Imagery,” Using Total Probability in Image Template Matching 357 in Proceedings of ASPRS Annual Conference, Tampa, 2007.

[46] Zhang L., “Automatic Digital Surface Model (DSM) Generation from Linear Array Images,” PhD Thesis, Institute of Geodesy and Photogrammetry Swiss Federal Institute of Technology (ETH) CH-8093 Zurich, 2005.

[47] Zhang L. and Gruen A., “Multi-Image Matching for DSM Generation from IKONOS Imagery,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 60, no. 3, pp. 195-211, 2006.

[48] Zhao F., Huang Q., and Gao W., “Image Matching by Normalized Cross-Correlation,” in Proceedings of IEEE International Conference on Acoustics Speech and Signal Processing Proceedings, Toulouse, pp. 729-732, 2006.

[49] Zitova B. and Flusser J., “Image Registration Methods: A Survey,” Image and Vision Computing, vol. 21, no. 11, pp. 977-1000, 2003. Haval Sadeq is a lecturer and head of the Geomatics (Surveying) Eng. dep. at Salahaddin University-Erbil, Iraq. He received his BSC degree fromSalahaddin University-Erbil, in 1996. He received his MSc degree in photogrammetry fromSalahaddin University-Erbil, Iraq, in 2000. In 2015 he received his PhD degree in Geomaticsfrom GlasgowUniversity, United Kingdom. His research interests are in photogrammetry, image matching, and, 3D city modelling from imagery.