Continuous software quality evolution is crucial albeit challenging due to tight budgets and timelines. In fact, neglecting software quality in favour of customer satisfaction; either by reducing internal or external defects or by adding technical features shall place much pressure on project managers and stakeholders to find a balance between project budget and schedule. The increasing demand for high-quality software among stakeholders emphasizes the need for comprehensive approaches that can evaluate and rank quality metrics to maximize their benefits. In this research paper, we introduce an assessment approach developed using key quality metrics integrated from Cost Of Software Quality (COSQ) metrics, reliability metrics, and cost of defects metrics based on quantitative multicriteria decision analysis capabilities of the Analytic Hierarchy Process (AHP) model applied with a real case study for the software development team in Small and Medium Enterprises (SMEs) since most of them do not follow standards nor adopt well-structured quality methods. The evaluation is established based on the integrated AHP assessment approach as a practical solution for organizations seeking a critical examination of the relative significance of software metrics in terms of their utility in enhancing business performance. As a result, an evaluation of these quality metrics has been conducted to highlight the percentage of weight for each quality metric based on interviews with subject matters experts. The ranking of software quality metrics greatly helps stakeholders in selecting the most appropriate attribute for evaluating the developed software to identify high-impact quality initiatives and measure their effectiveness in the Software Development Life Cycle (SDLC).

[1] Alakus T., Das R., and Turkoglu I., “An Overview of Quality Metrics Used in Estimating Software Faults,” in Proceedings of the International Artificial Intelligence and Data Processing Symposium, Malatya, pp. 1-6, 2019. DOI:10.1109/IDAP.2019.8875925

[2] Al Nawaiseh A., The Effect of Information Technology on Business and Marketing Intelligence Systems, Springer, 2023. https://doi.org/10.1007/978-3-031-12382-5_20

[3] Asadabadi M., Chang E., and Saberi M., “Are MCDM Methods Useful? A Critical Review of Analytic Hierarchy Process and Analytic Network Process,” Cogent Engineering, vol. 6, no. 1, pp. 1- 11, 2019. https://doi.org/10.1080/23311916.2019.1623153

[4] Bajjouk M., Ramachandiran C., Rana M., and Chelliah S., “Software Testing for Reliability and Quality Improvement,” Journal of Applied Technology and Innovation, vol. 5, no. 2, pp. 40- 46, 2021. https://jati.sites.apiit.edu.my/files/2021/03/Volum e5_Issue2_Paper7_2021.pdf

[5] Belinda B., Emmanuel A., Solomon N., and Kayode A., “Evaluating Software Quality Attributes Using Analytic Hierarchy Process,” International Journal of Advanced Computer Science and Applications, vol. 12, no. 3, pp. 165- 173, 2021. DOI:10.14569/IJACSA.2021.0120321

[6] Colakoglu F., Yazici A., and Mishra A., “Software Product Quality Metrics: A Systematic Mapping Study,” IEEE Access, vol. 9, pp. 44647-44670, 2021. https://ieeexplore.ieee.org/document/9336003

[7] Goepel K., “Implementation of an Online Software Tool for the Analytic Hierarchy Process (AHP-OS),” International Journal of the Analytic Hierarchy Process, vol. 10, no. 3, pp. 469-487, 2018. https://doi.org/10.13033/ijahp.v10i3.590

[8] Hamed A., Elbakry H., Riad A., and Moawad R., “A Proposed Technical Debt Management Approach Applied on Software Projects in Egypt,” Journal of Internet Services and Information Security, vol. 13, no. 3, pp. 156-177, 2023. DOI: 10.58346/JISIS.2023.I3.010

[9] Helmold M., Virtual and Innovative Quality Management across the Value Chain, Springer, 2023. https://doi.org/10.1007/978-3-031-30089- 9_9

[10] Ismail E., Utelieva N., Balmaganbetova A., and Tursynbayeva S., “The Choice of Measures Reliability of the Software for Space Applications,” in Proceedings of the International Conference on Electrical, Communication, and Computer Engineering, Istanbul, pp. 1-5, 2020. DOI:10.1109/ICECCE49384.2020.9179411

[11] Kassie N. and Singh J., “A Study on Software Quality Factors and Metrics to Enhance Software Quality Assurance,” International Journal of Productivity and Quality Management, vol. 29, no. 1, pp. 24-44, 2020. DOI:10.1504/IJPQM.2019.10025496

[12] Kaur G. and Bahl K., “Software Reliability, Metrics, Reliability Improvement Using Agile Process,” International Journal of Innovative Science, Engineering and Technology, vol. 1, no. 3, pp. 143-147, 2014. https://ijiset.com/v1s3/IJISET_V1_I3_24.pdf

[13] Khan A., Hussain I., and Zamir M., “Analytic Hierarchy Process‐based Prioritization Framework for Vendor’s Reliability Challenges in Global Software Development,” Journal of Software: Evolution and Process, vol. 33, no. 3, pp. 1-22, 2021. https://doi.org/10.1002/smr.2310 290 The International Arab Journal of Information Technology, Vol. 21, No. 2, March 2024

[14] Krasner H., The Cost of Poor Quality Software in the US: A 2018 Report, Technical Report, 2018. https://www.it-cisq.org/the-cost-of-poor-quality- software-in-the-us-a-2018-report/

[15] Kyavars V. and Subramanian S., “Multi Criteria Decision Making to Select the Suitable Method for the Preparation of Nanocrystals Using an Analytic Hierarchy Process,” Indian Journal of Pharmaceutical Education and Research, vol. 51, no. 2, pp. 249-259, 2017. https://ijper.org/sites/default/files/10.5530ijper.51 .2.30.pdf

[16] Mall R., Fundamentals of Software Engineering, PHI Learning Private Limited, 2018. https://books.google.jo/books?id=-JNuDwAAQBAJ

[17] Modhiya S. and Desai D., “A Review on Cost of Quality Methodology and Hidden Costs in Manufacturing Industries,” REST Journal on Emerging Trends in Modelling and Manufacturing, vol. 2, no. 4, pp. 87-94, 2016. https://journals.indexcopernicus.com/search/articl e?articleId=1552642

[18] Mu E. and Pereyra-Rojas M., SpringerBriefs in Operations Research, Springer, 2017. https://doi.org/10.1007/978-3-319-33861-3_2

[19] Murumkar A., Teli S., Bhushi U., and Deshpande A., “Hidden Cost of Quality: A Review” in Proceedings of the 11th ISDSI International Conference, at IIM, Tiruchirappalli, pp. 1-20, 2017. https://www.researchgate.net/publication/321706 247_Hidden_Cost_of_Quality_A_Review

[20] Murumkar A., Teli S., Jadhav S., Dharmadhikari S., and Nikam M., “Integrated Approach of Cost of Quality and Six Sigma,” in Proceedings of the Global Meet on Advances in Design, Materials and Thermal Engineering, Navi Mumbai, pp. 30, 2018. https://docplayer.net/150025544-Global- meet-on-advances-in-design-materials-thermal- engineering.html

[21] Patel K., “Literature Review on Software Reliable Metrics,” International Journal of Engineering Research and Technology, vol. 9, no. 5, pp. 407- 410, 2021. https://www.ijert.org/literature- review-on-software-reliable-metrics

[22] Pillai N. and Hemamalini R., “Hybrid User Acceptance Test Procedure to Improve the Software Quality,” The International Arab Journal of Information Technology, vol. 19, no. 6, pp. 956-964, 2022. https://www.iajit.org/portal/images/Year2022/No .6/20887.pdf

[23] Prabhu S. and Shashirekha H., “Effectiveness of Software Metrics on Reliability for Safety Critical Real-Time Software,” in Proceedings of the Congress on Intelligent Systems, New Delhi, pp. 713-724, 2021. https://doi.org/10.1007/978-981- 33-6981-8_56

[24] Rashid J., Mahmood T., and Nisar M., “A Study on Software Metrics and its Impact on Software Quality,” Technical Journal, University of Engineering and Technology Journal, vol. 24, no. 1, pp. 1-14, 2019. https://api.semanticscholar.org/CorpusID:170078 652

[25] Rathi G., Tiwari U., and Singh N., “Software Reliability: Elements, Approaches and Challenges,” in Proceedings of the International Conference on Advances in Computing, Communication and Materials, Dehradun, pp. 1- 5, 2022. DOI:10.1109/ICACCM56405.2022.10009422

[26] Sahu K. and Srivastava R., Data Management, Analytics and Innovation, Springer, 2019. https://doi.org/10.1007/978-981-13-1402-5_17

[27] Shahid M., “Software Quality Models and Reliability Measurement Metrics,” LC International Journal of STEM, vol. 1, no. 2, pp. 49-54, 2020. file:///C:/Users/user/Downloads/LCJSTEM- 019.pdf

[28] Shraim M., “A Simple Model for Identifying Costs of Quality,” in Proceedings of the ASEE Virtual Annual Conference Content Access, Ohio, pp. 1-12, 2020. DOI:10.18260/1-2--34051

[29] Siavvas M., Chatzidimitriou K., and Symeonidis A., “QATCH-An Adaptive Framework for Software Product Quality Assessment,” Expert Systems with Applications, vol. 86, pp. 350-366, 2017. https://doi.org/10.1016/j.eswa.2017.05.060

[30] Thakkar J., Multi-Criteria Decision Making, Springer, 2021. https://link.springer.com/book/10.1007/978-981- 33-4745-8

[31] Tiwari U., Kumar S., and Matta P., “Execution- History Based Reliability Estimation for Component-based Software: Considering Reusability-Ratio and Interaction-Ratio,” International Journal of System Assurance Engineering and Management, vol. 11, no. 5, pp. 1003-1019, 2020. https://link.springer.com/article/10.1007/s13198- 020-01035-1

[32] Viswanathan G. and Prabhu J., “Survey of Methodologies for Quantifying Software Reliability,” International Journal of Internet Technology and Secured Transactions, vol. 10, no. 5, pp. 565-575, 2020. https://doi.org/10.1504/IJITST.2020.109535