Enhancing Software Process Assessment with an Ontology-Based Tool: Integrating CMMI, SPICE, and TMMI Models

Abstract

Software process reference models like Capability Maturity Model Integration (CMMI) and Software Process Improvement and Capability Determination (SPICE) have played a crucial role in evaluating processes for several decades. Their adoption by institutions has become essential for consistently delivering software projects to customers on time and with expected quality. However, conducting software process assessments demands considerable time, effort, and skilled personnel. This research introduces an ontology-based tool that facilitates software process assessment for organizations by integrating widely used process reference models, namely CMMI, SPICE, and Test Maturity Model Integration (TMMI). The development of this tool involves multiple stages: creating ontologies for each process reference model, integrating them into the tool, enabling querying capabilities, and visualizing the ontologies. Through a validation study in a selected organization, two sets of processes were assessed using the Ontology-Based Software Process Assessment Tool (OSPAT). The results demonstrated that organizations can benefit from OSPAT in evaluating their software development processes across diverse reference models, thereby enhancing overall process efficiency and quality.

Keywords

• Software Process Reference Model
• Process Assessment Tool
• Semantic Web Tool
• Software Process Improvement

References

1. 15504, A. I. I. (2003). Information Technology–Process Assessment.
2. Aktaş, A. Z., Yağdereli, E., & Serdaroğlu, D. (2021). An introduction to software testing methodologies. Gazi University Journal of Science Part A: Engineering and Innovation, 8(1), 1-15.
3. Athiththan, K., Rovinsan, S., Sathveegan, S., Gunasekaran, N., Gunawardena, K. S., & Kasthurirathna, D. (2018, December). An ontology-based approach to automate the software development process. In: Proceedings of the 2018 IEEE International Conference on Information and Automation for Sustainability (ICIAFS) (pp. 1-6). IEEE.
4. Castellano, I. L., Aguilar, G. F. C., Silega, N., Kamal, T., Al-Gaashani, M., Samee, N. A., & Alabdulhafith, M. (2023). An Ontology-Based Approach to Reduce the Negative Impact of Code Smells in Software Development Projects. IEEE Access, 11, 100146-100153 https://www.doi.org/10.1109/ACCESS.2023.3300575
5. Charfi, S., Ezzedine, H., & Kolski, C. (2015). RITA: a useR Interface evaluaTion frAmework. Journal of Universal Computer Science, 21(4), 526-560.
6. Feloni, D., & Braga, R. T. V. (2015). Methodologies for Evaluation and Improvement of Software Processes in the Context of Quality and Maturity Models: a Systematic Mapping. In CIbSE (p. 123).
7. Gazel, S. (2009). "CMMI-DEV" için bir ontoloji ve CMMI esaslı süreç değerlendirmenin ontoloji tabanlı bir araç ile desteklenmesi. MSc Thesis, Hacettepe University.
8. Gazel, S., Sezer, E. A., & Tarhan, A. (2012). An ontology based infrastructure to support CMMI-based software process assessment. Gazi University Journal of Science, 25(1), 155-164.

9. Gazel, S., Tarhan, A., & Sezer, E. (2009). A CMMI ontology for an ontology-based software process assessment tool, Proceedings of the 16th EuroSPI2 Conference.
10. Göçmen, E. (2021). A maturity model for assessing sustainable project management knowledge areas: A case study within a logistics firm. Journal of Advanced Research in Natural and Applied Sciences, 7(4), 536-555.
11. Haider, W., Ilyas M., Khalid S., & Ali, S. (2023). Factors influencing sustainability aspects in crowdsourced software development: A systematic literature review. Journal of Software: Evolution and Process, e2630. https://www.doi.org/10.1002/smr.2630
12. Hunter, R., Robinson, G., & Woodman, I. (1997). Tool support for software process assessment and improvement. Software Process: Improvement and Practice, 3(4), 213-223.
13. İlisulu, F., Kolukısa, A., & Kavak, K. (2020). Akıllı Şebeke Olgunluk Modelinin Dünya Çapındaki Uyarlamaları ve Türkiye için Öneriler. Bilişim Teknolojileri Dergisi, 13(2), 123-136. https://www.doi.org/10.17671/gazibtd.533221
14. Kalaycı, O. (2007). Yöneticiler için Doğru Sorular CMMI. Shamrock Süreç İyileştirme ve Yenilikçilik, Kanada.
15. Kiv, S., Wautelet, Y., Heng, S., & Kolp, M. (2022). OBAMA, an Ontology-Based Software Tool for Agile Method Adoption. arXiv preprint arXiv:2206.02207.
16. Lok, R. H., & Walker, A. (1997). Automated tool support for an emerging international software process assessment standard. In: Proceedings of the IEEE International Symposium on Software Engineering Standards. IEEE, (pp. 25-35).
17. Mora, M., Cervantes-Pérez, F., Garrido, L., Wang, F., & Angel-Sicilia, M. (2010). On KM, KMS and ontology-based KMS in the domain of SwE standards and models of processes: A conceptual survey. Intelligent Decision Technologies, 4(1), 75-98.
18. Silega, N., Castro Aguilar, G. F., Martillo Alcívar, I., Faggioni, K. M., Rogozov, Y. I. ,& Lapshin, V. S. (2023). An ontology-based approach to support the knowledge management of software quality standards. Enfoque UTE, 14(3), 49-56. https://www.doi.org/10.29019/enfoqueute.946
19. Soydan, G. H., & Kokar, M. (2006). An OWL ontology for representing the CMMI-SW model, Workshop on Semantic Web Enabled Software Engineering (SWESE). Citeseer.
20. Türkyılmaz, İ., & Yaşar, C. (2008). Semantik web teknolojileri. Akademik Bilişim 2008.
21. Vanamali, B., Bella, F., & Hörmann, K. (2008). From CMMI to SPICE-Experiences on How to Survive a SPICE Assessment Having Already Implemented CMMI, 2008 32nd Annual IEEE International Computer Software and Applications Conference. IEEE, pp. 1045-1052.
22. Yucalar, F., & Erdoğan, Ş. Z. (2009). A questionnaire based method for CMMI level 2 maturity assessment. Journal of Aeronautics and Space Technologies, 4(2), 39-46.
23. Yürüm, O. R. (2014). GSPA: A generic software process assessment tool. MSc Thesis, Middle East Technical University.
24. Zaied, A. N., H., Eldrandaly, K., & Tantawy, A. (2021). An OWL-Based Ontology Structure for representing Multimodel Process Improvement Framework. Kafrelsheikh Journal of Information Sciences, 2(1), 1-11. https://doi.org/10.21608/kjis.2021.22087.1007
25. Zhang, L., Olsen, A., & Lobov, A. (2022). An ontology-based KBE application for supply chain sustainability assessment. Resources, Environment and Sustainability, 10, 100086.