A new approach to event- and model-based feature-driven software testing and comparison with similar approaches

Abstract

A software can be thought as a composition of features. Feature-oriented software development (FOSD) builds the development process on features. Part of the FOSD process is testing, and accordingly, it should be feature-driven. In model-based testing, test cases are systematically generated using the model. This research concentrates on event-based graphical models and utilizes event sequence graphs (ESGs). We develop a new test sequence generation algorithm for ESGs and named it short and frequent test sequences (SFT). Then we compare it with the existing test sequence generation algorithm called TSD. Moreover, we introduce two model-building approaches, namely daisy and swim lane, for ESGs and analyze their effects on feature-driven testing. For the evaluation, we use five different feature-driven software models. The evaluation results shows that both modeling approaches are advantageous in certain test objectives. For testing the software product as a whole, test sequence(s) should be generated by TSD from daisy modeled ESG. If a certain feature within the software product or its interaction with another feature is to be tested, then test sequence(s) should be generated by SFT from swim lane modeled ESG.

Keywords

• Event sequence graphs
• Feature-oriented software development
• Model-based testing

References

1. 1. Apel, S., Batory, D., Kästner, C., Saake, G., Feature-oriented software product lines. 2016, USA: Springer-Verlag Berlin Heidelberg.
2. 2. Apel, S., Kästner, C., An overview of feature-oriented software development. J. Object Technol, 2009. 8(5): p. 49-84.
3. 3. Belli, F., Finite state testing and analysis of graphical user interfaces. Proceedings of the 12th IEEE International Symposium on Software Reliability Engineering, 2001. Washington, DC, USA: p. 34-43.
4. 4. Memon, A.M., An event‐flow model of GUI‐based applications for testing. Software testing, verification and reliability, 2007. 17(3): p. 137-157.
5. 5. Amjad, A., Azam, F., Anwar, M.W., Butt, W.H., Rashid, M., Event-driven process chain for modeling and verification of business requirements–a systematic literature review. IEEE Access, 2018. 6: p. 9027-9048.
6. 6. Belli, F., Budnik, C.J., White, L., Event based modelling, analysis and testing of user interactions: approach and case study. Software Testing, Verification and Reliability, 2006. 16(1): p. 3-32.
7. 7. Belli, F., Budnik, C.J., Minimal Spanning Set for Coverage Testing of Interactive Systems. Proceedings of the International Colloquium on Theoretical Aspects of Computing, 2005. Springer Berlin Heidelberg: p. 220-234.
8. 8. Belli, F., Guler, N., Linschulte, M., Does" depth" really matter? on the role of model refinement for testing and reliability. Proceedings of the IEEE 35th Annual Computer Software and Applications Conference (COMPSAC), 2011: p. 630-639.

9. 9. Burkard, R., Dell’Amico, M., Martello, S., Assignment problems: revised reprint. 2012, SIAM.
10. 10. Kas’ yanov, V.N., Distinguishing hammocks in a directed graph. Proceedings of the Doklady Akademii Nauk, 1975.
11. 11. Ferrante, J., Ottenstein, K.J., Warren, J.D., The program dependence graph and its use in optimization. ACM Transactions on Programming Languages and Systems, 1987. 9(3): p. 319-349.
12. 12. Dijkstra, E.W., A note on two problems in connexion with graphs. Numerische Mathematik, 1959. 1: p. 269-271.
13. 13. Kim, S., Jin, H., Seo, M., Har, D., Optimal path planning of automated guided vehicle using dijkstra algorithm under dynamic conditions. Proceedings of the 7th IEEE International Conference on Robot Intelligence Technology and Applications, 2019. p. 231-236.
14. 14. Luo, M., Hou, X., & Yang, J., Surface optimal path planning using an extended Dijkstra algorithm. IEEE Access, 2020. 8: p. 147827-147838.
15. 15. Olimpiew, E.M., Gomaa, H., Model-based testing for applications derived from software product lines. ACM SIGSOFT Software Engineering Notes, 2005. 30(4): p. 1-7.
16. 16. Lamancha, B.P., Díaz, O., Azanza, M., Polo, M., Software product line testing: A feature oriented approach. Proceedings of the IEEE International Conference on Industrial Technology, 2012. p. 298-305.
17. 17. Petry, K. L., OliveiraJr, E., Zorzo, A. F., Model-based testing of software product lines: Mapping study and research roadmap. Journal of Systems and Software, 2020. 167: p. 110608.
18. 18. Lity, S., Lochau, M., Schaefer, I., Goltz, U., Delta-oriented model-based SPL regression testing. Proceedings of the Third International Workshop on Product LinE Approaches in Software Engineering, 2012.
19. 19. Uzuncaova, E., Khurshid, S., Batory, D., Incremental test generation for software product lines. IEEE transactions on software engineering, 2010. 36(3): p. 309-322.
20. 20. Neto, P.A. da M.S., Machado, I. do C., Cavalcanti, Y.C., Almeida, E.S. de, Garcia, V.C., Meira, S.R. de L., A Regression Testing Approach for Software Product Lines Architectures. Proceedings of the Fourth Brazilian Symposium on Software Components, Architectures and Reuse, 2010. p. 41–50.
21. 21. Lochau, M., Schaefer, I., Kamischke, J., Lity, S., Incremental Model-Based Testing of Delta-Oriented Software Product Lines. in Tests and Proofs, 2012. p. 67–82.
22. 22. Dukaczewski, M., Schaefer, I., Lachmann, R., Lochau, M., Requirements-based delta-oriented SPL testing. Proceedings of the 4th International Workshop on Product LinE Approaches in Software Engineering, 2013. p. 49-52.
23. 23. Varshosaz, M., Beohar, H., Mousavi, M.R., Delta-oriented FSM-based testing. Proceedings of the International Conference on Formal Engineering Methods, 2015: p. 366-381.
24. 24. Devroey, X., Perrouin, G., Schobbens, P.-Y., Abstract test case generation for behavioural testing of software product lines. Proceedings of the 18th ACM International Software Product Line Conference, Companion Volume for Workshops, Demonstrations and Tools, 2014: p. 86-93.
25. 25. Belli, F., Tuglular, T., Ufuktepe, E., Heterogeneous Modeling and Testing of Software Product Lines. Proceedings of the 21st IEEE International Conference on Software Quality, Reliability and Security Companion, 2021: p. 1079-1088.
26. 26. Tuglular, T., Beyazıt, M., Öztürk, D., Featured Event Sequence Graphs for Model-Based Incremental Testing of Software Product Lines. Proceedings of the 43rd IEEE International Conference on Computer, Software and Applications, 2019. Milwaukee, Wisconsin, USA: p. 197-202.