INVESTIGATION OF TEST AUTOMATION DATA USING STATISTICAL METHODS

Year 2014, Volume: 32 Issue: 1, 10 - 22, 01.03.2014

Muhammed Maruf Öztürk Ahmet Zengin

Abstract

As the scale of software projects increase, the time allocated to development of software increases that testing of software quality is becoming important depending of this situation. Software test teams take some responsibilities to reduce time of project development and make particular planning to shorten completion of project as well as the time of maintenance. At this point of view, various automated test tools are widely used to reduce project effort and time. The most common area of using automated test is web based software. Thanks to automated tests, errors can be detected which available in web based software and all transactions are saved. Owing to running of these test tools on the basis of object oriented languages and provided libraries that enable to user controlling these tools are considered as the reason of selection. This study presents a framework that provide controlling of test tools and analyzing test data statistically. The innovation of statistical analysis which performed on software test area has been depicted.

Keywords

Software testing, automated test, statistical analysis.

References

• [1] Besson, F. M., Beder, D. M., Chaim, M. L.: An Automated Approach for Acceptance Web Test Case Modeling and Executing, Agile Processes in Software Engineering and Extreme Programming, 48, 160-165, 2010.
• [2] Larsen, M.:Get the Balance Right: Acceptance Test Driven Development, GUI Automation and Exploratory Testing, PNSQC 2012, 1-14, 2012.
• [3] Adzic, G.: Test Driven. NET Development with FitNesse, Lulu Enterprises Uk Limited, 2008.
• [4] Shahamiri, S., Kadira, W., Ibrahima, S., Hashim, S.: An automated framework for software test oracle. Information and Software Technology, 53, 2011.
• [5] Pocatilu, P.:Automated Software Testing Process, Economy Informatics, 2(1), 97-99, 2002.
• [6] Kim, E. H., Na, J. C., and Ryoo S. M.: Implementing an Effective Test Automation Framework, Computer Software and Applications Conference, 2, 534-538, 2009.
• [7] Badle, S., Selenium Web Browser Automation Site, Available from: http://docs.seleniumhq.org/, 2013.
• [8] Wang, Xinchun, and Peijie Xu: Build an auto testing framework based on selenium and fitnesse., ITCS International Conference onInformation Technology and Computer Science, 2, 2009.
• [9] Richardson, A.:Selenium Simplified, A tutorial guide to using the Selenium API in Java with JUnit, London, 2010.
• [10] Ozturk, M. Maruf: Distance education measurement and evaluation system design and performance analyze with software testing techniques, published master dissertation, 2012.
• [11] Bruns, A. Kornstadt, A., Wichmann, D.: Web Application Tests with Selenium, IEEE Software, 88-91, 2009.
• [12] Catelani, M., Ciani, L., Scarano, V. L., Bacioccola, A.: Software automated testing: A solution to maximize the test plan coverage and to increase software reliability and quality in use, Computer Standards & Interfaces, 33(2), 152-158, 2011.
• [13] Huttermann, M.:Quality and Testing, DevOps for Developers, 51-64, 2012.
• [14] Pan, Z., Park, H., Baik, J., Choi, H.: A Six Sigma Framework for Software Process Improvements and its Implementation. In: Software Engineering Conference. IEEE, Los Alamitos, 2007.
• [15] Löffler, R., Gülldali, B., Geisen, S.:Towards Model-based Acceptance Testing for Scrum. Softwaretechnik-Trends, GI, 2010.
• [16] Collins, E., Dias-Neto, A.,de Lucena, V.F.:Strategies for Agile Software Testing Automation: An Industrial Experience, 440-445, 2012.
• [17] Dale H. Emery. Writing Maintainable Automated Acceptance Tests. http://dhemery.com/pdf/writing maintainable automated acceptance tests.pdf, 2013. [Online; accessed 14-June-2013].
• [18] Xie, T.:Improving Effectiveness of Automated Software Testing in the Absence of Specifications, In Proceedings of the 22nd IEEE international Conference on Software Maintenance, 355-359, 2006.
• [19] Jureczko, M., Mynarski, M.: Automated acceptance testing tools for web applications using test-driven development. Electrotechnical Review, 86(9), 198-202, 2010.
• [20] S.L. Eddins: Automated Software Testing for Matlab. IEEE Computing in Science, 2009.
• [21] Head, G.E. “Six-Sigma Software Using Cleanroom Software Engineering Techniques.” Hewlett-Packard Journal 1994 (June 1994): 40–50.
• [22] Cvetan Redzic and Jongmoon Baik, “Six Sigma Approach in Software Quality Improvement”, International Conference on Software Engineering Research, Management and Applications (SERA'06), August 2006.
• [23] T. Galinac, Ž. Car, Software verification process improvement proposal using Six Sigma Proceedings of 8th International Product-Focused Software Process Improvement Conference, Lecture Notes in Computer Science, 4589, 51–64, Springer-Verlag, Berlin, 2007.
• [24] Fehlmann, Th. (2004), “Six sigma for software”, Proceedings of the 1st SMEF Conference, Rome.
• [25] Arul, K., Kohli, H., “Six Sigma for software application of hypothesis tests to software data”, Software Quality Journal, 12(1), 29-42, 2004.
• [26] D. E. Harter, C. F. Kemerer, and Sandra A. Slaughter, “Does software process improvement reduce the severity of defects? A longitudinal field study”, IEEE Trans. Software Eng., 38(4), 810-827, 2012.
• [27] Champ, C.W. and Woodall, W.H., Exact Results for Shewhart Control Charts with Supplementary Runs Rules, Technometrics, 29, 1987.
• [28] Shewhart, W.A., Economic Control of Quality of Manufactured Product, Van Nostrand-Reinhold, NY, 1931.
• [29] Fisher, R.A., Statistical Methods for Research Workers. Oliver & Boyd, Edinburgh, 1925.
• [30] Glidden, David V., Stephen C. Shiboski, and Charles E. McCulloch. Regression methods in biostatistics: linear, logistic, survival, and repeated measures models. Springer, 2011.