ABSTRACT
Software testing is an essential activity for software quality, since it allows the identification of bugs. However, testing is an expensive activity, because it requires time and experts. As a means of reducing the testing costs, many software companies have bet on the tests automation. As the main benefit, this automation cuts down the time spent to execute the tests. Nevertheless, there are few studies in the literature about the effort required to automate tests. This experience report describes a test automation experience in a Test Factory, describing the time spent, challenges faced, and lessons learned. In addition, this article presents a process for this activity, which was defined based on the gained experience.
- Francisco Almenar, Anna I Esparcia-Alcázar, Mirella Martínez, and Urko Rueda. 2016. Automated testing of web applications with TESTAR. In International Symposium on Search Based Software Engineering. Springer, 218--223.Google ScholarCross Ref
- Bruno Aragão, Ismayle De Sousa Santos, Tales Nogueira, Lana Mesquita, and Rossana Andrade. 2017. Modelagem Interativa de um Processo de Desenvolvimento com Base na Percepção da Equipe: Um Relato de Experiência. In Anais do Simpósio Brasileiro de Sistemas de Informação (SBSI).Google Scholar
- Eliane Collins, Arilo Dias-Neto, and Vicente F de Lucena Jr. 2012. Strategies for agile software testing automation: An industrial experience. In Computer Software and Applications Conference Workshops (COMPSACW). IEEE, 440--445. Google ScholarDigital Library
- Rossana Maria de Castro Andrade, Ismayle de Sousa Santos, Valéria Lelli, Káthia Marçal de Oliveira, and Ana Regina Rocha. 2017. Software Testing Process in a Test Factory - From Ad hoc Activities to an Organizational Standard. In 19th International Conference on Enterprise Information Systems. 132--143.Google ScholarCross Ref
- Dharmalingam Ganesan, Mikael Lindvall, Stefan Hafsteinsson, Rance Cleaveland, Susanne L Strege, and Walter Moleski. 2016. Experience report: Model-based test automation of a concurrent flight software bus. In Software Reliability Engineering (ISSRE), 2016 IEEE 27th International Symposium on. IEEE, 445--454.Google ScholarCross Ref
- Vahid Garousi and Junji Zhi. 2013. A survey of software testing practices in Canada. Journal of Systems and Software 86, 5 (2013), 1354--1376. Google ScholarDigital Library
- Katja Karhu, Tiina Repo, Ossi Taipale, and Kari Smolander. 2009. Empirical observations on software testing automation. In Software Testing Verification and Validation, 2009. ICST'09. International Conference on. IEEE, 201--209. Google ScholarDigital Library
- Jussi Kasurinen, Ossi Taipale, and Kari Smolander. 2010. Software test automation in practice: empirical observations. Advances in Software Engineering 2010 (2010). Google ScholarDigital Library
- Dima Kovalenko. 2014. Selenium Design Patterns and Best Practices. Packt Publishing Ltd.Google Scholar
- Divya Kumar and KK Mishra. 2016. The Impacts of Test Automation on Software's Cost, Quality and Time to Market. Procedia Computer Science 79 (2016), 8--15.Google ScholarCross Ref
- T Lima, Ayla Dantas, and Livia MR Vasconcelos. 2012. Usando o SilkTest para automatizar testes: um Relato de Experiência. In 6TH Brazilian Workshop on Systematic and Automated Software Testing.Google Scholar
- Glenford J Myers, Corey Sandler, and Tom Badgett. 2011. The art of software testing. John Wiley & Sons. Google ScholarDigital Library
- Dudekula Mohammad Rafi, Katam Reddy Kiran Moses, Kai Petersen, and Mika V Mäntylä. 2012. Benefits and limitations of automated software testing: Systematic literature review and practitioner survey. In Proceedings of the 7th International Workshop on Automation of Software Test. IEEE Press, 36--42. Google ScholarDigital Library
- Ana Sanz, Javier Garcia, Javier Saldana, and Antonio Amescua. 2009. A proposal of a process model to create a Test Factory. In Software Quality, 2009. WOSQ'09. ICSE Workshop on. IEEE, 65--70. Google ScholarDigital Library
- Alexander Shvets, M Pavlova, and G Frey. 2015. Design Patterns explained simply. URL: https://sourcemaking.com {Online} (2015).Google Scholar
- Maneela Tuteja, Gaurav Dubey, et al. 2012. A research study on importance of testing and quality assurance in software development life cycle (SDLC) models. International Journal of Soft Computing and Engineering 2, 3 (2012), 251--257.Google Scholar
- Kristian Wiklund, Sigrid Eldh, Daniel Sundmark, and Kristina Lundqvist. 2017. Impediments for software test automation: A systematic literature review. Software Testing, Verification and Reliability 27, 8 (2017).Google Scholar
Index Terms
- Test Automation in a Test Factory: an Experience Report
Recommendations
Achieving test automation with testers without coding skills: an industrial report
ASE '18: Proceedings of the 33rd ACM/IEEE International Conference on Automated Software EngineeringWe present a process driven test automation solution which enables delegating (part of) automation tasks from test automation engineer (expensive resource) to test analyst (non-developer, less expensive). In our approach, a test automation engineer ...
Software test automation practices in agile development environment: an industry experience report
AST '12: Proceedings of the 7th International Workshop on Automation of Software TestThe increased importance of Test Automation in software engineering is very evident considering the number of companies investing in automated testing tools nowadays, with the main aim of preventing defects during the development process. Test ...
Test automation on mobile device
AST '10: Proceedings of the 5th Workshop on Automation of Software TestTo ensure the software quality of mobile device, it is essential to build sophisticated testing automation strategy. In this paper, we introduced the idea of constructing a testing framework, elaborated the problems encountered in practice and proposed ...
Comments