skip to main content
10.1145/3229345.3229356acmotherconferencesArticle/Chapter ViewAbstractPublication PagessbsiConference Proceedingsconference-collections
research-article

Test Automation in a Test Factory: an Experience Report

Authors Info & Claims
Published:04 June 2018Publication History

ABSTRACT

Software testing is an essential activity for software quality, since it allows the identification of bugs. However, testing is an expensive activity, because it requires time and experts. As a means of reducing the testing costs, many software companies have bet on the tests automation. As the main benefit, this automation cuts down the time spent to execute the tests. Nevertheless, there are few studies in the literature about the effort required to automate tests. This experience report describes a test automation experience in a Test Factory, describing the time spent, challenges faced, and lessons learned. In addition, this article presents a process for this activity, which was defined based on the gained experience.

References

  1. Francisco Almenar, Anna I Esparcia-Alcázar, Mirella Martínez, and Urko Rueda. 2016. Automated testing of web applications with TESTAR. In International Symposium on Search Based Software Engineering. Springer, 218--223.Google ScholarGoogle ScholarCross RefCross Ref
  2. Bruno Aragão, Ismayle De Sousa Santos, Tales Nogueira, Lana Mesquita, and Rossana Andrade. 2017. Modelagem Interativa de um Processo de Desenvolvimento com Base na Percepção da Equipe: Um Relato de Experiência. In Anais do Simpósio Brasileiro de Sistemas de Informação (SBSI).Google ScholarGoogle Scholar
  3. Eliane Collins, Arilo Dias-Neto, and Vicente F de Lucena Jr. 2012. Strategies for agile software testing automation: An industrial experience. In Computer Software and Applications Conference Workshops (COMPSACW). IEEE, 440--445. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Rossana Maria de Castro Andrade, Ismayle de Sousa Santos, Valéria Lelli, Káthia Marçal de Oliveira, and Ana Regina Rocha. 2017. Software Testing Process in a Test Factory - From Ad hoc Activities to an Organizational Standard. In 19th International Conference on Enterprise Information Systems. 132--143.Google ScholarGoogle ScholarCross RefCross Ref
  5. Dharmalingam Ganesan, Mikael Lindvall, Stefan Hafsteinsson, Rance Cleaveland, Susanne L Strege, and Walter Moleski. 2016. Experience report: Model-based test automation of a concurrent flight software bus. In Software Reliability Engineering (ISSRE), 2016 IEEE 27th International Symposium on. IEEE, 445--454.Google ScholarGoogle ScholarCross RefCross Ref
  6. Vahid Garousi and Junji Zhi. 2013. A survey of software testing practices in Canada. Journal of Systems and Software 86, 5 (2013), 1354--1376. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Katja Karhu, Tiina Repo, Ossi Taipale, and Kari Smolander. 2009. Empirical observations on software testing automation. In Software Testing Verification and Validation, 2009. ICST'09. International Conference on. IEEE, 201--209. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Jussi Kasurinen, Ossi Taipale, and Kari Smolander. 2010. Software test automation in practice: empirical observations. Advances in Software Engineering 2010 (2010). Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Dima Kovalenko. 2014. Selenium Design Patterns and Best Practices. Packt Publishing Ltd.Google ScholarGoogle Scholar
  10. Divya Kumar and KK Mishra. 2016. The Impacts of Test Automation on Software's Cost, Quality and Time to Market. Procedia Computer Science 79 (2016), 8--15.Google ScholarGoogle ScholarCross RefCross Ref
  11. T Lima, Ayla Dantas, and Livia MR Vasconcelos. 2012. Usando o SilkTest para automatizar testes: um Relato de Experiência. In 6TH Brazilian Workshop on Systematic and Automated Software Testing.Google ScholarGoogle Scholar
  12. Glenford J Myers, Corey Sandler, and Tom Badgett. 2011. The art of software testing. John Wiley & Sons. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Dudekula Mohammad Rafi, Katam Reddy Kiran Moses, Kai Petersen, and Mika V Mäntylä. 2012. Benefits and limitations of automated software testing: Systematic literature review and practitioner survey. In Proceedings of the 7th International Workshop on Automation of Software Test. IEEE Press, 36--42. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Ana Sanz, Javier Garcia, Javier Saldana, and Antonio Amescua. 2009. A proposal of a process model to create a Test Factory. In Software Quality, 2009. WOSQ'09. ICSE Workshop on. IEEE, 65--70. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Alexander Shvets, M Pavlova, and G Frey. 2015. Design Patterns explained simply. URL: https://sourcemaking.com {Online} (2015).Google ScholarGoogle Scholar
  16. Maneela Tuteja, Gaurav Dubey, et al. 2012. A research study on importance of testing and quality assurance in software development life cycle (SDLC) models. International Journal of Soft Computing and Engineering 2, 3 (2012), 251--257.Google ScholarGoogle Scholar
  17. Kristian Wiklund, Sigrid Eldh, Daniel Sundmark, and Kristina Lundqvist. 2017. Impediments for software test automation: A systematic literature review. Software Testing, Verification and Reliability 27, 8 (2017).Google ScholarGoogle Scholar

Index Terms

  1. Test Automation in a Test Factory: an Experience Report

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      SBSI '18: Proceedings of the XIV Brazilian Symposium on Information Systems
      June 2018
      578 pages
      ISBN:9781450365598
      DOI:10.1145/3229345

      Copyright © 2018 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 4 June 2018

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

      Acceptance Rates

      Overall Acceptance Rate181of557submissions,32%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader