skip to main content
10.1145/3624032.3624046acmotherconferencesArticle/Chapter ViewAbstractPublication PagessastConference Proceedingsconference-collections
extended-abstract

ATF - An end-to-end testing framework: experience report

Published:17 October 2023Publication History

ABSTRACT

Software products nowadays are becoming increasingly complex, containing modules directed for different devices, such as mobile and web. To maintain the quality of these products, development companies may adopt software testing techniques, such as end-to-end functional adequacy tests. However, a challenge arises when these companies serve diverse clients employing various technologies, requiring their developers and testers to possess knowledge across all these technologies. In this paper, we report our experience using the Automated Testing Framework (ATF), which makes the development of end-to-end functional adequacy tests easier for various types of devices in a standardized and organized manner. We also discuss its use on projects from two real clients presenting productivity data and feedback collected from the testers. Based on their feedback, we present the challenges they face and how we intend to tackle them.

References

  1. Hadeel Mohamed Eladawy, Amr E. Mohamed, and Sameh A. Salem. 2018. A New Algorithm for Repairing Web-Locators using Optimization Techniques. 2018 13th International Conference on Computer Engineering and Systems (ICCES) (2018), 327–331.Google ScholarGoogle ScholarCross RefCross Ref
  2. Martin Fowler. 2013. Page Object. https://martinfowler.com/bliki/PageObject.html. Accessed: 2023-07-27.Google ScholarGoogle Scholar
  3. Hiroyuki Kirinuki and Haruto Tanno. 2022. Automating End-to-End Web Testing via Manual Testing. J. Inf. Process. 30 (2022), 294–306. https://doi.org/10.2197/ipsjjip.30.294Google ScholarGoogle ScholarCross RefCross Ref
  4. Maurizio Leotta, Diego Clerissi, Filippo Ricca, and Paolo Tonella. 2016. Chapter Five - Approaches and Tools for Automated End-to-End Web Testing. Advances in Computers, Vol. 101. Elsevier, 193–237. https://doi.org/10.1016/bs.adcom.2015.11.007Google ScholarGoogle ScholarCross RefCross Ref
  5. J. Lin and S. Malek. 2022. GUI Test Transfer from Web to Android. In 2022 IEEE Conference on Software Testing, Verification and Validation (ICST). IEEE Computer Society, Los Alamitos, CA, USA, 1–11. https://doi.org/10.1109/ICST53961.2022.00011Google ScholarGoogle ScholarCross RefCross Ref
  6. Yu Liu, Rahulkrishna Yandrapally, Anup K. Kalia, Saurabh Sinha, Rachel Tzoref-Brill, and Ali Mesbah. 2022. CRAWLABEL: Computing Natural-Language Labels for UI Test Cases. In 2022 IEEE/ACM International Conference on Automation of Software Test (AST). 103–114. https://doi.org/10.1145/3524481.3527229Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Dudekula Mohammad Rafi, Katam Reddy Kiran Moses, Kai Petersen, and Mika V. Mäntylä. 2012. Benefits and limitations of automated software testing: Systematic literature review and practitioner survey. In 2012 7th International Workshop on Automation of Software Test (AST). 36–42. https://doi.org/10.1109/IWAST.2012.6228988Google ScholarGoogle ScholarCross RefCross Ref
  8. Filippo Ricca and Andrea Stocco. 2021. Web Test Automation: Insights from the Grey Literature. In SOFSEM 2021: Theory and Practice of Computer Science, Tomáš Bureš, Riccardo Dondi, Johann Gamper, Giovanna Guerrini, Tomasz Jurdziński, Claus Pahl, Florian Sikora, and Prudence W.H. Wong (Eds.). Springer International Publishing, Cham, 472–485.Google ScholarGoogle Scholar
  9. John Ferguson Smart and Jan Molak. 2023. BDD in Action: Behavior-driven development for the whole software lifecycle. Simon and Schuster.Google ScholarGoogle Scholar
  10. Andrea Stocco, Maurizio Leotta, Filippo Ricca, and Paolo Tonella. 2017. APOGEN: automatic page object generator for web testing. Software Quality Journal 25 (09 2017). https://doi.org/10.1007/s11219-016-9331-9Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Yan Zheng, Yi Liu, Xiaofei Xie, Yepang Liu, Lei Ma, Jianye Hao, and Yang Liu. 2021. Automatic Web Testing Using Curiosity-Driven Reinforcement Learning. In 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE). 423–435. https://doi.org/10.1109/ICSE43902.2021.00048Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. ATF - An end-to-end testing framework: experience report

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Other conferences
        SAST '23: Proceedings of the 8th Brazilian Symposium on Systematic and Automated Software Testing
        September 2023
        133 pages
        ISBN:9798400716294
        DOI:10.1145/3624032

        Copyright © 2023 Owner/Author

        Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 17 October 2023

        Check for updates

        Qualifiers

        • extended-abstract
        • Research
        • Refereed limited

        Acceptance Rates

        Overall Acceptance Rate35of72submissions,49%
      • Article Metrics

        • Downloads (Last 12 months)19
        • Downloads (Last 6 weeks)3

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format .

      View HTML Format