skip to main content
10.1145/3275245.3275273acmotherconferencesArticle/Chapter ViewAbstractPublication PagessbqsConference Proceedingsconference-collections
research-article

Towards an automatic approach to estimating test effort: An Experience Report

Authors Info & Claims
Published:17 October 2018Publication History

ABSTRACT

Testing is a key activity to increase the quality of a software development project. However, this activity presents challenges, such as estimating the effort required to test software. Test estimates are sometimes performed based on experience, which may make the estimation inaccurate. In this paper, an experiment report is presented on the application of a semiautomatic approach to the estimation of the test effort, with the objective of systematizing the process of estimating the test effort and, at the same time, generating estimates closer to the actual effort spent. The approach was applied in a test factory and the estimated times were close to the actual effort, indicating that the approach used is promising.

References

  1. R. M. C. Andrade, V. Lelli, R. N. S. Castro, and I. S. Santos. 2017. Fifteen Years of Industry and Academia Partnership: Lessons Learned from a Brazilian Research Group. In 2017 IEEE/ACM 4th International Workshop on Software Engineering Research and Industrial Practice (SER IP). 10--16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Prasanta Bhattacharya, Praveen Ranjan Srivastava, and Bhanu Prasad. 2012. Software test effort estimation using particle swarm optimization. In Proceedings of the International Conference on Information Systems Design and Intelligent Applications 2012 (INDIA 2012) held in Visakhapatnam, India, January 2012. Springer, 827--835.Google ScholarGoogle ScholarCross RefCross Ref
  3. Rossana M. de Castro Andrade, Ismayle de Sousa Santos, Valéria Lelli, Káthia Marçal de Oliveira, and Ana Regina Cavalcanti da Rocha. 2017. Software Testing Process in a Test Factory - From Ad hoc Activities to an Organizational Standard. In ICEIS.Google ScholarGoogle Scholar
  4. Daniel G e Silva, Mario Jino, and Bruno T de Abreu. 2010. Machine learning methods and asymmetric cost function to estimate execution effort of software testing. In Software Testing, Verification and Validation (ICST), 2010 Third International Conference on. IEEE, 275--284. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Olga Fedotova, Leonor Teixeira, Helena Alvelos, et al. 2013. Software Effort Estimation with Multiple Linear Regression: Review and Practical Application. J. Inf. Sci. Eng. 29, 5 (2013), 925--945.Google ScholarGoogle Scholar
  6. Shaiful Islam, Bishwajit B Pathik, Manzur H Khan, and Mamun Habib. 2013. Software test estimation tools using use cases and functions. In Industrial Engineering and Engineering Management (IEEM), 2013 IEEE International Conference on. IEEE, 390--394.Google ScholarGoogle ScholarCross RefCross Ref
  7. Shaiful Islam, Bishwajit B Pathik, Manzur H Khan, and Mamun Habib. 2016. Software test estimation tool: Comparable with COCOMOII model. In Industrial Engineering and Engineering Management (IEEM), 2016 IEEE International Conference on. IEEE, 204--208.Google ScholarGoogle ScholarCross RefCross Ref
  8. Kamala Ramasubramani Jayakumar and Alain Abran. 2013. A survey of software test estimation techniques. Journal of Software Engineering and Applications 6, 10 (2013), 47.Google ScholarGoogle ScholarCross RefCross Ref
  9. Divya Kumar and KK Mishra. 2016. The Impacts of Test Automation on Software's Cost, Quality and Time to Market. Procedia Computer Science 79 (2016), 8--15.Google ScholarGoogle ScholarCross RefCross Ref
  10. Vu Nguyen, Vu Pham, and Vu Lam. 2013. qEstimation: A Process for Estimating Size and Effort of Software Testing. In Proceedings of the 2013 International Conference on Software and System Process (ICSSP 2013). ACM, New York, NY, USA, 20--28. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Alessandro Orso and Gregg Rothermel. 2014. Software testing: a research travelogue (2000--2014). In Proceedings of the on Future of Software Engineering. ACM, 117--132. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Madhukar Pai, Michael McCulloch, Jennifer D Gorman, Nitika Pai, Wayne Enanoria, Gail Kennedy, Prathap Tharyan, and John M Colford. 2004. Systematic reviews and meta-analyses: an illustrated, step-by-step guide. The National medical journal of India 17, 2 (2004), 86--95. http://europepmc.org/abstract/MED/15141602Google ScholarGoogle Scholar
  13. Ismayle De Sousa Santos, Wellington Franco, Bruno S. Aragão, and Rossana Andrade. 2015. Definição e Apliçãao de um Processo de Testes Ágeis: um Relato de Experiência. (01 2015).Google ScholarGoogle Scholar
  14. Ana Sanz, Javier Garcia, Javier Saldana, and Antonio Amescua. 2009. A proposal of a process model to create a Test Factory. In Software Quality, 2009. WOSQ'09. ICSE Workshop on. IEEE, 65--70. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Praveen Ranjan Srivastava, Sirish Kumar, AP Singh, and G Raghurama. 2011. Software testing effort: an assessment through fuzzy criteria approach. Journal of Uncertain Systems 5, 3 (2011), 183--201.Google ScholarGoogle Scholar
  16. Praveen Ranjan Srivastava, Abhishek Varshney, Priyanka Nama, and Xin-She Yang. 2012. Software test effort estimation: a model based on cuckoo search. International Journal of Bio-Inspired Computation 4, 5 (2012), 278--285. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Maneela Tuteja, Gaurav Dubey, et al. 2012. A research study on importance of testing and quality assurance in software development life cycle (SDLC) models. International Journal of Soft Computing and Engineering 2, 3 (2012), 251--257.Google ScholarGoogle Scholar
  18. Lucas Vieira, Cayk Barreto, Erick Santos, Bruno S. Aragão, Ismayle De Sousa Santos, and Rossana Andrade. 2018. Automação de Testes em uma Fábrica de Testes: Um Relato de Experiência. (06 2018).Google ScholarGoogle Scholar

Index Terms

  1. Towards an automatic approach to estimating test effort: An Experience Report

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      SBQS '18: Proceedings of the XVII Brazilian Symposium on Software Quality
      October 2018
      384 pages
      ISBN:9781450365659
      DOI:10.1145/3275245

      Copyright © 2018 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 17 October 2018

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

      Acceptance Rates

      Overall Acceptance Rate35of99submissions,35%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader