EVEREST: An Automatic Model-Based Testing Tool for Asynchronous Reactive Systems
DOI:
https://doi.org/10.5753/jserd.2021.1094Keywords:
Model-based testing, conformance checking, test generation, reactive systems, automatic toolAbstract
Reactive systems are characterized by their interaction with the environment, where the exchange of the input and output stimuli, usually, occurs asynchronously. Systems of this nature, in general, require a rigorous testing activity in the development process.Thereforemodelbasedtestinghasbeensuccessfullyappliedoverasynchronousreactive systems using Input Output Labeled Transition System (IOLTS) as the basis. In this work, we present are active testing tool to check conformance, generate test suites, and run test cases using IOLTS models. Our tool can check whether the behavior of an implementation under test (IUT) complies with the behavior of its respective specification. We have implemented two conformance relations in our tool: the classical ioco relation; and the conformance based on regular languages. The tool also provides a test suite generation in a blackbox testing setting for finding faults over IUTs according to a specific domain. In addition, we describe some case studies to probe the tool’s functionalities and also give a comparative analysis. Finally, we offer practical experiments to evaluate the performance of our tool using several scenarios.
Downloads
References
Belinfante, A. (2010a). Jtorx: A tool for online modeldriven test derivation and execution. In Esparza, J. and Majumdar, R., editors, Tools and Algorithms for the Construction and Analysis of Systems, 16th International Conference, TACAS 2010, Lecture Notes in Computer Science, pages 266–270. Springer.
Belinfante, A. (2010b). Jtorx: A tool for online modeldriven test derivation and execution. In Esparza, J. and Majumdar, R., editors, Tools and Algorithms for the Construction and Analysis of Systems, pages 266–270, Berlin, Heidelberg. Springer Berlin Heidelberg.
Belinfante, A. (2014). JTorX: Exploring ModelBased Testing. Centre for Telematics and Information Technology (CTIT), Netherlands. IPA Dissertation series no. 2014-09.
Bonifacio, A. L. and Moura, A. V. (2019). Complete test suites for input/output systems. CoRR, abs/1902.10278. Accessed on: 2019-06.
Calamé, J. (2005). Specificationbased test generation with tgv. Software Engineering Notes
Clarke, D., Jéron, T., Rusu, V., and Zinovieva, E. (2002). STG: A Symbolic Test Generation Tool. In Katoen, J.P. and Stevens, P., editors, Tools and Algorithms for the Construction and Analysis of Systems, pages 470–475, Berlin, Heidelberg. Springer Berlin Heidelberg.
de Vries, R. (2001). Towards formal test purposes. In Tretmans, G. and Brinksma, H., editors, Formal Approaches to Testing of Software 2001 (FATES’01) Volume NS-01-4, BRICS Notes Series, pages 61–76, Aarhus, Denkmark.
Gomes, C. S. and Bonifacio, A. L. (2019). Automatically checking conformance on asynchronous reactive systems. In The Fourteenth International Conference on Software Engineering Advances, pages 17–23.
Jard, C. and Jéron, T. (2005). Tgv: theory, principles and algorithms. International Journal on Software Tools for Technology Transfer, 7(4):297–315. Accessed on: 2019-08.
Larsen, K. G., Mikucionis, M., Nielsen, B., and Skou, A. (2005). Testing Realtime Embedded Software Using UPPAALTRON: An Industrial Case Study. In Proceedings of the 5th ACM International Conference on Embedded Software, EMSOFT ’05, pages 299–306. ACM.
Mark Utting, B. L. (2007). practical modelbased testing a tools approach. Elsevier, 1nd edition.
Marsso, L., Mateescu, R., and Serwe, W. (2018). Testor: A modular tool for onthefly conformance test case generation. In Beyer, D. and Huisman, M., editors, Tools and Algorithms for the Construction and Analysis of Systems, pages 211–228, Cham. Springer International Publishing.
Mostowski, W., Poll, E., Schmaltz, J., Tretmans, J., and Wichers Schreur, R. (2009). ModelBased Testing of Electronic Passports. In Alpuente, M., Cook, B., and Joubert, C., editors, Formal Methods for Industrial Critical Systems, pages 207-209, Berlin, Heidelberg. Springer Berlin Heidelberg.
Naik, K. and Tripathy, P. (2018). Software Testing and Quality Assurance: Theory and Practice. Wiley Publishing, 2nd edition.
Roehm, H., Oehlerking, J., Woehrle, M., and Althoff, M. (2016). Reachset conformance testing of hybrid automata. In Proceedings of the 19th International Conference on Hybrid Systems: Computation and Control, HSCC ’16,
pages 277–286, New York, NY, USA. ACM.
Simão, A. d. S. and Petrenko, A. (2014). Generating complete and finite test suite for ioco: Is it possible? In Proceedings Ninth Workshop on ModelBased Testing, MBT 2014, Grenoble, France, 6 April 2014., pages 56–70. Accessed on: 2019-07.
Sipser, M. (2006). Introduction to the Theory of Computation. Course Technology, second edition.
Tretmans, J. (1993). A formal approach to conformance testing. In Rafiq, O., editor, Protocol Test Systems, VI, Proceedings of the IFIP TC6/WG6.1 Sixth International Workshop on Protocol Test systems, Pau, France, 2830 September, 1993, volume C19 of IFIP Transactions, pages 257–276. North-Holland.
Tretmans, J. (2008). Model based testing with labelled transition systems. In Hierons, R. M., Bowen, J. P., and Harman, M., editors, Formal Methods and Testing, An Outcome of the FORTEST Network, Revised Selected Papers, volume 4949 of Lecture Notes in Computer Science, pages 1–38. Springer.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2021 Adilson Bonifacio
This work is licensed under a Creative Commons Attribution 4.0 International License.
