EVEREST: An Automatic Model-Based Testing Tool for Asynchronous Reactive Systems
An IOLTS Model-Based Testing Tool
Keywords:Model-based testing, conformance checking, test generation, reactive systems, automatic tool
Reactive systems are characterized by the interaction with the environment, where the exchange of the input and output stimuli, usually, occurs asynchronously.
Systems of this nature, in general, require a rigorous testing activity over their developing process. Therefore model-based testing has been successfully applied over asynchronous reactive systems using Input Output Labeled Transition Systems (IOLTSs) as the basis. In this work we present a reactive testing tool to check conformance, generate test suites and run test cases using IOLTS models. Our tool can check whether the behavior of an implementation under test (IUT) complies with the behavior of its respective specification. We have implemented a classical conformance relation ioco and a more general notion of conformance based on regular languages. Further, the tool provides a test suite generation in a black-box testing setting for finding faults over IUTs according to a specific domain. We have also described some case studies to probe the tool's functionalities and also to highlight a comparative analysis on both conformance approaches. Finally, we offer experiments to evaluate the performance of our tool using several scenarios.
Belinfante, A. (2010a). Jtorx: A tool for online modeldriven test derivation and execution. In Esparza, J. and
Majumdar, R., editors, Tools and Algorithms for the Construction and Analysis of Systems, 16th International Conference, TACAS 2010, Lecture Notes in Computer Science,
pages 266–270. Springer.
Belinfante, A. (2010b). Jtorx: A tool for online modeldriven test derivation and execution. In Esparza, J. and
Majumdar, R., editors, Tools and Algorithms for the Construction and Analysis of Systems, pages 266–270, Berlin,
Heidelberg. Springer Berlin Heidelberg.
Belinfante, A. (2014). JTorX: Exploring ModelBased Testing. Centre for Telematics and Information Technology
(CTIT), Netherlands. IPA Dissertation series no. 201409.
Bonifacio, A. L. and Moura, A. V. (2019). Complete test
suites for input/output systems. CoRR, abs/1902.10278.
Accessed on: 201906.
Calamé, J. (2005). Specificationbased test generation with
tgv. Software Engineering Notes
Clarke, D., Jéron, T., Rusu, V., and Zinovieva, E. (2002).
STG: A Symbolic Test Generation Tool. In Katoen, J.P.
and Stevens, P., editors, Tools and Algorithms for the Construction and Analysis of Systems, pages 470–475, Berlin,
Heidelberg. Springer Berlin Heidelberg.
de Vries, R. (2001). Towards formal test purposes. In Tretmans, G. and Brinksma, H., editors, Formal Approaches
to Testing of Software 2001 (FATES’01) Volume NS014,
BRICS Notes Series, pages 61–76, Aarhus, Denkmark.
Gomes, C. S. and Bonifacio, A. L. (2019). Automatically
checking conformance on asynchronous reactive systems.
In The Fourteenth International Conference on Software
Engineering Advances, pages 17–23.
Jard, C. and Jéron, T. (2005). Tgv: theory, principles and
algorithms. International Journal on Software Tools for
Technology Transfer, 7(4):297–315. Accessed on: 2019
Larsen, K. G., Mikucionis, M., Nielsen, B., and Skou, A.
(2005). Testing Realtime Embedded Software Using
UPPAALTRON: An Industrial Case Study. In Proceedings of the 5th ACM International Conference on Embedded Software, EMSOFT ’05, pages 299–306. ACM.
Mark Utting, B. L. (2007). practical modelbased testing a
tools approach. Elsevier, 1nd edition.
Marsso, L., Mateescu, R., and Serwe, W. (2018). Testor: A
modular tool for onthefly conformance test case generation. In Beyer, D. and Huisman, M., editors, Tools and
Algorithms for the Construction and Analysis of Systems,
pages 211–228, Cham. Springer International Publishing.
Mostowski, W., Poll, E., Schmaltz, J., Tretmans, J., and
Wichers Schreur, R. (2009). ModelBased Testing of Electronic Passports. In Alpuente, M., Cook, B., and Joubert,
C., editors, Formal Methods for Industrial Critical Systems, pages 207–209, Berlin, Heidelberg. Springer Berlin
Naik, K. and Tripathy, P. (2018). Software Testing and Quality Assurance: Theory and Practice. Wiley Publishing,
Roehm, H., Oehlerking, J., Woehrle, M., and Althoff, M.
(2016). Reachset conformance testing of hybrid automata.
In Proceedings of the 19th International Conference on
Hybrid Systems: Computation and Control, HSCC ’16,
pages 277–286, New York, NY, USA. ACM.
Simão, A. d. S. and Petrenko, A. (2014). Generating complete and finite test suite for ioco: Is it possible? In Proceedings Ninth Workshop on ModelBased Testing, MBT
, Grenoble, France, 6 April 2014., pages 56–70. Accessed on: 201907.
Sipser, M. (2006). Introduction to the Theory of Computation. Course Technology, second edition.
Tretmans, J. (1993). A formal approach to conformance testing. In Rafiq, O., editor, Protocol Test Systems, VI, Proceedings of the IFIP TC6/WG6.1 Sixth International Workshop on Protocol Test systems, Pau, France, 2830 September, 1993, volume C19 of IFIP Transactions, pages 257–
Tretmans, J. (2008). Model based testing with labelled transition systems. In Hierons, R. M., Bowen, J. P., and Harman,
M., editors, Formal Methods and Testing, An Outcome of
the FORTEST Network, Revised Selected Papers, volume
of Lecture Notes in Computer Science, pages 1–38.
How to Cite
Copyright (c) 2021 Adilson Bonifacio
This work is licensed under a Creative Commons Attribution 4.0 International License.