EVEREST: An Automatic Model-Based Testing Tool for Asynchronous Reactive Systems

An IOLTS Model-Based Testing Tool

Authors

  • Adilson Bonifacio UEL
  • Camila Sonoda Gomes UEL

DOI:

https://doi.org/10.5753/jserd.2021.1094

Keywords:

Model-based testing, conformance checking, test generation, reactive systems, automatic tool

Abstract

Reactive systems are characterized by the interaction with the environment, where the exchange of the input and output stimuli, usually, occurs asynchronously.
Systems of this nature, in general, require a rigorous testing activity over their developing process. Therefore model-based testing has been successfully applied over asynchronous reactive systems using Input Output Labeled Transition Systems (IOLTSs) as the basis. In this work we present a reactive testing tool to check conformance, generate test suites and run test cases using IOLTS models. Our tool can check whether the behavior of an implementation under test (IUT) complies with the behavior of its respective specification. We have implemented a classical conformance relation ioco and a more general notion of conformance based on regular languages. Further, the tool provides a test suite generation in a black-box testing setting for finding faults over IUTs according to a specific domain. We have also described some case studies to probe the tool's functionalities and also to highlight a comparative analysis on both conformance approaches. Finally, we offer experiments to evaluate the performance of our tool using several scenarios.

Downloads

Download data is not yet available.

References

Belinfante, A. (2010a). Jtorx: A tool for on­line modeldriven test derivation and execution. In Esparza, J. and

Majumdar, R., editors, Tools and Algorithms for the Construction and Analysis of Systems, 16th International Conference, TACAS 2010, Lecture Notes in Computer Science,

pages 266–270. Springer.

Belinfante, A. (2010b). Jtorx: A tool for on­line modeldriven test derivation and execution. In Esparza, J. and

Majumdar, R., editors, Tools and Algorithms for the Construction and Analysis of Systems, pages 266–270, Berlin,

Heidelberg. Springer Berlin Heidelberg.

Belinfante, A. (2014). JTorX: Exploring Model­Based Testing. Centre for Telematics and Information Technology

(CTIT), Netherlands. IPA Dissertation series no. 2014­09.

Bonifacio, A. L. and Moura, A. V. (2019). Complete test

suites for input/output systems. CoRR, abs/1902.10278.

Accessed on: 2019­06.

Calamé, J. (2005). Specification­based test generation with

tgv. Software Engineering Notes

Clarke, D., Jéron, T., Rusu, V., and Zinovieva, E. (2002).

STG: A Symbolic Test Generation Tool. In Katoen, J.­P.

and Stevens, P., editors, Tools and Algorithms for the Construction and Analysis of Systems, pages 470–475, Berlin,

Heidelberg. Springer Berlin Heidelberg.

de Vries, R. (2001). Towards formal test purposes. In Tretmans, G. and Brinksma, H., editors, Formal Approaches

to Testing of Software 2001 (FATES’01) ­ Volume NS­01­4,

BRICS Notes Series, pages 61–76, Aarhus, Denkmark.

Gomes, C. S. and Bonifacio, A. L. (2019). Automatically

checking conformance on asynchronous reactive systems.

In The Fourteenth International Conference on Software

Engineering Advances, pages 17–23.

Jard, C. and Jéron, T. (2005). Tgv: theory, principles and

algorithms. International Journal on Software Tools for

Technology Transfer, 7(4):297–315. Accessed on: 2019­

Larsen, K. G., Mikucionis, M., Nielsen, B., and Skou, A.

(2005). Testing Real­time Embedded Software Using

UPPAAL­TRON: An Industrial Case Study. In Proceedings of the 5th ACM International Conference on Embedded Software, EMSOFT ’05, pages 299–306. ACM.

Mark Utting, B. L. (2007). practical model­based testing a

tools approach. Elsevier, 1nd edition.

Marsso, L., Mateescu, R., and Serwe, W. (2018). Testor: A

modular tool for on­the­fly conformance test case generation. In Beyer, D. and Huisman, M., editors, Tools and

Algorithms for the Construction and Analysis of Systems,

pages 211–228, Cham. Springer International Publishing.

Mostowski, W., Poll, E., Schmaltz, J., Tretmans, J., and

Wichers Schreur, R. (2009). Model­Based Testing of Electronic Passports. In Alpuente, M., Cook, B., and Joubert,

C., editors, Formal Methods for Industrial Critical Systems, pages 207–209, Berlin, Heidelberg. Springer Berlin

Heidelberg.

Naik, K. and Tripathy, P. (2018). Software Testing and Quality Assurance: Theory and Practice. Wiley Publishing,

nd edition.

Roehm, H., Oehlerking, J., Woehrle, M., and Althoff, M.

(2016). Reachset conformance testing of hybrid automata.

In Proceedings of the 19th International Conference on

Hybrid Systems: Computation and Control, HSCC ’16,

pages 277–286, New York, NY, USA. ACM.

Simão, A. d. S. and Petrenko, A. (2014). Generating complete and finite test suite for ioco: Is it possible? In Proceedings Ninth Workshop on Model­Based Testing, MBT

, Grenoble, France, 6 April 2014., pages 56–70. Accessed on: 2019­07.

Sipser, M. (2006). Introduction to the Theory of Computation. Course Technology, second edition.

Tretmans, J. (1993). A formal approach to conformance testing. In Rafiq, O., editor, Protocol Test Systems, VI, Proceedings of the IFIP TC6/WG6.1 Sixth International Workshop on Protocol Test systems, Pau, France, 28­30 September, 1993, volume C­19 of IFIP Transactions, pages 257–

North­Holland.

Tretmans, J. (2008). Model based testing with labelled transition systems. In Hierons, R. M., Bowen, J. P., and Harman,

M., editors, Formal Methods and Testing, An Outcome of

the FORTEST Network, Revised Selected Papers, volume

of Lecture Notes in Computer Science, pages 1–38.

Springer.

Downloads

Published

2021-08-26

How to Cite

Bonifacio, A., & Gomes, C. S. (2021). EVEREST: An Automatic Model-Based Testing Tool for Asynchronous Reactive Systems: An IOLTS Model-Based Testing Tool. Journal of Software Engineering Research and Development, 9(1), 6:1 – 6:14. https://doi.org/10.5753/jserd.2021.1094

Issue

Section

Research Article