Development of a Tool for Differential Testing of Compilers Using Randomly Generated Codes

Abstract


It is notable that software projects are becoming more complex and extensive, which depend mostly on the compiler or interpreter of the programming language chosen for their development. In this sense, how is it possible to guarantee the quality and reliability of these development tools? One of the possibilities is to run tests exhaustively, identifying and correcting errors, until we have some certainty that the code produced is free of bugs. In this way, this project proposes the development of a tool that applies generated randomly test cases and compares the results with different Java compilers.
Keywords: Random Program Generator, Differential Testing for Compilers, Java Language

References

Cass, S. (2019). As principais linguagens de programação de 2019. IEEE Spec.

Claessen, K. and Hughes, J. (2000). Quickcheck: A lightweight tool for random testing of haskell programs.SIGPLAN Not., 35(9):268–279. DOI: 10.1145/357766.351266

Kraus, L. F., Schafaschek, B., Ribeiro, R. G., and da Silva Feitosa, S. (2021). Synthesis of random real-world java programs from preexisting libraries. In 25th Brazilian Symposium on Programming Languages, SBLP’21, page 108–115, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3475061.3475087

McKeeman, W. M. (1998). Differential testing for software. DIGITAL TECHNICAL JOURNAL, 10(1):100–107.

Ofenbeck, G., Rompf, T., and Püschel, M. (2016). Randir: Differential testing for embedded compilers.In Proceedings of the 2016 7th ACM SIGPLAN Symposium on Scala, SCALA 2016, page 21–30, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/2998392.2998397

Palka, M. H., Claessen, K., Russo, A., and Hughes, J. (2011).Testing an optimising compiler by generating random lambda terms. In Proceedings of the 6th International Workshop on Automation of Software Test, AST ’11, pages 91–97, New York, NY,USA. ACM. DOI: 10.1145/1982595.1982615
Published
2021-11-17
COELHO, Bruno Schafaschek; KRAUZ, Luiz Felipe; FEITOSA, Samuel da Silva. Development of a Tool for Differential Testing of Compilers Using Randomly Generated Codes. In: WORKSHOP-SCHOOL ON THEORETICAL COMPUTER SCIENCE (WEIT), 6. , 2021, Online. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2021 . p. 68-72. DOI: https://doi.org/10.5753/weit.2021.18924.