Deriving Sound Test Scripts from Requirements Written in a Controlled Natural Language

Resumo


In an industrial context, ad-hoc/manual testing strategies, using natural language, still seem to be highly prevalent since natural language descriptions are, more likely, easier to understand. Still, the lack of rigor can generate inaccurate tests. Aligned with other modern approaches, we promote the use of natural language descriptions with rigorously defined underlying semantics. As a distinguished feature of our approach, we cover the entire (direct engineering) testing process, from requirements to manual or automated test cases generated automatically. Requirements written in a controlled natural language are parsed, and their semantics are automatically modeled using the CSP process algebra. To address soundness and deal with different abstraction levels, we formalize the concept of a domain model, in which additional information, such as hierarchical composition and a dependence relation among test steps, is defined. Then, sound test cases are generated from the inferred scenarios using the cspio conformance relation. These test cases, still expressed in CSP, can then be linearized back to natural language to allow manual execution or directly translated into test scripts for automated execution.
Palavras-chave: Formal Semantics, Controlled Natural Language, Test Case Consistency, Domain Model
Publicado
03/12/2025
ARRUDA, Filipe; BARROS, Flávia; SAMPAIO, Augusto. Deriving Sound Test Scripts from Requirements Written in a Controlled Natural Language. In: SIMPÓSIO BRASILEIRO DE MÉTODOS FORMAIS (SBMF), 28. , 2025, Recife/PE. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2025 . p. 101-118.