A Transparency-oriented BPMN Model Inspection Checklist: From conception to expert evaluations
Resumo
Process modeling is a key component for the success of an information system. Ensuring the quality of these models is essential for developing effective systems, including accessibility, auditability, understandability, informativeness, and usability. This article presents the design and evaluation of the Transparency-oriented Process Checklist (TPC), a structured inspection instrument for BPMN models emphasizing transparency-related quality characteristics. The TPC was developed by analyzing and integrating items from two existing checklists (CMP and BPCheck), refining them based on transparency dimensions, and structuring it with 51 verification items. A comparative evaluation was conducted to assess the applicability and effectiveness of the TPC. The evaluation team was divided into two groups. One group used the TPC, while the other applied BPCheck to inspect a real-world BPMN model. The results demonstrated that the TPC facilitated the identification of more quality problems (21 vs. 17), achieved greater agreement with the predefined “Oracle” answers (68.63% vs. 36.36%), and received more favorable assessments regarding understandability and support for identifying auditability issues. These findings underscore the TPC’s potential as a valuable instrument for supporting the inspection for the enhancement of BPMN process models.
Palavras-chave:
Transparency, Inspection, Process Model, Business Process Modeling Notation (BPMN)
Referências
Salma Ayari, Yosra Ben Dali Hlaoui, and Leila Jemni Ben Ayed. 2018. A New Approach for the Verification of BPMN Models Using Refinement Patterns. In 2018 IEEE 42nd Annual Computer Software and Applications Conference (COMPSAC), Vol. 1. IEEE, 807–808.
Daniel M. Berry Berry. 2017. Evaluation of Tools for Hairy Requirements and Software Engineering Tasks. In 2017 IEEE 25th International Requirements Engineering Conference Workshops (REW). 284–291.
Frederik P Brooks and No Silver Bullet. 1987. Essence and accidents of software engineering. IEEE computer 20, 4 (1987), 10–19.
C Cappelli. 2009. Uma Abordagem para Transparência em Processos Organizacionais Utilizando Aspectos. Rio de Janeiro. 328 p. Ph.D. Dissertation. Tese de Doutorado–Departamento de Informática, Pontifícia Universidade .
Diego André Cerqueira, Rafael Maiani de Mello, and Guilherme Horta Travassos. 2023. Um checklist para inspeção de privacidade e proteção de dados pessoais em artefatos de software. In Congresso Ibero-Americano em Engenharia de Software (CIbSE). SBC, 206–213.
Juliana Conceição, Julio Leite, and Rita Suzana. 2025. A Transparency-oriented BPMN Model Inspection Checklist: from conception to expert evaluations. DOI: 10.5281/zenodo.17373498
Ferrari A. Fornari F.-Gnesi S. Polini A. Re B. Spagnolo G. O Corradini, F. 2018. A guidelines framework for understandable BPMN models. Data Knowledge Engineering 113 (2018), 129–154.
Clemilson Luís de Brito Dias, Vinicius Stein Dani, Jan Mendling, and Lucineia Heloisa Thom. 2019. Anti-patterns for process modeling problems: an analysis of BPMN 2.0-based tools behavior. In International Conference on Business Process Management. Springer, 745–757.
André Luiz de Castro Leal, Henrique Prado Sousa, Julio Cesar Sampaio do Prado Leite, and José Luis Braga. 2011. Transparência Aplicada a Modelos de Negócio.. In CIbSE. 321–332.
Gretchen T De Macedo, Awdren Fontão, and Bruno Gadelha. 2023. UIProtoCheck: a checklist for semantic inspection of user interface prototypes. In Proceedings of the XXXVII Brazilian Symposium on Software Engineering. 485–490.
Rafael Maiani de Mello, Rebeca Campos Motta, and Guilherme Horta Travassos. 2016. A checklist-based inspection technique for business process models. In International Conference on Business Process Management. Springer, 108–123.
Rafael M de Mello, Eldanae N Teixeira, Marcelo Schots, Cláudia ML Werner, and Guilherme Horta Travassos. 2012. Checklist-based inspection technique for feature models review. In 2012 Sixth Brazilian Symposium on Software Components, Architectures and Reuse. IEEE, 140–149.
P Engiel. 2012. Projetando o Entendimento de modelos de Processos de Prestação de Serviços Públicos, 2012. Master’s thesis. Dissertação (Mestrado)–Universidade Federal do Estado do Rio de Janeiro.
Siamak Farshidi, Izaak Beer Kwantes, and Slinger Jansen. 2024. Business process modeling language selection for research modelers. Software and Systems Modeling 23, 1 (2024), 137–162.
Soeli T Fiorini, JC Sampaio do Prado Leite, and TDL de Macedo-Soares. 1996. Integrating business processes with requirements elicitation. In Proceedings of WET ICE’96. IEEE 5thWorkshop on Enabling Technologies; Infrastucture for Collaborative Enterprises. IEEE, 226–231.
Wilson Gomes, Paula Karini Dias Ferreira Amorim, and Maria Paula Almada. 2018. Novos desafios para a ideia de transparência pública. In E-Compós, Vol. 21.
Cornelia Haisjackl, Jakob Pinggera, Pnina Soffer, Stefan Zugal, Shao Yi Lim, and Barbara Weber. 2015. Identifying quality issues in BPMN models: an exploratory study. In International Workshop on Business Process Modeling, Development and Support. Springer, 217–230.
Cornelia Haisjackl, Pnina Soffer, Shao Yi Lim, and Barbara Weber. 2018. How do humans inspect BPMN models: an exploratory study. Software & Systems Modeling 17 (2018), 655–673.
Mahmood Hosseini, Alimohammad Shahri, Keith Phalp, and Raian Ali. 2018. Four reference models for transparency requirements in information systems. Requirements Engineering 23 (2018), 251–275.
Andrii Kopp, Dmytro Orlovskyi, and Sergey Orekhov. 2022. Towards Understandability Evaluation of Business Process Models using Activity Textual Analysis.. In MoMLeT+ DS. 200–211.
Ajay Krishna, Pascal Poizat, and Gwen Salaün. 2017. VBPMN: automated verification of BPMN processes (tool paper). In Integrated Formal Methods: 13th International Conference, IFM 2017, Turin, Italy, September 20-22, 2017, Proceedings 13. Springer, 323–331.
Julio Cesar Sampaio do Prado Leite and Claudia Cappelli. 2010. Software transparency. Business & Information Systems Engineering 2 (2010), 127–139.
Giovana Brandão Ribeiro Linhares and Julio Cesar Sampaio Prado Leite. 2019. Negotiation-Collaboration for Quality of Quality Requirements. In Proceedings of the XVIII Brazilian Symposium on Software Quality. 216–221.
Tomás Lopes and Sérgio Guerreiro. 2023. Assessing business process models: a literature reviewon techniques for BPMN testing and formal verification. Business Process Management Journal 29, 8 (2023), 133–162.
João Mendes, Davi Viana, and Luis Rivero. 2021. Developing an inspection checklist for the adequacy assessment of software systems to quality attributes of the brazilian general data protection law: An initial proposal. In Proceedings of the XXXV Brazilian Symposium on Software Engineering. 263–268.
Li T. Silva-L. Almentero E. do Prado Leite J. C. S. Portugal, R. L. 2018. Nfrfinder: a knowledge based strategy for mining non-functional requirements. In Proceedings of the XXXII Brazilian Symposium on Software Engineering. 102–111.
Roxana Lisette Quintanilla Portugal, Priscila Engiel, Hugo Roque, and Julio Cesar Sampaio do Prado Leite. 2017. Is there a demand of software transparency?. In Proceedings of the XXXI Brazilian Symposium on Software Engineering. 204–213.
Álvaro Rocha and Luís Paulo Reis. 2018. Developments and Advances in Intelligent Systems and Applications. Springer.
Małgorzata Sadowska. 2015. An approach to assessing the quality of business process models expressed in BPMN. E-Informatica Software Engineering Journal 9, 1 (2015).
Carlos E Salgado, Juliana Teixeira, Nuno Santos, Ricardo J Machado, and Rita SP Maciel. 2015. A SoaML approach for derivation of a process-oriented logical architecture from use cases. In International Conference on Exploring Services Science. Springer, 80–94.
Juliana Conceição Santos. 2025. Process Checklist: Checklist Orientado à Transparência para Inspeção de Processos BPMN. (2025).
Juliana Conceição Santos, Júlio César Sampaio do Prado Leite, Rita Suzana, and Pitangueira Maciel. 2023. O Uso de Inspeção na Transparência de Processos. In Proceedings of the Workshop on Requirements Engineering.
Yu-Cheng Tu, Ewan Tempero, and Clark Thomborson. 2016. An experiment on the impact of transparency on the effectiveness of requirements documents. Empirical Software Engineering 21 (2016), 1035–1066.
Boukadi K. Ben-Abdallah H. Yahya, F. 2019. Improving the quality of Business Process Models: Lesson learned from the State of the Art. Business Process Management Journal 25 (2019), 1357–1376.
Muhammad Sohaib Yousaf, Saqib Ali, Qamar Nawaz, Salman Afsar, Imran Mumtaz, and Nida Rashid. 2022. Fagan inspection: A defects finding mechanism in software requirements specification (SRS) document. VFAST Transactions on Software Engineering 10, 1 (2022), 46–55.
Daniel M. Berry Berry. 2017. Evaluation of Tools for Hairy Requirements and Software Engineering Tasks. In 2017 IEEE 25th International Requirements Engineering Conference Workshops (REW). 284–291.
Frederik P Brooks and No Silver Bullet. 1987. Essence and accidents of software engineering. IEEE computer 20, 4 (1987), 10–19.
C Cappelli. 2009. Uma Abordagem para Transparência em Processos Organizacionais Utilizando Aspectos. Rio de Janeiro. 328 p. Ph.D. Dissertation. Tese de Doutorado–Departamento de Informática, Pontifícia Universidade .
Diego André Cerqueira, Rafael Maiani de Mello, and Guilherme Horta Travassos. 2023. Um checklist para inspeção de privacidade e proteção de dados pessoais em artefatos de software. In Congresso Ibero-Americano em Engenharia de Software (CIbSE). SBC, 206–213.
Juliana Conceição, Julio Leite, and Rita Suzana. 2025. A Transparency-oriented BPMN Model Inspection Checklist: from conception to expert evaluations. DOI: 10.5281/zenodo.17373498
Ferrari A. Fornari F.-Gnesi S. Polini A. Re B. Spagnolo G. O Corradini, F. 2018. A guidelines framework for understandable BPMN models. Data Knowledge Engineering 113 (2018), 129–154.
Clemilson Luís de Brito Dias, Vinicius Stein Dani, Jan Mendling, and Lucineia Heloisa Thom. 2019. Anti-patterns for process modeling problems: an analysis of BPMN 2.0-based tools behavior. In International Conference on Business Process Management. Springer, 745–757.
André Luiz de Castro Leal, Henrique Prado Sousa, Julio Cesar Sampaio do Prado Leite, and José Luis Braga. 2011. Transparência Aplicada a Modelos de Negócio.. In CIbSE. 321–332.
Gretchen T De Macedo, Awdren Fontão, and Bruno Gadelha. 2023. UIProtoCheck: a checklist for semantic inspection of user interface prototypes. In Proceedings of the XXXVII Brazilian Symposium on Software Engineering. 485–490.
Rafael Maiani de Mello, Rebeca Campos Motta, and Guilherme Horta Travassos. 2016. A checklist-based inspection technique for business process models. In International Conference on Business Process Management. Springer, 108–123.
Rafael M de Mello, Eldanae N Teixeira, Marcelo Schots, Cláudia ML Werner, and Guilherme Horta Travassos. 2012. Checklist-based inspection technique for feature models review. In 2012 Sixth Brazilian Symposium on Software Components, Architectures and Reuse. IEEE, 140–149.
P Engiel. 2012. Projetando o Entendimento de modelos de Processos de Prestação de Serviços Públicos, 2012. Master’s thesis. Dissertação (Mestrado)–Universidade Federal do Estado do Rio de Janeiro.
Siamak Farshidi, Izaak Beer Kwantes, and Slinger Jansen. 2024. Business process modeling language selection for research modelers. Software and Systems Modeling 23, 1 (2024), 137–162.
Soeli T Fiorini, JC Sampaio do Prado Leite, and TDL de Macedo-Soares. 1996. Integrating business processes with requirements elicitation. In Proceedings of WET ICE’96. IEEE 5thWorkshop on Enabling Technologies; Infrastucture for Collaborative Enterprises. IEEE, 226–231.
Wilson Gomes, Paula Karini Dias Ferreira Amorim, and Maria Paula Almada. 2018. Novos desafios para a ideia de transparência pública. In E-Compós, Vol. 21.
Cornelia Haisjackl, Jakob Pinggera, Pnina Soffer, Stefan Zugal, Shao Yi Lim, and Barbara Weber. 2015. Identifying quality issues in BPMN models: an exploratory study. In International Workshop on Business Process Modeling, Development and Support. Springer, 217–230.
Cornelia Haisjackl, Pnina Soffer, Shao Yi Lim, and Barbara Weber. 2018. How do humans inspect BPMN models: an exploratory study. Software & Systems Modeling 17 (2018), 655–673.
Mahmood Hosseini, Alimohammad Shahri, Keith Phalp, and Raian Ali. 2018. Four reference models for transparency requirements in information systems. Requirements Engineering 23 (2018), 251–275.
Andrii Kopp, Dmytro Orlovskyi, and Sergey Orekhov. 2022. Towards Understandability Evaluation of Business Process Models using Activity Textual Analysis.. In MoMLeT+ DS. 200–211.
Ajay Krishna, Pascal Poizat, and Gwen Salaün. 2017. VBPMN: automated verification of BPMN processes (tool paper). In Integrated Formal Methods: 13th International Conference, IFM 2017, Turin, Italy, September 20-22, 2017, Proceedings 13. Springer, 323–331.
Julio Cesar Sampaio do Prado Leite and Claudia Cappelli. 2010. Software transparency. Business & Information Systems Engineering 2 (2010), 127–139.
Giovana Brandão Ribeiro Linhares and Julio Cesar Sampaio Prado Leite. 2019. Negotiation-Collaboration for Quality of Quality Requirements. In Proceedings of the XVIII Brazilian Symposium on Software Quality. 216–221.
Tomás Lopes and Sérgio Guerreiro. 2023. Assessing business process models: a literature reviewon techniques for BPMN testing and formal verification. Business Process Management Journal 29, 8 (2023), 133–162.
João Mendes, Davi Viana, and Luis Rivero. 2021. Developing an inspection checklist for the adequacy assessment of software systems to quality attributes of the brazilian general data protection law: An initial proposal. In Proceedings of the XXXV Brazilian Symposium on Software Engineering. 263–268.
Li T. Silva-L. Almentero E. do Prado Leite J. C. S. Portugal, R. L. 2018. Nfrfinder: a knowledge based strategy for mining non-functional requirements. In Proceedings of the XXXII Brazilian Symposium on Software Engineering. 102–111.
Roxana Lisette Quintanilla Portugal, Priscila Engiel, Hugo Roque, and Julio Cesar Sampaio do Prado Leite. 2017. Is there a demand of software transparency?. In Proceedings of the XXXI Brazilian Symposium on Software Engineering. 204–213.
Álvaro Rocha and Luís Paulo Reis. 2018. Developments and Advances in Intelligent Systems and Applications. Springer.
Małgorzata Sadowska. 2015. An approach to assessing the quality of business process models expressed in BPMN. E-Informatica Software Engineering Journal 9, 1 (2015).
Carlos E Salgado, Juliana Teixeira, Nuno Santos, Ricardo J Machado, and Rita SP Maciel. 2015. A SoaML approach for derivation of a process-oriented logical architecture from use cases. In International Conference on Exploring Services Science. Springer, 80–94.
Juliana Conceição Santos. 2025. Process Checklist: Checklist Orientado à Transparência para Inspeção de Processos BPMN. (2025).
Juliana Conceição Santos, Júlio César Sampaio do Prado Leite, Rita Suzana, and Pitangueira Maciel. 2023. O Uso de Inspeção na Transparência de Processos. In Proceedings of the Workshop on Requirements Engineering.
Yu-Cheng Tu, Ewan Tempero, and Clark Thomborson. 2016. An experiment on the impact of transparency on the effectiveness of requirements documents. Empirical Software Engineering 21 (2016), 1035–1066.
Boukadi K. Ben-Abdallah H. Yahya, F. 2019. Improving the quality of Business Process Models: Lesson learned from the State of the Art. Business Process Management Journal 25 (2019), 1357–1376.
Muhammad Sohaib Yousaf, Saqib Ali, Qamar Nawaz, Salman Afsar, Imran Mumtaz, and Nida Rashid. 2022. Fagan inspection: A defects finding mechanism in software requirements specification (SRS) document. VFAST Transactions on Software Engineering 10, 1 (2022), 46–55.
Publicado
04/11/2025
Como Citar
SANTOS, Juliana Conceição; MACIEL, Rita Suzana Pitangueira; LEITE, Julio Cesar Sampaio do Prado.
A Transparency-oriented BPMN Model Inspection Checklist: From conception to expert evaluations. In: SIMPÓSIO BRASILEIRO DE QUALIDADE DE SOFTWARE (SBQS), 24. , 2025, São José dos Campos/SP.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2025
.
p. 259-269.
DOI: https://doi.org/10.5753/sbqs.2025.15083.
