A Rapid Review on Advanced Software-in-the-Loop Methods for Automotive Software Verification
Resumo
The V-cycle has been the primary software development methodology in the automotive sector. However, with the increasing complexity of software, both from an architectural and technological perspective, software verification has become inefficient compared to system verification. This inefficiency results in rework and increased costs due to late error detection. Software deemed functional during verification may prove ineffective when tested in the simulated vehicle environment, as development requirements are ever-expanding, and test simulation environments have not kept pace with this evolution. The simulation environments used in automotive development are based on a guided simulation approach, encompassing Model-in-the-Loop (MiL), Software-in-the-Loop (SiL), Processor-in-the-Loop (PiL), and Hardware-in-the-Loop (HiL) testing. These tests are conducted between system and software verification and must be used in conjunction to achieve comprehensive validation. To address inefficiencies in software verification, techniques such as MiL, SiL, and PiL are excellent techniques. SiL, in particular, plays an essencial role in simulating code before its integration into the system. This rapid review will discuss techniques that make simulations more representative of the real vehicle system, considering the electromechanical structure of sensors and actuators outlined in the software requirements, as well as the network of ECUs, which follows a distributed communication model.
Palavras-chave:
Software verification, Software-in-the-Loop (SiL), Simulation environments, Automotive Software
Referências
2008. IEEE Standard for a Precision Clock Synchronization Protocol for Networked Measurement and Control Systems. [link]
Sujit Sopan Barhate. 2015. Effective test strategy for testing automotive software. In 2015 International Conference on Industrial Instrumentation and Control (ICIC). 645–649. DOI: 10.1109/IIC.2015.7150821
Bruno Cartaxo, Gustavo Pinto, and Sergio Soares. 2018. The Role of Rapid Reviews in Supporting Decision-Making in Software Engineering Practice. In Proceedings of the 22nd International Conference on Evaluation and Assessment in Software Engineering 2018 (Christchurch, New Zealand) (EASE ’18). Association for Computing Machinery, New York, NY, USA, 24–34. DOI: 10.1145/3210459.3210462
Giovanni Mercurio Casolino, Milad AlizadehTir, Alessandro Andreoli, Mariano Albanesi, and Fabrizio Marignetti. 2016. Software-in-the-loop simulation of a test system for automotive electric drives. In IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society. 1882–1887. DOI: 10.1109/IECON.2016.7794145
Fabio Falcini and Giuseppe Lami. 2021. System and Software Testing in Automotive: an Empirical Study on Process Improvement Areas. In 2021 14th IEEE Conference on Software Testing, Verification and Validation (ICST). 253–262. DOI: 10.1109/ICST49551.2021.00035
Goran Frehse, Arne Hamann, Sophie Quinton, and Matthias Woehrle. 2014. Formal Analysis of Timing Effects on Closed-Loop Properties of Control Software. In 2014 IEEE Real-Time Systems Symposium. 53–62. DOI: 10.1109/RTSS.2014.28
Prakhar Gupta, Rongyao Wang, Tyler Ard, Jihun Han, Dominik Karbowski, Ardalan Vahidi, and Yunyi Jia. 2023. An X-in-the-Loop (XIL) Testing Framework for Validation of Connected and Autonomous Vehicles. In 2023 IEEE International Automated Vehicle Validation Conference (IAVVC). 1–6. DOI: 10.1109/IAVVC57316.2023.10328040
Sooyong Jeong, Yongsub Kwak, and Woo Jin Lee. 2016. Software-in-the-Loop simulation for early-stage testing of AUTOSAR software component. In 2016 Eighth International Conference on Ubiquitous and Future Networks (ICUFN). 59–63. DOI: 10.1109/ICUFN.2016.7536980
Sooyong Jeong and Woo Jin Lee. 2017. An automated testing method for AUTOSAR software components based on SiL simulation. In 2017 Ninth International Conference on Ubiquitous and Future Networks (ICUFN). 278–283. DOI: 10.1109/ICUFN.2017.7993793
James Kapinski, Jyotirmoy Deshmukh, Xiaoqing Jin, Hisahiro Ito, and Ken Butts. 2015. Simulation-guided approaches for verification of automotive powertrain control systems. In 2015 American Control Conference (ACC). 4086–4095. DOI: 10.1109/ACC.2015.7171968
Sunghee Lee, Bueng Il Hwang, Kang-Bok Seo, and Woo Jin Lee. 2016. Relative Time Synchronization of Distributed Applications for Software-in-the-Loop Simulation. In 2016 IEEE Intl Conference on Computational Science and Engineering (CSE) and IEEE Intl Conference on Embedded and Ubiquitous Computing (EUC) and 15th Intl Symposium on Distributed Computing and Applications for Business Engineering (DCABES). 753–756. DOI: 10.1109/CSE-EUC-DCABES.2016.273
Bohan Liu, He Zhang, and Saichun Zhu. 2016. An Incremental V-Model Process for Automotive Development. In 2016 23rd Asia-Pacific Software Engineering Conference (APSEC). 225–232. DOI: 10.1109/APSEC.2016.040
Dhasarathy Parthasarathy, Karl Bäckstrom, Jens Henriksson, and Sólrún Einarsdóttir. 2020. Controlled time series generation for automotive software-in-the-loop testing using GANs. In 2020 IEEE International Conference On Artificial Intelligence Testing (AITest). 39–46. DOI: 10.1109/AITEST49225.2020.00013
Dhasarathy Parthasarathy and Anton Johansson. 2021. SilGAN: Generating driving maneuvers for scenario-based software-in-the-loop testing. In 2021 IEEE International Conference on Artificial Intelligence Testing (AITest). 65–72. DOI: 10.1109/AITEST52744.2021.00022
Indrasen Raghupatruni, Thomas Goeppel, Muhammed Atak, Julien Bou, and Thomas Huber. 2019. Empirical Testing of Automotive Cyber-Physical Systems with Credible Software-in-the-Loop Environments. In 2019 IEEE International Conference on Connected Vehicles and Expo (ICCVE). 1–6. DOI: 10.1109/ICCVE45908.2019.8965169
Kushal Koppa Shivanandaswamy, Chandrima Sarkar, Sivakumar Rajagopal, Lakkappa Pisutre Ramachandra, and Chiranjeevi Manchasandra Chayakumar. 2021. Emphasis on Evaluative Prerequisites for Decisive Software-in-the-Loop (SiL) Environments. In 2021 8th International Conference on Computing for Sustainable Global Development (INDIACom). 450–457.
Mohamed Fasil Syed Ahamed, Girma Tewolde, and Jaerock Kwon. 2018. Software-in-the-Loop Modeling and Simulation Framework for Autonomous Vehicles. In 2018 IEEE International Conference on Electro/Information Technology (EIT). 0305–0310. DOI: 10.1109/EIT.2018.8500101
Ghizlane Tibba, Christoph Malz, Christoph Stoermer, Natarajan Nagarajan, Licong Zhang, and Samarjit Chakraborty. 2016. Testing automotive embedded systems under X-in-the-loop setups. In 2016 IEEE/ACMInternational Conference on Computer-Aided Design (ICCAD). 1–8. DOI: 10.1145/2966986.2980076
Vassil Todorov, Frédéric Boulanger, and Safouan Taha. 2018. Formal Verification of Automotive Embedded Software. In 2018 IEEE/ACM 6th International FME Workshop on Formal Methods in Software Engineering (FormaliSE). 84–87.
VDA QMC Working Group 13 / Automotive SIG 2017. Automotive SPICE Process Assessment Model (version 3.1 ed.). VDA QMC Working Group 13 / Automotive SIG. Available at: [link].
Sujit Sopan Barhate. 2015. Effective test strategy for testing automotive software. In 2015 International Conference on Industrial Instrumentation and Control (ICIC). 645–649. DOI: 10.1109/IIC.2015.7150821
Bruno Cartaxo, Gustavo Pinto, and Sergio Soares. 2018. The Role of Rapid Reviews in Supporting Decision-Making in Software Engineering Practice. In Proceedings of the 22nd International Conference on Evaluation and Assessment in Software Engineering 2018 (Christchurch, New Zealand) (EASE ’18). Association for Computing Machinery, New York, NY, USA, 24–34. DOI: 10.1145/3210459.3210462
Giovanni Mercurio Casolino, Milad AlizadehTir, Alessandro Andreoli, Mariano Albanesi, and Fabrizio Marignetti. 2016. Software-in-the-loop simulation of a test system for automotive electric drives. In IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society. 1882–1887. DOI: 10.1109/IECON.2016.7794145
Fabio Falcini and Giuseppe Lami. 2021. System and Software Testing in Automotive: an Empirical Study on Process Improvement Areas. In 2021 14th IEEE Conference on Software Testing, Verification and Validation (ICST). 253–262. DOI: 10.1109/ICST49551.2021.00035
Goran Frehse, Arne Hamann, Sophie Quinton, and Matthias Woehrle. 2014. Formal Analysis of Timing Effects on Closed-Loop Properties of Control Software. In 2014 IEEE Real-Time Systems Symposium. 53–62. DOI: 10.1109/RTSS.2014.28
Prakhar Gupta, Rongyao Wang, Tyler Ard, Jihun Han, Dominik Karbowski, Ardalan Vahidi, and Yunyi Jia. 2023. An X-in-the-Loop (XIL) Testing Framework for Validation of Connected and Autonomous Vehicles. In 2023 IEEE International Automated Vehicle Validation Conference (IAVVC). 1–6. DOI: 10.1109/IAVVC57316.2023.10328040
Sooyong Jeong, Yongsub Kwak, and Woo Jin Lee. 2016. Software-in-the-Loop simulation for early-stage testing of AUTOSAR software component. In 2016 Eighth International Conference on Ubiquitous and Future Networks (ICUFN). 59–63. DOI: 10.1109/ICUFN.2016.7536980
Sooyong Jeong and Woo Jin Lee. 2017. An automated testing method for AUTOSAR software components based on SiL simulation. In 2017 Ninth International Conference on Ubiquitous and Future Networks (ICUFN). 278–283. DOI: 10.1109/ICUFN.2017.7993793
James Kapinski, Jyotirmoy Deshmukh, Xiaoqing Jin, Hisahiro Ito, and Ken Butts. 2015. Simulation-guided approaches for verification of automotive powertrain control systems. In 2015 American Control Conference (ACC). 4086–4095. DOI: 10.1109/ACC.2015.7171968
Sunghee Lee, Bueng Il Hwang, Kang-Bok Seo, and Woo Jin Lee. 2016. Relative Time Synchronization of Distributed Applications for Software-in-the-Loop Simulation. In 2016 IEEE Intl Conference on Computational Science and Engineering (CSE) and IEEE Intl Conference on Embedded and Ubiquitous Computing (EUC) and 15th Intl Symposium on Distributed Computing and Applications for Business Engineering (DCABES). 753–756. DOI: 10.1109/CSE-EUC-DCABES.2016.273
Bohan Liu, He Zhang, and Saichun Zhu. 2016. An Incremental V-Model Process for Automotive Development. In 2016 23rd Asia-Pacific Software Engineering Conference (APSEC). 225–232. DOI: 10.1109/APSEC.2016.040
Dhasarathy Parthasarathy, Karl Bäckstrom, Jens Henriksson, and Sólrún Einarsdóttir. 2020. Controlled time series generation for automotive software-in-the-loop testing using GANs. In 2020 IEEE International Conference On Artificial Intelligence Testing (AITest). 39–46. DOI: 10.1109/AITEST49225.2020.00013
Dhasarathy Parthasarathy and Anton Johansson. 2021. SilGAN: Generating driving maneuvers for scenario-based software-in-the-loop testing. In 2021 IEEE International Conference on Artificial Intelligence Testing (AITest). 65–72. DOI: 10.1109/AITEST52744.2021.00022
Indrasen Raghupatruni, Thomas Goeppel, Muhammed Atak, Julien Bou, and Thomas Huber. 2019. Empirical Testing of Automotive Cyber-Physical Systems with Credible Software-in-the-Loop Environments. In 2019 IEEE International Conference on Connected Vehicles and Expo (ICCVE). 1–6. DOI: 10.1109/ICCVE45908.2019.8965169
Kushal Koppa Shivanandaswamy, Chandrima Sarkar, Sivakumar Rajagopal, Lakkappa Pisutre Ramachandra, and Chiranjeevi Manchasandra Chayakumar. 2021. Emphasis on Evaluative Prerequisites for Decisive Software-in-the-Loop (SiL) Environments. In 2021 8th International Conference on Computing for Sustainable Global Development (INDIACom). 450–457.
Mohamed Fasil Syed Ahamed, Girma Tewolde, and Jaerock Kwon. 2018. Software-in-the-Loop Modeling and Simulation Framework for Autonomous Vehicles. In 2018 IEEE International Conference on Electro/Information Technology (EIT). 0305–0310. DOI: 10.1109/EIT.2018.8500101
Ghizlane Tibba, Christoph Malz, Christoph Stoermer, Natarajan Nagarajan, Licong Zhang, and Samarjit Chakraborty. 2016. Testing automotive embedded systems under X-in-the-loop setups. In 2016 IEEE/ACMInternational Conference on Computer-Aided Design (ICCAD). 1–8. DOI: 10.1145/2966986.2980076
Vassil Todorov, Frédéric Boulanger, and Safouan Taha. 2018. Formal Verification of Automotive Embedded Software. In 2018 IEEE/ACM 6th International FME Workshop on Formal Methods in Software Engineering (FormaliSE). 84–87.
VDA QMC Working Group 13 / Automotive SIG 2017. Automotive SPICE Process Assessment Model (version 3.1 ed.). VDA QMC Working Group 13 / Automotive SIG. Available at: [link].
Publicado
30/09/2024
Como Citar
PESTANA, Larissa; MIRANDA, Breno.
A Rapid Review on Advanced Software-in-the-Loop Methods for Automotive Software Verification. In: SIMPÓSIO BRASILEIRO DE TESTES DE SOFTWARE SISTEMÁTICO E AUTOMATIZADO (SAST), 9. , 2024, Curitiba/PR.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2024
.
p. 56-65.
DOI: https://doi.org/10.5753/sast.2024.3883.
