Experiences in IETF-BMWG: Towards a Methodology for VNF Benchmarking Automation

• Raphael Rosa UNICAMP
• Christian Rothenberg UNICAMP

DOI: https://doi.org/10.5753/wpietf.2020.13795

Resumo

Network Functions Virtualization (NFV) aims at high-end carriergrade performance but lacks common methodologies for testing Virtual Network Functions (VNFs). Benchmarking VNFs should consider different degrees of freedom instead of the black-box common approaches created for bare metal network functions. We understand such status-quo needs to be altered having basis on the solid ground of extensive and automated experimentation. Since 2015, we have been addressing a role in this scenario, from a position paper to the creation of the draft “Methodology for VNF Benchmarking Automation” in the Internet Engineering Task Force (IETF) Benchmarking Methodology Working Group (BMWG). This paper tells the tale about this draft in BMWG, associated with the perks of developing an open source reference implementation and academic papers, as the means of the old IETF mantra on running code. The story intends to showcase our experiences in IETF and BMWG, covering technical content (e.g., YANG models) as much as draft reviews on mailing-lists.

Referências

Cao, L., Sharma, P., Fahmy, S., and Saxena, V. (2015). NFV-VITAL: A framework for characterizing the performance of virtual network functions. In IEEE Conference on NFV-SDN, pages 93–99.

ETSI GS NFV-TST (2016). ETSI GS NFV-TST 002 V1.1.1 Report on NFV Interoperability Testing Methodology. Accessed on 2017-06-01.

Mijumbi, R. et al. (2016). Network Function Virtualization: State-of-the-Art and Research Challenges. IEEE Communications Surveys Tutorials, 18(1):236–262.

Morton, A. (2016). Considerations for benchmarking virtual network functions and their infrastructure. Internet draft. Accessed on 2017-06-01.

Peuster, M. and Karl, H. (2016). Understand your chains: Towards performance prolebased network service management. In Proceeding of the Fifth European Workshop on Software Dened Networks (EWSDN).

Peuster, M., Schneider, S., Zhao, M., Xilouris, G., Trakadas, P., Vicens, F., Tavernier, W., Soenen, T., Vilalta, R., Andreou, G., Kyriazis, D., and Karl, H. (2019). Introducing automated verication and validation for virtualized network functions and services. IEEE Communications Magazine, 57(5):96–102.

Rosa, R. V., Bertoldo, C., and Rothenberg, C. E. (2017). Take your vnf to the gym: A testing framework for automated nfv performance benchmarking. IEEE Communications Magazine, 55(9):110–117.

Rosa, R. V. and Rothenberg, C. (2017). Taking Open vSwitch to the Gym: An Automated Benchmarking Approach. In IV Workshop pre IETF/IRTF.

Rosa, R. V., Rothenberg, C. E., Peuster, M., and Karl, H. (2019). Methodology for VNF Benchmarking Automation. Internet-Draft draft-rosa-bmwg-vnfbench-05, Internet Engineering Task Force. Work in Progress.

Rosa, R. V., Rothenberg, C. E., and Szabo, R. (2015a). VBaaS: VNF Benchmark-as-a- In 2015 Fourth European Workshop on Software Dened Networks, pages Service. 79–84.

Rosa, R. V., Rothenberg, C. E., and Szabo, R. (2015b). VNF Benchmark-as-a-Service. Internet draft. Accessed on 2017-06-01.

Rosa, R. V., Rothenberg, C. E., and Szabo, R. (2016). VNF Benchmarking Methodology. Internet draft. Accessed on 2017-06-01.

Tahhan, M., O'Mahony, B., and Morton, A. (2016). Benchmarking virtual switches in opnfv. IETF BMWG: Internet draft.

Van Rossem, S., Tavernier, W., Colle, D., Pickavet, M., and Demeester, P. (2020). Vnf performance modelling: From stand-alone to chained topologies. Computer Networks, 181:107428.

Veitch, P., McGrath, M. J., and Bayon, V. (2015). An Instrumentation and Analytics Framework for Optimal and Robust NFV Deployment. IEEE Communications Magazine, 53(2):126–133.