Taking Open vSwitch to the Gym: An Automated Benchmarking Approach

• Raphael Vicente Rosa UNICAMP
• Christian Esteve Rothenberg UNICAMP

##plugins.pubIds.doi.readerDisplayName## https://doi.org/10.5753/wpietf.2017.3605

Resumen

Performance benchmarking in Network Function Virtualization (NFV) pose challenging issues due to all moving parts of virtualized infrastructures potentially affecting the packet processing performance of Virtualized Network Functions (VNFs). Despite the advances in best-of-breed network virtualization technologies, the dependencies on the underlying allocated hardware resources, their characteristics and customized configurations, result in benchmarking hazards that call for innovative and standardized testing methodologies towards adequate VNF performance profiling. To this end, we designed and prototyped Gym, a testing framework for automated NFV performance benchmarking we experimentally validated on Open vSwitch as a target VNF. The design principles and implementation of Gym demonstrate an useful apparatus to assist standards organizations formalizing VNF testing methodologies.

Citas

Emmerich, P., Gallenmüller, S., Raumer, D., Wohlfart, F., and Carle, G. (2015). Moongen: A scriptable high-speed packet generator. In Proceedings of the 2015 Internet Measurement Conference, IMC ’15, pages 275–287, New York, NY, USA. ACM.

ETSI GS NFV-TST (2016). ETSI GS NFV-TST 002 V1.1.1 - Report on NFV Interoperability Testing Methodology.

Jain, S., Kumar, A., Mandal, S., Ong, J., Poutievski, L., Singh, A., Venkata, S., Wanderer, J., Zhou, J., Zhu, M., Zolla, J., Hölzle, U., Stuart, S., and Vahdat, A. (2013). B4: Experience with a globally-deployed software defined wan. SIGCOMM Comput. Commun. Rev., 43(4):3–14.

Molnár, L., Pongrácz, G., Enyedi, G., Kis, Z. L., Csikor, L., Juhász, F., Kőrösi, A., and Rétvári, G. (2016). Dataplane specialization for high-performance openflow software switching. In Proceedings of the 2016 ACM SIGCOMM Conference, SIGCOMM ’16, pages 539–552, New York, NY, USA. ACM.

Morton, A. (2016). Considerations for benchmarking virtual network functions and their infrastructure. IETF BMWG: Internet draft.

Pfaff, B., Pettit, J., Koponen, T., Jackson, E., Zhou, A., Rajahalme, J., Gross, J., Wang, A., Stringer, J., Shelar, P., Amidon, K., and Casado, M. (2015). The design and implementation of open vswitch. In 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI 15), pages 117–130, Oakland, CA. USENIX Association.

Raumer, D., Gallenmüller, S., Wohlfart, F., Emmerich, P., Werneck, P., and Carle, G. (2016). Revisiting benchmarking methodology for interconnect devices. In Proceedings of the 2016 Applied Networking Research Workshop, ANRW ’16, pages 55–61, New York, NY, USA. ACM.

Rosa, R. V., Rothenberg, C. E., and Szabo, R. (2015a). VBaaS: VNF Benchmark-as-a-Service. In 2015 Fourth European Workshop on Software Defined Networks, pages 79–84.

Rosa, R. V., Rothenberg, C. E., and Szabo, R. (2015b). VNF Benchmark-as-a-Service. IRTF NFVRG: Internet draft.

Rosa, R. V., Rothenberg, C. E., and Szabo, R. (2016). VNF Benchmarking Methodology. IETF BMWG: Internet draft.

Tahhan, M., O’Mahony, B., and Morton, A. (2016). Benchmarking virtual switches in opnfv. IETF BMWG: Internet draft.