Assessing the Computation and Communication Overhead of Linux Containers for HPC Applications

  • Guilherme Rezende Alles UFRGS
  • Alexandre Carissimi UFRGS
  • Lucas Mello Schnorr UFRGS

Abstract


Virtualization technology provides features that are desirable for highperformance computing (HPC), such as enhanced reproducibility for scientific experiments and flexible execution environment customization. This paper explores the performance implications of applying Operating System (OS) containers in HPC applications. Docker and Singularity are compared to a native baseline with no virtualization, using synthetic workloads and an earthquake simulator called Ondes3D as benchmarks. Our evaluation using up to 256 cores indicate that (a) Singularity containers have minor performance overhead, (b) Docker containers do suffer from increased network latency, and (c) performance gains are attainable with an optimized container on top of a regular OS.
Keywords: Containers, Virtualization, Linux, Virtual machining, Kernel, virtualization, containers, hpc, docker, singularity, performance
Published
2018-10-01
ALLES, Guilherme Rezende; CARISSIMI, Alexandre; SCHNORR, Lucas Mello. Assessing the Computation and Communication Overhead of Linux Containers for HPC Applications. In: BRAZILIAN SYMPOSIUM ON HIGH PERFORMANCE COMPUTING SYSTEMS (SSCAD), 19. , 2018, São Paulo. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2018 . p. 116-123.