Mainstream vs. Emerging HPC: Metrics, Trade-Offs and Lessons Learned

• Milan Radulovic Barcelona Supercomputing Center
• Kazi Asifuzzaman Barcelona Supercomputing Center
• Darko Zivanovic Barcelona Supercomputing Center
• Nikola Rajovic Barcelona Supercomputing Center
• Guillaume Colin de Verdiére CEA, DIF
• Dirk Pleiter Universität Regensburg
• Manolis Marazakisl Foundation For Research & Technology – Hellas
• Nikolaos Kallimanis Foundation For Research & Technology – Hellas
• Paul Carpenter Barcelona Supercomputing Center
• Petar Radojković Barcelona Supercomputing Center
• Eduard Ayguadé Barcelona Supercomputing Center

Resumo

Various servers with different characteristics and architectures are hitting the market, and their evaluation and comparison in terms of HPC features is complex and multidimensional. In this paper, we share our experience of evaluating a diverse set of HPC systems, consisting of three mainstream and five emerging architectures. We evaluate the performance and power efficiency using prominent HPC benchmarks, High-Performance Linpack (HPL) and High Performance Conjugate Gradients (HPCG), and expand our analysis using publicly available specialized kernel benchmarks, targeting specific system components. In addition to a large body of quantitative results, we emphasize six usually overlooked aspects of the HPC platforms evaluation, and share our conclusions and lessons learned. Overall, we believe that this paper will improve the evaluation and comparison of HPC platforms, making a first step towards a more reliable and uniform methodology.

Palavras-chave: Computer architecture, Benchmark testing, Servers, Power measurement, Bridges, Libraries, System software, HPC, emerging and mainstream architectures, energy efficiency, weak vs. strong cores, memory latency and bandwidth, BytelFLOP ratio