On the Performance and Isolation of Asymmetric Microkernel Design for Lightweight Manycores

  • Pedro H. Penna UGA
  • João Souto UFSC
  • Davidson F. G. Lima PUC-MG
  • Márcio Castro UFSC
  • François Broquedis UGA
  • Henrique C. Freitas PUC-MG
  • Jean-François Méhaut UGA


Multikernel operating systems (OSs) were introduced to match the architectural characteristics of lightweight manycores. While several multikernel OS designs are possible, in this work we argue on one that is structured in asymmetric microkernel instances. We deliver an open-source implementation of an OS kernel with these characteristics, and we provide a comprehensive assessment using a representative benchmark suite. Our results show that an asymmetric microkernel design is scalable and introduces at most 0.9% of performance interference in an application execution. Also, our results unveil co-design aspects between an OS kernel and the architecture of lightweight manycore, concerning the memory system and core grouping.

Palavras-chave: Multiprocessor/Multicore/Manycore Systems, Resource Management


E. Francesquini M. Castro P. H. Penna F. Dupros H. Freitas P. Navaux J.-F. Méhaut "On the Energy Efficiency and Performance of Irregular Application Executions on Multicore NUMA and Manycore Platforms" Journal of Parallel and Distributed Computing vol. 76 no. C pp. 32-48 Feb. 2015.

B. Bohnenstiehl A. Stillmaker J. Pimentel T. Andreas B. Liu A. Tran E. Adeagbo B. Baas "KiloCore: A 32-nm 1000-Processor Computational Array" IEEE Journal of Solid-State Circuits vol. 52 no. 4 pp. 891-902 2017.

D. Rossi A. Pullini I. Loi M. Gautschi F. K. Gurkaynak A. Teman J. Constantin A. Burg I. Miro-Panades E. Beigne F. Clermidy P. Flatresse L. Benini "Energy-efficient near-threshold parallel computing: The pulpv2 cluster" IEEE Micro vol. 37 no. 5 pp. 20-31 sep 2017.

D. Melpignano L. Benini E. Flamand B. Jego T. Lepley G. Haugou F. Clermidy D. Dutoit "Platform 2012 a Many-Core Computing Accelerator for Embedded SoCs" Design Automation Conf. pp. 1137 jun 2012.

S. Davidson S. Xie C. Torng K. Al-Hawai A. Rovinski T. Ajayi L. Vega C. Zhao R. Zhao S. Dai A. Amarnath B. Veluri P. Gao A. Rao G. Liu R. K. Gupta Z. Zhang R. Dreslinski C. Batten M. B. Taylor "The Celerity Open-Source 511-Core RISC-V Tiered Accelerator Fabric: Fast Architectures and Design Methodologies for Fast Chips" IEEE Micro vol. 38 no. 2 pp. 30-41 mar 2018.

B. de Dinechin R. Ayrignac P.-E. Beaucamps P. Couvert B. Ganne P. de Massas F. Jacquet S. Jones N. Chaisemartin F. Riss T. Strudel "A clustered manycore processor architecture for embedded and accelerated applications" Int. Conf. on High Performance Extreme Computing pp. 1-6 2013.

A. Olofsson T. Nordstrom Z. Ul-Abdin "Kickstarting high-performance energy-efficient manycore architectures with epiphany" Asilomar Conf. on Signals Systems and Computers pp. 1719-1726 november 2014.

F. Zheng H.-L. Li H. Lv F. Guo X.-H. Xu X.-H. Xie "Cooperative Computing Techniques for a Deeply Fused and Heterogeneous Many-Core Processor Architecture" Journal of Computer Science and Technology vol. 30 no. 1 pp. 145-162 Jan. 2015.

H. Fu W. Yin G. Yang X. Chen C. He B. Chen Z. Yin Z. Zhang W. Zhang T. Zhang W. Xue W. Liu "18.9-Pflops Nonlinear Earthquake Simulation on Sunway TaihuLight: Enabling Depiction of 18-Hz and 8-Meter Scenarios" Int. Conf. for High Performance Computing Networking Storage and Analysis pp. 1-12 nov 2017.

J. Ross D. Richie "Implementing OpenSHMEM for the Adapteva Epiphany RISC Array Processor" Procedia Computer Science vol. 80 no. C pp. 2353-2356 jan 2016.

B. D. de Dinechin P. G. de Massas G. Lager C. Léger B. Orgogozo J. Reybert T. Strudel "A Distributed Run-Time Environment for the Kalray MPPA-256 Integrated Manycore Processor" Procedia Computer Science vol. 18 pp. 1654-1663 jan 2013.

S. Boyd-Wickizer H. Chen R. Chen Y. Mao F. Kaashoek R. Morris A. Pesterev L. Stein M. Wu Y. Dai Y. Zhang Z. Zhang "Corey: An Operating System for Many Cores" USENIX Conf. on Operating Systems Design and Implementation pp. 43-57 dec 2008.

B. Rhoden K. Klues D. Zhu E. Brewer "Improving Per-Node Efficiency in the Datacenter with New OS Abstractions" ACM Symp. on Cloud Computing pp. 1-8 Oct. 2011.

R. Wisniewski T. Inglett P. Keppel R. Murty R. Riesen "mOS: An Architecture for Extreme-Scale Operating Systems" Int. Workshop on Runtime and Operating Systems for Supercomputers pp. 1-8 Jun. 2014.

D. Wentzlaff A. Agarwal "Factored Operating Systems (FOS): The Case for a Scalable Operating System for Multicores" ACM SIGOPS Operating Systems Review vol. 43 no. 2 pp. 76-85 Apr. 2009.

A. Baumann P. Barham P.-E. Dagand T. Harris R. Isaacs S. Peter T. Roscoe A. Schüpbach A. Singhania "The Multikernel: A New OS Architecture for Scalable Multicore Systems" ACM Symp. on Operating Systems Principles pp. 29-44 Oct. 2009.

F. Kluge M. Gerdes T. Ungerer "An Operating System for Safety-Critical Applications on Manycore Processors" Int. Symp. on Object/Component/Service-Oriented Real-Time Distributed Computing pp. 238-245 Jun. 2014.

E. Nightingale O. Hodson R. McIlroy C. Hawblitzel G. Hunt "Helios: Heterogeneous Multiprocessing with Satellite Kernels" ACM Symp. on Operating Systems Principles pp. 221-234 Oct. 2009.

A. Barbalace M. Sadini S. Ansary C. Jelesnianski A. Ravichandran C. Kendir A. Murray B. Ravindran "Popcorn: Bridging the Programmability Gap in Heterogeneous-ISA Platforms" European Conf. on Computer Systems pp. 1-16 Apr. 2015.

P. H. Penna M. Souza E. Podestá J. Souto M. Castro F. Broquedis H. Freitas J.-F. Mehaut "Rmem: An os service for transparent remote memory access in lightweight manycores" Int. Workshop on Programmability and Architectures for Heterogeneous Multicores pp. 1-16 jan 2019.

P. H. Penna D. Francis J. Souto "The hardware abstraction layer of nanvix for the kalray mppa-256 lightweight manycore processor" Conférence d’Informatique en Parallélisme Architecture et Système pp. 1-11 jun 2019.

M.-H. Haghbayan A. Miele A. M. Rahmani P. Liljeberg H. Tenhunen "Performance/Reliability-Aware Resource Management for Many-Cores in Dark Silicon Era" IEEE Transactions on Computers vol. 66 no. 9 pp. 1599-1612 sep 2017.

J. Hascoët B. D. de Dinechin P. G. de Massas M. Q. Ho "Asynchronous One-Sided Communications and Synchronizations for a Clustered Manycore Processor" Symp. on Embedded Systems for Real-Time Multimedia pp. 51-60 oct 2017.

B. D. de Dinechin Y. Durand D. van Amstel A. Ghiti "Guaranteed Services of the NoC of a Manycore Processor" Int. Workshop on Network on Chip Architectures pp. 11-16 2014.

S. Wallentowitz P. Wagner M. Tempelmeier T. Wild A. Herkersdorf "Open Tiled Manycore System-on-Chip" Tech. Rep. Apr. 2013.

J. Colmenares S. Bird H. Cook P. Pearce D. Zhu J. Shalf K. Asanović J. Kubiatowicz "Resource Management in the Tessellation Manycore OS" USENIX Conference on Hot Topics in Parallelism jun 2010.
PENNA, Pedro H.; SOUTO, João; LIMA, Davidson F. G.; CASTRO, Márcio; BROQUEDIS, François; FREITAS, Henrique C.; MÉHAUT , Jean-François. On the Performance and Isolation of Asymmetric Microkernel Design for Lightweight Manycores. In: SIMPÓSIO BRASILEIRO DE ENGENHARIA DE SISTEMAS COMPUTACIONAIS (SBESC), 9. , 2019, Natal. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2019 . p. 33-40. ISSN 2237-5430.