ECHOFS: A Scheduler-Guided Temporary Filesystem to Leverage Node-Local NVMS

• Alberto Miranda Barcelona Supercomputing Center
• Ramon Nou Barcelona Supercomputing Center
• Toni Cortes Barcelona Supercomputing Center / Universitat Politecnica de Catalunya

Resumo

The growth in data-intensive scientific applications poses strong demands on the HPC storage subsystem, as data needs to be copied from compute nodes to I/O nodes and vice versa for jobs to run. The emerging trend of adding denser, NVM-based burst buffers to compute nodes, however, offers the possibility of using these resources to build temporary file systems with specific I/O optimizations for a batch job. In this work, we present echofs, a temporary filesystem that coordinates with the job scheduler to preload a job's input files into node-local burst buffers. We present the results measured with NVM emulation, and different FS backends with DAX/FUSE on a local node, to show the benefits of our proposal and such coordination.

Palavras-chave: Buffer storage, Metadata, Fuses, Nonvolatile memory, Hardware, Computer architecture, Random access memory