A Metadata Cluster Based on OSD+ Devices

  • Ana Aviles-González University of Murcia
  • Juan Piernas University of Murcia
  • Pilar González-Ferez University of Murcia

Resumo


We present the design and implementation of both an enhanced type of OSD device, the OSD+ device, and a metadata cluster based on it. OSD+s support data objects and directory objects. A directory object stores file names and attributes, and supports metadata--related operations. OSD+s profit the directory implementation and features of the underlying file systems used by the storage nodes, achieving a great flexibility, simplicity and small overhead. By using OSD+ devices, we show how a metadata cluster can effectively be managed by all the servers in a system, improving the performance, scalability and availability of the metadata service. The performance of our new metadata cluster has been evaluated and compared with Lustre's. The results show that our proposal obtains a better throughput than Lustre when both use a single metadata server, easily getting improvements of more than 60--80\%, and that the performance scales with the number of OSD+s.

Palavras-chave: Servers, Performance evaluation, Scalability, Kernel, Linux, Semantics, IP networks, Metadata cluster, OSD, parallel file system
Publicado
26/10/2011
AVILES-GONZÁLEZ, Ana; PIERNAS, Juan; GONZÁLEZ-FEREZ, Pilar. A Metadata Cluster Based on OSD+ Devices. In: INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE AND HIGH PERFORMANCE COMPUTING (SBAC-PAD), 23. , 2011, Vitória/ES. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2011 . p. 64-71.