Parallel Storage Devices Profiling with SeRRa
Resumo
This work presents the parallel storage device profiling tool SeRRa. Our tool obtains the sequential to random throughput ratio for reads and writes of different sizes on storage devices. In order to provide this information efficiently, SeRRa employs benchmarks to obtain the values for only a subset of the parameter space and estimates the remaining values through linear models. The MPI parallelization of SeRRa presented in this paper allows for faster profiling. Our results show that our parallel SeRRa provides profiles up to 8:7 times faster than the sequential implementation, up to 895 times faster than the originally required time (without SeRRa).
Referências
Agrawal, N., Prabhakaran, V., Wobber, T., Davis, J. D., Manasse, M., and Panigrahy, R. (2008). Design tradeoffs for ssd performance. In USENIX Annual Technical Conference, ATC’08, pages 57–70, Berkeley, CA, USA. USENIX Association.
Boito, F. Z., Kassick, R., Navaux, P. O. A., and Denneulin, Y. (2013). Agios: Application-guided i/o scheduling for parallel file systems. In International Conference on Parallel and Distributed Systems (ICPADS), pages 43–50, Seoul, South Korea. IEEE.
Boito, F. Z., Kassick, R. V., Navaux, P. O., and Denneulin, Y. (2015). Towards fast profiling of storage devices regarding access sequentiality. In Symposium on Applied Computing (SAC), Salamanca, Spain. ACM.
Bolze, R., Cappello, F., Caron, E., Dayde, M., Desprez, F., Jeannot, E., Jegou, Y., Lanteri, S., Leduc, J., Melab, N., Mornet, G., Namyst, R., Primet, P., Quetier, B., Richard, O., Talbi, E.-G., and Touche, I. (2006). Grid5000: A large scale and highly reconfigurable experimental grid testbed. International Journal of High Performance Computing Applications, 20(4):481–494.
Bucy, J. S., Schindler, J., Schlosser, S. W., and Ganger, G. R. (2008). The disksim simulation environment reference manual. Parallel Data Laboratory, 4 edition. Available at http://www.pdl.cmu.edu/PDL-FTP/DriveChar/CMU-PDL-08-101.pdf. Accessed in January 2015.
Chen, F., Koufaty, D. A., and Zhang, X. (2009). Understanding intrinsic characteristics and system implications of flash memory based solid state drives. In 11th International Joint Conference on Measurement and Modeling of Computer Systems, pages 181–192, New York, NY, USA. ACM.
Desnoyers, P. (2012). Analytic modeling of ssd write performance. In Proceedings of the 5th Annual International Systems and Storage Conference, SYSTOR ’12, pages 12–1, New York, NY, USA. ACM.
El Maghraoui, K., Kandiraju, G., Jann, J., and Pattnaik, P. (2010). Modeling and simulating flash based solid-state disks for operating systems. In Proceedings of the first joint WOSP/SIPEW international conference on Performance engineering, pages 15–26, San Jose, California, USA. ACM.
Kim, Y., Tauras, B., Gupta, A., and Urgaonkar, B. (2009). Flashsim: A simulator for nand flash-based solid-state drives. In First International Conference on Advances in System Simulation (SIMUL), SIMUL ’09, pages 125–131, Washington, DC, USA. IEEE Computer Society.
Norcott, W. D. and Capps, D. (2006). Iozone filesystem benchmark. Available at www.iozone.org. Accessed in March 2014.
Rajimwale, A., Prabhakaran, V., and Davis, J. D. (2009). Block management in solid-state devices. In Proceedings of the USENIX Annual Technical Conference, pages 279–284, San Jose, CA, USA. USENIX Association.
Shan, H., Antypas, K., and Shalf, J. (2008). Characterizing and predicting the i/o performance of hpc applications using a parameterized synthetic benchmark. In Proceedings of the ACM/IEEE Conference on Supercomputing, SC ’08, pages 42–53, Piscataway, NJ, USA. IEEE Press.
Xu, W., Lu, Y., Li, Q., Zhou, E., Song, Z., Dong, Y., Zhang, W., Wei, D., Zhang, X., Chen, H., et al. (2014). Hybrid hierarchy storage system in milkyway-2 supercomputer. Frontiers of Computer Science, 8(3):367–377.
Yoo, J., Won, Y., Hwang, J., Kang, S., Choi, J., Yoon, S., and Cha, J. (2013). Vssim: Virtual machine based ssd simulator. In IEEE 29th Symposium on Mass Storage Systems and Technologies (MSST), pages 1–14, Long Beach, CA, USA. IEEE.
Zhang, Y. and Bhargava, B. (2008). Self-learning disk scheduling. IEEE Transactions on Knowledge and Data Engineering, 21(1):50–65.
Boito, F. Z., Kassick, R., Navaux, P. O. A., and Denneulin, Y. (2013). Agios: Application-guided i/o scheduling for parallel file systems. In International Conference on Parallel and Distributed Systems (ICPADS), pages 43–50, Seoul, South Korea. IEEE.
Boito, F. Z., Kassick, R. V., Navaux, P. O., and Denneulin, Y. (2015). Towards fast profiling of storage devices regarding access sequentiality. In Symposium on Applied Computing (SAC), Salamanca, Spain. ACM.
Bolze, R., Cappello, F., Caron, E., Dayde, M., Desprez, F., Jeannot, E., Jegou, Y., Lanteri, S., Leduc, J., Melab, N., Mornet, G., Namyst, R., Primet, P., Quetier, B., Richard, O., Talbi, E.-G., and Touche, I. (2006). Grid5000: A large scale and highly reconfigurable experimental grid testbed. International Journal of High Performance Computing Applications, 20(4):481–494.
Bucy, J. S., Schindler, J., Schlosser, S. W., and Ganger, G. R. (2008). The disksim simulation environment reference manual. Parallel Data Laboratory, 4 edition. Available at http://www.pdl.cmu.edu/PDL-FTP/DriveChar/CMU-PDL-08-101.pdf. Accessed in January 2015.
Chen, F., Koufaty, D. A., and Zhang, X. (2009). Understanding intrinsic characteristics and system implications of flash memory based solid state drives. In 11th International Joint Conference on Measurement and Modeling of Computer Systems, pages 181–192, New York, NY, USA. ACM.
Desnoyers, P. (2012). Analytic modeling of ssd write performance. In Proceedings of the 5th Annual International Systems and Storage Conference, SYSTOR ’12, pages 12–1, New York, NY, USA. ACM.
El Maghraoui, K., Kandiraju, G., Jann, J., and Pattnaik, P. (2010). Modeling and simulating flash based solid-state disks for operating systems. In Proceedings of the first joint WOSP/SIPEW international conference on Performance engineering, pages 15–26, San Jose, California, USA. ACM.
Kim, Y., Tauras, B., Gupta, A., and Urgaonkar, B. (2009). Flashsim: A simulator for nand flash-based solid-state drives. In First International Conference on Advances in System Simulation (SIMUL), SIMUL ’09, pages 125–131, Washington, DC, USA. IEEE Computer Society.
Norcott, W. D. and Capps, D. (2006). Iozone filesystem benchmark. Available at www.iozone.org. Accessed in March 2014.
Rajimwale, A., Prabhakaran, V., and Davis, J. D. (2009). Block management in solid-state devices. In Proceedings of the USENIX Annual Technical Conference, pages 279–284, San Jose, CA, USA. USENIX Association.
Shan, H., Antypas, K., and Shalf, J. (2008). Characterizing and predicting the i/o performance of hpc applications using a parameterized synthetic benchmark. In Proceedings of the ACM/IEEE Conference on Supercomputing, SC ’08, pages 42–53, Piscataway, NJ, USA. IEEE Press.
Xu, W., Lu, Y., Li, Q., Zhou, E., Song, Z., Dong, Y., Zhang, W., Wei, D., Zhang, X., Chen, H., et al. (2014). Hybrid hierarchy storage system in milkyway-2 supercomputer. Frontiers of Computer Science, 8(3):367–377.
Yoo, J., Won, Y., Hwang, J., Kang, S., Choi, J., Yoon, S., and Cha, J. (2013). Vssim: Virtual machine based ssd simulator. In IEEE 29th Symposium on Mass Storage Systems and Technologies (MSST), pages 1–14, Long Beach, CA, USA. IEEE.
Zhang, Y. and Bhargava, B. (2008). Self-learning disk scheduling. IEEE Transactions on Knowledge and Data Engineering, 21(1):50–65.
Publicado
20/07/2015
Como Citar
MACHADO, Vinicius; BOITO, Francieli; KASSICK, Rodrigo; BEZ, Jean Luca; NAVAUX, Philippe; DENNEULIN, Yves.
Parallel Storage Devices Profiling with SeRRa. In: WORKSHOP EM DESEMPENHO DE SISTEMAS COMPUTACIONAIS E DE COMUNICAÇÃO (WPERFORMANCE), 14. , 2015, Recife.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2015
.
p. 107-119.
ISSN 2595-6167.
DOI: https://doi.org/10.5753/wperformance.2015.10401.
