Impacto da Migração de Máquinas Virtuais de Xen na Execução de Programas MPI
Resumo
A virtualização pode ser vista como a manutenção de máquinas virtuais, cada qual com seu sistema operacional, sobre um conjunto de recursos. Para área de alto desempenho, ela possibilita criar várias máquinas virtuais em cada recurso, permitindo testes de desempenho de aplicações científicas com diversas configurações. Além disso, o conceito de virtualização abrange a idéia de migração, onde é possível transportar uma máquina virtual para um diferente recurso. Nesse contexto, a ferramenta Xen suporta as características apresentadas e foi usada para avaliar o custo da migração de máquinas virtuais que executam programas MPI. O propósito final é avaliar a viabilidade de Xen para o desenvolvimento de uma biblioteca de migração de processos MPI, tornando possível um reescalonamento eficiente deles em tempo de execução. O presente artigo apresenta os resultados sobre o impacto da migração de máquinas virtuais Xen na execução de programas MPI. Ele também aborda alguns testes de computação e comunicação com o Xen e trabalhos relacionados sobre migração com virtualização.Referências
K. Adams and O. Agesen. A comparison of software and hardware techniques for x86 virtualization. In ASPLOSXII: Proceedings of the 12th international conference on Architectural support for programming languages and operating systems, pages 2–13, New York, NY, USA, 2006. ACM Press.
D. H. Bailey, E. Barszcz, J. T. Barton, D. S. Browning, R. L. Carter, L. Dagum, R. A. Fatoohi, P. O. Frederickson, T. A. Lasinski, R. S. Schreiber, H. D. Simon, V. Venkatakrishnan, and S. K. Weeratunga. The nas parallel benchmarks - sumary and preliminary results. In Supercomputing ’91: Proceedings of the 1991 ACM/IEEE conference on Supercomputing, pages 158–165, New York, NY, USA, 1991. ACM Press.
P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield. Xen and the art of virtualization. In Proceedings of the nineteenth ACM symposium on Operating systems principles, volume 37, 5 of Operating Systems Review, pages 164–177, New York, 2003. ACM Press.
M. P. Boufleur, G. P. Koslovski, and A. S. Charão. Avaliação do uso de xen em ambientes de alto desempenho. In Workshop em Sistemas Computacionais de Alto Desempenho - WSCAD 2006, pages 141–147, Ouro Preto - MG, 2006.
M. C. Cera, G. P. Pezzi, E. N. Mathias, N. Maillard, and P. O. A. Navaux. Improving the dynamic creation of processes in mpi-2. In Lecture Notes in Computer Science - 13th European PVMMPI Users Group Meeting, volume 4192/2006, pages 247–255, Bonn, Germany, 2006. Springer Berlin / Heidelberg.
C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live migration of virtual machines. In Proceedings of the 2nd USENIX Symposium on Networked Systems Design and Implementation, pages 20–34, Boston, MA, USA, May 2005.
T. Clark. Storage Virtualization: Technologies for Simplifying Data Storage and Management. Addison-Wesley Professional, 2005.
Dongarra, Moler, Bunch, and Stewart. Linpack. Philadelphia, 1986.
K. J. Duda and D. R. Cheriton. Borrowed-virtual-time (BVT) scheduling: supporting latency-sensitive threads in a general-purpose scheduler. Operating Systems Review, 33(5):261–276, Dec. 1999.
G. Goth. Virtualization: Old technology offers huge new potential. IEEE Distributed Systems Online, 8(2):3, 2007.
W. Huang, J. Liu, B. Abali, and D. K. Panda. A case for high performance computing with virtual machines. In ICS ’06: Proceedings of the 20th annual international conference on Supercomputing, pages 125–134, New York, NY, USA, 2006. ACM Press.
M. L. Massie, B. N. Chun, and D. E. Culler. The ganglia distributed monitoring system: design, implementation, and experience. Parallel Computing, 30(7):817–840, July 2004.
D. S. Milojicic, F. Douglis, Y. Paindaveine, R. Wheeler, and S. Zhou. Process migration. ACM Computing Surveys, Sept. 2000.
A. Nagarajan, F. Mueller, C. Engelmann, and S. L. Scott. Proactive fault tolerance for HPC with Xen virtualization. In Proceedings of the 21st ACM International Conference on Supercomputing (ICS) 2007, Seattle,WA, USA, June 16-20, 2007. To appear.
Z. Pan, X. Ren, R. Eigenmann, and D. Xu. Executing mpi programs on virtual machines in an internet sharing system. In 20th International Parallel and Distributed Processing Symposium (IPDPS 2006). IEEE, 2006.
A. Petitet, R. C. Whaley, J. Dongarra, and A. Cleary. Hpl - a portable implementation of the high-performance linpack benchmark for distributed-memory computers. Disponivel em http://www.netlib.org/benchmark/hpl/. Acessado em junho de 2007.
D. Plummer. An ethernet address resolution protocol. RFC 826, Nov. 1982.
S. Sankaran, J. M. Squyres, B. Barrett, A. Lumsdaine, J. Duell, P. Hargrove, and E. Roman. The LAM/MPI checkpoint/restart framework: System-initiated checkpointing. International Journal of High Performance Computing Applications, 19(4):479, Winter 2005.
R. E. Silva, G. Pezzi, N. Maillard, and T. Diverio. Automatic data-flow graph generation of mpi programs. In SBACPAD ’05: Proceedings of the 17th International Symposium on Computer Architecture on High Performance Computing, pages 93–100, Washington, DC, USA, 2005. IEEE Computer Society.
Q. Snell, A. Mikler, and J. Gustafson. NetPIPE: A Network Protocol Independent Performace Evaluator, 1996.
R. P. Souto, R. B. Avila, P. O. A. Navaux, M. X. Py, T. A. Diverio, H. F. C. Velho, S. Stephany, A. J. Preto, J. Panetta, E. R. Rodrigues, E. S. Almeida, P. L. S. Dias, and A. W. Gandu. Processing mesoscale climatology in a grid environment. In CCGRID ’07: Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid, pages 363–370, Washington, DC, USA, 2007. IEEE Computer Society.
G. Stellner. CoCheck: Checkpointing and Process Migration for MPI. In Proceedings of the International Parallel Processing Symposium, pages 526–531, Honolulu, HI, Apr 1996. IEEE Computer Society Press.
L. Youseff, R. Wolski, B. C. Gorda, and C. Krintz. Paravirtualization for HPC systems. In G.Min, B. D.Martino, L. T. Yang, M. Guo, and G. R¨unger, editors, ISPA Workshops, volume 4331 of Lecture Notes in Computer Science, pages 474–486. Springer, 2006.
D. H. Bailey, E. Barszcz, J. T. Barton, D. S. Browning, R. L. Carter, L. Dagum, R. A. Fatoohi, P. O. Frederickson, T. A. Lasinski, R. S. Schreiber, H. D. Simon, V. Venkatakrishnan, and S. K. Weeratunga. The nas parallel benchmarks - sumary and preliminary results. In Supercomputing ’91: Proceedings of the 1991 ACM/IEEE conference on Supercomputing, pages 158–165, New York, NY, USA, 1991. ACM Press.
P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield. Xen and the art of virtualization. In Proceedings of the nineteenth ACM symposium on Operating systems principles, volume 37, 5 of Operating Systems Review, pages 164–177, New York, 2003. ACM Press.
M. P. Boufleur, G. P. Koslovski, and A. S. Charão. Avaliação do uso de xen em ambientes de alto desempenho. In Workshop em Sistemas Computacionais de Alto Desempenho - WSCAD 2006, pages 141–147, Ouro Preto - MG, 2006.
M. C. Cera, G. P. Pezzi, E. N. Mathias, N. Maillard, and P. O. A. Navaux. Improving the dynamic creation of processes in mpi-2. In Lecture Notes in Computer Science - 13th European PVMMPI Users Group Meeting, volume 4192/2006, pages 247–255, Bonn, Germany, 2006. Springer Berlin / Heidelberg.
C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live migration of virtual machines. In Proceedings of the 2nd USENIX Symposium on Networked Systems Design and Implementation, pages 20–34, Boston, MA, USA, May 2005.
T. Clark. Storage Virtualization: Technologies for Simplifying Data Storage and Management. Addison-Wesley Professional, 2005.
Dongarra, Moler, Bunch, and Stewart. Linpack. Philadelphia, 1986.
K. J. Duda and D. R. Cheriton. Borrowed-virtual-time (BVT) scheduling: supporting latency-sensitive threads in a general-purpose scheduler. Operating Systems Review, 33(5):261–276, Dec. 1999.
G. Goth. Virtualization: Old technology offers huge new potential. IEEE Distributed Systems Online, 8(2):3, 2007.
W. Huang, J. Liu, B. Abali, and D. K. Panda. A case for high performance computing with virtual machines. In ICS ’06: Proceedings of the 20th annual international conference on Supercomputing, pages 125–134, New York, NY, USA, 2006. ACM Press.
M. L. Massie, B. N. Chun, and D. E. Culler. The ganglia distributed monitoring system: design, implementation, and experience. Parallel Computing, 30(7):817–840, July 2004.
D. S. Milojicic, F. Douglis, Y. Paindaveine, R. Wheeler, and S. Zhou. Process migration. ACM Computing Surveys, Sept. 2000.
A. Nagarajan, F. Mueller, C. Engelmann, and S. L. Scott. Proactive fault tolerance for HPC with Xen virtualization. In Proceedings of the 21st ACM International Conference on Supercomputing (ICS) 2007, Seattle,WA, USA, June 16-20, 2007. To appear.
Z. Pan, X. Ren, R. Eigenmann, and D. Xu. Executing mpi programs on virtual machines in an internet sharing system. In 20th International Parallel and Distributed Processing Symposium (IPDPS 2006). IEEE, 2006.
A. Petitet, R. C. Whaley, J. Dongarra, and A. Cleary. Hpl - a portable implementation of the high-performance linpack benchmark for distributed-memory computers. Disponivel em http://www.netlib.org/benchmark/hpl/. Acessado em junho de 2007.
D. Plummer. An ethernet address resolution protocol. RFC 826, Nov. 1982.
S. Sankaran, J. M. Squyres, B. Barrett, A. Lumsdaine, J. Duell, P. Hargrove, and E. Roman. The LAM/MPI checkpoint/restart framework: System-initiated checkpointing. International Journal of High Performance Computing Applications, 19(4):479, Winter 2005.
R. E. Silva, G. Pezzi, N. Maillard, and T. Diverio. Automatic data-flow graph generation of mpi programs. In SBACPAD ’05: Proceedings of the 17th International Symposium on Computer Architecture on High Performance Computing, pages 93–100, Washington, DC, USA, 2005. IEEE Computer Society.
Q. Snell, A. Mikler, and J. Gustafson. NetPIPE: A Network Protocol Independent Performace Evaluator, 1996.
R. P. Souto, R. B. Avila, P. O. A. Navaux, M. X. Py, T. A. Diverio, H. F. C. Velho, S. Stephany, A. J. Preto, J. Panetta, E. R. Rodrigues, E. S. Almeida, P. L. S. Dias, and A. W. Gandu. Processing mesoscale climatology in a grid environment. In CCGRID ’07: Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid, pages 363–370, Washington, DC, USA, 2007. IEEE Computer Society.
G. Stellner. CoCheck: Checkpointing and Process Migration for MPI. In Proceedings of the International Parallel Processing Symposium, pages 526–531, Honolulu, HI, Apr 1996. IEEE Computer Society Press.
L. Youseff, R. Wolski, B. C. Gorda, and C. Krintz. Paravirtualization for HPC systems. In G.Min, B. D.Martino, L. T. Yang, M. Guo, and G. R¨unger, editors, ISPA Workshops, volume 4331 of Lecture Notes in Computer Science, pages 474–486. Springer, 2006.
Publicado
24/10/2007
Como Citar
NEVES, Marcelo Veiga; RIGHI, Rodrigo da Rosa; MAILLARD, Nicolas; NAVAUX, Philippe O. A..
Impacto da Migração de Máquinas Virtuais de Xen na Execução de Programas MPI. In: SIMPÓSIO EM SISTEMAS COMPUTACIONAIS DE ALTO DESEMPENHO (SSCAD), 8. , 2007, Gramado.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2007
.
p. 41-48.
DOI: https://doi.org/10.5753/wscad.2007.18751.
