A volunteer computing system implemented with peer-to-peer communication optimized for small and limited environments
Resumo
The computational needs of scientific experiments often require powerful computers. One alternative way to obtain this processing power is taking advantage of the idle processing of personal computers as volunteers. This technique is known as volunteer computing and has great potential in helping scientists. However, there are several issues which can reduce the efficiency of this approach when applied to complex scientific experiments, such as, the ones with long processing time, very large input or output data, etc. In order to face these challenges, we designed a volunteer computing system based on peer-to-peer communication. When compared with the local execution of activities and traditional volunteer computing, the execution time was improved and, in some cases, there was also a reduction of the server upload bandwidth use.
Referências
Acharya, A., Edjlali, G., and Saltz, J. (1997). The utility of exploiting idle workstations for parallel computation. ACM SIGMETRICS Performance Evaluation Review, 25(1):225–234.
Akamai (2013). The state of the internet. Technical Report Vol 6, Num 2, Akamai Faster Forward.
Anderson, D. (2004). BOINC: a system for public-resource computing and storage. In Fifth IEEE/ACM International Workshop on Grid Computing, pages 4–10.
Anderson, D. P. and Fedak, G. (2006). The Computational and Storage Potential of Volunteer Computing. In Cluster Computing and the Grid, 2006. CCGRID 06. Sixth IEEE International Symposium on, volume 1, pages 73–80.
Bharathi, S., Chervenak, A., Deelman, E., Mehta, G., Su, M.-H., and Vahi, K. (2008). Characterization of scientific workflows. In 2008 Third Workshop on Workflows in Support of Large-Scale Science, pages 1–10. IEEE.
Dethier, G., Briquet, C., Marchot, P., and de Marneffe, P.-A. (2008). LBG-SQUARE Fault-Tolerant, Locality-Aware Co-Allocation in P2P Grids. In 2008 Ninth International Conference on Parallel and Distributed Computing, Applications and Technologies, pages 252–258. IEEE.
Dias, J., Ogasawara, E., de Oliveira, D., Pacitti, E., and Mattoso, M. (2010). Improving Many-Task computing in scientific workflows using P2P techniques. In 2010 3rd Workshop on Many-Task Computing on Grids and Supercomputers, pages 1–10. IEEE.
Digiampietri, L., Alves, C., Trucolo, C., and Oliveira, R. (2014a). Análise da rede dos doutores que atuam em computação no brasil. In CSBC-BraSNAM 2014.
Digiampietri, L., de Jsus Prez-Alczar, J., Santiago, C., Oliveira, G., Khouri, A., and Arajo, J. (2014b). A framework for automatic composition of scientific experiments: Achievements, lessons learned and challenges. In VIII Brazilian e-Science Workshop.
Digiampietri, L. A., Maruyama, W. T., Santiago, C. R. N., and da Silva Lima, J. J. (2015). Um Sistema de Predio de Relacionamentos em Redes Sociais. In Simpsio Brasileiro de Sistemas de Informao (SBSI 2015), pages 139–146.
Duan, K., Padget, J., Kim, H. A., and Hosobe, H. (2012). Composition of engineering web services with universal distributed data-flows framework based on ROA. In Proceedings of the Third International Workshop on RESTful Design - WS-REST ’12, page 41, New York, New York, USA. ACM Press.
Gentzsch, W., Grandinetti, L., Joubert, G., Ricci, L., Baraglia, R., Ghafarian, T., Deldari, H., Javadi, B., Yaghmaee, M. H., and Buyya, R. (2013). CycloidGrid: A proximity-aware P2P-based resource discovery architecture in volunteer computing systems. Future Generation Computer Systems, 29(6):1583–1595.
Kondo, D., Fedak, G., Cappello, F., Chien, A. A., and Casanova, H. (2007). Characterizing resource availability in enterprise desktop grids. Future Generation Computer Systems, 23(7):888–903.
Kwan, S. K. and Jogesh, K. M. (2010). Bag-of-Tasks applications scheduling on volunteer desktop grids with adaptive information dissemination. In IEEE Local Computer Network Conference, pages 544–551. IEEE.
Majithia, S., Shields, M., Taylor, I., and Wang, I. (2004). Triana: a graphical Web service composition and execution toolkit. In Proceedings. IEEE International Conference on Web Services, 2004., pages 514–521. IEEE.
Mastroianni, C., Cozza, P., Talia, D., Kelley, I., and Taylor, I. (2009). A scalable super-peer approach for public scientific computation. Future Generation Computer Systems, 25(3):213–223.
Medeiros, J. W., Weske, M., Vossen, G., and Bauzer, C. (1996). Scientific workflow systems. NSF Workshop on Workflow and Process Automation: State-of-the-art and Future Directions.
Murata, Y., Inaba, T., Takizawa, H., and Kobayashi, H. (2008). Implementation and evaluation of a distributed and cooperative load-balancing mechanism for dependable volunteer computing. In 2008 IEEE International Conference on Dependable Systems and Networks With FTCS and DCC (DSN), pages 316–325. IEEE.
Rius, J., Estrada, S., Cores, F., and Solsona, F. (2012). Incentive mechanism for scheduling jobs in a peer-to-peer computing system. Simulation Modelling Practice and Theory, 25:36–55.
Seffino, L., Medeiros, C., Rocha, J., and Yi, B. (1999). WOODSS - A Spatial Decision Support System based on Workflows. Decision Support Systems, 27(1-2):105–123.
Wen Dou, Yan Jia, Huai Ming Wang, Wen Qiang Song, and Peng Zou (2003). A P2P approach for global computing. In Proceedings International Parallel and Distributed Processing Symposium, page 6. IEEE Comput. Soc.
Zhao, Z., Yang, F., and Xu, Y. (2009). PPVC: A P2P volunteer computing system. In 2009 2nd IEEE International Conference on Computer Science and Information Technology, pages 51–55. IEEE.
Akamai (2013). The state of the internet. Technical Report Vol 6, Num 2, Akamai Faster Forward.
Anderson, D. (2004). BOINC: a system for public-resource computing and storage. In Fifth IEEE/ACM International Workshop on Grid Computing, pages 4–10.
Anderson, D. P. and Fedak, G. (2006). The Computational and Storage Potential of Volunteer Computing. In Cluster Computing and the Grid, 2006. CCGRID 06. Sixth IEEE International Symposium on, volume 1, pages 73–80.
Bharathi, S., Chervenak, A., Deelman, E., Mehta, G., Su, M.-H., and Vahi, K. (2008). Characterization of scientific workflows. In 2008 Third Workshop on Workflows in Support of Large-Scale Science, pages 1–10. IEEE.
Dethier, G., Briquet, C., Marchot, P., and de Marneffe, P.-A. (2008). LBG-SQUARE Fault-Tolerant, Locality-Aware Co-Allocation in P2P Grids. In 2008 Ninth International Conference on Parallel and Distributed Computing, Applications and Technologies, pages 252–258. IEEE.
Dias, J., Ogasawara, E., de Oliveira, D., Pacitti, E., and Mattoso, M. (2010). Improving Many-Task computing in scientific workflows using P2P techniques. In 2010 3rd Workshop on Many-Task Computing on Grids and Supercomputers, pages 1–10. IEEE.
Digiampietri, L., Alves, C., Trucolo, C., and Oliveira, R. (2014a). Análise da rede dos doutores que atuam em computação no brasil. In CSBC-BraSNAM 2014.
Digiampietri, L., de Jsus Prez-Alczar, J., Santiago, C., Oliveira, G., Khouri, A., and Arajo, J. (2014b). A framework for automatic composition of scientific experiments: Achievements, lessons learned and challenges. In VIII Brazilian e-Science Workshop.
Digiampietri, L. A., Maruyama, W. T., Santiago, C. R. N., and da Silva Lima, J. J. (2015). Um Sistema de Predio de Relacionamentos em Redes Sociais. In Simpsio Brasileiro de Sistemas de Informao (SBSI 2015), pages 139–146.
Duan, K., Padget, J., Kim, H. A., and Hosobe, H. (2012). Composition of engineering web services with universal distributed data-flows framework based on ROA. In Proceedings of the Third International Workshop on RESTful Design - WS-REST ’12, page 41, New York, New York, USA. ACM Press.
Gentzsch, W., Grandinetti, L., Joubert, G., Ricci, L., Baraglia, R., Ghafarian, T., Deldari, H., Javadi, B., Yaghmaee, M. H., and Buyya, R. (2013). CycloidGrid: A proximity-aware P2P-based resource discovery architecture in volunteer computing systems. Future Generation Computer Systems, 29(6):1583–1595.
Kondo, D., Fedak, G., Cappello, F., Chien, A. A., and Casanova, H. (2007). Characterizing resource availability in enterprise desktop grids. Future Generation Computer Systems, 23(7):888–903.
Kwan, S. K. and Jogesh, K. M. (2010). Bag-of-Tasks applications scheduling on volunteer desktop grids with adaptive information dissemination. In IEEE Local Computer Network Conference, pages 544–551. IEEE.
Majithia, S., Shields, M., Taylor, I., and Wang, I. (2004). Triana: a graphical Web service composition and execution toolkit. In Proceedings. IEEE International Conference on Web Services, 2004., pages 514–521. IEEE.
Mastroianni, C., Cozza, P., Talia, D., Kelley, I., and Taylor, I. (2009). A scalable super-peer approach for public scientific computation. Future Generation Computer Systems, 25(3):213–223.
Medeiros, J. W., Weske, M., Vossen, G., and Bauzer, C. (1996). Scientific workflow systems. NSF Workshop on Workflow and Process Automation: State-of-the-art and Future Directions.
Murata, Y., Inaba, T., Takizawa, H., and Kobayashi, H. (2008). Implementation and evaluation of a distributed and cooperative load-balancing mechanism for dependable volunteer computing. In 2008 IEEE International Conference on Dependable Systems and Networks With FTCS and DCC (DSN), pages 316–325. IEEE.
Rius, J., Estrada, S., Cores, F., and Solsona, F. (2012). Incentive mechanism for scheduling jobs in a peer-to-peer computing system. Simulation Modelling Practice and Theory, 25:36–55.
Seffino, L., Medeiros, C., Rocha, J., and Yi, B. (1999). WOODSS - A Spatial Decision Support System based on Workflows. Decision Support Systems, 27(1-2):105–123.
Wen Dou, Yan Jia, Huai Ming Wang, Wen Qiang Song, and Peng Zou (2003). A P2P approach for global computing. In Proceedings International Parallel and Distributed Processing Symposium, page 6. IEEE Comput. Soc.
Zhao, Z., Yang, F., and Xu, Y. (2009). PPVC: A P2P volunteer computing system. In 2009 2nd IEEE International Conference on Computer Science and Information Technology, pages 51–55. IEEE.
Publicado
26/07/2018
Como Citar
SANTIAGO, Caio; DIGIAMPIETRI, Luciano Antonio.
A volunteer computing system implemented with peer-to-peer communication optimized for small and limited environments. In: BRAZILIAN E-SCIENCE WORKSHOP (BRESCI), 12. , 2018, Natal.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2018
.
p. 9-16.
ISSN 2763-8774.
DOI: https://doi.org/10.5753/bresci.2018.3268.
