Simulação de Redes Neuronais em Ambientes Heterogêneos e Paralelos
Resumo
Um dos maiores problemas na simulação de redes neuronais é o custo computacional associado à execução desses algoritmos. A paralelização dessas simulações tem sido uma solução bastante adotada para contornar esse problema, muito em virtude do inerente paralelismo das redes neuronais. Arquiteturas paralelas do tipo SIMD e MIMD são frequentemente utilizadas, de forma isolada, para essa finalidade. Esse trabalho investiga a adequação e as restrições de utilização de heterogeneidade e paralelismo conjugando arquiteturas SIMD e MIMD para a simulação de redes neuronais. Essa estratégia se mostrou boa, entretanto sua eficiência é extremamente dependente das dimensões da rede a ser simulada e do ambiente computacional utilizado.
Referências
Barbosa, V. C. and Lima, P. M. V. (1990). On the distribuited parallel simulation of hopfield's neural networks. Software - Pratice and Experience, 20(10):967 - 983.
Chu, L. C. and Wah, B. W. (1992). Optimal mapping of neural-network learning on message-passing multicomputers. Journal of Parallel and Distibuited Computing, (14):319 - 339.
D. E. Rumelhart, G. E. H. and Williams, R. J. (1986). Parallel Distributed Processing: Explorations in the Microstructure of Cognition, volume 1. MIT Press, Cambridge, MA.
Feldman, J. A., Fanty, M. A., Goddard, N. H., and Lynne, K. J. (1988). Computing with structured connectionist networks. Communications of the ACM, 31(2):170 -187.
Forrest, B. M., Roweth, D., Stroud, N., Wallace, D. J., and Wilson, G. (1987). Implementing neural network models on parallel computers. The Computer Journal, 30(5):413 - 419.
Fortuna, L., G.Muscato, G.Nunnari, and Sicurella, G. (1990). A transputer-based multilayer perceptron network simulator.
Geist, A., Benguelim, A., Dongarra, J., Jiang, W., Manchek, R., and Sunderam, V. (1993). PVM 9.0 User's Guide and Reference Manual. Oak Ridge National Laboratory.
Ghosh, J. and Hwang, K. (1989). Mapping neural networks onto message-passing multicomputers. Journal of Parallel and Distributed Computing, (6):291 - 330.
Hecht-Nielsen, R. (1988). Applications of counterpropagation neural networks. Neural Networks, (1):131-140.
Heileman, G. L., Georgiopoulos, M., and Roome, W. D. (1992). A general framework fo concurrent simulation of neural network models. IEEE Transactions on Software Engineering, 18(7):551 - 562.
M. H. Garzon, S. P. Franklin, W. B. W. S. B. J. and Dickerson, D. (1992). Design and testing of a general-purpouse neurocomputer. Journal of Paralel and Distributed Computing, (14):203 - 220.
Meira Jr, W. (1993). Implementação de redes neuronais em ambientes paralelos. Master's thesis, Departamento de Ciência da Computação - UFMG, Belo Horizonte, MG.
Meira Jr., W. and Carvalho, M. L. B. (1992). SIRNEM: A Parallel Neural Network Simulation System. In XVIII Conferencia Latinoamericana de Informatica, pages 757 - 761. Centro Latinoamericano de Estudios em Informatica CLEI.
Murre, J. M. J. (1993). Transputers and neural networks: An analysis of implementation constraints and performance. IEEE Transactions on Neural Networks, 4(2):284 - 292.
Nordström, T. and Svensson, B. (1992). Using and designing massively parallel computers for artificial neural networks. Journal of Parallel and Distributed Computing, (14):260 - 285.
Perez, M. J. (1990). Simulação paralela de redes neurais numa rede de transputers. Manuscrito.
Salles, J., Vieira, M., Meira Jr., W., and Carvalho, M. L. B. (1992). Implementação de redes neuronais em máquinas simd (Implementation of Neural Networks in SIMD Machines). In IV Simpósio Brasileiro de Arquiteturas de Computadores e Processamento de Alto Desempenho, pages 347 - 361.
Simpson, P. K. (1990). Artificial Neural Systems - Foundations, Paradigms, Applications and Implementations. Neural Networks: Research and Applications. Pergamon Press, Ist edition edition.
Tollenaere, T. and Orban, G. A. (1991). Simulating modular neural networks on message-passing multiprocessors, Parallel Computing, 17(17):361-379.
W. M. Lin, V. K. P. and Przytula, K. W. (1991). Algorithmic mapping of neural network models onto parallel simd machines. IEEE Transactions on Computers, 40(12):1390 - 1401.
Zurada, J. M. (1992). Introduction to Artificial Neural Systems. St Paul, USA.
Chu, L. C. and Wah, B. W. (1992). Optimal mapping of neural-network learning on message-passing multicomputers. Journal of Parallel and Distibuited Computing, (14):319 - 339.
D. E. Rumelhart, G. E. H. and Williams, R. J. (1986). Parallel Distributed Processing: Explorations in the Microstructure of Cognition, volume 1. MIT Press, Cambridge, MA.
Feldman, J. A., Fanty, M. A., Goddard, N. H., and Lynne, K. J. (1988). Computing with structured connectionist networks. Communications of the ACM, 31(2):170 -187.
Forrest, B. M., Roweth, D., Stroud, N., Wallace, D. J., and Wilson, G. (1987). Implementing neural network models on parallel computers. The Computer Journal, 30(5):413 - 419.
Fortuna, L., G.Muscato, G.Nunnari, and Sicurella, G. (1990). A transputer-based multilayer perceptron network simulator.
Geist, A., Benguelim, A., Dongarra, J., Jiang, W., Manchek, R., and Sunderam, V. (1993). PVM 9.0 User's Guide and Reference Manual. Oak Ridge National Laboratory.
Ghosh, J. and Hwang, K. (1989). Mapping neural networks onto message-passing multicomputers. Journal of Parallel and Distributed Computing, (6):291 - 330.
Hecht-Nielsen, R. (1988). Applications of counterpropagation neural networks. Neural Networks, (1):131-140.
Heileman, G. L., Georgiopoulos, M., and Roome, W. D. (1992). A general framework fo concurrent simulation of neural network models. IEEE Transactions on Software Engineering, 18(7):551 - 562.
M. H. Garzon, S. P. Franklin, W. B. W. S. B. J. and Dickerson, D. (1992). Design and testing of a general-purpouse neurocomputer. Journal of Paralel and Distributed Computing, (14):203 - 220.
Meira Jr, W. (1993). Implementação de redes neuronais em ambientes paralelos. Master's thesis, Departamento de Ciência da Computação - UFMG, Belo Horizonte, MG.
Meira Jr., W. and Carvalho, M. L. B. (1992). SIRNEM: A Parallel Neural Network Simulation System. In XVIII Conferencia Latinoamericana de Informatica, pages 757 - 761. Centro Latinoamericano de Estudios em Informatica CLEI.
Murre, J. M. J. (1993). Transputers and neural networks: An analysis of implementation constraints and performance. IEEE Transactions on Neural Networks, 4(2):284 - 292.
Nordström, T. and Svensson, B. (1992). Using and designing massively parallel computers for artificial neural networks. Journal of Parallel and Distributed Computing, (14):260 - 285.
Perez, M. J. (1990). Simulação paralela de redes neurais numa rede de transputers. Manuscrito.
Salles, J., Vieira, M., Meira Jr., W., and Carvalho, M. L. B. (1992). Implementação de redes neuronais em máquinas simd (Implementation of Neural Networks in SIMD Machines). In IV Simpósio Brasileiro de Arquiteturas de Computadores e Processamento de Alto Desempenho, pages 347 - 361.
Simpson, P. K. (1990). Artificial Neural Systems - Foundations, Paradigms, Applications and Implementations. Neural Networks: Research and Applications. Pergamon Press, Ist edition edition.
Tollenaere, T. and Orban, G. A. (1991). Simulating modular neural networks on message-passing multiprocessors, Parallel Computing, 17(17):361-379.
W. M. Lin, V. K. P. and Przytula, K. W. (1991). Algorithmic mapping of neural network models onto parallel simd machines. IEEE Transactions on Computers, 40(12):1390 - 1401.
Zurada, J. M. (1992). Introduction to Artificial Neural Systems. St Paul, USA.
Publicado
07/09/1993
Como Citar
MEIRA JÚNIOR, Wagner; CARVAHO, Márcio Luiz Bunte de.
Simulação de Redes Neuronais em Ambientes Heterogêneos e Paralelos. In: INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE AND HIGH PERFORMANCE COMPUTING (SBAC-PAD), 5. , 1993, Florianópolis/SC.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
1993
.
p. 217-231.
DOI: https://doi.org/10.5753/sbac-pad.1993.23034.
