Simulação de Redes Neuronais em Ambientes Heterogêneos e Paralelos
Abstract
One of the greatest problems simulating neural networks is its high computational cost. The parallelization of these simulations has frequently been used to minimize this problem, mainly because the neural networks intrinsics parallelism. To achieve this goal, parallel architectures such SIMD and MIMD are used isolated. This work studies the suitability and the restrictions of utilization of heterogeneity based upon SIMD and MIMD architectures to implement neural networks. As it will be presented in this work, this strategy presents a good performance in spite of being dependent of the dimension of the simulated network and the architecture used.
References
Barbosa, V. C. and Lima, P. M. V. (1990). On the distribuited parallel simulation of hopfield's neural networks. Software - Pratice and Experience, 20(10):967 - 983.
Chu, L. C. and Wah, B. W. (1992). Optimal mapping of neural-network learning on message-passing multicomputers. Journal of Parallel and Distibuited Computing, (14):319 - 339.
D. E. Rumelhart, G. E. H. and Williams, R. J. (1986). Parallel Distributed Processing: Explorations in the Microstructure of Cognition, volume 1. MIT Press, Cambridge, MA.
Feldman, J. A., Fanty, M. A., Goddard, N. H., and Lynne, K. J. (1988). Computing with structured connectionist networks. Communications of the ACM, 31(2):170 -187.
Forrest, B. M., Roweth, D., Stroud, N., Wallace, D. J., and Wilson, G. (1987). Implementing neural network models on parallel computers. The Computer Journal, 30(5):413 - 419.
Fortuna, L., G.Muscato, G.Nunnari, and Sicurella, G. (1990). A transputer-based multilayer perceptron network simulator.
Geist, A., Benguelim, A., Dongarra, J., Jiang, W., Manchek, R., and Sunderam, V. (1993). PVM 9.0 User's Guide and Reference Manual. Oak Ridge National Laboratory.
Ghosh, J. and Hwang, K. (1989). Mapping neural networks onto message-passing multicomputers. Journal of Parallel and Distributed Computing, (6):291 - 330.
Hecht-Nielsen, R. (1988). Applications of counterpropagation neural networks. Neural Networks, (1):131-140.
Heileman, G. L., Georgiopoulos, M., and Roome, W. D. (1992). A general framework fo concurrent simulation of neural network models. IEEE Transactions on Software Engineering, 18(7):551 - 562.
M. H. Garzon, S. P. Franklin, W. B. W. S. B. J. and Dickerson, D. (1992). Design and testing of a general-purpouse neurocomputer. Journal of Paralel and Distributed Computing, (14):203 - 220.
Meira Jr, W. (1993). Implementação de redes neuronais em ambientes paralelos. Master's thesis, Departamento de Ciência da Computação - UFMG, Belo Horizonte, MG.
Meira Jr., W. and Carvalho, M. L. B. (1992). SIRNEM: A Parallel Neural Network Simulation System. In XVIII Conferencia Latinoamericana de Informatica, pages 757 - 761. Centro Latinoamericano de Estudios em Informatica CLEI.
Murre, J. M. J. (1993). Transputers and neural networks: An analysis of implementation constraints and performance. IEEE Transactions on Neural Networks, 4(2):284 - 292.
Nordström, T. and Svensson, B. (1992). Using and designing massively parallel computers for artificial neural networks. Journal of Parallel and Distributed Computing, (14):260 - 285.
Perez, M. J. (1990). Simulação paralela de redes neurais numa rede de transputers. Manuscrito.
Salles, J., Vieira, M., Meira Jr., W., and Carvalho, M. L. B. (1992). Implementação de redes neuronais em máquinas simd (Implementation of Neural Networks in SIMD Machines). In IV Simpósio Brasileiro de Arquiteturas de Computadores e Processamento de Alto Desempenho, pages 347 - 361.
Simpson, P. K. (1990). Artificial Neural Systems - Foundations, Paradigms, Applications and Implementations. Neural Networks: Research and Applications. Pergamon Press, Ist edition edition.
Tollenaere, T. and Orban, G. A. (1991). Simulating modular neural networks on message-passing multiprocessors, Parallel Computing, 17(17):361-379.
W. M. Lin, V. K. P. and Przytula, K. W. (1991). Algorithmic mapping of neural network models onto parallel simd machines. IEEE Transactions on Computers, 40(12):1390 - 1401.
Zurada, J. M. (1992). Introduction to Artificial Neural Systems. St Paul, USA.
Chu, L. C. and Wah, B. W. (1992). Optimal mapping of neural-network learning on message-passing multicomputers. Journal of Parallel and Distibuited Computing, (14):319 - 339.
D. E. Rumelhart, G. E. H. and Williams, R. J. (1986). Parallel Distributed Processing: Explorations in the Microstructure of Cognition, volume 1. MIT Press, Cambridge, MA.
Feldman, J. A., Fanty, M. A., Goddard, N. H., and Lynne, K. J. (1988). Computing with structured connectionist networks. Communications of the ACM, 31(2):170 -187.
Forrest, B. M., Roweth, D., Stroud, N., Wallace, D. J., and Wilson, G. (1987). Implementing neural network models on parallel computers. The Computer Journal, 30(5):413 - 419.
Fortuna, L., G.Muscato, G.Nunnari, and Sicurella, G. (1990). A transputer-based multilayer perceptron network simulator.
Geist, A., Benguelim, A., Dongarra, J., Jiang, W., Manchek, R., and Sunderam, V. (1993). PVM 9.0 User's Guide and Reference Manual. Oak Ridge National Laboratory.
Ghosh, J. and Hwang, K. (1989). Mapping neural networks onto message-passing multicomputers. Journal of Parallel and Distributed Computing, (6):291 - 330.
Hecht-Nielsen, R. (1988). Applications of counterpropagation neural networks. Neural Networks, (1):131-140.
Heileman, G. L., Georgiopoulos, M., and Roome, W. D. (1992). A general framework fo concurrent simulation of neural network models. IEEE Transactions on Software Engineering, 18(7):551 - 562.
M. H. Garzon, S. P. Franklin, W. B. W. S. B. J. and Dickerson, D. (1992). Design and testing of a general-purpouse neurocomputer. Journal of Paralel and Distributed Computing, (14):203 - 220.
Meira Jr, W. (1993). Implementação de redes neuronais em ambientes paralelos. Master's thesis, Departamento de Ciência da Computação - UFMG, Belo Horizonte, MG.
Meira Jr., W. and Carvalho, M. L. B. (1992). SIRNEM: A Parallel Neural Network Simulation System. In XVIII Conferencia Latinoamericana de Informatica, pages 757 - 761. Centro Latinoamericano de Estudios em Informatica CLEI.
Murre, J. M. J. (1993). Transputers and neural networks: An analysis of implementation constraints and performance. IEEE Transactions on Neural Networks, 4(2):284 - 292.
Nordström, T. and Svensson, B. (1992). Using and designing massively parallel computers for artificial neural networks. Journal of Parallel and Distributed Computing, (14):260 - 285.
Perez, M. J. (1990). Simulação paralela de redes neurais numa rede de transputers. Manuscrito.
Salles, J., Vieira, M., Meira Jr., W., and Carvalho, M. L. B. (1992). Implementação de redes neuronais em máquinas simd (Implementation of Neural Networks in SIMD Machines). In IV Simpósio Brasileiro de Arquiteturas de Computadores e Processamento de Alto Desempenho, pages 347 - 361.
Simpson, P. K. (1990). Artificial Neural Systems - Foundations, Paradigms, Applications and Implementations. Neural Networks: Research and Applications. Pergamon Press, Ist edition edition.
Tollenaere, T. and Orban, G. A. (1991). Simulating modular neural networks on message-passing multiprocessors, Parallel Computing, 17(17):361-379.
W. M. Lin, V. K. P. and Przytula, K. W. (1991). Algorithmic mapping of neural network models onto parallel simd machines. IEEE Transactions on Computers, 40(12):1390 - 1401.
Zurada, J. M. (1992). Introduction to Artificial Neural Systems. St Paul, USA.
Published
1993-09-07
How to Cite
MEIRA JÚNIOR, Wagner; CARVAHO, Márcio Luiz Bunte de.
Simulação de Redes Neuronais em Ambientes Heterogêneos e Paralelos. In: INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE AND HIGH PERFORMANCE COMPUTING (SBAC-PAD), 5. , 1993, Florianópolis/SC.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
1993
.
p. 217-231.
DOI: https://doi.org/10.5753/sbac-pad.1993.23034.
