AGCRN-CR Method for Automatic Neural Network Search
Abstract
This paper describes an automatic search method, CGANN-DC (Cellular Genetic Algorithm + Neural Networks - Direct enCod), for Artificial Neural Networks (ANNs) using Cellular Genetic Algorithms (CGAs). The main difference between CGAs and Genetic Algorithms (GAs) is the use of a cellular automaton (CA) capable of providing the location for individuals, reducing the possibility of local minima in search space. The CGANN-DC performs evolutionary searches for initial weights, transfer functions, architectures and learning rules. Experimental results have shown that the CGANN-DC can find compact networks with a satisfactory generalization power.References
A. Abraham, (2004) “Meta learning evolutionary artificial neural networks”. In Neurocomputing, no. 56, pp. 1-38.
D. J. Newman, S. Hettich, C.L. Blake, and C.J. Merz, (1998) “UCI repository of machine learning databases” [Online]. Available: [link]
D. Simoncini, P. Collard, S. Verel, M. Clergue, (2007) “On the influence of selection operators on performances in cellular genetic algorithm.” In CEC — 2007, pp.4706-4713.
E. Alba, B. Dorronsoro, (2008) “Cellular Genetic Algorithms”, In Operations Research Computer Science Interfaces Series, Vol. 42. ISBN — 978-0-387-77609-5
E. Alba, and J. M. Troya, (2002) “Improving flexibility and efficiency by adding parallelism to genetic algorithms.” In Statistics and Computing, pages 91-114
H. Rajabalipour, H. Haron, M. I. Jambak, (2009) “The Improved Genetic Algorithm for Assignment Problems”, In ICSPS, pp. 187 - 191.
L. M. Almeida, (2007) “Uma metodologia de busca por redes neurais artificiais quase-ótimas.” Dissertação de mestrado — CIn - Centro de Informatica - UFPE.
L. M. Almeida and T. B. Ludermir (2007) “Automatically searching nearoptimal artificial neural networks.” In ESANN. pp. 549-554.
N. Garcia-Pedrajas, C. Hervas-Martinez, and D. Ortiz-Boyer, (2005) “Cooperative coevolution of artificial neural network ensembles for pattern classification” In IEEE Trans. Evolut. Computation, Vol. 9, no. 3, pp. 271-302.
R. Linden, (2006), “Algoritmos genéticos - Uma importante ferramenta da inteligência computacional”, Rio de Janeiro. Brasport, 1º edição
S. Wright, (1943) “Isolation by distance.” In Genetics, 28, pp. 114-138
S. Wolfram, (2002) “A New Kind of Science”, Wolfram Media, ISBN 1-57955-008-8
X. Yao, (1999) “Evolving artificial neural networks.” In Proceedings of the IEEE, 87(9): pp. 1423-1447.
Y. J. Cao, H. Q. Wu, (1998) “A Cellular Automata Based Genetic Algorithm and its Application in Machine Design Optimization.” In JCC, pages 1593 — 1598.
D. J. Newman, S. Hettich, C.L. Blake, and C.J. Merz, (1998) “UCI repository of machine learning databases” [Online]. Available: [link]
D. Simoncini, P. Collard, S. Verel, M. Clergue, (2007) “On the influence of selection operators on performances in cellular genetic algorithm.” In CEC — 2007, pp.4706-4713.
E. Alba, B. Dorronsoro, (2008) “Cellular Genetic Algorithms”, In Operations Research Computer Science Interfaces Series, Vol. 42. ISBN — 978-0-387-77609-5
E. Alba, and J. M. Troya, (2002) “Improving flexibility and efficiency by adding parallelism to genetic algorithms.” In Statistics and Computing, pages 91-114
H. Rajabalipour, H. Haron, M. I. Jambak, (2009) “The Improved Genetic Algorithm for Assignment Problems”, In ICSPS, pp. 187 - 191.
L. M. Almeida, (2007) “Uma metodologia de busca por redes neurais artificiais quase-ótimas.” Dissertação de mestrado — CIn - Centro de Informatica - UFPE.
L. M. Almeida and T. B. Ludermir (2007) “Automatically searching nearoptimal artificial neural networks.” In ESANN. pp. 549-554.
N. Garcia-Pedrajas, C. Hervas-Martinez, and D. Ortiz-Boyer, (2005) “Cooperative coevolution of artificial neural network ensembles for pattern classification” In IEEE Trans. Evolut. Computation, Vol. 9, no. 3, pp. 271-302.
R. Linden, (2006), “Algoritmos genéticos - Uma importante ferramenta da inteligência computacional”, Rio de Janeiro. Brasport, 1º edição
S. Wright, (1943) “Isolation by distance.” In Genetics, 28, pp. 114-138
S. Wolfram, (2002) “A New Kind of Science”, Wolfram Media, ISBN 1-57955-008-8
X. Yao, (1999) “Evolving artificial neural networks.” In Proceedings of the IEEE, 87(9): pp. 1423-1447.
Y. J. Cao, H. Q. Wu, (1998) “A Cellular Automata Based Genetic Algorithm and its Application in Machine Design Optimization.” In JCC, pages 1593 — 1598.
Published
2011-07-19
How to Cite
SILVA, Anderson Paulo da; LUDERMIR, Teresa B.; ALMEIDA, Leandro M..
AGCRN-CR Method for Automatic Neural Network Search. In: NATIONAL MEETING ON ARTIFICIAL AND COMPUTATIONAL INTELLIGENCE (ENIAC), 8. , 2011, Natal/RN.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2011
.
p. 843-854.
ISSN 2763-9061.
