Transferência Neural de Estilo: homem e máquina criando o inesperado
Resumo
O presente trabalho demonstra o uso de um algoritmo de transferência neural de características de sete obras de arte diferentes, cujos estilos foram aplicados a dois produtos interativos (um jogo digital e um aplicativo educacional) que empregam elementos tridimensionais. Apesar de muitos dos atributos visuais terem sidos preservados no processo de transferência, a análise dos resultados demonstrou que parte das construções gráficas obtidas poderia ate ser classificada individualmente como estilos digitais próprios, criados através das consideradas “falhas” do algoritmo utilizado. Assim, vislumbra-se algo um tanto surpreendente: homem e máquina trabalhando de forma integrada em uma sinergia maior do que a simples soma de suas atividades específicas.
Palavras-chave:
transferência neural de estilo, redes neurais, experimentação, algoritmo, falha
Referências
R. Gaafar, “Glitch: Art & technology: Processing media matter,” NEC-SUS_European Journal of Media Studies, vol. 9, no. 2, pp. 421–433, 2020.
Y. Li, C. Fang, J. Yang, Z. Wang, X. Lu, and M.-H. Yang, “Universal style transfer via feature transforms,” in Advances in neural information processing systems, 2017, pp. 386–396.
C. Olivieri, M. Angelillo, A. Gesualdo, A. Iannuzzo, and A. Fortunato,“Parametric design of purely compressed shells,”Mechanics of Materials, vol. 155, p. 103782, 2021.
L. Wyse, “Mechanisms of artistic creativity in deep learning neural networks,”arXiv preprint arXiv:1907.00321, 2019
T. C. O. Maia, R. A. F. d. Carmo, N. A. Chicca Junior, and A. J. M. Leite Junior, “Análise da transferência neural de estilos de obras de arte aplicadas em jogos digitais,” in 2020 19th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames). IEEE, 2020.
E. Lupton and J. C. Phillips,Graphic design: The new basics. Princeton Architectural Press, 2008
A. Hurlburt, Layout: o design da página impressa. NBL Editora, 1986.
D. A. Dondis and J. L. Camargo, Sintaxe da linguagem visual. Martins fontes São Paulo, 1997.
T. Samara, Design elements: A graphic style manual. Rockport publishers, 2007
L. A. Gatys, A. S. Ecker, and M. Bethge, “Image style transfer using convolutional neural networks,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 2414–2423
R. C. Gonzalez and R. E. Woods, Processamento de imagens digitais. Editora Blucher, 2000
A. A. Efros and W. T. Freeman, “Image quilting for texture synthesisand transfer,” in Proceedings of the 28th annual conference on Computer graphics and interactive techniques, 2001, pp. 341–346.
Y. Li, M.-Y. Liu, X. Li, M.-H. Yang, and J. Kautz, “A closed-form solution to photorealistic image stylization,” in Proceedings of the European Conference on Computer Vision (ECCV), 2018, pp. 453–468
J. Johnson, A. Alahi, and L. Fei-Fei, “Perceptual losses for real-timestyle transfer and super-resolution,” in European conference on computer vision. Springer, 2016, pp. 694–711.
X. Chen, A. Golovinskiy, and T. Funkhouser, “A benchmark for 3d mesh segmentation,”Acm transactions on graphics (tog), vol. 28, no. 3, pp.1–12, 2009.
T. Shin, N. Kasuya, I. Kitahara, Y. Kameda, and Y. Ohta, “A comparison between two 3d free-view point generation methods: Player-billboard and 3d reconstruction,” in 2010 3DTV-Conference: The True Vision-Capture, Transmission and Display of 3D Video. IEEE, 2010, pp. 1–4
T.-Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Dollár, and C. L. Zitnick, “Microsoft coco: Common objects incontext,” in European conference on computer vision. Springer, 2014, pp. 740–755.
I. Pedrosa, “Da cor à cor inexistente,” in Da cor à cor inexistente. Senac São Paulo, Brasil, 1995, pp. 220–220.
Y. Li, C. Fang, J. Yang, Z. Wang, X. Lu, and M.-H. Yang, “Universal style transfer via feature transforms,” in Advances in neural information processing systems, 2017, pp. 386–396.
C. Olivieri, M. Angelillo, A. Gesualdo, A. Iannuzzo, and A. Fortunato,“Parametric design of purely compressed shells,”Mechanics of Materials, vol. 155, p. 103782, 2021.
L. Wyse, “Mechanisms of artistic creativity in deep learning neural networks,”arXiv preprint arXiv:1907.00321, 2019
T. C. O. Maia, R. A. F. d. Carmo, N. A. Chicca Junior, and A. J. M. Leite Junior, “Análise da transferência neural de estilos de obras de arte aplicadas em jogos digitais,” in 2020 19th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames). IEEE, 2020.
E. Lupton and J. C. Phillips,Graphic design: The new basics. Princeton Architectural Press, 2008
A. Hurlburt, Layout: o design da página impressa. NBL Editora, 1986.
D. A. Dondis and J. L. Camargo, Sintaxe da linguagem visual. Martins fontes São Paulo, 1997.
T. Samara, Design elements: A graphic style manual. Rockport publishers, 2007
L. A. Gatys, A. S. Ecker, and M. Bethge, “Image style transfer using convolutional neural networks,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 2414–2423
R. C. Gonzalez and R. E. Woods, Processamento de imagens digitais. Editora Blucher, 2000
A. A. Efros and W. T. Freeman, “Image quilting for texture synthesisand transfer,” in Proceedings of the 28th annual conference on Computer graphics and interactive techniques, 2001, pp. 341–346.
Y. Li, M.-Y. Liu, X. Li, M.-H. Yang, and J. Kautz, “A closed-form solution to photorealistic image stylization,” in Proceedings of the European Conference on Computer Vision (ECCV), 2018, pp. 453–468
J. Johnson, A. Alahi, and L. Fei-Fei, “Perceptual losses for real-timestyle transfer and super-resolution,” in European conference on computer vision. Springer, 2016, pp. 694–711.
X. Chen, A. Golovinskiy, and T. Funkhouser, “A benchmark for 3d mesh segmentation,”Acm transactions on graphics (tog), vol. 28, no. 3, pp.1–12, 2009.
T. Shin, N. Kasuya, I. Kitahara, Y. Kameda, and Y. Ohta, “A comparison between two 3d free-view point generation methods: Player-billboard and 3d reconstruction,” in 2010 3DTV-Conference: The True Vision-Capture, Transmission and Display of 3D Video. IEEE, 2010, pp. 1–4
T.-Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Dollár, and C. L. Zitnick, “Microsoft coco: Common objects incontext,” in European conference on computer vision. Springer, 2014, pp. 740–755.
I. Pedrosa, “Da cor à cor inexistente,” in Da cor à cor inexistente. Senac São Paulo, Brasil, 1995, pp. 220–220.
Publicado
18/10/2021
Como Citar
MAIA, Tiago Caúla de Oliveira; DO CARMO, Rafael Augusto Ferreira; GOMES, George Allan Menezes; CHICCA JUNIOR, Natal Anacleto; LEITE JÚNIOR, Antônio José Melo.
Transferência Neural de Estilo: homem e máquina criando o inesperado. In: TRILHA DE ARTES & DESIGN – ARTIGOS COMPLETOS - SIMPÓSIO BRASILEIRO DE JOGOS E ENTRETENIMENTO DIGITAL (SBGAMES), 20. , 2021, Online.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2021
.
p. 245-254.
DOI: https://doi.org/10.5753/sbgames_estendido.2021.19645.
