Systematic Mapping Study on the Use of Generative Artificial Intelligence in Non-Interactive Audiovisual: Applications, Challenges, and Impacts

  • Guilherme de Queiroz Lima Roth UFPR
  • Rafael de Andrade Pereira UFPR
  • Natasha Malveira Costa Valentim UFPR

Resumo


Generative Artificial Intelligence (GAI) has transformed noninteractive audiovisual production, impacting creative workflows and media generation. This study maps the scientific literature on GAI in audiovisual production (2022-2025), identifying applications, challenges, and impacts. A Systematic Mapping Study was conducted using IEEE Xplore and ACM Digital Library, following PICOC and established SMS guidelines. The results highlight dominant technologies, application areas, evaluation practices, and ethical concerns, as well as methodological gaps and future research directions.

Palavras-chave: Generative Artificial Intelligence, Non-interactive Audiovisual Production, Systematic Mapping Study

Referências

Govind A, Ahad Anzar, Aiswarya Anil Nair, and Rohith Syam. 2024. GenAI Empowered Script to Storyboard Generator. In 2024 IEEE International Conference on Future Machine Learning and Data Science (FMLDS). 451–456. DOI: 10.1109/FMLDS63805.2024.00085

Victor R Basili and H Dieter Rombach. 1988. The TAME project: Towards improvement-oriented software environments. IEEE Transactions on Software Engineering 14, 6 (1988), 758–773. DOI: 10.1109/32.6156

Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020. Language Models are Few-Shot Learners. arXiv preprint arXiv:2005.14165 (2020). DOI: 10.48550/arXiv.2005.14165

Thiago Prado de Campos, Eduardo Filgueiras Damasceno, and Natasha Malveira Costa Valentim. 2022. Porifera: A Collaborative Tool to Support Systematic Literature Review and Systematic Mapping Study. In Proceedings of the XXXVI Brazilian Symposium on Software Engineering. ACM, New York, NY, USA, 452–457. DOI: 10.1145/3555228.3555273

Valerio Capraro, Austin Lentsch, Daron Acemoglu, Selin Akgun, Aisel Akhmedova, Ennio Bilancini, Jean-Francois Bonnefon, Pablo Branas-Garza, Luigi Butera, Karen M. Douglas, et al. 2024. The impact of generative artificial intelligence on socioeconomic inequalities and policy making. PNAS Nexus 3, 6 (2024), pgae191. DOI: 10.1093/pnasnexus/pgae191

Qi Chen, Mingkui Tan, Yuankai Qi, Jiaqiu Zhou, Yuanqing Li, and Qi Wu. 2022. V2C: Visual Voice Cloning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 21210–21219. DOI: 10.1109/CVPR52688.2022.02056

Yongkang Cheng, Mingjiang Liang, Shaoli Huang, Gaoge Han, Jifeng Ning, and Wei Liu. 2025. Conditional GAN for Enhancing Diffusion Models in Efficient and Authentic Global Gesture Generation from Audios. In 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). 2164–2173. DOI: 10.1109/WACV61041.2025.00217

Michel Chion. 2019. Audio-Vision: Sound on Screen (2nd ed.). Columbia University Press, New York. DOI: 10.7312/chio18588

Prafulla Dhariwal and Alex Nichol. 2021. Diffusion Models Beat GANs on Image Synthesis. arXiv preprint arXiv:2105.05233 (2021). DOI: 10.48550/arXiv.2105.05233

Yogesh K. Dwivedi, Nir Kshetri, Laurie O. Hughes, Emma Louise Slade, Anand Jeyaraj, Arpan Kumar Kar, Abdullah M. Baabdullah, Alex Koohang, Vishnupriya Raghavan, Manju Ahuja, Hanaa Albanna, Mousa Ahmad Albashrawi, Adil S. Al-Busaidi, Janarthanan Balakrishnan, Yves Barlette, Somprakas Basu, Indranil Bose, Laurence Brooks, Dimitrios Buhalis, Lemuria Carter, Rahul De, Yanqing Duan, Denis Dennehy, Rameshwar Dubey, Rohita Dwivedi, John S. Edwards, Carlos Flavian, et al. 2023. Opinion Paper: “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management 71 (2023), 102642. DOI: 10.1016/j.ijinfomgt.2023.102642

Farshad Einabadi, Jean-Yves Guillemaut, and Adrian Hilton. 2021. Deep Neural Models for Illumination Estimation and Relighting: A Survey. Computer Graphics Forum 40, 6 (2021), 315–331. DOI: 10.1111/cgf.14283

Oscar Estrada Torrejon, Nicholas Peretti, and Ricardo Figueroa. 2020. Rotoscope Automation with Deep Learning. SMPTE Motion Imaging Journal 129, 2 (2020), 16–26. DOI: 10.5594/JMI.2019.2959967

Joseph L. Fleiss. 1971. Measuring nominal scale agreement among many raters. Psychological Bulletin 76, 5 (1971), 378–382. DOI: 10.1037/h0031619

Luciano Floridi and Massimo Chiriatti. 2020. GPT-3: Its Nature, Scope, Limits, and Consequences. Minds and Machines 30, 4 (2020), 681–694. DOI: 10.1007/s11023-020-09548-1

Erick Giovanni Franco Lazarte, María Trinidad Juárez Paccotaipe, Rosa Candelaria Ramirez Heredia, and Teresa Marlene Vela Loyola. 2025. Audiovisual Narrative in the Age of Artificial Intelligence: Advances, Trends and Challenges: A Systematic Review. Journal of Educational and Social Research 15, 1 (2025), 1. DOI: 10.36941/jesr-2025-0001

Jorge Franganillo. 2022. Contenido generado por inteligencia artificial: oportunidades y amenazas. Anuario ThinkEPI 16 (2022). DOI: 10.3145/thinkepi.2022.e16a24

Leonardo Gambacorta, Tullio Jappelli, and Tommaso Oliviero. 2025. Exploring Household Adoption and Usage of Generative AI: New Evidence from Italy. BIS Working Paper 1298. Bank for International Settlements. [link]

Iryna Gavran, Serhii Honcharuk, Volodymyr Mykhalov, Kateryna Stepanenko, and Nataliia Tsimokh. 2025. The Impact of Artificial Intelligence on the Production and Editing of Audiovisual Content. PDT&C 54, 3 (July 2025), 223–235. DOI: 10.1515/pdtc-2025-0022

Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative Adversarial Nets. In Advances in Neural Information Processing Systems, Vol. 27. 2672–2680. DOI: 10.48550/arXiv.1406.2661

Grand View Research. 2025. Generative AI Market Size And Share | Industry Report, 2030. Industry Report, Grand View Research. [link] Accessed November 2025.

Paolo Grigis and Antonella De Angeli. 2024. Playwriting with Large Language Models: Perceived Features, Interaction Strategies and Outcomes. In Proceedings of the 2024 International Conference on Advanced Visual Interfaces (AVI). 1–9. DOI: 10.1145/3656650.3656688

Satoshi Iizuka and Edgar Simo-Serra. 2019. DeepRemaster: Temporal Source-Reference Attention Networks for Comprehensive Video Enhancement. ACM Transactions on Graphics 38, 6 (2019), 1–13. DOI: 10.1145/3355089.3356570

Dhiraj Jadhav, Sakshee Agrawal, Sakshi Jagdale, Pranav Salunkhe, and Raj Salunkhe. 2024. AI-Driven Text-to-Multimedia Content Generation: Enhancing Modern Content Creation. In 2024 8th International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC). 1610–1615. DOI: 10.1109/I-SMAC61858.2024.10714771

Roy Kapon, Guy Tevet, Daniel Cohen-Or, and Amit H. Bermano. 2024. MAS: Multi-view Ancestral Sampling for 3D Motion Generation Using 2D Diffusion. In 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 1965–1974. DOI: 10.1109/CVPR52733.2024.00192

Tero Karras, Samuli Laine, Miika Aittala, Janne Hellsten, Jaakko Lehtinen, and Timo Aila. 2020. Analyzing and Improving the Image Quality of StyleGAN. arXiv preprint arXiv:1912.04958 (2020). DOI: 10.48550/arXiv.1912.04958

Barbara Kitchenham and Shari Charters. 2007. Guidelines for Performing Systematic Literature Reviews in Software Engineering. Technical Report TR/SE-0401. Keele University and Empirical Software Engineering, National ICT Australia Ltd., Keele, UK and Sydney, Australia. [link] Joint Technical Report.

J Richard Landis and Gary G Koch. 1977. The measurement of observer agreement for categorical data. Biometrics 33, 1 (1977), 159–174. DOI: 10.2307/2529310

Yunxin Li, Haoyuan Shi, Baotian Hu, Longyue Wang, Jiashun Zhu, Jinyi Xu, Zhen Zhao, and Min Zhang. 2024. Anim-Director: A Large Multimodal Model Powered Agent for Controllable Animation Video Generation. In SIGGRAPH Asia 2024 Conference Papers. 1–11. DOI: 10.1145/3680528.3687688

Tingting Liao, Hongwei Yi, Yuliang Xiu, Jiaxiang Tang, Yangyi Huang, Justus Thies, and Michael J. Black. 2024. TADA! Text to Animatable Digital Avatars. In 2024 International Conference on 3D Vision (3DV). 1508–1519. DOI: 10.1109/3DV62453.2024.00150

Chang Liu, Haoning Wu, Yujie Zhong, Xiaoyun Zhang, Yanfeng Wang, and Weidi Xie. 2024. Intelligent Grimm - Openended Visual Storytelling via Latent Diffusion Models. In 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 6190–6200. DOI: 10.1109/CVPR52733.2024.00592

Jiaxi Lv, Yi Huang, Mingfu Yan, Jiancheng Huang, Jianzhuang Liu, Yifan Liu, Yafei Wen, Xiaoxin Chen, and Shifeng Chen. 2024. GPT4Motion: Scripting Physical Motions in Text-to-Video Generation via Blender-Oriented GPT Planning. In 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). 1430–1440. DOI: 10.1109/CVPRW63382.2024.00150

Luisa Martins, Stênio Ferreira, and Tiago Maritan. 2025. Automatic 3D animation generation for Sign Language: A case study of Sign Language Machine Translation. In Proceedings of the 31st Brazilian Symposium on Multimedia and the Web (WebMedia). Sociedade Brasileira de Computação, Rio de Janeiro, Brazil, 67–76. DOI: 10.5753/webmedia.2025.16135

Cihan Orak and Zeynep Turan. 2024. Using artificial intelligence in digital video production: A systematic review study. Journal of Educational Technology & Online Learning 7, 3 (Sept. 2024), 286–307. DOI: 10.31681/jetol.1459434

Matthew J. Page, Joanne E. McKenzie, Patrick M. Bossuyt, Isabelle Boutron, Tammy C. Hoffmann, Cynthia D. Mulrow, et al. 2021. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ 372 (2021), n71. DOI: 10.1136/bmj.n71

Kai Petersen, Robert Feldt, Shahid Mujtaba, and Michael Mattsson. 2008. Systematic Mapping Studies in Software Engineering. In 12th International Conference on Evaluation and Assessment in Software Engineering (EASE). 68–77. DOI: 10.14236/ewic/EASE2008.8

Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Bjorn Ommer. 2022. High-Resolution Image Synthesis with Latent Diffusion Models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). DOI: 10.48550/arXiv.2112.10752

Stuart J. Russell and Peter Norvig. 2016. Artificial Intelligence: A Modern Approach (3rd ed.). Pearson Education, Upper Saddle River, NJ. [link]

Simone de Oliveira Santos, Robson de Moraes Alves, Francisco Carlos de Mattos Brito Oliveira, and Francisco Ivanilso Soares Araujo. 2025. Investigating LLM-based tools to support Usability, Accessibility, User Experience in HCI activities: A Systematic Literature Mapping. In Proceedings of the 31st Brazilian Symposium on Multimedia and the Web (WebMedia). Sociedade Brasileira de Computação, Rio de Janeiro, Brazil, 631–645. DOI: 10.5753/webmedia.2025.16160

Ming Shen, Gang Huang, Yuxuan Wu, Shuyi Song, Sheng Zhou, Liangcheng Li, Zhi Yu, Wei Wang, and Jiajun Bu. 2024. Making Accessible Movies Easily: An Intelligent Tool for Authoring and Integrating Audio Descriptions to Movies. In Proceedings of the 21st International Web for All Conference (W4A ’24). 160–164. DOI: 10.1145/3677846.3677855

Junrong Song and David Yip. 2023. Exploring the Intersection of AI Art and Film: A Case Study of Giant. In 2023 IEEE International Conference on Multimedia and Expo Workshops (ICMEW). 347–352. DOI: 10.1109/ICMEW59549.2023.00066

Aniruddha Tiwari, Rushit Dave, and Mounika Vanamala. 2023. Leveraging Deep Learning Approaches for Deepfake Detection: A Review. arXiv preprint (April 2023). arXiv:2304.01908 [cs.LG]

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention Is All You Need. In Advances in Neural Information Processing Systems. DOI: 10.48550/arXiv.1706.03762

Dan Valeriu Voinea. 2025. The Algorithmic Auteur: AI, Cultural Production, and the Reconfiguration of Audiovisual Media. Social Sciences and Education Research Review 12, 1 (July 2025), 256–268. DOI: 10.5281/zenodo.15804554

Sitong Wang, Samia Menon, Tao Long, Keren Henderson, Dingzeyu Li, Kevin Crowston, Mark Hansen, Jeffrey V Nickerson, and Lydia B Chilton. 2024. ReelFramer: Human-AI Co-Creation for News-to-Video Translation. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems. 1–20. DOI: 10.1145/3613904.3642868

Christoph Johannes Weber, Sebastian Burgkart, and Sylvia Rothe. 2024. wr-AI-ter: Enhancing Ownership Perception in AI-Driven Script Writing. In Proceedings of the 2024 ACM International Conference on Interactive Media Experiences (IMX ’24). 145–156. DOI: 10.1145/3639701.3656325

Roel J. Wieringa, Neil A. M. Maiden, Nancy R. Mead, and Colette Rolland. 2006. Requirements engineering paper classification and evaluation criteria: a proposal and a discussion. Requirements Engineering 11, 1 (2006), 102–107. DOI: 10.1007/s00766-005-0021-6

Weimei Wu, Jianhua Hu, Yingjie Huang, Wenying Zeng, and Hui Shao. 2024. Intelligent Teaching Platform Based on Large Models. In Proceedings of the 2024 International Symposium on Artificial Intelligence for Education. 409–415. DOI: 10.1145/3700297.3700367

Zhiyu Yin, Kehai Chen, Xuefeng Bai, Ruili Jiang, Juntao Li, Hongdong Li, Jin Liu, Yang Xiang, Jun Yu, and Min Zhang. 2025. A Survey: Spatiotemporal Consistency in Video Generation. arXiv preprint arXiv:2502.17863 (2025). DOI: 10.48550/arXiv.2502.17863

Jingbo Zhang, Xiaoyu Li, Ziyu Wan, Can Wang, and Jing Liao. 2024. Text2NeRF: Text-Driven 3D Scene Generation With Neural Radiance Fields. IEEE Transactions on Visualization and Computer Graphics 30, 12 (2024), 7749–7762. DOI: 10.1109/TVCG.2024.3361502
Publicado
27/10/2026
ROTH, Guilherme de Queiroz Lima; PEREIRA, Rafael de Andrade; VALENTIM, Natasha Malveira Costa. Systematic Mapping Study on the Use of Generative Artificial Intelligence in Non-Interactive Audiovisual: Applications, Challenges, and Impacts. In: BRAZILIAN SYMPOSIUM ON MULTIMEDIA AND THE WEB (WEBMEDIA), 32. , 2026, Lavras/MG. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2026 . p. 637-650. DOI: https://doi.org/10.5753/webmedia.2026.29899.