Social eXtended Reality (XR) and Virtual Production: Crafting New Frontiers in Immersive Storytelling

• Álvaro Egea Benavente i2CAT Foundation / University of Valencia
• Marc Martos Cabré i2CAT Foundation
• Javier Montesa Brainstorm Multimedia
• Francisco Ibañez Brainstorm Multimedia
• Sergi Fernández i2CAT Foundation
• Mario Montagud Climent i2CAT Foundation / University of Valencia

DOI: https://doi.org/10.5753/imxw.2025.1505

Resumo

Immersive technologies are transforming how we consume, interact and engage with media. In this context, Social eXtended Reality (XR) is emerging as a powerful medium for remote communication, social interaction, and shared virtual experiences. Simultaneously, advances in multi-modal virtual production tools are expanding the boundaries of immersion, interactivity, and narrative design —while enabling the scalable distribution of rich immersive experiences via traditional 2D video platforms. This paper explores new frontiers in interactive and immersive storytelling through the convergence of Social XR, holographic communication, and virtual production. First, it proposes a cohesive architectural framework to seamlessly integrate innovative tools from these technological domains, aiming to support diverse interaction and media presentation modalities. Second, it outlines potential use cases and presents preliminary findings that demonstrate the feasibility and transformative potential of such newly envisioned cross-technology integration.

Palavras-chave: Holographic Communications, Holoportation, Multimodal Interaction, Social eXtended Reality (XR), Storytelling, Virtual Production, Volumetric Video

Referências

Sergi Fernández, Mario Montagud, Gianluca Cernigliaro, and David Rincón. 2021. Toward hyper-realistic and interactive social VR experiences in live TV scenarios. IEEE Transactions on Broadcasting 68, 1 (2021), 13–32.

Sergi Fernández, Mario Montagud, Gianluca Cernigliaro, and David Rincón. 2022. Multiparty holomeetings: Toward a new era of low-cost volumetric holographic meetings in virtual reality. IEEE ACCESS 10 (2022), 81856–81876.

Manolya Kavakli and Cinzia Cremona. 2022. The virtual production studio concept–an emerging game changer in filmmaking. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 29–37.

Jie Li, Yiping Kong, Thomas Röggla, Francesca De Simone, Swamy Ananthanarayan, Huib De Ridder, Abdallah El Ali, and Pablo Cesar. 2019. Measuring and understanding photo sharing experiences in social virtual reality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–14.

Mario Montagud, Jie Li, Gianluca Cernigliaro, Abdallah El Ali, Sergi Fernández, and Pablo Cesar. 2022. Towards socialVR: evaluating a novel technology for watching videos together. Virtual Reality 26, 4 (2022), 1593–1613.

Mario Montagud, Marc Martos, Álvaro Egea, and Sergi Fernández. 2021. Toward hyper-realistic and interactive social VR experiences in live TV scenarios. IEEE Transactions on Broadcasting 68, 1 (2021), 13–32.

Francesca De Simone, Jiel Li, Henrique Galvan Debarba, Abdallah El Ali, Simon Gunkel, and Pablo Cesar. 2019. Watching videos together in social virtual reality: An experimental study on user’s QoE. In 2019 IEEE Conference on virtual reality and 3d user interfaces (VR). IEEE, 890–891.

Jon Swords and Nina Willment. 2024. The emergence of virtual production–a research agenda. Convergence 30, 5 (2024), 1557–1574.