Digital Twin Development for Cultural Heritage Buildings: A Multimodal Approach to Simulating Energy Performance

• Elissavet Batziou Centre for Research and Technology Hellas
• Nikolaos I. Dourvas Centre for Research and Technology Hellas
• Konstantinos Ioannidis Centre for Research and Technology Hellas
• Sotiris Diplaris Centre for Research and Technology Hellas
• Stefanos Vrochidis Centre for Research and Technology Hellas
• Ioannis Kompatsiaris Centre for Research and Technology Hellas

DOI: https://doi.org/10.5753/imxw.2025.9461

Abstract

Cultural heritage buildings represent invaluable historical and architectural assets, but their preservation often conflicts with the need for modern energy efficiency. This paper presents a novel framework for digital twin development that adopts a multimodal approach to provide an open-source environment of a CH building with the goal to simulate and optimize energy performance in heritage structures. By integrating diverse data modalities, such as structural analysis, environmental monitoring, and multimedia documentation, the proposed digital twin provides a comprehensive, dynamic representation of the building’s energy behavior. This approach enables more accurate simulations of energy performance, facilitating informed decision-making for sustainable retrofitting while respecting the unique constraints of cultural heritage conservation. The application of this framework in a real case study demonstrates the potential of multimodal digital twins to bridge the gap between preservation and energy efficiency, to increase immersiveness and to highlight their role in advancing sustainable management practices for heritage sites. The findings underscore the transformative potential of digital twin technology in fostering sustainable, data-driven solutions for cultural heritage conservation.

Keywords: Digital Twins, Cultural Heritage, Multimodal, Simulation, Energy Performance, Immersive technologies

References

Abdelali Agouzoul, Mohamed Tabaa, Badr Chegari, Emmanuel Simeu, Abbas Dandache, and Karim Alami. 2021. Towards a digital twin model for building energy management: case of Morocco. Procedia Computer Science 184 (2021), 404–410.

Ando Andriamamonjy, Dirk Saelens, and Ralf Klein. 2018. An automated IFCbased workflow for building energy performance simulation with Modelica. Automation in Construction 91 (2018), 166–181.

Buddhika Arsecularatne, Navodana Rodrigo, and Ruidong Chang. 2024. Digital Twins for Reducing Energy Consumption in Buildings: A Review. Sustainability 16, 21 (2024), 9275.

Bożena Babiarz and Władysław Szymański. 2020. Introduction to the dynamics of heat transfer in buildings. Energies 13, 23 (2020), 6469.

Sebastian Barzaghi, Alice Bordignon, Bianca Gualandi, Ivan Heibi, Arcangelo Massari, Arianna Moretti, Silvio Peroni, and Giulia Renda. 2024. A Proposal for a FAIR Management of 3D Data in Cultural Heritage: The Aldrovandi Digital Twin Case. arXiv preprint arXiv:2407.02018 (2024).

Mafkereseb Kassahun Bekele, Roberto Pierdicca, Emanuele Frontoni, Eva Savina Malinverni, and James Gain. 2018. A survey of augmented, virtual, and mixed reality for cultural heritage. Journal on Computing and Cultural Heritage (JOCCH) 11, 2 (2018), 1–36.

Rafaela Bortolini, Raul Rodrigues, Hamidreza Alavi, Luisa Felix Dalla Vecchia, and Núria Forcada. 2022. Digital twins’ applications for building energy efficiency: A review. Energies 15, 19 (2022), 7002.

Marcello Carrozzino and Massimo Bergamasco. 2010. Beyond virtual museums: Experiencing immersive virtual reality in real museums. Journal of cultural heritage 11, 4 (2010), 452–458.

Andres Sebastian Cespedes-Cubides and Muhyiddine Jradi. 2024. A review of building digital twins to improve energy efficiency in the building operational stage. Energy Informatics 7, 1 (2024), 11.

Jack CP Cheng, Jiaying Zhang, Helen HL Kwok, and Jimmy CK Tong. 2024. Thermal performance improvement for residential heritage building preservation based on digital twins. Journal of Building Engineering 82 (2024), 108283.

Marguba Egamova and Bobur Matyokubov. 2023. Improving the energy efficiency of the external walls of residential buildings being built on the basis of a new model project. 3, 3 (2023), 150–155.

Mohamed El-Gohary, Riad El-Abed, and Osama Omar. 2023. Prediction of an Efficient Energy-Consumption Model for Existing Residential Buildings in Lebanon Using an Artificial Neural Network as a Digital Twin in the Era of Climate Change. Buildings 13, 12 (2023), 3074.

MElagiry, N Charbel, P Bourreau, E Di Angelis, and A Costa. 2020. IFC to Building Energy Performance Simulation: A systematic review of the main adopted tools and approaches. In BauSim Conference 2020, Vol. 8. IBPSA-Germany and Austria, 527–534.

Aleksandar Jankovic and Francesco Goia. 2021. Impact of double skin facade constructional features on heat transfer and fluid dynamic behaviour. Building and Environment 196 (2021), 107796.

Stylianos Karatzas, Vasiliki Lazari, Kalliopi Fouseki, Valeria Natalia Pracchi, and Evagelos Balaskas. 2024. Digital twins-enabled heritage buildings management through social dynamics. Journal of Cultural Heritage Management and Sustainable Development (2024).

Xiangxiong Kong. 2024. Monitoring Time-Varying Changes of Historic Structures Through Photogrammetry-Driven Digital Twinning. arXiv preprint arXiv:2407.18925 (2024).

Elena Lucchi. 2023. Digital twins for the automation of the heritage construction sector. Automation in Construction 156 (2023), 105073.

Angelo Massafra, Giorgia Predari, Riccardo Gulli, et al. 2022. Towards digital twin driven cultural heritage management: A Hbim-based workflow for energy improvement of Modern buildings. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences 46 (2022), 149–157.

Lina Morkunaite, Justas Kardoka, Darius Pupeikis, Paris Fokaides, and Vangelis Angelakis. 2023. Digital Twin for Grey Box modeling of Multistory residential building thermal dynamics. In 2023 IEEE 9th World Forum on Internet of Things (WF-IoT). IEEE, 1–6.

Zhongjun Ni, Chi Zhang, Magnus Karlsson, and Shaofang Gong. 2023. Leveraging deep learning and digital twins to improve energy performance of buildings. In 2023 IEEE 3rd International Conference on Industrial Electronics for Sustainable Energy Systems (IESES). IEEE, 1–6.

Franco Niccolucci and Achille Felicetti. 2024. Digital Twin sensors in cultural heritage applications. arXiv preprint arXiv:2407.07750 (2024).

Greesan R, Mekala C, and Rajesh B. 2024. Numerical study and experimental validation of heat transfer in a CenoPCM reinforced multi-layered meta-material wall for energy efficient buildings. Building Services Engineering Research and Technology 45 (08 2024). DOI: 10.1177/01436244241277163

YanwenWu,Wenna Jian, Liu Yang, Tengyue Zhang, and Yan Liu. 2021. Effects of Different Surface Heat Transfer Coefficients on Predicted Heating and Cooling Loads towards Sustainable Building Design. Buildings 11, 12 (2021), 609.

Seungkeun Yeom, Juui Kim, Hyuna Kang, Seunghoon Jung, and Taehoon Hong. 2024. Digital twin (DT) and extended reality (XR) for building energy management. Energy and Buildings (2024), 114746.