DTMCash: Exploiting User Viewport Redundancy for 360º Video Streaming Optimization

• Gustavo Dias UFG
• Luciano de S. Fraga UFG
• Kleber V. Cardoso UFG
• Sand L. Correa UFG

DOI: https://doi.org/10.5753/sbrc.2024.1414

Abstract

The advancement of immersive technologies, such as Augmented Reality (AR) and Virtual Reality (VR), has brought significant challenges to the transmission of 360° videos, with increasing bandwidth requirements and low latency due to the size of frames. Our proposal, DTMCash, stands out in addressing these challenges by adopting dynamic tiles and combining user viewports, effectively tackling the issue of transmission in multi-user scenarios. Compared to a state-of-the-art solution, our approach reduces the aggregate bandwidth consumption of the Internet link by at least 48.2%, while maintaining the same consumption on the wireless link, also providing greater efficiency in cache usage.

References

Cao, J., Lam, K.-Y., Lee, L.-H., Liu, X., Hui, P., and Su, X. (2023). Mobile Augmented Reality: User Interfaces, Frameworks, and Intelligence. ACM Comput. Surv., 55(9).

Hsu, C.-H. (2020). MEC-Assisted FoV-Aware and QoE-Driven Adaptive 360° Video Streaming for Virtual Reality. In 2020 16th International Conference on Mobility, Sensing and Networking (MSN), pages 291–298.

Li, J., Wen, Z., Li, S., Zhao, Y., Guo, B., and Wen, J. (2016). Novel tile segmentation scheme for omnidirectional video. In 2016 IEEE International Conference on Image Processing (ICIP), pages 370–374.

Liu, L., Zhong, R., Zhang, W., Liu, Y., Zhang, J., Zhang, L., and Gruteser, M. (2018). Cutting the Cord: Designing a High-Quality Untethered VR System with Low Latency Remote Rendering. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys ’18), page 68–80.

Lo, W.-C., Huang, C.-Y., and Hsu, C.-H. (2018). Edge-Assisted Rendering of 360° Videos Streamed to Head-Mounted Virtual Reality. In 2018 IEEE International Symposium on Multimedia (ISM), pages 44–51.

Madarasingha, C. and Thilakarathna, K. (2021). Vastile: Viewport adaptive scalable 360-degree video frame tiling. In Proceedings of the 29th ACM International Conference on Multimedia, MM ’21, page 4555–4563, New York, NY, USA. Association for Computing Machinery.

Madarasingha, C., Thilakarathna, K., and Zomaya, A. (2022). Opcash: Optimized utilization of mec cache for 360-degree video streaming with dynamic tiling. In 2022 IEEE International Conference on Pervasive Computing and Communications (Per-Com), pages 34–43. IEEE.

Nasrabadi, A. T., Samiei, A., Mahzari, A., McMahan, R. P., Prakash, R., Farias, M. C. Q., and Carvalho, M. M. (2019). A taxonomy and dataset for 360° videos. In Proceedings of the 10th ACM Multimedia Systems Conference, MMSys ’19, page 273–278, New York, NY, USA. Association for Computing Machinery.

Ozcinar, C., Cabrera, J., and Smolic, A. (2019). Visual Attention-Aware Omnidirectional Video Streaming Using Optimal Tiles for Virtual Reality. IEEE Journal on Emerging and Selected Topics in Circuits and Systems, 9(1):217–230.

Papaioannou, G. and Koutsopoulos, I. (2019). Tile-based Caching Optimization for 360° Videos. In Proceedings of the Twentieth ACM International Symposium on Mobile Ad Hoc Networking and Computing, pages 171–180.

Qian, F., Han, B., Xiao, Q., and Gopalakrishnan, V. (2018). Flare: Practical Viewport-Adaptive 360-Degree Video Streaming for Mobile Devices. In Proceedings of the 24th Annual International Conference on Mobile Computing and Networking (MobiCom ’18), page 99–114.

van der Hooft, J., Amirpour, H., Vega, M. T., Sanchez, Y., Schatz, R., Schierl, T., and Timmerer, C. (2023). A Tutorial on Immersive Video Delivery: From Omnidirectional Video to Holography. IEEE Communications Surveys & Tutorials, 25(2):1336–1375.

Wu, D., Yang, Z., Zhang, P., Wang, R., Yang, B., and Ma, X. (2023). Virtual-Reality Interpromotion Technology for Metaverse: A Survey. IEEE Internet of Things Journal, 10(18):15788–15809.

Yao, J., Han, T., and Ansari, N. (2019). On mobile edge caching. IEEE Communications Surveys & Tutorials, 21(3):2525–2553.

Yaqoob, A., Bi, T., and Muntean, G.-M. (2020). A Survey on Adaptive 360° Video Streaming: Solutions, Challenges and Opportunities. IEEE Communications Surveys & Tutorials, 22(4):2801–2838.

Zhou, C., Xiao, M., and Liu, Y. (2018). ClusTile: Toward Minimizing Bandwidth in 360-degree Video Streaming. In IEEE INFOCOM 2018 - IEEE Conference on Computer Communications, pages 962–970.