ABSTRACT
Holoscopic imaging, also known as integral imaging, is a promising solution for glasses-free 3D technology since it allows a more natural and immersive 3D sensation with continuous full motion parallax. However, in order to provide 3D holoscopic content with convenient visual quality in terms of resolution and 3D perception, ultra-high resolution acquisition and display devices are required. Consequently, efficient video coding tools become essential to deal with this large amount of data. However, current and emerging state-of-the-art video coding technologies do not yet address the specific characteristics of 3D holoscopic content. In this context, this paper presents and studies a coding scheme based on the concept of self-similarity compensated prediction, which is used to explore the particular arrangement of 3D holoscopic content through the introduction of new prediction modes. In order to profoundly analyze these new prediction modes, two different generations of video codecs, modified to handle 3D holoscopic content, are examined and compared: the first one is derived from the H.264/AVC video coding standard while the second one is based on the recent standardization project called High Efficient Video Coding (HEVC). Experimental results clearly show the advantages of using this coding scheme in both codecs, as well as the connection between the performance of the self-similarity compensation process and the characteristics of the 3D holoscopic content.
- Aggoun, A. A 3D DCT Compression Algorithm For Omnidirectional Integral Images. In IEEE International Conference on Accoustics, Speech and Signal Processing (ICASSP 2006) (Toulouse, France May 2006), 517--520.Google Scholar
- Aggoun, A. Compression of 3D Integral Images Using 3D Wavelet Transform. Display Technology, Journal of, 7, 11 (Nov. 2011), 586--592.Google Scholar
- Au, O. C., Zhang, X., Pang, C., and Wen, X. Suggested Common test conditions and software reference configurations for Screen Content Coding. JCTVC-F696 , Joint Collaborative Team on Video Coding (JCT-VC), Torino, July, 2011.Google Scholar
- Bjontegaard, G. Calculation of average PSNR differences between RD curves. ITU-T Video Coding Experts Group (VCEG) Meeting, Austin, TX, USA, April, 2001.Google Scholar
- Conti, C., Lino, J., Nunes, P., Soares, L. D., and Correia, P.L. Spatial Prediction Based on Self-Similarity for 3D Holoscopic Image and Video Coding. In 18th International Conference on Image Processing (ICIP 2011) (Brussels, Belgium 2011), 977--980.Google ScholarCross Ref
- Lippmann, G. Epreuves Reversibles Donnant la Sensation du Relief. Journal de Physique Théorique et Appliquée, 7, 1 (November 1908), 821--825.Google ScholarCross Ref
- Markets and Markets. Three-Dimensional (3D) Technology Market (2011 -- 2016) By Products, Applications & Technology Focus, Global Forecast & Analysis -- Features Introduction To 4D Technology. Markets and Markets, 2012.Google Scholar
- McCann, K., Bross, B., Sekiguchi, S., and Han, W. HM4: High Efficiency Video Coding (HEVC) Test Model 4 Encoder Description. JCTVC-F802, Joint Collaborative Team on Video Coding (JCT-VC), Torino, 2011.Google Scholar
- Shi, S., Gioia, P., and Madec, G. Efficient Compression Method for Integral Images Using Multi-View Video Coding. In 18th International Conference on Image Processing (ICIP 2011) (Brussels, Belgium September 2011), 141--144.Google Scholar
- Ugur, K., Andersson, K., Fuldseth, A. et al. High Performance, Low Complexity Video Coding and the Emerging HEVC Standard. IEEE Transactions on Circuits and Systems for Video Technology, 20, 12 (December 2010), 1688--1697. Google ScholarDigital Library
- Vetro, A., Wiegand, T., and Sullivan, G.J. Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard. Proceedings of the IEEE, 99, 4 (April 2011), 626--642.Google ScholarCross Ref
- Wiegand, T., Sullivan, G. J., Bjøntegaard, G., and Luthra, A. Overview of the H.264/AVC Video Coding Standard. IEEE Transactions on Circuits and Systems for Video Technology, 13, 7 (July 2003), 560--576. Google ScholarDigital Library
Index Terms
- Influence of self-similarity on 3D holoscopic video coding performance
Recommendations
HEVC-based 3D holoscopic video coding using self-similarity compensated prediction
Holoscopic imaging, also known as integral, light field, and plenoptic imaging, is an appealing technology for glassless 3D video systems, which has recently emerged as a prospective candidate for future image and video applications, such as 3D ...
Efficient Inter-Prediction Transcoding Algorithm from H.264/AVC to HEVC
RCAE 2019: Proceedings of the 2019 The 2nd International Conference on Robotics, Control and Automation EngineeringWith the development of the High Efficiency Video Coding (HEVC) video compression standard, there is an urgent need for more research on video format transcoding from H.264/Advanced Video Coding (AVC) to HEVC. In this paper, we highlight the difference ...
Multi-view video coding based on high efficiency video coding
PSIVT'11: Proceedings of the 5th Pacific Rim conference on Advances in Image and Video Technology - Volume Part IIMultiview video coding is one of the key techniques to realize the 3D video system. MPEG started a standardization activity on 3DVC (3D video coding) in 2007. 3DVC is based on multiview video coding. MPEG finalized the standard for multiview video ...
Comments