Design of synthetic light field datasets
Abstract
The growing number of articles related to light fields indicates the relevance that this subject has taken on today. In this context, there is a need for more work with a vision for creating light field videos. Thus, the present work aims to supply a lack in the scientific community, allowing access to the beginning of a project of synthetic datasets of light field videos. From scenarios and animations created in Blender, it was possible to create light field videos, with which it is possible explore the particularities of this type of video.References
T. Ebrahimi, S. Foessel, F. Pereira, and P. Schelkens, "Jpeg pleno: Toward an efficient representation of visual reality," IEEE Multimedia, vol. 23, no. 4, pp. 14–20, 2016.
I. JTC1/SC29/WG11, "MPEG-I Visual activities on 6DoF and light fields," 10 2017.
M. Broxton, J. Flynn, R. Overbeck, D. Erickson, P. Hedman, M. DuVall, J. Dourgarian, J. Busch, M. Whalen, and P. Debevec, "Immersive light field video with a layered mesh representation," vol. 39, no. 4, pp. 86:1– 86:15, 2020.
R. S. Overbeck, D. Erickson, D. Evangelakos, M. Pharr, and P. Debevec, "A system for acquiring, processing, and rendering panoramic light field stills for virtual reality," ACM Trans. Graph., vol. 37, no. 6, Dec. 2018. [Online]. Available: https://doi.org/10.1145/3272127.3275031
E. H. Adelson, J. R. Bergen et al., The plenoptic function and the elements of early vision. Vision and Modeling Group, Media Laboratory, Massachusetts Institute of . . . , 1991, vol. 2.
C. Zhang and T. Chen, "Light field sampling," Synthesis lectures on image, video, and multimedia processing, vol. 2, no. 1, pp. 1–102, 2006.
S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen, "The lumigraph," in Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, 1996, pp. 43–54.
M. Levoy and P. Hanrahan, "Light field rendering," in Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, 1996, pp. 31–42.
E. H. Adelson and J. Y. Wang, "Single lens stereo with a plenoptic camera," IEEE transactions on pattern analysis and machine intelligence, vol. 14, no. 2, pp. 99–106, 1992.
J. BRADLEY. (2012) Review: Lytro light field camera. [Online]. Available: https://www.wired.com/2012/02/lytro-camera-2/
[Online]. Available: http://graphics.stanford.edu/projects/lightfield
[Online]. Available: https://www.blender.org/
[Online]. Available: https://sketchfab.com/3d-models
K. Honauer, O. Johannsen, D. Kondermann, and B. Goldluecke, "A dataset and evaluation methodology for depth estimation on 4d light fields," in Asian Conference on Computer Vision. Springer, 2016, pp. 19–34.
C. G. Jinglei Shi, Xiaoran Jiang, "A framework for learning depth from a flexible subset of dense and sparse light field views," IEEE Transactions on Image Processing, Institute of Electrical and Electronics Engineers, 2019.
R. Hartley and A. Zisserman, Multiple view geometry in computer vision. Cambridge university press, 2003.
[Online]. Available: https://github.com/lightfield-analysis/blender-addon
[Online]. Available: https://imagemagick.org/index.php
[Online]. Available: https://www.mathworks.com/?s tid=gn logo
T.-C. Wang, J.-Y. Zhu, N. K. Kalantari, A. A. Efros, and R. Ramamo- orthi, "Light field video capture using a learning-based hybrid imaging system," ACM Transactions on Graphics (TOG), vol. 36, no. 4, pp. 1–13, 2017.
[Online]. Available: https://harllon.github.io/LightField-Blender/
I. JTC1/SC29/WG11, "MPEG-I Visual activities on 6DoF and light fields," 10 2017.
M. Broxton, J. Flynn, R. Overbeck, D. Erickson, P. Hedman, M. DuVall, J. Dourgarian, J. Busch, M. Whalen, and P. Debevec, "Immersive light field video with a layered mesh representation," vol. 39, no. 4, pp. 86:1– 86:15, 2020.
R. S. Overbeck, D. Erickson, D. Evangelakos, M. Pharr, and P. Debevec, "A system for acquiring, processing, and rendering panoramic light field stills for virtual reality," ACM Trans. Graph., vol. 37, no. 6, Dec. 2018. [Online]. Available: https://doi.org/10.1145/3272127.3275031
E. H. Adelson, J. R. Bergen et al., The plenoptic function and the elements of early vision. Vision and Modeling Group, Media Laboratory, Massachusetts Institute of . . . , 1991, vol. 2.
C. Zhang and T. Chen, "Light field sampling," Synthesis lectures on image, video, and multimedia processing, vol. 2, no. 1, pp. 1–102, 2006.
S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen, "The lumigraph," in Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, 1996, pp. 43–54.
M. Levoy and P. Hanrahan, "Light field rendering," in Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, 1996, pp. 31–42.
E. H. Adelson and J. Y. Wang, "Single lens stereo with a plenoptic camera," IEEE transactions on pattern analysis and machine intelligence, vol. 14, no. 2, pp. 99–106, 1992.
J. BRADLEY. (2012) Review: Lytro light field camera. [Online]. Available: https://www.wired.com/2012/02/lytro-camera-2/
[Online]. Available: http://graphics.stanford.edu/projects/lightfield
[Online]. Available: https://www.blender.org/
[Online]. Available: https://sketchfab.com/3d-models
K. Honauer, O. Johannsen, D. Kondermann, and B. Goldluecke, "A dataset and evaluation methodology for depth estimation on 4d light fields," in Asian Conference on Computer Vision. Springer, 2016, pp. 19–34.
C. G. Jinglei Shi, Xiaoran Jiang, "A framework for learning depth from a flexible subset of dense and sparse light field views," IEEE Transactions on Image Processing, Institute of Electrical and Electronics Engineers, 2019.
R. Hartley and A. Zisserman, Multiple view geometry in computer vision. Cambridge university press, 2003.
[Online]. Available: https://github.com/lightfield-analysis/blender-addon
[Online]. Available: https://imagemagick.org/index.php
[Online]. Available: https://www.mathworks.com/?s tid=gn logo
T.-C. Wang, J.-Y. Zhu, N. K. Kalantari, A. A. Efros, and R. Ramamo- orthi, "Light field video capture using a learning-based hybrid imaging system," ACM Transactions on Graphics (TOG), vol. 36, no. 4, pp. 1–13, 2017.
[Online]. Available: https://harllon.github.io/LightField-Blender/
Published
2020-11-07
How to Cite
DA PAZ, Harllon Oliveira; VELHO, Luiz; PAGLIARI, Carla L..
Design of synthetic light field datasets. In: WORKSHOP OF UNDERGRADUATE WORKS - CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 33. , 2020, Evento Online.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2020
.
p. 155-158.
DOI: https://doi.org/10.5753/sibgrapi.est.2020.13000.
