Projeto de datasets de light fields sintéticos
Resumo
A crescente quantidade de artigos relacionados a “light field” indicam a relevância que esse assunto tem tomado nos dias atuais. Nesse contexto, percebe-se a necessidade de mais trabalhos com uma visão para criação de vídeos “light field”. Dessa forma, o presente trabalho objetiva suprir uma carência presente na comunidade científica, permitindo o acesso ao início de um projeto de datasets de “lightfield” de vídeos sintéticos. A partir de cenários e animações criadas no Blender, foi possível criar alguns vídeos “light field”, com os quais é possível realizar estudos aprofundados sobre as particularidades deste tipo de vídeo.Referências
T. Ebrahimi, S. Foessel, F. Pereira, and P. Schelkens, "Jpeg pleno: Toward an efficient representation of visual reality," IEEE Multimedia, vol. 23, no. 4, pp. 14–20, 2016.
I. JTC1/SC29/WG11, "MPEG-I Visual activities on 6DoF and light fields," 10 2017.
M. Broxton, J. Flynn, R. Overbeck, D. Erickson, P. Hedman, M. DuVall, J. Dourgarian, J. Busch, M. Whalen, and P. Debevec, "Immersive light field video with a layered mesh representation," vol. 39, no. 4, pp. 86:1– 86:15, 2020.
R. S. Overbeck, D. Erickson, D. Evangelakos, M. Pharr, and P. Debevec, "A system for acquiring, processing, and rendering panoramic light field stills for virtual reality," ACM Trans. Graph., vol. 37, no. 6, Dec. 2018. [Online]. Available: https://doi.org/10.1145/3272127.3275031
E. H. Adelson, J. R. Bergen et al., The plenoptic function and the elements of early vision. Vision and Modeling Group, Media Laboratory, Massachusetts Institute of . . . , 1991, vol. 2.
C. Zhang and T. Chen, "Light field sampling," Synthesis lectures on image, video, and multimedia processing, vol. 2, no. 1, pp. 1–102, 2006.
S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen, "The lumigraph," in Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, 1996, pp. 43–54.
M. Levoy and P. Hanrahan, "Light field rendering," in Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, 1996, pp. 31–42.
E. H. Adelson and J. Y. Wang, "Single lens stereo with a plenoptic camera," IEEE transactions on pattern analysis and machine intelligence, vol. 14, no. 2, pp. 99–106, 1992.
J. BRADLEY. (2012) Review: Lytro light field camera. [Online]. Available: https://www.wired.com/2012/02/lytro-camera-2/
[Online]. Available: http://graphics.stanford.edu/projects/lightfield
[Online]. Available: https://www.blender.org/
[Online]. Available: https://sketchfab.com/3d-models
K. Honauer, O. Johannsen, D. Kondermann, and B. Goldluecke, "A dataset and evaluation methodology for depth estimation on 4d light fields," in Asian Conference on Computer Vision. Springer, 2016, pp. 19–34.
C. G. Jinglei Shi, Xiaoran Jiang, "A framework for learning depth from a flexible subset of dense and sparse light field views," IEEE Transactions on Image Processing, Institute of Electrical and Electronics Engineers, 2019.
R. Hartley and A. Zisserman, Multiple view geometry in computer vision. Cambridge university press, 2003.
[Online]. Available: https://github.com/lightfield-analysis/blender-addon
[Online]. Available: https://imagemagick.org/index.php
[Online]. Available: https://www.mathworks.com/?s tid=gn logo
T.-C. Wang, J.-Y. Zhu, N. K. Kalantari, A. A. Efros, and R. Ramamo- orthi, "Light field video capture using a learning-based hybrid imaging system," ACM Transactions on Graphics (TOG), vol. 36, no. 4, pp. 1–13, 2017.
[Online]. Available: https://harllon.github.io/LightField-Blender/
I. JTC1/SC29/WG11, "MPEG-I Visual activities on 6DoF and light fields," 10 2017.
M. Broxton, J. Flynn, R. Overbeck, D. Erickson, P. Hedman, M. DuVall, J. Dourgarian, J. Busch, M. Whalen, and P. Debevec, "Immersive light field video with a layered mesh representation," vol. 39, no. 4, pp. 86:1– 86:15, 2020.
R. S. Overbeck, D. Erickson, D. Evangelakos, M. Pharr, and P. Debevec, "A system for acquiring, processing, and rendering panoramic light field stills for virtual reality," ACM Trans. Graph., vol. 37, no. 6, Dec. 2018. [Online]. Available: https://doi.org/10.1145/3272127.3275031
E. H. Adelson, J. R. Bergen et al., The plenoptic function and the elements of early vision. Vision and Modeling Group, Media Laboratory, Massachusetts Institute of . . . , 1991, vol. 2.
C. Zhang and T. Chen, "Light field sampling," Synthesis lectures on image, video, and multimedia processing, vol. 2, no. 1, pp. 1–102, 2006.
S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen, "The lumigraph," in Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, 1996, pp. 43–54.
M. Levoy and P. Hanrahan, "Light field rendering," in Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, 1996, pp. 31–42.
E. H. Adelson and J. Y. Wang, "Single lens stereo with a plenoptic camera," IEEE transactions on pattern analysis and machine intelligence, vol. 14, no. 2, pp. 99–106, 1992.
J. BRADLEY. (2012) Review: Lytro light field camera. [Online]. Available: https://www.wired.com/2012/02/lytro-camera-2/
[Online]. Available: http://graphics.stanford.edu/projects/lightfield
[Online]. Available: https://www.blender.org/
[Online]. Available: https://sketchfab.com/3d-models
K. Honauer, O. Johannsen, D. Kondermann, and B. Goldluecke, "A dataset and evaluation methodology for depth estimation on 4d light fields," in Asian Conference on Computer Vision. Springer, 2016, pp. 19–34.
C. G. Jinglei Shi, Xiaoran Jiang, "A framework for learning depth from a flexible subset of dense and sparse light field views," IEEE Transactions on Image Processing, Institute of Electrical and Electronics Engineers, 2019.
R. Hartley and A. Zisserman, Multiple view geometry in computer vision. Cambridge university press, 2003.
[Online]. Available: https://github.com/lightfield-analysis/blender-addon
[Online]. Available: https://imagemagick.org/index.php
[Online]. Available: https://www.mathworks.com/?s tid=gn logo
T.-C. Wang, J.-Y. Zhu, N. K. Kalantari, A. A. Efros, and R. Ramamo- orthi, "Light field video capture using a learning-based hybrid imaging system," ACM Transactions on Graphics (TOG), vol. 36, no. 4, pp. 1–13, 2017.
[Online]. Available: https://harllon.github.io/LightField-Blender/
Publicado
07/11/2020
Como Citar
DA PAZ, Harllon Oliveira; VELHO, Luiz; PAGLIARI, Carla L..
Projeto de datasets de light fields sintéticos. In: WORKSHOP DE TRABALHOS DA GRADUAÇÃO - CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 33. , 2020, Evento Online.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2020
.
p. 155-158.
DOI: https://doi.org/10.5753/sibgrapi.est.2020.13000.
