Simultaneous magnification of subtle motions and color variations in videos using Riesz pyramids

  • Thomas V. Fontanari UFRGS
  • Manuel M. Oliveira UFRGS

Resumo


Videos often contain subtle motions and color variations that cannot be easily observed. Examples include, for instance, head motion and changes in skin face color due to blood flow controlled by the heart pumping rhythm. A few techniques have been developed to magnify these subtle signals. However, previous techniques were targeted specifically towards magnification of either motion or color variations. Trying to magnify both aspects applying two of these techniques in sequence does not produce good results. We present a method for magnifying subtle motions and color variations in videos, which can be performed either separately or simultaneously. Our approach is based on the Riesz pyramid, which was previously used only for motion magnification. Besides modifying the local phases of the coefficients of this pyramid, we show how altering its local amplitudes and its residue can be used to magnify intensity/color variations. We demonstrate the effectiveness of our technique in multiple videos by magnifying both subtle motion and color variations simultaneously.

Palavras-chave: Eulerian video magnification, Riesz pyramids
Publicado
18/10/2021
Como Citar

Selecione um Formato
FONTANARI, Thomas V.; OLIVEIRA, Manuel M.. Simultaneous magnification of subtle motions and color variations in videos using Riesz pyramids. In: CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 34. , 2021, Online. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2021 .