Hierarchical Time-Aware Approach for Video Summarization

• Leonardo Vilela Cardoso PUC Minas https://orcid.org/0000-0003-0365-6403
• Gustavo Oliveira Rocha Gomes PUC Minas https://orcid.org/0009-0008-8384-6218
• Silvio Jamil Ferzoli Guimarães PUC Minas https://orcid.org/0000-0001-8522-2056
• Zenilton Kleber Gonçalves do Patrocínio Júnior PUC Minas https://orcid.org/0000-0003-0804-1790

Resumo

Video summarization consists of generating a concise video representation that captures all its meaningful information. However, conventional summarization techniques often fall short of capturing all the significant events in a video due to their inability to incorporate the hierarchical structure of the video content. This work proposes an unsupervised method, named Hierarchical Time-aware Summarizer–HieTaSumm, that uses a hierarchical approach for that task. In this regard, hierarchical strategies for video summarization have emerged as a promising solution, in which video content is modeled as a graph to identify keyframes that represent the most relevant information. This approach enables the extraction of the frames that convey the central message of the video, resulting in a more effective and precise summary. Experimental results indicate that the proposed approach has great potential. Specifically, it seems to enhance coherence among different video segments, reducing frame redundancy in the generated summaries, and enhancing the diversity of selected keyframes.