DRIFT: A visual analytic tool for scientific literature exploration based on textual and image content

  • Ximena Pocco Universidad Catolica San Pablo
  • Jorge Poco FGV
  • Matheus Viana IBM Research
  • Rogerio de Paula IBM Research
  • Luis G. Nonato USP
  • Erick Gomez-Nieto Universidad Catolica San Pablo

Resumo


Exploring digital libraries of scientific articles is an essential task for any research community. The typical approach is to query the articles’ data based on keywords and manually inspect the resulting list of documents to identify which papers are of interest. Besides being time-consuming, such a manual inspection is quite limited, as it can hardly provide an overview of articles with similar topics or subjects. Moreover, accomplishing queries based on content other than keywords is rarely doable, impairing finding documents with similar images. In this paper, we propose a visual analytic methodology for exploring and analyzing scientific document collections that consider the content of scientific documents, including images. The proposed approach relies on a combination of Content-Based Image Retrieval (CBIR) and multidimensional projection to map the documents to a visual space based on their similarity, thus enabling an interactive exploration. Additionally, we enable visual resources to display complementary information on selected documents that uncover hidden patterns and semantic relations. We show the effectiveness of our methodology through two case studies and a user evaluation, which attest to the usefulness of the proposed framework in exploring scientific document collections.
Palavras-chave: Visual analytics, Semantics, Image retrieval, Manuals, Inspection, Libraries, Task analysis
Publicado
18/10/2021
Como Citar

Selecione um Formato
POCCO, Ximena; POCO, Jorge; VIANA, Matheus; PAULA, Rogerio de; NONATO, Luis G.; GOMEZ-NIETO, Erick. DRIFT: A visual analytic tool for scientific literature exploration based on textual and image content. In: CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 34. , 2021, Online. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2021 .