Multiple Parenting Relationships in Image Phylogeny: Tracking Down Forgeries and Their Creators Online
Resumo
Due to the large amount of images shared on the web, tracking the spread and evolution of their content have become an increasingly important problem. As an image might be a composition created through the combination of the semantic information existent in two or more source images, establishing a relationship between the sources and the composite is an ever-growing problem of interest. We name as Multiple Parenting Phylogeny the problem of identifying such relationships in a set containing near-duplicate subsets of source and composition images. To tackle this problem, this work presents a three-step solution: (1) separation of near-duplicate groups; (2) classification of the relations between the groups; and (3) identification of the images used to create the original composition. Furthermore, we extend upon this framework by introducing key improvements, such as better identification of when two images share content, and improved ways to compare this content. Evaluation of the proposed method is performed by means of quantitative metrics established for evaluating the accuracy in reconstructing phylogenies and finding multiple parenting relationships in the different datasets. Finally, we also analyze the results qualitatively, with images obtained from the web
Referências
De Rosa, A., Uccheddu, F., Costanzo, A., Piva, A., and Barni, M. (2010). Exploring image dependencies: a new challenge in image forensics. In SPIE Media Forensics and Security II, page 75410.
Dias, Z., Rocha, A., and Goldenstein, S. (2010). First steps toward image phylogeny. In IEEE Intl. Workshop on Information Forensics and Security (WIFS), pages 1–6.
Dias, Z., Rocha, A., and Goldenstein, S. (2012). Image phylogeny by minimal spanning trees. IEEE Transactions on Information Forensics and Security (TIFS), 7(2):774–788.
Dias, Z., Rocha, A., and Goldenstein, S. (2013). Toward image phylogeny forests: Automatically recovering semantically similar image relationships. Elsevier Forensic Science Intl., 231(1-3):178–189.
Kennedy, L. and Chang, S.-F. (2008). Internet image archaeology: Automatically tracing the manipulation history of photographs on the web. In ACM Intl. Conference on Multimedia (ACM-MM), pages 349–358.
Zhao, W.-L. and Ngo, C.-W. (2009). Scale-rotation invariant pattern entropy for keypoint-based near-duplicate detection. IEEE Transactions on Image Processing (TIP), 18(2):412–423.
Zhao, W.-L., Ngo, C.-W., Tan, H.-K., and Wu, X. (2007). Near-duplicate keyframe identification with interest point matching and pattern learning. IEEE Transactions on Multimedia (MM), 9(5):1037–1048.
