Geometria dos Embeddings em Recomendação: GNNs e Transformers sob Manifold Learning
Resumo
Foram comparados três paradigmas de recomendação - LightGCN, KGAT e SASRec - sob a perspectiva de manifold learning, com o intuito de verificar como cada arquitetura molda a geometria dos embeddings aprendidos. Foram adotados dois protocolos de avaliação: previsão cronológica do próximo item e recomendação geral top-K, ambos com ranqueamento full-corpus. As métricas de Preservação de Vizinhança (NP@10) e Distorção de Distância Local (LDD@10) são definidas com o grafo de interação de itens (Jaccard) como espaço de referência. Em MovieLens-1M, Yelp2018 e Amazon-Book, o SASRec domina a previsão sequencial, enquanto o LightGCN iguala ou supera o KGAT em recomendação geral, contrariando a hipótese de que grafos de conhecimento aprimoram sistematicamente o desempenho. A análise geométrica esclarece esse resultado.
Referências
Gao, C., Zheng, Y., Li, N., Li, Y., Qin, Y., Piao, J., Quan, Y., Chang, J., Jin, D., He, X., and Li, Y. (2023). A survey of graph neural networks for recommender systems: Challenges, methods, and directions. ACM Transactions on Recommender Systems, 1(1):1–51.
Guo, Q., Zhuang, F., Qin, C., Zhu, H., Xie, X., Xiong, H., and He, Q. (2020). A survey on knowledge graph-based recommender systems. IEEE Transactions on Knowledge and Data Engineering, 34(8):3549–3568.
He, X., Deng, K., Wang, X., Li, Y., Zhang, Y., and Wang, M. (2020). Lightgcn: Simplifying and powering graph convolution network for recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 639–648.
Kang, W.-C. and McAuley, J. (2018). Self-attentive sequential recommendation. In IEEE International Conference on Data Mining (ICDM), pages 197–206.
Krichene, W. and Rendle, S. (2020). On sampled metrics for item recommendation. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pages 1748–1757.
Roweis, S. T. and Saul, L. K. (2000). Nonlinear dimensionality reduction by locally linear embedding. Science, 290(5500):2323–2326.
Tenenbaum, J. B., De Silva, V., and Langford, J. C. (2000). A global geometric framework for nonlinear dimensionality reduction. Science, 290(5500):2319–2323.
van der Maaten, L. J. P. and Hinton, G. E. (2008). Visualizing data using t-sne. Journal of Machine Learning Research, 9(1):2579–2605.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., and Polosukhin, I. (2017). Attention is all you need. Advances in neural information processing systems, 30.
Venna, J. and Kaski, S. (2006). Neighborhood preservation in nonlinear projection methods: An experimental study. In International Conference on Artificial Neural Networks, pages 485–491.
Wang, X., He, X., Cao, Y., Liu, M., and Chua, T.-S. (2019a). Kgat: Knowledge graph attention network for recommendation. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pages 950–958.
Wang, X., He, X., Wang, M., Feng, F., and Chua, T.-S. (2019b). Neural graph collaborative filtering. In Proceedings of the 42nd international ACM SIGIR conference on Research and development in Information Retrieval, pages 165–174.
Wu, S., Sun, F., Zhang, W., Xie, X., and Cui, B. (2022). Graph Neural Networks in Recommender Systems: A Survey. ACM Computing Surveys, 55(5):1–37.
