A Web-Based Information System for Ornamental Rock Classification and Similarity Search Using Siamese Networks
Resumo
Research Context: The time-consuming, subjective, and error-prone process for identification of ornamental rocks, which is traditionally based on visual analysis and expert knowledge. This task is vital for competitiveness in construction, mining, and geology. Advances in computer vision create opportunities to automate such tasks and provide aid for professionals. Scientific/Practical Problem: The ornamental rock industry faces challenges in accurately and efficiently classifying rocks and retrieving similar units for high-demand users. The current manual effort is imprecise and slow, highlighting the need for AI solutions to improve the process. Proposed Solution and/or Analysis: This work proposes a web-based information system that uses Siamese Networks to aid analysts and general users in finding the class of a given ornamental rock, and its most similar pair of images in a dataset. Related IS Theory: Task-Technology Fit (TTF) guides our work. The proposed system is designed to allow smoother and quicker task completion, reducing time and effort. In addition, users can more easily and effectively achieve their desired outcomes. The smoother task execution can lead to lower costs associated with task performance. Research Method: A system is proposed using Siamese Networks to perform classification and similarity recognition of ornamental rocks. Summary of Results: The system successfully finds the class of the given image, as well as the image pair that most resembles it. The Siamese network comparison technique also allows for the correct identification of classes not used in training, but existing in the user’s database. Contributions and Impact to IS area: This work bridges advanced vision models and decision support in ornamental rocks identification, transforming a neural network model into a reliable, evidence-based system and task-aligned evaluation.
Referências
Araujo, J. V. C. (2022). Rede neural convolucional para classificação de chapas polidas de rochas ornamentais. Monografia de graduação (Bacharelado em Sistemas de Informação), Instituto Federal do Espírito Santo, Cachoeiro de Itapemirim.
Bhende, N., Sheth, S., and Reddy, M. (2025). Siamese network embeddings and knn classifier for robust acne image classification: A hybrid approach. In 2025 International Conference on Information, Implementation, and Innovation in Technology (I2ITCON), pages 1–7.
CETEM (2020). Request characterization of ornamental stones. [link]. Accessed on September 13, 2025.
Chiodo Filho, C. (2020). Identificação de minerais por meio de Redes Neurais Convolucionais: um estudo comparativo entre Inteligência Artificial e o Sistema Visual Humano. Anais do Brazilian e-Science Workshop (BreSci).
Dias, D., Komati, K., and Gazolli, K. (2024a). Automating rock classification: A vision transformer approach in Brazil’s ornamental stone. Ibero-Latin American Congress on Computational Methods in Engineering (CILAMCE).
Dias, D. F., Komati, K. S., and de Souza Gazolli, K. A. (2024b). Comparative evaluation of image classification models for ornamental rock classification. In 2024 L Latin American Computer Conference (CLEI), pages 1–4.
Dong, L., Sun, C., Yu, X., Zhang, X., Chen, M., and Xu, M. (2025). Hybrid architecture for tight sandstone: Automated mineral identification and quantitative petrology. Minerals, 15(9).
Eppel, S., Li, J. Y., Drehwald, M. S., and Aspuru-Guzik, A. (2024). Infusing synthetic data with real-world patterns for zero-shot material state segmentation. In The Thirty-eight Conference on Neural Information Processing Systems Datasets and Benchmarks Track.
FINDES (2024). Espírito santo: a world reference in the ornamental stone sector. [link]. Accessed on September 13, 2025.
Hinton, G. E. and Roweis, S. (2002). Stochastic neighbor embedding. Advances in neural information processing systems, 15.
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., and Salakhutdinov, R. R. (2012). Improving neural networks by preventing co-adaptation of feature detectors.
Nesteruk, S., Agafonova, J., Pavlov, I., Gerasimov, M., Latyshev, N., Dimitrov, D., Kuznetsov, A., Kadurin, A., and Plechov, P. (2023). Mineralimage5k: A benchmark for zero-shot raw mineral visual recognition and description. Computers & Geosciences, 178:105414.
Ouzounis, A., Sidiropoulos, G., Papakostas, G., Sarafis, I., Stamkos, A., and Solakis, G. (2021). Interpretable deep learning for marble tiles sorting. In DeLTA, pages 101–108.
Pal, A., Xue, Z., Befano, B., Rodriguez, A. C., Long, L. R., Schiffman, M., and Antani, S. (2021). Deep metric learning for cervical image classification. IEEE Access, 9:53266–53275.
Rajpoot, A. and K.R., S. (2023). Enhancing rare retinal disease classification: a few-shot meta-learning framework utilizing fundus images. Multimedia Tools and Applications, 83:1–19.
Serrano, N. and Bellogín, A. (2023). Siamese neural networks in recommendation. Neural Computing and Applications, 35(19):13941–13953.
Sidiropoulos, G. K., Ouzounis, A. G., Papakostas, G. A., Lampoglou, A., Sarafis, I. T., Stamkos, A., and Solakis, G. (2022). Hand-crafted and learned feature aggregation for visual marble tiles screening. Journal of Imaging, 8(7).
Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., and Salakhutdinov, R. (2014). Dropout: A simple way to prevent neural networks from overfitting. Journal of Machine Learning Research, 15(56):1929–1958.
Vignesh Baalaji, S., Sandhya, S., Sajidha, S. A., Nisha, V. M., Vimalapriya, M. D., and Tyagi, A. K. (2023). Autonomous face mask detection using single shot multi-box detector, and ResNet-50 with identity retrieval through face matching using deep siamese neural network. Journal of Ambient Intelligence and Humanized Computing, 14(8):11195–11205.
Wang, F. and Liu, H. (2021). Understanding the behaviour of contrastive loss. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 2495–2504.
Zheng, D., Zhong, H., Camps-Valls, G., Cao, Z., Ma, X., Mills, B., Hu, X., Hou, M., and Ma, C. (2024). Explainable deep learning for automatic rock classification. Computers & Geosciences, 184:105511.
