Reference Architecture for Big Data in the Public Sector

• Victoria T. Oliveira UFC
• Rossana M. C. Andrade UFC
• Miguel Fraklin de Castro UFC
• Pedro Almir M. Oliveira UFC / IFMA
• Maria Inês Vale Silva UFC / SEFAZ-CE
• Davyson S. Ribeiro UFC / SEFAZ-CE
• Ismayle S. Santos UFC / UECE

DOI: https://doi.org/10.5753/lasdigov.2026.23579

Abstract

This article presents the proposal and evaluation of a Reference Architecture for Big Data Systems in the public sector, designed based on modern data engineering principles and aligned with approaches such as Data Mesh and the Medallion architecture. The architecture organizes data flow into well-defined layers, promoting scalability, governance, and data reuse throughout the analytical lifecycle. Additionally, it incorporates guidelines that foster team autonomy, process standardization, and improved communication among stakeholders. The evaluation involved 18 professionals with experience in Data Science and Big Data. The results indicate a positive perception regarding the clarity, organization, and applicability of the proposed architecture. Participants highlighted the clear definition of components and their support for task execution and team integration. Furthermore, the architecture demonstrated adaptability to different contexts and demands. It is concluded that the proposed architecture represents a viable alternative to support Big Data initiatives in the public sector, contributing to greater efficiency, organization, and quality in data usage.

References

Chamikara, M., Bertok, P., Liu, D., Camtepe, S., and Khalil, I. (2020). Efficient privacy preservation of big data for accurate data mining. Information Sciences, 527:420–443.

Davoudian, A. and Liu, M. (2020). Big data systems: A software engineering perspective. 53(5).

Ismail, F. N., Sengupta, A., and Amarasoma, S. (2025). Big data architecture for large organizations. arXiv preprint arXiv:2505.04717.

Kleppmann, M. (2017). Designing data-intensive applications: The big ideas behind reliable, scalable, and maintainable systems. ” O’Reilly Media, Inc.”.

Mishra, S., Shinde, M., Yadav, A., Ayyub, B., and Rao, A. (2024). An ai-driven data mesh architecture enhancing decision-making in infrastructure construction and public procurement. arXiv preprint arXiv:2412.00224.

Oliveira, V., Andrade, R., Castro, M., and Santos, I. (2025). From acquisition to interpretation: A model for creating data storytelling in big data. In Anais do XIII Latin American Symposium on Digital Government, pages 227–236, Porto Alegre, RS, Brasil. SBC.

PRESSMAN, Roger S.; MAXIM, B. R. (2021). Engenharia de Software. McGraw-Hill Brasil, [S. l.], 9 edition.

Ramos, G., Fernandes, D., Coelho, J., and Aquino, A. (2022). Data lakes lógicos como plataformas para dados governamentais em sociedades e cidades inteligentes. In Anais do X Workshop de Computação Aplicada em Governo Eletrônico, pages 215–226, Porto Alegre, RS, Brasil. SBC.

Santos, I., Oliveira, P., Oliveira, V., Nogueira, T., Dantas, A., Menescal, L., Élcio Batista, and Andrade, R. (2023). Big data fortaleza: Plataforma inteligente para políticas públicas baseadas em evidências. In Anais do XI Workshop de Computação Aplicada em Governo Eletrônico, pages 200–211, Porto Alegre, RS, Brasil. SBC.

Shahnawaz, M. and Kumar, M. (2025). A comprehensive survey on big data analytics: Characteristics, tools and techniques. ACM Comput. Surv., 57(8).

Warren, J. and Marz, N. (2015). Big Data: Principles and best practices of scalable realtime data systems. Simon and Schuster.

Wu, J., Guo, S., Li, J., and Zeng, D. (2016). Big data meet green challenges: Greening big data. IEEE Systems Journal, 10(3):873–887.