Diversity of Meteorological Data of the City of Rio de Janeiro: A Proposal for Storage Architecture and Data Flow for Forecast Models

  • Bruno L. Freitas Fluminense Federal University (UFF)
  • Augusto J. M. da Fonseca Federal Center for Technological Education of Rio de Janeiro (CEFET/RJ)
  • Eduardo Bezerra Federal Center for Technological Education of Rio de Janeiro (CEFET/RJ)
  • Flávia C. Bernardini Fluminense Federal University (UFF)
  • Mariza Ferro Fluminense Federal University (UFF)

Abstract


Precipitation nowcasting is an essential component of early warning systems and consecutive actions within crisis management for extreme weather events in urban areas. This article presents the work in progress for the collection, description of features, preparation, and use of multiple meteorological observations as data sources available for the city of Rio de Janeiro. The challenge is to bring together different sources, which are available openly or under restrictions of cooperation agreements, from different portals and websites, under the responsibility of different owners in different spheres (municipal, state and federal), with the objective of developing a data lake that brings them all together and can be used for the development of forecasting models.

Keywords: extreme weather, data lake

References

Ferro, M., Bezerra, E., Ogasawara, E., Moraes, N., and Porto, F. (2022). Towards a definition for extreme weather events in rio de janeiro city. In Anais Estendidos do XXXVII Simpósio Brasileiro de Bancos de Dados, pages 181–186. SBC.

Jitkajornwanich, K., Pant, N., Fouladgar, M., and Elmasri, R. (2020). A survey on spatial, temporal, and spatio-temporal database research and an original example of relevant applications using sql ecosystem and deep learning. Journal of Information and Telecommunication, 4(4):524–559.

Marzban, C. and Sandgathe, S. (2006). Cluster analysis for verification of precipitation fields. Weather and Forecasting, 21(5):824–838.

Salles Civitarese, D., Szwarcman, D., Zadrozny, B., and Watson, C. (2021). Extreme precipitation seasonal forecast using a transformer neural network. arXiv e-prints, pages arXiv–2107.

Stocker, T. F., Qin, D., Plattner, G.-K., Tignor, M. M., Allen, S. K., Boschung, J., Nauels, A., Xia, Y., Bex, V., and Midgley, P. M. (2014). Climate change 2013: The physical science basis. contribution of working group i to the fifth assessment report of ipcc the intergovernmental panel on climate change.

Wanderley, H. and Bunhak, A. (2016). Alteration in precipitation and number of days without rain in the southern region of rio de janeiro state. rev brasil geog físic. 9. 7. 2341–2353.
Published
2023-09-25
FREITAS, Bruno L.; DA FONSECA, Augusto J. M.; BEZERRA, Eduardo; BERNARDINI, Flávia C.; FERRO, Mariza. Diversity of Meteorological Data of the City of Rio de Janeiro: A Proposal for Storage Architecture and Data Flow for Forecast Models. In: WORKSHOP ON DATA-DRIVEN EXTREME EVENTS ANALYTICS - BRAZILIAN SYMPOSIUM ON DATABASES (SBBD), 38. , 2023, Belo Horizonte/MG. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2023 . p. 306-311. DOI: https://doi.org/10.5753/sbbd_estendido.2023.235307.