Embracing Data Irregularities in Multivariate Time Series with Recurrent and Graph Neural Networks

• Marcel Rodrigues de Barros USP
• Thiago Lizier Rissi USP
• Eduardo Faria Cabrera USP
• Eduardo Aoun Tannuri USP
• Edson Satoshi Gomi USP
• Rodrigo Augusto Barreira Petróleo Brasileiro S.A.
• Anna Helena Reali Costa USP

Resumo

Data collection in many engineering fields involves multivariate time series gathered from a sensor network. These sensors often display differing sampling rates, missing data, and various irregularities. To manage these issues, complex preprocessing mechanisms are required, which become coupled with any statistical model trained with the transformed data. Modeling the motion of seabed-anchored floating platforms from measurements is a typical example for that. We propose and analyze a model that uses both recurrent and graph neural networks to handle irregularly sampled multivariate time series, while maintaining low computational cost. In this model, each time series is represented as a node in a heterogeneous graph, where edges depict the relationships between each measured variable. The time series are encoded using independent recurrent neural networks. A graph neural network then propagates information across the time series using attention layers. The outcome is a set of updated hidden representations used by the recurrent neural networks to create forecasts in an autoregressive manner. This model can generate forecasts for all input time series simultaneously while remaining lightweight. We argue that this architecture opens up new possibilities as the model can be integrated into low-capacity systems without needing expensive GPU clusters for inference.