Integrating and Processing Events from Heterogeneous Data Sources
Resumo
Environmental monitoring studies present many challenges. A huge amount of data are provided in different formats from different sources (e.g. sensor networks and databases). This paper presents a framework we have developed to overcome some of these problems, based on combining aspects of Enterprise Service Bus (ESB) architectures and Event Processing mechanisms. First, we treat integration using ESB and then use event processing to transform, filter and detect event patterns, where all data arriving at a given point are treated uniformly as event streams. A case study concerning data streams of meteorological stations is provided to show the feasibility of this solution.
Referências
Babu, S. and Widom, J. (2001). Continuous queries over data streams. SIGMOD Rec., 30(3):109–120.
Bailey, D. and Wright, E. (2003). Practical SCADA for Industry. IDC Technologies.
Broering, A., Foerster, T., Jirka, S., and Priess, C. (2010). Sensor bus: an intermediary layer for linking geosensors and the sensor web. In Proc. COM.Geo ’10, pages 12:1–12:8.
Churcher, G. E. and Foley, J. (2010). Applying complex event processing and extending sensor web enablement to a health care sensor network architecture. In Sensor Systems and Software, volume 24 of Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, pages 1–10. Springer.
Dunkel, J. (2009). On complex event processing for sensor networks. In Autonomous Decentralized Systems, 2009. ISADS ’09. International Symposium on, pages 1–6.
EsperTech Inc. (2012). Esper website. [link] (Accessed Apr, 2012).
Etzion, O. and Niblett, P. (2011). Event Processing in Action. Manning.
Gurgen, L., Roncancio, C., Labbé, C., Bottaro, A., and Olive, V. (2008). Sstreamware: a service oriented middleware for heterogeneous sensor data management. In Proc. 5th Intl conf. on Pervasive services, ICPS ’08, pages 121–130.
Hohpe, G. and Woolf, B. (2003). Enterprise Integration Patterns: Designing, Building, and Deploying Messaging Solutions. Addison-Wesley Professional.
Luckham, D. C. (2001). The Power of Events: An Introduction to Complex Event Processing in Distributed Enterprise Systems. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA.
Luckham, D. C. (2006). What’s the Difference Between ESP and CEP? [link] (Accessed Jun, 2012).
Magid, Y., Sharon, G., Arcushin, S., Ben-Harrush, I., and Rabinovich, E. (2010). Industry experience with the IBM Active Middleware Technology (AMiT) Complex Event Processing engine. In Proc. 4th ACM DEBS ’10, pages 140–149.
Menge, F. (2007). Enterprise service bus. Free and Open Source Software Conference.
MuleSoft Inc. (2012). Mule website. [link] (Accessed Apr, 2012).
Rademakers, T. and Dirksen, J. (2009). Open-Source ESBs in Action. Manning Publications Co., Greenwich, CT, USA.
Teymourian, K. and Paschke, A. (2010). Enabling knowledge-based complex event processing. In Proc. EDBT/ICDT Workshops, EDBT ’10, pages 37:1–37:7, New York, NY, USA. ACM.
Bailey, D. and Wright, E. (2003). Practical SCADA for Industry. IDC Technologies.
Broering, A., Foerster, T., Jirka, S., and Priess, C. (2010). Sensor bus: an intermediary layer for linking geosensors and the sensor web. In Proc. COM.Geo ’10, pages 12:1–12:8.
Churcher, G. E. and Foley, J. (2010). Applying complex event processing and extending sensor web enablement to a health care sensor network architecture. In Sensor Systems and Software, volume 24 of Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, pages 1–10. Springer.
Dunkel, J. (2009). On complex event processing for sensor networks. In Autonomous Decentralized Systems, 2009. ISADS ’09. International Symposium on, pages 1–6.
EsperTech Inc. (2012). Esper website. [link] (Accessed Apr, 2012).
Etzion, O. and Niblett, P. (2011). Event Processing in Action. Manning.
Gurgen, L., Roncancio, C., Labbé, C., Bottaro, A., and Olive, V. (2008). Sstreamware: a service oriented middleware for heterogeneous sensor data management. In Proc. 5th Intl conf. on Pervasive services, ICPS ’08, pages 121–130.
Hohpe, G. and Woolf, B. (2003). Enterprise Integration Patterns: Designing, Building, and Deploying Messaging Solutions. Addison-Wesley Professional.
Luckham, D. C. (2001). The Power of Events: An Introduction to Complex Event Processing in Distributed Enterprise Systems. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA.
Luckham, D. C. (2006). What’s the Difference Between ESP and CEP? [link] (Accessed Jun, 2012).
Magid, Y., Sharon, G., Arcushin, S., Ben-Harrush, I., and Rabinovich, E. (2010). Industry experience with the IBM Active Middleware Technology (AMiT) Complex Event Processing engine. In Proc. 4th ACM DEBS ’10, pages 140–149.
Menge, F. (2007). Enterprise service bus. Free and Open Source Software Conference.
MuleSoft Inc. (2012). Mule website. [link] (Accessed Apr, 2012).
Rademakers, T. and Dirksen, J. (2009). Open-Source ESBs in Action. Manning Publications Co., Greenwich, CT, USA.
Teymourian, K. and Paschke, A. (2010). Enabling knowledge-based complex event processing. In Proc. EDBT/ICDT Workshops, EDBT ’10, pages 37:1–37:7, New York, NY, USA. ACM.
Publicado
16/07/2012
Como Citar
KOGA, Ivo; MEDEIROS, Claudia Bauzer.
Integrating and Processing Events from Heterogeneous Data Sources. In: BRAZILIAN E-SCIENCE WORKSHOP (BRESCI), 6. , 2012, Curitiba/PR.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2012
.
p. 32-39.
ISSN 2763-8774.
