Design and Development of a Distributed Data Collection and Treatment Service for Internet of Things Environments
Abstract
The development of the Internet of Things (IoT) has led to a considerable increase in the number and variety of devices connected to the Internet. Sensors have become a regular part of our environment, installed in cars and buildings, as well as smart phones and other devices that continuously collect data about our lives even without our intervention. With such connected devices, a broad range of applications has been developed and deployed, including those dealing with massive volumes of data. In this paper, we propose a data management approach within an IoT environment, thus contributing with the specification of functionalities and the conception of techniques for collecting, filtering and storing data conveniently and efficiently. Our main goal is to enable multiple and distinct middleware to work together in a non-intrusive manner. The corresponding developed prototype is used for the validation of our proposal in a case study regarding a Smart Home System scenario.
Keywords:
Internet of Things, Data Management
References
Ashton, K. (2009). That ‘internet of things’ thing. RFiD Journal, 22(7), 97-114.
Atzori, L., Iera, A., and Morabito, G. (2010). The internet of things: A survey. Computer networks, 54(15), 2787-2805.
Bahga, A., and Madisetti, V. (2014). Internet of Things: A Hands-on Approach. 1a. ed. VPT.
Botta, A., de Donato, W., Persico, V., & Pescapé, A. (2016). Integration of cloud computing and internet of things: a survey. Future Generation Computer Systems. 56(1), 684-700.
Cassandra (2016) “Cassandra”. Disponível em: <http://cassandra.apache.org>. Acessado em Janeiro, 2016.
Ferreira, H. G. C., Canedo, E. D., De Sousa Júnior, R. T. (2014). A ubiquitous communication architecture integrating transparent UPnP and REST APIs. International Journal of Embedded Systems, 6(2-3), 188-197.
Chaqfeh, M., and Mohamed, N. (2012). “Challenges in middleware solutions for the internet of things.” In Collaboration Technologies and Systems (CTS), 2012 International Conference on, pages 21-26. IEEE.
Cockcroft, A., and Sheahan, D. (2011). “Benchmarking cassandra scalability on awsover a million writes per second.” Disponível em [link]. Acessado em janeiro de 2016.
Cooper, J., and James, A. (2009). Challenges for database management in the internet of things. IETE Technical Review, 26(5), 320-329.
Fersi, G. (2015). “Middleware for Internet of Things: A Study.” In International Conference on Distributed Computing in Sensor Systems, pages 230-235. IEEE.
Fremantle, P. (2014). A reference architecture for the Internet of Things. WSO2 White paper.
Garg, N. (2013). Apache Kafka. Packt Publishing Ltd. Birmingham.
Ghosh, A., and Das, S. K. (2008). Coverage and connectivity issues in wireless sensor networks: A survey. Pervasive and Mobile Computing, 4(3), 303-334.
Gubbi, J., Buyya, R., Marusic, S., and Palaniswami, M. (2013). Internet of Things (IoT): A vision, architectural elements, and future directions. Future Generation Computer Systems, 29(7), 1645-1660.
Kreps, J., Narkhede, N., and Rao, J. (2011). Kafka: A distributed messaging system for log processing. In Network Meets Database, pages 1-7.
Lakshman, A., and Malik, P. (2010). Cassandra: a decentralized structured storage system. ACM SIGOPS Operating Systems Review. 44(2), 35-40.
Le-Phuoc, D., Nguyen-Mau, H. Q., Parreira, J. X., and Hauswirth, M. (2012). A middleware framework for scalable management of linked streams. Web Semantics: Science, Services and Agents on the World Wide Web, 16:42-51.
Xively platform. Disponível em <http://xively.com>. Acessado em Janeiro, 2016.
Lu, B., & Xiaohui, Y. (2016). Research on Cassandra Data Compaction Strategies for Time-Series Data. In Journal of computers, 11(6), 504 – 512.
Mashal, I., Alsaryrah, O., Chung, T. Y., Yang, C. Z., Kuo, W. H., and Agrawal, D. P. (2015). Choices for interaction with things on Internet and underlying issues. Ad Hoc Networks, 28(1), 68-90.
Misra, G., Kumar, V., Agarwal, A., and Agarwal, K. (2016). Internet of Things (IoT)–A Technological Analysis and Survey on Vision, Concepts, Challenges, Innovation Directions, Technologies, and Applications. American Journal of Electrical and Electronic Engineering, 4(1), 23-32.
Misra, P., Simmhan, Y., and Warrior, J. (2015). Towards a Practical Architecture for the Next Generation Internet of Things. arXiv preprint arXiv:1502.00797.
Nan, C., Lee, Y., Tila, F., and Kim, D. H. (2016). Design and Implementation of Middleware Based on ID and IP Address for Actuator Networks. International Journal of Smart home. 10(1), 41-48.
Perera, C., Zaslavsky, A., Christen, P., and Georgakopoulos, D. (2014). Context aware computing for the internet of things: A survey. IEEE Communications Surveys & Tutorials, 16(1):414-454.
Pires, P. F., Cavalcante, E., Barros, T., Delicato, F. C., Batista, T., and Costa, B. (2014). A platform for integrating physical devices in the Internet of Things. In Embedded and Ubiquitous Computing, 12th IEEE International Conference, pages 234-241.
Qin, W., Li, Q., Sun, L., Zhu, H., Liu, Y. (2011) RestThing: A Restful Web service infrastructure for mash-up physical and Web resources. In Embedded and Ubiquitous Computing, 9th International Conference, pages 197-204.
Rafiei, D., and Mendelzon, A. (1997). Similarity-based queries for time series data. ACM SIGMOD, 26(2):13-25.
Shahrivari, S. (2014). Beyond batch processing: towards real-time and streaming big data. Computers, 3(4):117-129.
Soldatos, J., Serrano, M., Hauswirth, M. (2012b) Convergence of Utility Computing with the Internet-of-Things. In Innovative Mobile and Internet Services in Ubiquitous Computing, 2012 6th International Conference, pages 874-879.
Soldatos, J., Kefalakis, N., Hauswirth, M., Serrano, M., Calbimonte, J. P., Riahi, M., and Skorin-Kapov, L. (2015b). OpenIoT: Open Source Internet-of-Things in the Cloud. In Springer International Publishing, pages 13-25.
Storm. Disponível em <http://storm.incubator.apache.org>. Acessado em Janeiro, 2016.
Streamparse. Disponível em <https://pypi.python.org/pypi/streamparse/2.1.3>. Acessado em Janeiro, 2016.
Teixeira, T., Hachem, S., Issarny, V., and Georgantas, N. (2011). Service oriented middleware for the internet of things: A perspective. Pages 220-229. Springer Berlin Heidelberg, Berlin, Heidelberg.
Zookeeper. Disponível em <http://zookeeper.apache.org>. Acessado em Janeiro, 2016.
Atzori, L., Iera, A., and Morabito, G. (2010). The internet of things: A survey. Computer networks, 54(15), 2787-2805.
Bahga, A., and Madisetti, V. (2014). Internet of Things: A Hands-on Approach. 1a. ed. VPT.
Botta, A., de Donato, W., Persico, V., & Pescapé, A. (2016). Integration of cloud computing and internet of things: a survey. Future Generation Computer Systems. 56(1), 684-700.
Cassandra (2016) “Cassandra”. Disponível em: <http://cassandra.apache.org>. Acessado em Janeiro, 2016.
Ferreira, H. G. C., Canedo, E. D., De Sousa Júnior, R. T. (2014). A ubiquitous communication architecture integrating transparent UPnP and REST APIs. International Journal of Embedded Systems, 6(2-3), 188-197.
Chaqfeh, M., and Mohamed, N. (2012). “Challenges in middleware solutions for the internet of things.” In Collaboration Technologies and Systems (CTS), 2012 International Conference on, pages 21-26. IEEE.
Cockcroft, A., and Sheahan, D. (2011). “Benchmarking cassandra scalability on awsover a million writes per second.” Disponível em [link]. Acessado em janeiro de 2016.
Cooper, J., and James, A. (2009). Challenges for database management in the internet of things. IETE Technical Review, 26(5), 320-329.
Fersi, G. (2015). “Middleware for Internet of Things: A Study.” In International Conference on Distributed Computing in Sensor Systems, pages 230-235. IEEE.
Fremantle, P. (2014). A reference architecture for the Internet of Things. WSO2 White paper.
Garg, N. (2013). Apache Kafka. Packt Publishing Ltd. Birmingham.
Ghosh, A., and Das, S. K. (2008). Coverage and connectivity issues in wireless sensor networks: A survey. Pervasive and Mobile Computing, 4(3), 303-334.
Gubbi, J., Buyya, R., Marusic, S., and Palaniswami, M. (2013). Internet of Things (IoT): A vision, architectural elements, and future directions. Future Generation Computer Systems, 29(7), 1645-1660.
Kreps, J., Narkhede, N., and Rao, J. (2011). Kafka: A distributed messaging system for log processing. In Network Meets Database, pages 1-7.
Lakshman, A., and Malik, P. (2010). Cassandra: a decentralized structured storage system. ACM SIGOPS Operating Systems Review. 44(2), 35-40.
Le-Phuoc, D., Nguyen-Mau, H. Q., Parreira, J. X., and Hauswirth, M. (2012). A middleware framework for scalable management of linked streams. Web Semantics: Science, Services and Agents on the World Wide Web, 16:42-51.
Xively platform. Disponível em <http://xively.com>. Acessado em Janeiro, 2016.
Lu, B., & Xiaohui, Y. (2016). Research on Cassandra Data Compaction Strategies for Time-Series Data. In Journal of computers, 11(6), 504 – 512.
Mashal, I., Alsaryrah, O., Chung, T. Y., Yang, C. Z., Kuo, W. H., and Agrawal, D. P. (2015). Choices for interaction with things on Internet and underlying issues. Ad Hoc Networks, 28(1), 68-90.
Misra, G., Kumar, V., Agarwal, A., and Agarwal, K. (2016). Internet of Things (IoT)–A Technological Analysis and Survey on Vision, Concepts, Challenges, Innovation Directions, Technologies, and Applications. American Journal of Electrical and Electronic Engineering, 4(1), 23-32.
Misra, P., Simmhan, Y., and Warrior, J. (2015). Towards a Practical Architecture for the Next Generation Internet of Things. arXiv preprint arXiv:1502.00797.
Nan, C., Lee, Y., Tila, F., and Kim, D. H. (2016). Design and Implementation of Middleware Based on ID and IP Address for Actuator Networks. International Journal of Smart home. 10(1), 41-48.
Perera, C., Zaslavsky, A., Christen, P., and Georgakopoulos, D. (2014). Context aware computing for the internet of things: A survey. IEEE Communications Surveys & Tutorials, 16(1):414-454.
Pires, P. F., Cavalcante, E., Barros, T., Delicato, F. C., Batista, T., and Costa, B. (2014). A platform for integrating physical devices in the Internet of Things. In Embedded and Ubiquitous Computing, 12th IEEE International Conference, pages 234-241.
Qin, W., Li, Q., Sun, L., Zhu, H., Liu, Y. (2011) RestThing: A Restful Web service infrastructure for mash-up physical and Web resources. In Embedded and Ubiquitous Computing, 9th International Conference, pages 197-204.
Rafiei, D., and Mendelzon, A. (1997). Similarity-based queries for time series data. ACM SIGMOD, 26(2):13-25.
Shahrivari, S. (2014). Beyond batch processing: towards real-time and streaming big data. Computers, 3(4):117-129.
Soldatos, J., Serrano, M., Hauswirth, M. (2012b) Convergence of Utility Computing with the Internet-of-Things. In Innovative Mobile and Internet Services in Ubiquitous Computing, 2012 6th International Conference, pages 874-879.
Soldatos, J., Kefalakis, N., Hauswirth, M., Serrano, M., Calbimonte, J. P., Riahi, M., and Skorin-Kapov, L. (2015b). OpenIoT: Open Source Internet-of-Things in the Cloud. In Springer International Publishing, pages 13-25.
Storm. Disponível em <http://storm.incubator.apache.org>. Acessado em Janeiro, 2016.
Streamparse. Disponível em <https://pypi.python.org/pypi/streamparse/2.1.3>. Acessado em Janeiro, 2016.
Teixeira, T., Hachem, S., Issarny, V., and Georgantas, N. (2011). Service oriented middleware for the internet of things: A perspective. Pages 220-229. Springer Berlin Heidelberg, Berlin, Heidelberg.
Zookeeper. Disponível em <http://zookeeper.apache.org>. Acessado em Janeiro, 2016.
Published
2016-10-04
How to Cite
HUACARPUMA, Ruben C.; DE SOUSA JÚNIOR, Rafael T.; HOLANDA, Maristela; LIFSCHITZ, Sérgio.
Design and Development of a Distributed Data Collection and Treatment Service for Internet of Things Environments. In: BRAZILIAN SYMPOSIUM ON DATABASES (SBBD), 31. , 2016, Salvador/BA.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2016
.
p. 28-39.
ISSN 2763-8979.
DOI: https://doi.org/10.5753/sbbd.2016.24306.
