Scheduling Policies for Bulk Data Transfer Inter Data Center using Routing and Spectrum Allocation

• Léia Sousa de Sousa Universidade de Brasília
• André C. Drummond Universidade de Brasília

DOI: https://doi.org/10.5753/sbrc.2019.7379

Abstract

Bulk Data Transfer (BDT) and its generalization, Multiple Bulk Data Transfer (MBDT), are critical services for business operations in geo-distributed inter-center data networks. In these networks, BDT or MBDT applications perform synchronization, resynchronization, data replication, virtual machine migration, and big data aggregation, among other tasks, requiring large amounts of bandwidth and efficient traffic engineering solutions. Elastic optical networks (EON) enable on-demand resource provisioning and allocation through Spectrum Routing and Allocation (RSA). This paper proposes and compares application-aware dynamic RSA solutions employing Smallest Deadline First (SDF), Larger Data Amount (LDA), Smallest Data Amount (SDA), and Smallest Remaining Time (SRT) scheduling techniques.

Keywords: Scheduling Policies, Elastic Optical Networks, Big Data

References

Aibin, M. and Walkowiak, K. (2017). Analysis of inter-data center elastic optical network. In 19th International Conference on Transparent Optical Networks (ICTON), 2017, pages 1–4. IEEE.

Castro, M. and Liskov, B. (2002). Practical byzantine fault tolerance and proactive recovery. ACM Transactions on Computer Systems (TOCS), 20(4):398–461.

Chatterjee, B. C., Kitsuwan, N., and Oki, E. (2017). Performance evaluation of firstlast- exact fit spectrumallocation policy for elastic optical networks. In 2017 19th International Conference on Transparent Optical Networks (ICTON), pages 1–4.

Cormen, T. H., Leiserson, C. E., Rivest, R. L., and Stein, C. (2009). Introduction to algorithms. MIT press.

Costa, L. R., de Sousa, L. S., de Oliveira, F. R., da Silva, K. A., Júnior, P. J. S., and Drummond, A. C. (2016). Ons: Simulador de eventos discretos para redes ´opticas wdmeon. In XXXIV Simpósio Brasileiro de Redes de Computadores e Sistemas Distribu´ıdos (SBRC). Sociedade Brasileira de Computação (SBC).

Deng, G. and Wang, K. (2018). An application-aware qos routing algorithm for sdn-based iot networking. In 2018 IEEE Symposium on Computers and Communications (ISCC), pages 00186–00191.

Li, G., Qian, Y., Liu, L., and Yang, Y. R. (2018). Jms: Joint bandwidth allocation and flow assignment for transfers with multiple sources. In 2018 IEEE Third International Conference on Data Science in Cyberspace (DSC), pages 123–130. IEEE.

Lu, W., Liang, L., and Zhu, Z. (2017). On vnf-sc deployment and task scheduling for bulk-data transfers in inter-dc eons. In IEEE/CIC Int. Conf. Communications in China (ICCC), pages 1–4.

Lu, W. and Zhu, Z. (2015). Malleable reservation based bulk-data transfer to recycle spectrum fragments in elastic optical networks. Journal of Lightwave Technology, 33(10):2078–2086.

Luo, L., Yu, H., and Ye, Z. (2018). Deadline-guaranteed point-to-multipoint bulk transfers in inter-datacenter networks. In 2018 IEEE International Conference on Communications (ICC), pages 1–6. IEEE.

Sousa, L. S. and Drummond, A. C. (2017). Provendo multiplas transfências de dados em massa com roteamento e alocac¸ ão de espectro ciente da aplicação em redes opticas el´asticas. Simpósio Brasileiro de Redes de Computadores (SBRC), 35(1/2017).

Srinivasan, S. M., Truong-Huu, T., and Gurusamy, M. (2018). Deadline-aware scheduling and flexible bandwidth allocation for big-data transfers. IEEE Access, 6:74400–74415.

Wang, N., Jue, J. P., Wang, X., Zhang, Q., Cankaya, H. C., and Sekiya, M. (2015). Holding-time-aware scheduling for immediate and advance reservation in elastic optical networks. In 2015 IEEE International Conference on Communications (ICC), pages 5180–5185. IEEE.

Wu, Y., Zhang, Z.,Wu, C., Guo, C., Li, Z., and Lau, F. C. (2017). Orchestrating bulk data transfers across geo-distributed datacenters. IEEE Transactions on Cloud Computing, 5(1):112–125.

Yen, J. Y. (1971). Finding the k shortest loopless paths in a network. management Science, 17(11):712–716.

Zhang, H., Chen, K., Bai, W., Han, D., Tian, C., Wang, H., Guan, H., and Zhang, M. (2015). Guaranteeing deadlines for inter-datacenter transfers. In Proceedings of the Tenth European Conference on Computer Systems, EuroSys ’15, pages 20:1– 20:14, New York, NY, USA. ACM.