UMBU: Um Framework para Experimentação e Avaliação de QoE em Transmissões Multimídia
Abstract
Among the leading available solutions for network multimedia Quality of Experience (QoE) analysis, EvalVid is the primary open source reference in this area. However, this tool has numerous shortcomings ranging from the installation to QoE analysis, imposing severe restrictions that limit the operationalization of large-scale evaluations. In view of this, this paper proposes a breakthrough in the multimedia transmission QoE experimentation field, the Unified Multimedia-based Network Evaluation Platform (UMBU), a framework for multimedia experimentation and evaluation featuring a ubiquitous interface for refined management of experiments-related operations, as well as to provide a series of mechanisms that allow the conduction of multiple assessments in a scalable and flexible way.
References
Boucadairm, M. and Jacquenet, C. (2014). Software-Dened Networking: A Perspective from within a Service Provider Environment. Internet Engineering Task Force Request for Comments (RFC 7149).
Bouras, C., Charalambides, S., Drakoulelis, M., Kioumourtzis, G., and Stamos, K. (2013). Simulation design and execution-the case of tral. In SIMULTECH, pages 27–34.
Chen, Y., Wu, K., and Zhang, Q. (2015). From QoS to QoE: A tutorial on video quality assessment. IEEE Communications Surveys & Tutorials, 17(2):1126–1165.
Chikkerur, S., Sundaram, V., Reisslein, M., and Karam, L. J. (2011). Objective video quality assessment methods: A classication, review, and performance comparison. IEEE transactions on broadcasting, 57(2):165–182.
Cisco, C. V. N. I. (2017). Global mobile data trafc forecast update, 2016–2021 white paper, 2017.
Clark, A., Wu, Q., Schott, R., and Zorn, G. (2014). RTP Control Protocol (RTCP) Extended Report (XR) Blocks for Mean Opinion Score (MOS) Metric Reporting. Internet Engineering Task Force Request for Comments (RFC 7266).
Gaubatz, M. and Hemami, S. (2011). Metrix mux visual quality assessment package. http://www.foulard.ece.cornell.edu/gaubatz/metrixmux.
Ke, C.-H., Lin, C.-H., Shieh, C.-K., and Hwang, W.-S. (2006). A novel realistic simulation tool for video transmission over wireless network. In Sensor Networks, Ubiquitous, and Trustworthy Computing, 2006. IEEE International Conference on, volume 1, pages 7–pp. IEEE.
Ke, C.-H., Shieh, C.-K., Hwang, W.-S., and Ziviani, A. (2008). An evaluation framework for more realistic simulations of mpeg video transmission. Journal of Information Science & Engineering, 24(2).
Klaue, J., Rathke, B., and Wolisz, A. (2003). Evalvid–a framework for video transmission and quality evaluation. In International Conference on Modelling Techniques and Tools for Computer Performance Evaluation, pages 255–272. Springer.
Krasula, L., Klíma, M., Rogard, E., and Jeanblanc, E. (2011). Matlab-based applications for image processing and image quality assessment–part i: Software description. Radioengineering, 20(4):1009–1015.
Mijumbi, R., Serrat, J., Gorricho, J. L., Bouten, N., Turck, F. D., and Boutaba, R. (2016). Network function virtualization: State-of-the-art and research challenges. IEEE Communications Surveys Tutorials, 18(1):236–262.
Murthy, A. V. and Karam, L. J. (2010). A matlab-based framework for image and video quality evaluation. In Quality of Multimedia Experience (QoMEX), 2010 Second International Workshop on, pages 242–247. IEEE.
Silva, F. S. D., Neto, A. V., Maciel, D., Castillo-Lema, J., Silva, F., Frosi, P., and Cerqueira, E. (2016). An innovative software-dened winemo architecture for advanced qos-guaranteed mobile service transport. Computer Networks, 107:270–291.
Vatolin, D., Moskvin, A., Petrov, O., and Trunichkin, N. (2009). MSU Video Quality Measurement Tool.
Wang, Z., Sheikh, H. R., Bovik, A. C., et al. (2003). Objective video quality assessment. The handbook of video databases: design and applications, 41:1041–1078.
Bouras, C., Charalambides, S., Drakoulelis, M., Kioumourtzis, G., and Stamos, K. (2013). Simulation design and execution-the case of tral. In SIMULTECH, pages 27–34.
Chen, Y., Wu, K., and Zhang, Q. (2015). From QoS to QoE: A tutorial on video quality assessment. IEEE Communications Surveys & Tutorials, 17(2):1126–1165.
Chikkerur, S., Sundaram, V., Reisslein, M., and Karam, L. J. (2011). Objective video quality assessment methods: A classication, review, and performance comparison. IEEE transactions on broadcasting, 57(2):165–182.
Cisco, C. V. N. I. (2017). Global mobile data trafc forecast update, 2016–2021 white paper, 2017.
Clark, A., Wu, Q., Schott, R., and Zorn, G. (2014). RTP Control Protocol (RTCP) Extended Report (XR) Blocks for Mean Opinion Score (MOS) Metric Reporting. Internet Engineering Task Force Request for Comments (RFC 7266).
Gaubatz, M. and Hemami, S. (2011). Metrix mux visual quality assessment package. http://www.foulard.ece.cornell.edu/gaubatz/metrixmux.
Ke, C.-H., Lin, C.-H., Shieh, C.-K., and Hwang, W.-S. (2006). A novel realistic simulation tool for video transmission over wireless network. In Sensor Networks, Ubiquitous, and Trustworthy Computing, 2006. IEEE International Conference on, volume 1, pages 7–pp. IEEE.
Ke, C.-H., Shieh, C.-K., Hwang, W.-S., and Ziviani, A. (2008). An evaluation framework for more realistic simulations of mpeg video transmission. Journal of Information Science & Engineering, 24(2).
Klaue, J., Rathke, B., and Wolisz, A. (2003). Evalvid–a framework for video transmission and quality evaluation. In International Conference on Modelling Techniques and Tools for Computer Performance Evaluation, pages 255–272. Springer.
Krasula, L., Klíma, M., Rogard, E., and Jeanblanc, E. (2011). Matlab-based applications for image processing and image quality assessment–part i: Software description. Radioengineering, 20(4):1009–1015.
Mijumbi, R., Serrat, J., Gorricho, J. L., Bouten, N., Turck, F. D., and Boutaba, R. (2016). Network function virtualization: State-of-the-art and research challenges. IEEE Communications Surveys Tutorials, 18(1):236–262.
Murthy, A. V. and Karam, L. J. (2010). A matlab-based framework for image and video quality evaluation. In Quality of Multimedia Experience (QoMEX), 2010 Second International Workshop on, pages 242–247. IEEE.
Silva, F. S. D., Neto, A. V., Maciel, D., Castillo-Lema, J., Silva, F., Frosi, P., and Cerqueira, E. (2016). An innovative software-dened winemo architecture for advanced qos-guaranteed mobile service transport. Computer Networks, 107:270–291.
Vatolin, D., Moskvin, A., Petrov, O., and Trunichkin, N. (2009). MSU Video Quality Measurement Tool.
Wang, Z., Sheikh, H. R., Bovik, A. C., et al. (2003). Objective video quality assessment. The handbook of video databases: design and applications, 41:1041–1078.
Published
2018-05-06
How to Cite
DE AZEVEDO, Carlos; P. NETO, Emídio; DOS SANTOS, Charles; SILVA, Felipe; VENÂNCIO NETO, Augusto.
UMBU: Um Framework para Experimentação e Avaliação de QoE em Transmissões Multimídia. In: DEMO SESSION - BRAZILIAN SYMPOSIUM ON COMPUTER NETWORKS AND DISTRIBUTED SYSTEMS (SBRC), 1. , 2018, Campos do Jordão.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2018
.
ISSN 2177-9384.
DOI: https://doi.org/10.5753/sbrc_estendido.2018.14167.
