ABSTRACT
This paper presents a metadata-based framework for software architecture evaluation of quality attributes. It implements a scenario-based approach that uses dynamic analysis and code repository mining to provide an automated way to reveal degradations of scenarios on releases of web-based systems. The evaluation process has three phases: (i) dynamic analysis that collects information of scenarios in terms of measurable quality attributes; (ii) degradation analysis that processes and compares the results of the dynamic analysis in term of quality attributes for two or more existing releases of a web-based system to identify degraded scenarios considering the desired quality attributes; (iii) repository mining that looks for development issues and commits associated to code assets of the degraded scenarios. The paper also presents and discusses the obtained results of the framework instantiation for the library module of a large-scale web system.
- Silva, L. and Balasubramaniam, D. 2012. Controlling software architecture erosion: A survey. Journal of Systems and Software. 85, 1 (January 2012), 132--151. Google ScholarDigital Library
- Taylor, R. N., Medvidovic, N. and Dashofy, E. M. 2009. Software Architecture: Foundations, Theory, and Practice. Wiley Publishing. Google ScholarDigital Library
- Clements, P., Kazman, R. and Klein, M. 2002. Evaluating Software Architectures: Methods and Case Studies. Addison-Wesley. Google ScholarDigital Library
- Ali Babar, M. and Gorton, I. 2004. Comparison of Scenario-Based Software Architecture Evaluation Methods. In Proceedings of APSEC'04. Washington, DC, USA, 600--607. Google ScholarDigital Library
- Kazman, R., Abowd, G., Bass, L. and Clements, P. 1996. Scenario-Based Analysis of Software Architecture. IEEE Softw. 13, 6 (November 1996), 47--55. Google ScholarDigital Library
- Roy, B. and Graham, T. C. N. 2008. Methods for Evaluating Software Architecture: A Survey. Technical Report No. 2008--545, School of Computing, Queen's University at Kingston. Ontario, Canada.Google Scholar
- Ganesan, D., Lindvall, M., Cleaveland, R., Jetley, R., Jones, P. and Zhang, Y. 2011. Architecture Reconstruction and Analysis of Medical Device Software. In Proceedings of WICSA'11. Washington, DC, USA, 194--203. Google ScholarDigital Library
- Ganesan, D., Keuler, T. and Nishimura, Y. 2009. Architecture compliance checking at run-time. Information and Software Technology. 51, 11 (November 2009), 1586--1600. Google ScholarDigital Library
- Abi-Antoun, M and Aldrich, J. 2009. Static extraction and conformance analysis of hierarchical runtime architectural structure using annotations. SIGPLAN Not. 44, 10 (October 2009), 321--340. Google ScholarDigital Library
- Ciraci, S., Sozer, H. and Tekinerdogan, B. 2012. An Approach for Detecting Inconsistencies between Behavioral Models of the Software Architecture and the Code. In Proceedings of COMPSAC'12. IEEE Computer Society, Washington, DC, USA, 257--266. Google ScholarDigital Library
- Gokhale, S. S. 2007. Architecture-Based Software Reliability Analysis: Overview and Limitations. IEEE Ns On Dependable And Secure Computing. 4, 1 (January 2007), 32--40. Google ScholarDigital Library
- Williams, L. G. and Smith, C. U. 2002. PASASM: a method for the performance assessment of software architectures. In Proceedings of WOSP'02. ACM, New York, USA, 179--189. Google ScholarDigital Library
- Malik, H., Hemmati, H. and Hassan, A. E. 2013. Automatic detection of performance deviations in the load testing of large scale systems. In Proceedings of ICSE'13. IEEE Press, Piscataway, NJ, USA, 1012--1021. Google ScholarDigital Library
- Nistor, A., Jiang, T. and Tan, L. 2013. Discovering, reporting, and fixing performance bugs. In Proceedings of MSR'13. IEEE Press, Piscataway, NJ, USA, 237--246. Google ScholarDigital Library
- Nguyen, T. H. D., Nagappan, M., Hassan, A. E., Nasser, M. and Flora, P. 2014. An industrial case study of automatically identifying performance regression-causes. In Proceedings of MSR'14. ACM, New York, NY, USA, 232--241. Google ScholarDigital Library
- Tibermacine, C. and Zernadji, T. 2011. Supervising the evolution of web service orchestrations using quality requirements. In Proceedings of ECSA'11, Ivica Crnkovic, Volker Gruhn, and Matthias Book (Eds.). Springer-Verlag, Berlin, Heidelberg, 1--16. Google ScholarDigital Library
- SINFO: http://www.info.ufrn.br/wikisistemas/doku.php (June 2014).Google Scholar
- Apache JMeter: http://jmeter.apache.org (June 2014).Google Scholar
Index Terms
A Metadata-based Framework for Quality Attribute Degradation Analysis in Web Systems
Recommendations
Automated architectural evaluation of web information systems
WebMedia '13: Proceedings of the 19th Brazilian symposium on Multimedia and the webTraditional scenario-based architectural analysis methods rely on manual review-based evaluation that requires advanced skills from architects and developers. They are usually applied when the architecture is under development, but before its ...
Automating the Assessment of the Performance Quality Attribute for Evolving Software Systems: An Exploratory Study
HICSS '15: Proceedings of the 2015 48th Hawaii International Conference on System SciencesThis paper describes an exploratory study for the evaluation of the performance quality attribute for releases of the same system. The main aim is to reveal performance degradations of architectural scenarios and their possible causes. Three software ...
A survey on quality attributes in service-based systems
Service-based systems have become popular in the software industry. In software engineering, it is widely acknowledged that requirements on quality attributes (e.g., performance, security, reliability) significantly impact the design of software ...
Comments