skip to main content
10.1145/2664551.2664570acmotherconferencesArticle/Chapter ViewAbstractPublication PageswebmediaConference Proceedingsconference-collections
research-article

A Metadata-based Framework for Quality Attribute Degradation Analysis in Web Systems

Authors Info & Claims
Published:18 November 2014Publication History

ABSTRACT

This paper presents a metadata-based framework for software architecture evaluation of quality attributes. It implements a scenario-based approach that uses dynamic analysis and code repository mining to provide an automated way to reveal degradations of scenarios on releases of web-based systems. The evaluation process has three phases: (i) dynamic analysis that collects information of scenarios in terms of measurable quality attributes; (ii) degradation analysis that processes and compares the results of the dynamic analysis in term of quality attributes for two or more existing releases of a web-based system to identify degraded scenarios considering the desired quality attributes; (iii) repository mining that looks for development issues and commits associated to code assets of the degraded scenarios. The paper also presents and discusses the obtained results of the framework instantiation for the library module of a large-scale web system.

References

  1. Silva, L. and Balasubramaniam, D. 2012. Controlling software architecture erosion: A survey. Journal of Systems and Software. 85, 1 (January 2012), 132--151. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Taylor, R. N., Medvidovic, N. and Dashofy, E. M. 2009. Software Architecture: Foundations, Theory, and Practice. Wiley Publishing. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Clements, P., Kazman, R. and Klein, M. 2002. Evaluating Software Architectures: Methods and Case Studies. Addison-Wesley. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Ali Babar, M. and Gorton, I. 2004. Comparison of Scenario-Based Software Architecture Evaluation Methods. In Proceedings of APSEC'04. Washington, DC, USA, 600--607. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Kazman, R., Abowd, G., Bass, L. and Clements, P. 1996. Scenario-Based Analysis of Software Architecture. IEEE Softw. 13, 6 (November 1996), 47--55. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Roy, B. and Graham, T. C. N. 2008. Methods for Evaluating Software Architecture: A Survey. Technical Report No. 2008--545, School of Computing, Queen's University at Kingston. Ontario, Canada.Google ScholarGoogle Scholar
  7. Ganesan, D., Lindvall, M., Cleaveland, R., Jetley, R., Jones, P. and Zhang, Y. 2011. Architecture Reconstruction and Analysis of Medical Device Software. In Proceedings of WICSA'11. Washington, DC, USA, 194--203. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Ganesan, D., Keuler, T. and Nishimura, Y. 2009. Architecture compliance checking at run-time. Information and Software Technology. 51, 11 (November 2009), 1586--1600. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Abi-Antoun, M and Aldrich, J. 2009. Static extraction and conformance analysis of hierarchical runtime architectural structure using annotations. SIGPLAN Not. 44, 10 (October 2009), 321--340. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Ciraci, S., Sozer, H. and Tekinerdogan, B. 2012. An Approach for Detecting Inconsistencies between Behavioral Models of the Software Architecture and the Code. In Proceedings of COMPSAC'12. IEEE Computer Society, Washington, DC, USA, 257--266. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Gokhale, S. S. 2007. Architecture-Based Software Reliability Analysis: Overview and Limitations. IEEE Ns On Dependable And Secure Computing. 4, 1 (January 2007), 32--40. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Williams, L. G. and Smith, C. U. 2002. PASASM: a method for the performance assessment of software architectures. In Proceedings of WOSP'02. ACM, New York, USA, 179--189. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Malik, H., Hemmati, H. and Hassan, A. E. 2013. Automatic detection of performance deviations in the load testing of large scale systems. In Proceedings of ICSE'13. IEEE Press, Piscataway, NJ, USA, 1012--1021. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Nistor, A., Jiang, T. and Tan, L. 2013. Discovering, reporting, and fixing performance bugs. In Proceedings of MSR'13. IEEE Press, Piscataway, NJ, USA, 237--246. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Nguyen, T. H. D., Nagappan, M., Hassan, A. E., Nasser, M. and Flora, P. 2014. An industrial case study of automatically identifying performance regression-causes. In Proceedings of MSR'14. ACM, New York, NY, USA, 232--241. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Tibermacine, C. and Zernadji, T. 2011. Supervising the evolution of web service orchestrations using quality requirements. In Proceedings of ECSA'11, Ivica Crnkovic, Volker Gruhn, and Matthias Book (Eds.). Springer-Verlag, Berlin, Heidelberg, 1--16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. SINFO: http://www.info.ufrn.br/wikisistemas/doku.php (June 2014).Google ScholarGoogle Scholar
  18. Apache JMeter: http://jmeter.apache.org (June 2014).Google ScholarGoogle Scholar

Index Terms

  1. A Metadata-based Framework for Quality Attribute Degradation Analysis in Web Systems

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      WebMedia '14: Proceedings of the 20th Brazilian Symposium on Multimedia and the Web
      November 2014
      256 pages
      ISBN:9781450332309
      DOI:10.1145/2664551

      Copyright © 2014 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 18 November 2014

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      WebMedia '14 Paper Acceptance Rate25of86submissions,29%Overall Acceptance Rate270of873submissions,31%
    • Article Metrics

      • Downloads (Last 12 months)2
      • Downloads (Last 6 weeks)0

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader