skip to main content
10.1145/3364641.3364645acmotherconferencesArticle/Chapter ViewAbstractPublication PagessbqsConference Proceedingsconference-collections
research-article

Analysis of the Utilization of Scrum Framework Effort Estimation Metrics in Federal Public Administration

Published: 28 October 2019 Publication History

Abstract

The usage of agile software development methods is a reality in private and public organizations. However, the use of story points, a Scrum's typical metric for effort estimation has encountered resistance to its adoption in public administration, especially by regulatory authorities, once it varies according to the team's expertise. Thus, this paper aims to identify alternative metrics used by public administration to measure the effort in agile software development. From a documental research with qualitative approach, we analyzed the legal and normative framework of the federal sphere and we identified 57 software development contracts, whose metrics were analyzed. Hence, the main results showed that function points analysis remains being the most used metric, even in agile software development projects, due to their objectivity regarding functional requirements. However, the Technical Service Unit (UST) or related metrics has gained strength in agile software development projects, considering that it is indispensable to use a service catalog prepared at the contracting planning stage, as preconized by Brazilian Federal Court of Accounts (TCU) in its Judgment 2.362/2015.

References

[1]
Santos, A. (2014). "Adoção de Métodos Ágeis e do Pensamento Lean na Gestão de Contratos de Fornecedores de Desenvolvimento de Software em Organizações Públicas Brasileiras - Um Estudo de Caso". Dissertação de Mestrado. Universidade de Brasília.
[2]
Vacari, I. (2015). "Um Estudo Empírico sobre a Adoção de Métodos Ágeis para Desenvolvimento de Software em Organizações Públicas". Dissertação de Mestrado. Pontifícia Universidade Católica do Rio Grande Sul.
[3]
Mazuco, A. (2017). "Percepções de Práticas Ágeis em Desenvolvimento de Software: Benefícios e Desafios". Dissertação de Mestrado. Universidade de Brasília.
[4]
Schwaber, K., Sutherland, J. (2017). "Guia do SCRUM - Um guia definitivo para o Scrum: As regras do jogo", https://www.scrumguides.org/docs/scrumguide/v2017/2017-Scrum-Guide-Portuguese-Brazilian.pdf.
[5]
Hoda, R., Murugesan, L. (2016). "Multi-level Agile Project Management Challenges: A self-organizing team perspective". The Journal of Systems and Software. 117, 245--257.
[6]
Brasil. (1988). "Constituição da República Federativa do Brasil", http://www.planalto.gov.br/ccivil_03/Constituicao/Constituicao.htm.
[7]
Brasil. (2019). "Instrução Normativa 01/2019-SGD/ME", http://www.in.gov.br/materia/-/asset_publisher/Kujrw0TZC2Mb/content/id/70267659/do1-2019-04-05-instrucao-normativa-n-1-de-4-de-abril-de-2019-70267535
[8]
Brasil. (2014). "Instrução Normativa 04/2014-SLTI/MPOG", https://www.governodigital.gov.br/sisp/ncti-nucleo-de-contratacoes-de-tecnologia-da-informacao/in-4-instrucao-normativa-mp-slti-no-4-2014>.
[9]
Silva, R., Souza Neto, J. (2015). "Contratação do Desenvolvimento Ágil de Software na Administração Pública Federal: riscos e ações mitigadoras". Revista do Serviço Público, Brasília, 66(1), 97--120.
[10]
Brasil. (2013). "Acórdão n° 2.314/2013". Tribunal de Contas da União, http://www.tcu.gov.br/consultas/juris/docs/judoc/acord/20130830/ac_2314_33_13_p.doc.
[11]
Hoda, R., Salleh, N., Grundy, J., Tee, H. (2017). "Systematic Literature Reviews in Agile Software Development: a tertiary study." Information and Software Technology.1--20.
[12]
Schön, E. M., Sedeño, J., Mejías, M., Thomaschewski, J., Escalona, M. J. (2019). "A Metamodel for Agile Requirements Engineering". Journal of Computer and Communication, 7, 1--22.
[13]
Dingsøyr, T., Dybå, T., Gjertsen, M., Jacobsen, A., Mathisen, T. E., Nordfjord, J., Røe, K. Strand, K. (2019). "Key Lessons from Tailoring Agile Methods for Large-Scale Software Development". IT Professional, 34--41.
[14]
Malgonde, O., Chari, K. (2019). "An Ensemble-Based Model for Predicting Agile Software Development Effort". Empirical Software Engineering, 24(2), 1017--1055.
[15]
Rising, L., Janoff, N. (2000). "The Scrum Software Development Process for Small Teams". IEEE Software, 26--32.
[16]
Takeushi, H., Nonaka, I. (1986). "The New New Product Development Game". Harvard Business Review.
[17]
Yu, J. (2018). "Design and Implementation of Subject-based Learning Website Based on Scrum". MATEC Web of Conferences, 232, 1--6.
[18]
Matthies, C., Huegle, J., Durschmid, T., Teusner, R. (2019). "Attitudes, Beliefs, and Development Data Concerning Agile Software Development Practices". IEEE.
[19]
Stray, V., Sjøberg, D., Dybå, T. (2016). "The Daily Stand-Up Meeting". Journal of Systems and Software. 144, 101--124.
[20]
Dingsøyr, T., Falessi, D., Powler, K. (2019). "Agile Development at Scale: The Next Frontier". IEEE Software. 30--38.
[21]
Rubart, J. (2014). "A Cooperative Multitouch Scrum Task Board for Synchronous Face-to-Face Collaboration". International Conference on Interactive Tabletops and Surfaces.
[22]
Fowler, F. (2019). "Navigating Hybrid Scrum Environments: Understanding the Essentials, Avoiding the Pitfalls", Apress.
[23]
Cleland-Huang, J., Vierhauser, M. (2018). "Discovering, Analyzing, and Managing Safety Stories in Agile Projects". IEEE International Conference on Requirements Engineering, 262--273.
[24]
Knowledge21. (2019). "Scrum", https://www.knowledge21.com.br/sobreagilidade/scrum/.
[25]
Brasil. (1967). "Decreto-Lei 200", http://www.planalto.gov.br/ccivil_03/decreto-lei/del0200.htm.
[26]
Brasil. (1994). "Decreto 1.048", http://www.planalto.gov.br/ccivil_03/decreto/1990-1994/D1048.htm.
[27]
Brasil. (2011). "Decreto 7.579", http://www.planalto.gov.br/ccivil_03/_Ato2011-2014/2011/Decreto/D7579.htm#art11>.
[28]
Uchoa, A. (2013). "Contratação de Desenvolvimento Ágil de Software pelo Governo". Dissertação de Mestrado. Universidade Federal do Rio de Janeiro.
[29]
Duarte, E., Ramalho, F., Autran, M., Paiva, E., Araújo, M. (2009). "Estratégias Metodológicas Adotadas nas Pesquisas de Iniciação Científica Premiadas na UFPB". Revista Eletrônica de Biblioteconomia e Ciência da Informação. 14(27), 170--190.
[30]
Creswell, J. (2009). "Research Design: Qualitative, Quantitative, and Mixed Methods Approaches" (3 ed.). SAGE Publication.
[31]
Myszczuk, A. P.; Silva, C. L. (2019). "Política Pública para Empreendimentos do Setor Elétrico: Estudo Comparativo entre a Regulação Brasileira e Cubana sobre Meio Ambiente e Uso dos Recursos Naturais". Revista Brasileira de Gestão e Desenvolvimento Regional, 15(2), 100--110.
[32]
Martins, G. A., Theóphilo, C. R. (2016) "Metodologia da investigação científica para ciências sociais aplicadas". São Paulo: Atlas, 2016.
[33]
Brasil. (2016). "Portaria n°20/2016", https://www.governodigital.gov.br/documentos-e-arquivos/legislacao/Portaria%20MP-STI%20no%2020%20de%2014%20de%20junho%20de%202016.pdf.
[34]
Brasil. (1993). "Lei 8.666", http://www.planalto.gov.br/ccivil_03/leis/l8666cons.htm>.
[35]
Brasil. (2002). "Lei 10.520", http://www.planalto.gov.br/ccivil_03/leis/2002/l10520.htm.
[36]
Brasil. (2003). "Acórdão n° 1.558/2003". Tribunal de Contas da União.
[37]
Guimarães, V.; Lara, A.; Puttini, R. (2017). "Aplicação de Análise de Pontos por Função em Projetos SOA. Revista Científica Multidisciplinar Núcleo do Conhecimento", 8(1), 88--102.
[38]
Brasil. (2015) "Guia de Contagem de Pontos de Função". Ministério do Planejamento, Orçamento e Gestão, http://www.planejamento.gov.br/servicos/central-de-conteudos/GuiadeContagemdePontosdeFuncao.pdf>.
[39]
Shahid, M.; Tasneem, K. (2018). "Impact of Avoiding Non-functional Requirements in Software Development Stage". American Journal of Information Science and Computer Engineering. 3(4), 52- 55.
[40]
Essado, MM., Carvalho, N., Ambrósio, A. M. (2012). "Estimativa de Teste de Software: A Análise de Pontos de Teste Aplicada a um Caso de Estudo Real". Workshop em Engenharia e Tecnologias Espaciais.
[41]
Brasil. (2015). "Acórdão n° 2.362/2015". Tribunal de Contas da União, https://contas.tcu.gov.br/sagas/SvlVisualizarRelVotoAcRtf^codFiltro=SAGAS-SESSAO-ENCERRADA&item0=537247.

Cited By

View all
  • (2023)Unveiling Quality in Chatbot Conversations: Quantitative Analysis of Chatbot RequirementsProceedings of the XXII Brazilian Symposium on Software Quality10.1145/3629479.3629481(148-157)Online publication date: 7-Nov-2023
  • (2022)Metrics for Performance Improvement in Organisations Using Scrum, ITIL and CMMIWSEAS TRANSACTIONS ON ELECTRONICS10.37394/232017.2022.13.1213(89-99)Online publication date: 14-Sep-2022
  • (2021)A metric for software service outsourcing contracts within the scope of the Brazilian Federal Public Administration2021 International Conference on Computational Science and Computational Intelligence (CSCI)10.1109/CSCI54926.2021.00366(1983-1988)Online publication date: Dec-2021

Index Terms

  1. Analysis of the Utilization of Scrum Framework Effort Estimation Metrics in Federal Public Administration

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    SBQS '19: Proceedings of the XVIII Brazilian Symposium on Software Quality
    October 2019
    330 pages
    ISBN:9781450372824
    DOI:10.1145/3364641
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    In-Cooperation

    • SBC: Brazilian Computer Society

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 28 October 2019

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Administração Pública Federal
    2. Contratação de Serviços de TI
    3. Desenvolvimento de Software
    4. Gestão de Contratos de Tecnologia da Informação
    5. Métodos Ágeis
    6. Scrum

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    SBQS'19
    SBQS'19: XVIII Brazilian Symposium on Software Quality
    October 28 - November 1, 2019
    Fortaleza, Brazil

    Acceptance Rates

    SBQS '19 Paper Acceptance Rate 35 of 99 submissions, 35%;
    Overall Acceptance Rate 35 of 99 submissions, 35%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)14
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 27 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Unveiling Quality in Chatbot Conversations: Quantitative Analysis of Chatbot RequirementsProceedings of the XXII Brazilian Symposium on Software Quality10.1145/3629479.3629481(148-157)Online publication date: 7-Nov-2023
    • (2022)Metrics for Performance Improvement in Organisations Using Scrum, ITIL and CMMIWSEAS TRANSACTIONS ON ELECTRONICS10.37394/232017.2022.13.1213(89-99)Online publication date: 14-Sep-2022
    • (2021)A metric for software service outsourcing contracts within the scope of the Brazilian Federal Public Administration2021 International Conference on Computational Science and Computational Intelligence (CSCI)10.1109/CSCI54926.2021.00366(1983-1988)Online publication date: Dec-2021

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media