Skip to main content
SpringerLink
Log in

Regulation and Ethics of Facial Recognition Systems: An Analysis of Cases in the Court of Appeal in the State of São Paulo

  • Conference paper
  • First Online:
Intelligent Systems (BRACIS 2023)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 14195))

Included in the following conference series:

  • 234 Accesses

Abstract

Context: The use of Artificial Intelligence (AI) in various sectors of the economy is already a reality in Brazil. Consequently, since 2019, the number of cases in the Judiciary involving AI has increased. Cases involving facial recognition systems (FRS) for contracting bank credit are increasing annually, so it is necessary to analyze how the Judiciary handles the issues. Problem: Why is the São Paulo Court of Appeal ruling in favor of banks in all cases involving taking out credit through facial recognition technology? Methodology and Methods: Data were collected and processed using automated computer programs. The qualitative analysis used the analytical, comparative and monographic methods. Results: The Court of Appeal of São Paulo considers it difficult to deceive an AI system, therefore, the burden of proof is on the author, even if there is a consumer relationship. That is, the decisions are contrary to the general rule of the Code of Consumer Protection in Brazil, which consists of reversing the burden of proof in consumer relations when one of the parties is underprivileged. Contributions and Solutions: The research points to the path of jurisprudence in cases involving the contracting of credit through FRS, and the Judiciary is deciding against the bank’s customers, dispensing with the production of evidence by the banking sector. Therefore, it is necessary to alert the National Council of Justice and the Central Bank regarding this situation so that it is disciplined adequately since the FRS is fallible and does not guarantee the absence of fraud.

This work was carried out at the Center for Artificial Intelligence (C4AI-USP), with support by the São Paulo Research Foundation (FAPESP grant #2019/07665-4) and by the IBM Corporation. This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - Brasil (CAPES) - Finance Code 001.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    São Paulo’s State Court of Justice web portal - Jurisprudence consultations - Full consultation: https://esaj.tjsp.jus.br/cjsg/consultaCompleta.do?f=1.

  2. 2.

    Project coding and data treatment methods applied to this work: https://github.com/isabellalopes-usp/tjsp_data_treatment.

  3. 3.

    Individuals who acquire certification to work in the sale of banking services, with emphasis on credit operations and credit card granting.

References

  1. Brasil: Decreto no̱ 10.046, de 9 de outubro de 2019: Dispõe sobre a governança no compartilhamento de dados no âmbito da administração pública federal e institui o cadastro base do cidadão e o comitê central de governança de dados. Diário Oficial da República Federativa do Brasil (2019). https://www.planalto.gov.br/ccivil_03/_ato2019-2022/2019/decreto/D10046.htm

  2. Buolamwini, J., Gebru, T.: Gender shades: intersectional accuracy disparities in commercial gender classification. In: Conference on Fairness, Accountability and Transparency, pp. 77–91. PMLR (2018)

    Google Scholar 

  3. Camargo, C.H., et al.: Um ano de pandemia da covid-19: diversidade genética do sars-cov-2 no brasil. BEPA. Boletim Epidemiológico Paulista 18(207), 12–33 (2021)

    Article  Google Scholar 

  4. Camarotto, M.: Reclamaçães explodem e governo decide olhar de perto o crédito consignado (2020). https://valorinveste.globo.com/produtos/credito/noticia/2020/10/16/reclamacoes-explodem-e-governo-decide-olhar-de-perto-o-credito-consignado.ghtml. Accessed 1 May 2023

  5. Cheng, L., Liu, F., Yao, D.: Enterprise data breach: causes, challenges, prevention, and future directions. Wiley Interdisc. Rev. Data Mining Knowl. Disc. 7(5), e1211 (2017). https://doi.org/10.1002/widm.1211

    Article  Google Scholar 

  6. Daly, A.: Everyday AI ethics: from the global to local through facial recognition. OSF Preprints (2022). https://doi.org/10.31219/osf.io/bhm3w

  7. European Union: EUR-LLex: access to European union law. micro-, small- and medium-sized enterprises: definition and scope (2016). https://eur-lex.europa.eu/legal-content/PT/TXT/?uri=celex:32016R0679. Accessed 1 May 2023

  8. Filho, J.J.: Pacote TJSP: Coleta e organização de dados do tribunal de justiça de são paulo (2020). https://github.com/jjesusfilho/tjsp. Accessed 20 Nov 2022

  9. Garvie, C.: The perpetual line-up: Unregulated police face recognition in America. Center on Privacy & Technology, Georgetown Law (2016)

    Google Scholar 

  10. Gil, A.C.: Como elaborar projetos de pesquisa, 4th edn. Editora Atlas, São Paulo (2002)

    Google Scholar 

  11. Glez-Peña, D., Lourenço, A., López-Fernández, H., Reboiro-Jato, M., Fdez-Riverola, F.: Web scraping technologies in an API world. Brief. Bioinform. 15(5), 788–797 (2014). https://doi.org/10.1093/bib/bbt026

    Article  Google Scholar 

  12. Hao, K.: A us government study confirms most face recognition systems are racist (2019). https://www.technologyreview.com/2019/12/20/79/ai-face-recognition-racist-us-government-nist-study/. Accessed 10 May 2023

  13. Haraway, D.J.: The companion species manifesto: dogs, people, and significant otherness. Prickly Paradigm Press, Chicago (2003)

    Google Scholar 

  14. Lan, H.: COVID-scraper: an open-source toolset for automatically scraping and processing global multi-scale spatiotemporal COVID-19 records. IEEE Access 9, 84783–84798 (2021). https://doi.org/10.1109/ACCESS.2021.3085682

    Article  Google Scholar 

  15. Lupton, D.: Digital companion species and eating data: implications for theorising digital data-human assemblages. Big Data Soc. 3(1), 1–5 (2016). https://doi.org/10.1177/2053951715619947

    Article  Google Scholar 

  16. Lynch, J.: Face off: law enforcement use of face recognition technology. Elect. Front. Found. (EFF) (2020). https://doi.org/10.2139/ssrn.3909038

    Article  Google Scholar 

  17. Maslej, N., et al.: Artificial intelligence index report 2023. Technical report, Institute for Human-Centered AI - Stanford University, Stanford (2023). https://aiindex.stanford.edu/wp-content/uploads/2023/04/HAI_AI-Index-Report_2023.pdf

  18. Mol, A.: I eat an apple on theorizing subjectivities. Subjectivity 22, 28–37 (2008). https://doi.org/10.1057/sub.2008.2

    Article  Google Scholar 

  19. Montag, L., Mcleod, R., De Mets, L., Gauld, M., Rodger, F., Pełka, M.: The rise and rise of biometric mass surveillance in the EU: a legal analysis of biometric mass surveillance practices in Germany, The Netherlands, and Poland. EDRi (European Digital Rights) and EIJI (Edinburgh International Justice Initiative) (2021)

    Google Scholar 

  20. Phankokkruad, M., Jaturawat, P.: Influence of facial expression and viewpoint variations on face recognition accuracy by different face recognition algorithms. In: 2017 18th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD), pp. 231–237 (2017). https://doi.org/10.1109/SNPD.2017.8022727

  21. Procon: Procon tem reclamaçães de aposentados que não pediram empréstimos consignados (2020). https://globoplay.globo.com/v/8970817/. Accessed 1 May 2023

  22. Salomão, L.F., outros: Inteligëncia artificial: Tecnologia aplicada á gestão dos conflitos no âmbito do poder judiciário brasileiro (2020). https://ciapj.fgv.br/sites/ciapj.fgv.br/files/estudos_e_pesquisas_ia_1afase.pdf. Accessed 17 April 2023

  23. Sharif, M., Naz, F., Yasmin, M., Shahid, M.A., Rehman, A.: Face recognition: a survey. J. Eng. Sci. Technol. Rev. 10(2), 1–12 (2017)

    Article  Google Scholar 

  24. da Silva, T.: Visão computacional e racismo algorítmico: branquitude e opacidade no aprendizado de máquina. Revista da Associação Brasileira de Pesquisadores/as Negros/as (ABPN) 12(31), 428–448 (2020)

    Article  Google Scholar 

  25. Simonite, T.: AI is the future-but where are the women (2018). https://www.wired.com/story/artificial-intelligence-researchers-gender-imbalance. Accessed 30 April 2023

  26. União Europeia: Grupo de trabalho para o artigo 29\(^\circ \) para a proteção de dados (2017), https://edpb.europa.eu/about-edpb/more-about-edpb/article-29-working-party_pt. Accessed 1 May 2023

  27. VanderPlas, J.: Python for Data Science Handbook. O’Reilly Media, Sebastopol (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Law of Ribeirão Preto, University of São Paulo (USP), São Paulo, Brazil

    Cristina Godoy B. de Oliveira & Emily Liene Belotti

  2. School of Arts, Sciences and Humanities, USP, São Paulo, Brazil

    Otávio de Paula Albuquerque

  3. Institute of Mathematical and Computer Sciences of São Carlos, USP, São Paulo, Brazil

    Isabella Ferreira Lopes

  4. Department of Sociology, USP, São Paulo, Brazil

    Rodrigo Brandão de A. Silva & Glauco Arbix

Authors
  1. Cristina Godoy B. de Oliveira
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Otávio de Paula Albuquerque
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Emily Liene Belotti
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Isabella Ferreira Lopes
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Rodrigo Brandão de A. Silva
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Glauco Arbix
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Cristina Godoy B. de Oliveira .

Editor information

Editors and Affiliations

  1. Federal University of São Carlos, São Carlos, Brazil

    Murilo C. Naldi

  2. Centro Universitario da FEI, São Bernardo do Campo, Brazil

    Reinaldo A. C. Bianchi

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Godoy B. de Oliveira, C., de Paula Albuquerque, O., Liene Belotti, E., Ferreira Lopes, I., Brandão de A. Silva, R., Arbix, G. (2023). Regulation and Ethics of Facial Recognition Systems: An Analysis of Cases in the Court of Appeal in the State of São Paulo. In: Naldi, M.C., Bianchi, R.A.C. (eds) Intelligent Systems. BRACIS 2023. Lecture Notes in Computer Science(), vol 14195. Springer, Cham. https://doi.org/10.1007/978-3-031-45368-7_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-45368-7_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-45367-0

  • Online ISBN: 978-3-031-45368-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation