Skip to main content
SpringerLink
Log in

Entity Relation Extraction from News Articles in Portuguese for Competitive Intelligence Based on BERT

  • Conference paper
  • First Online:
Intelligent Systems (BRACIS 2021)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 13074))

Included in the following conference series:

Abstract

Competitive intelligence (CI) is a relevant area of a corporation and can support the strategic business area by showing those responsible, helping decision making on how to position an organization in the market. This work uses the Bidirectional Transformer Encoding Representations (BERT) to process a sentence and its named entities and extract the parts of the sentences that represent or describe the semantic relationship between these named entities. The approach was developed for the Portuguese language, considering the financial domain and exploring deep linguistic representations without using other lexical-semantic resources. The results of the experiments show a precision of 73.5% using the Jaccard metric that measures the similarity between sentences. A second contribution of this work is the manually constructed dataset with more than 4.500 tuples (phrase, entity, entity) annotated.

Financially supported by the Brazilian National Council for Scientific and Technological Development (CAPES) and the by Portuguese Foundation for Science and Technology (FCT)under the projects CEECIND/01997/2017, UIDB/00057/2020.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://github.com/DanielReeyes/financial-market-corpus.

  2. 2.

    https://spacy.io/.

  3. 3.

    https://github.com/huggingface/transformers.

  4. 4.

    https://spacy.io/.

  5. 5.

    https://www.tensorflow.org/.

References

  1. Batista, D.S., Forte, D., Silva, R., Martins, B., Silva, M.: Extracçao de relaçoes semânticas de textos em português explorando a dbpédia e a wikipédia. Linguamatica 5(1), 41–57 (2013)

    Google Scholar 

  2. Bruckschen, M., De Souza, J.G.C., Vieira, R., Rigo, S., Mota, C., Santos, D.: Sistema serelep para o reconhecimento de relaçoes entre entidades mencionadas (2008)

    Google Scholar 

  3. Chaves, M.: Geo-ontologias e padrões para reconhecimento de locais e de suas relações em textos: o sei-geo no segundo harem. Cristina Mota; Diana Santos (ed) Desafios na avaliação conjunta do reconhecimento de entidades mencionadas: O Segundo HAREM Linguateca 2008 (2008)

    Google Scholar 

  4. Cheng, W., Xiong, J.: Entity relationship extraction based on bi-channel neural network. In: 2020 2nd International Conference on Machine Learning, Big Data and Business Intelligence (MLBDBI), pp. 349–352. IEEE (2020)

    Google Scholar 

  5. Collovini, S., Gonçalves, P.N., Cavalheiro, G., Santos, J., Vieira, R.: Relation extraction for competitive intelligence. In: Quaresma, P., Vieira, R., Aluísio, S., Moniz, H., Batista, F., Gonçalves, T. (eds.) PROPOR 2020. LNCS (LNAI), vol. 12037, pp. 249–258. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-41505-1_24

    Chapter  Google Scholar 

  6. Collovini, S., Grando, F., Souza, M., Freitas, L., Vieira, R.: Semantic relations extraction in the organization domain. In: Proceedings of IADIS International Conference on Applied Computing, Rio de Janeiro, pp. 99–106 (2011)

    Google Scholar 

  7. Collovini, S., Pugens, L., Vanin, A.A., Vieira, R.: Extraction of relation descriptors for Portuguese using conditional random fields. In: Bazzan, A.L.C., Pichara, K. (eds.) IBERAMIA 2014. LNCS (LNAI), vol. 8864, pp. 108–119. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-12027-0_9

    Chapter  Google Scholar 

  8. Cruz, C.G.A., Weitzel, L.: Evaluation of relation extraction systems for Portuguese language pt-br. In: 2018 13th Iberian Conference on Information Systems and Technologies (CISTI), pp. 1–6. IEEE (2018)

    Google Scholar 

  9. Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: Pre-training of deep bidirectional transformers for language understanding. preprint arXiv:1810.04805 (2018)

  10. Etzioni, O., Fader, A., Christensen, J., Soderland, S., et al.: Open information extraction: the second generation. In: Twenty-Second International Joint Conference on Artificial Intelligence, pp. 3–10 (2011)

    Google Scholar 

  11. Fayyad, U., Piatetsky-Shapiro, G., Smyth, P.: From data mining to knowledge discovery in databases. AI Mag. 17(3), 37 (1996)

    Google Scholar 

  12. Florez, E., Precioso, F., Pighetti, R., Riveill, M.: Deep learning for identification of adverse drug reaction relations. In: Proceedings of the 2019 International Symposium on Signal Processing Systems, pp. 149–153 (2019)

    Google Scholar 

  13. GAN, T., GAN, Y., HE, Y.: Subsequence-level entity attention lstm for relation extraction. In: 2019 16th International Computer Conference on Wavelet Active Media Technology and Information Processing, pp. 262–265. IEEE (2019)

    Google Scholar 

  14. Han, X., Wang, L.: A novel document-level relation extraction method based on bert and entity information. IEEE Access 8, 96912–96919 (2020)

    Article  Google Scholar 

  15. Li, Q., et al.: A multi-task learning based approach to biomedical entity relation extraction. In: 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pp. 680–682. IEEE (2018)

    Google Scholar 

  16. Pandey, C., Ibrahim, Z., Wu, H., Iqbal, E., Dobson, R.: Improving RNN with attention and embedding for adverse drug reactions. In: Proceedings of the 2017 International Conference on Digital Health, pp. 67–71 (2017)

    Google Scholar 

  17. Qin, P., Xu, W., Guo, J.: Designing an adaptive attention mechanism for relation classification. In: 2017 International Joint Conference on Neural Networks (IJCNN), pp. 4356–4362. IEEE (2017)

    Google Scholar 

  18. Santos, D., Cardoso, N.: Reconhecimento de entidades mencionadas em português: Documentação e actas do harem, a primeira avaliação conjunta na área (2007)

    Google Scholar 

  19. Santos Neto, J.F.d, et al.: Reconhecimento de entidades nomeadas para o português usando redes neurais (2019)

    Google Scholar 

  20. Sarawagi, S.: Information extraction. Now Publishers Inc. (2008)

    Google Scholar 

  21. Souza, F., Nogueira, R., Lotufo, R.: BERTimbau: pretrained BERT models for Brazilian Portuguese. In: 9th Brazilian Conference on Intelligent Systems, BRACIS, Rio Grande do Sul, Brazil, October 20–23 (to appear) (2020)

    Google Scholar 

  22. Tang, Y.: An extended sequence labeling approach for relation extraction. In: 2019 IEEE International Conference on Power, Intelligent Computing and Systems (ICPICS), pp. 121–124. IEEE (2019)

    Google Scholar 

  23. Vaswani, A., et al.: Attention is all you need. preprint arXiv:1706.03762 1 (2017)

  24. Wang, C., Wang, Y., Mo, J., Wang, S.: End-to-end relation extraction based on part of speech syntax tree. In: 2020 2nd International Conference on Machine Learning, Big Data and Business Intelligence (MLBDBI), pp. 5–9. IEEE (2020)

    Google Scholar 

  25. Wang, Y., Sun, Y., Ma, Z., Gao, L., Xu, Y., Wu, Y.: A method of relation extraction using pre-training models. In: 2020 13th International Symposium on Computational Intelligence and Design (ISCID), pp. 176–179. IEEE (2020)

    Google Scholar 

  26. Weiss, A.: A brief guide to competitive intelligence: how to gather and use information on competitors. Bus. Inf. Rev. 19(2), 39–47 (2002)

    Google Scholar 

  27. Xue, K., Zhou, Y., Ma, Z., Ruan, T., Zhang, H., He, P.: Fine-tuning bert for joint entity and relation extraction in chinese medical text. In: 2019 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pp. 892–897. IEEE (2019)

    Google Scholar 

  28. Yin, B., Sun, Y., Wang, Y.: Entity relation extraction method based on fusion of multiple information and attention mechanism. In: 2020 IEEE 6th International Conference on Computer and Communications (ICCC). IEEE (2020)

    Google Scholar 

  29. Yu, H., Cao, Y., Cheng, G., Xie, P., Yang, Y., Yu, P.: Relation extraction with bert-based pre-trained model. In: 2020 International Wireless Communications and Mobile Computing (IWCMC), pp. 1382–1387. IEEE (2020)

    Google Scholar 

  30. Zhou, Z., Zhang, H.: Research on entity relationship extraction in financial and economic field based on deep learning. In: 2018 IEEE 4th International Conference on Computer and Communications (ICCC), pp. 2430–2435. IEEE (2018)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Pontifical Catholic University of Rio Grande do Sul, PUCRS, School of Technology, Porto Alegre, Brazil

    Daniel De Los Reyes, Douglas Trajano, Isabel Harb Manssour & Rafael H. Bordini

  2. CIDEHUS, University of Évora, Évora, Portugal

    Renata Vieira

Authors
  1. Daniel De Los Reyes
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Douglas Trajano
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Isabel Harb Manssour
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Renata Vieira
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Rafael H. Bordini
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Daniel De Los Reyes .

Editor information

Editors and Affiliations

  1. Universidade Federal de Sergipe, São Cristóvão, Brazil

    André Britto

  2. Universidade de São Paulo, São Paulo, Brazil

    Karina Valdivia Delgado

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Reyes, D.D.L., Trajano, D., Manssour, I.H., Vieira, R., Bordini, R.H. (2021). Entity Relation Extraction from News Articles in Portuguese for Competitive Intelligence Based on BERT. In: Britto, A., Valdivia Delgado, K. (eds) Intelligent Systems. BRACIS 2021. Lecture Notes in Computer Science(), vol 13074. Springer, Cham. https://doi.org/10.1007/978-3-030-91699-2_31

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-91699-2_31

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-91698-5

  • Online ISBN: 978-3-030-91699-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation