Automatic Localization of the Carotid Wall in Ultrasound Imaging Based on Convolutional Neural Network
Resumo
Atherosclerosis is the leading cause of death in the world. It is a cardiovascular disease characterized by the accumulation of inflammatory cells and lipids inside the artery walls. In Brazil, more than 30% of all deaths are due to cardiovascular diseases. The carotid intima-media thickness, obtained from ultrasound images, maybe an early estimate of atherosclerosis.This test is fast, safe and non-invasive, as well as being reproducible and relatively inexpensive. In this context, this work, based on convolutional neural networks and techniques of mathematical morphology, consists in automatically locating the region that covers the intima and media sublayers of carotid arteries. The proposed method obtained a score of 88% considering the trained model applied to 234 ultrasonographic images in two different datasets. The analysis of the neighborhood of the points obtained can be useful in the evaluation of cardiovascular risk factors.
Palavras-chave:
carotid wall, ultrasound imaging, convolutional
network, mathematical morphology
Referências
Alawi A. Alsheikh-Ali, Georgios D. Kitsios, Ethan M. Balk, Joseph Lau, and Stanley Ip. The vulnerable atherosclerotic plaque: Scope of the literature. Annals of Internal Medicine, 153 (6): 387 - 395, 2010. DOI: 10.7326/0003-4819-153-6-201009210-00272
Vera R. Bellinazzi, José A. Cipolli, Marcio V. Pimenta, Paula V. Guimar aes, and José A. Pio-Magalhães; Otavio R. Coelho-Filho; Tor BieringSørensen; José R. Matos-Souza; Andrei C. Sposito ; Wilson Nadruz. Carotid flow velocity/diameter ratio is a predictor of cardiovascular events in hypertensive patients. Journal of Hypertension, 33 (10): 2054 - 2060, 2015. DOI: 10.1097/hjh.0000000000000688
Asmatullah Chaudhry, Mehdi Hassan, Asifullah Khan, and Jin Young Kim. Automatic active contour-based segmentation and classification of carotid artery ultrasound images. Journal of Digital Imaging, 26 (6): 1071 - 1081, 2013.
Edward R Dougherty and Roberto A Lotufo. Hands-on morphological image processing, volume SPIE Press Bellingham, 2003. DOI: 10.1117/3.501104
Belda Dursun, Evrim Dursun, Gultekin Suleymanlar, Beste Ozben, Irfan Capraz, Ali Apaydin, and Tomris Ozben. Carotid artery intimamedia thickness correlates with oxidative stress in chronic haemodialysis patients with accelerated atherosclerosis. Nephrology Dialysis Transplantation, 23 (5): 1697 - 1703, 2008.
Faita Francesco, Gemignani Vincenzo, Bianchini Elisabetta, Giannarelli Chiara, Ghiadoni Lorenzo, and Demi Marcello. Real-time measurement system for evaluation of the carotid intima-media thickness with a robust edge operator. Journal of Ultrasound in Medicine, 27 (9): 1353 - 1361, 2008. DOI: 10.7863/jum.2008.27.9.1353
Philip Greenland, Jonathan Abrams, Gerard P. Aurigemma, M. Gene Bond, Luther T. Clark, Michael H. Criqui, John R. Crouse, Lawrence Friedman, Valentin Fuster, David M. Herrington, Lewis H. Kuller, Paul M. Ridker, William C. Roberts, William Stanford, Neil Stone, H. Jeremy Swan, Kathryn A. Taubert, and Lewis Wexler. Prevention conference v: Beyond secondary prevention: identifying the high-risk patient for primary prevention: noninvasive tests of atherosclerotic burden: Writing group iii. Circulation, 101 (1): E16 - 22, 2000.
Antonio Gulli and Sujit Pal. Deep Learning with Keras. Packt Publishing, 2017.
Göran K. Hansson. Inflammation, atherosclerosis, and coronary artery disease. The New England Journal of Medicine, 352 (16): 1685 - 1695, 2005. DOI: 10.1056/nejmra043430
Dana E. Ilea, Caoimhe Duffy, Liam Kavanagh, Alice Stanton, and Paul F. Whelan. Fully automated segmentation and tracking of the intima media thickness in ultrasound video sequences of the common carotid artery. IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 60 (1): 158 - 177, 2013. DOI: 10.1109/tuffc.2013.2547
Wilson Nadruz Junior. Relacção entre subcamadas da parede carotídea, risco cardiovascular e micro RNAs em indivíduos brasileiros. Projeto de pesquisa apresentado ao CNPq para obtencção de Bolsa de Produtividade em Pesquisa, 2017.
Sina Kianoush, Mohammad Yawar Yakoob, Mahmoud Al-Rifai, Andrew P. DeFilippis, Marcio S. Bittencourt, Bruce B. Duncan, Isabela M. Bensenor, Aruni Bhatnagar, Paulo A. Lotufo, and Michael J. Blaha. Associations of cigarette smoking with subclinical inflammation and atherosclerosis: ELSA-Brasil (The Brazilian Longitudinal Study of Adult Health). Journal of the American Heart Association, 6 (6), 2017. DOI: 10.1161/jaha.116.005088
Christos P. Loizou, Andrew Nicolaides, Efthyvoulos Kyriacou, Niki Georghiou, Maura Griffin, and Constantinos S. Pattichis. A comparison of ultrasound intima-media thickness measurements of the left and right common carotid artery. IEEE Journal of Translational Engineering in Health and Medicine, 3:(1900410) 1 - 10, 2015. DOI: 10.1109/jtehm.2015.2450735
Filippo Molinari, Kristen M. Meiburger, Luca Saba, U. Rajendra Acharya, Giuseppe Ledda, Guang Zeng, Sin Yee Stella Ho, Anil T. Ahuja, Suzanne C. Ho, Andrew Nicolaides, and Jasjit S. Suri. Ultrasound IMT measurement on a multi-ethnic and multi-institutional database: our review and experience using four fully automated and one semiautomated methods. Computer Methods and Programs in Biomedicine, 108 (3): 946 - 960,2012. DOI: 10.1016/j.cmpb.2012.05.008
Styliani Petroudi, Christos Loizou, Marios Pantziaris, and Constantinos Pattichis. Segmentation of the common carotid intima-media complex in ultrasound images using active contours. IEEE Transactions on Biomedical Engineering, 59 (11): 3060 - 3069, 2012.
Paolo Pignoli, Elena Tremoli, Andrea Poli, Pierluigi Oreste, and Rodolfo Paoletti. Intimal plus medial thickness of the arterial wall: a direct measurement with ultrasound imaging. Circulation, 74 (6): 1399 - 406, 1986. DOI: 10.1161/01.cir.74.6.1399
Pufa. Higher dha, not epa, associated with lower carotid thickness in japanese men, December https://www.fatsoflife.com/cardiovascularhealth/higher-dha-not-epa-associated-with-lower-carotid-thickness-injapanese-men-2/.
Baoge Qu and Tao Qu. Causes of changes in carotid intima-media thickness: a literature review. Cardiovascular Ultrasound, page 13 : 46, 2015. DOI: 10.1186/s12947-015-0041-4
Antonio Luiz P. Ribeiro, Bruce B. Duncan, Luisa C. C. Brant, Paulo A. Lotufo, José Geraldo Mill, and Sandhi M. Barreto. Cardiovascular health in brazil: trends and perspectives. Circulation, 133 (4): 422 - 433, 2016.
O. Ronneberger, P. Fischer, and T. Brox. U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention (MICCAI), volume 9351 of LNCS, pages 234 - Springer, 2015.
Russell Ross. Atherosclerosis - an inflammatory disease. The New England Journal of Medicine, 340 (2): 115 - 126, 1999. DOI: 10.1056/nejm199901143400207
Amanda V. Sardeli, Arthur F. Gáspari, Guilherme de Rossi, Giovana V. de Souza, Thiago M. F. de Souza, Cláudia R. Cavaglieri, José R. MatosSouza, Wilson Nadruz Jr., and Mara P. T. Chacon-Mikahil. Carotid intima-media thickness is associated with media rather than intima thickness. Atherosclerosis, 261 : 169 - 171, 2017. DOI: 10.1016/j.atherosclerosis.2017.03.033
R. Schreiber, A. V. Campos-Coelho, L. Brandao, R. L. Guimaraes, A. J. Kamada, M. C. Ferreira-Sae, J. R. Matos-Souza, J. A. Cipolli, J. L. de Lima-Filho, S. Crovella, and W. Nadruz. Mannose-binding lectin (mbl2) polymorphisms and inflammation in hypertensive patients. International Journal of Immunogenetics, 38 (6): 525 - 527, 2011. DOI: 10.1111/j.1744-313x.2011.01036.x
Evan Shelhamer, Jonathan Long, and Trevor Darrell. Fully convolutional networks for semantic segmentation. IEEE Trans. Pattern Anal. Mach. Intell., 39 (4): 640 - 651, April 2017. DOI: 10.1109/cvpr.2015.7298965
Stijn C.H. van den Oord, Eric J.G. Sijbrands, Gerrit L. ten Kate, David van Klaveren, Ron T. van Domburg, Antonius F.W. van der Steen, and Arend F.L. Schinkel. Carotid intima-media thickness for cardiovascular risk assessment: systematic review and meta-analysis. Atherosclerosis, 228 (1): 1 - 11, 2013. DOI: 10.1016/j.atherosclerosis.2013.01.025
Patrick Yerly, Pedro Marquès- Vidal, Reza Owlya, Eric Eeckhout, Lukas Kappenberger, Roger Darioli, and Michelè Depairon. The atherosclerosis burden score (ABS): a convenient ultrasound-based score of peripheral atherosclerosis for coronary artery disease prediction. Journal of Cardiovascular Translational Research, 8 (2): 138 - 147, 2015.
Shen Zhao, Zhifan Gao, Heye Zhang, Yaoqin Xie, Jianwen Luo, Dhanjoo Ghista, Zhanghong Wei, Xiaojun Bi, Huahua Xiong, Chenchu Xu, and Shuo Li. Robust segmentation of intima-media borders with different morphologies and dynamics during the cardiac cycle. IEEE Journal of Biomedical and Health Informatics, PP (99): 1 - 11, 2017.
Vera R. Bellinazzi, José A. Cipolli, Marcio V. Pimenta, Paula V. Guimar aes, and José A. Pio-Magalhães; Otavio R. Coelho-Filho; Tor BieringSørensen; José R. Matos-Souza; Andrei C. Sposito ; Wilson Nadruz. Carotid flow velocity/diameter ratio is a predictor of cardiovascular events in hypertensive patients. Journal of Hypertension, 33 (10): 2054 - 2060, 2015. DOI: 10.1097/hjh.0000000000000688
Asmatullah Chaudhry, Mehdi Hassan, Asifullah Khan, and Jin Young Kim. Automatic active contour-based segmentation and classification of carotid artery ultrasound images. Journal of Digital Imaging, 26 (6): 1071 - 1081, 2013.
Edward R Dougherty and Roberto A Lotufo. Hands-on morphological image processing, volume SPIE Press Bellingham, 2003. DOI: 10.1117/3.501104
Belda Dursun, Evrim Dursun, Gultekin Suleymanlar, Beste Ozben, Irfan Capraz, Ali Apaydin, and Tomris Ozben. Carotid artery intimamedia thickness correlates with oxidative stress in chronic haemodialysis patients with accelerated atherosclerosis. Nephrology Dialysis Transplantation, 23 (5): 1697 - 1703, 2008.
Faita Francesco, Gemignani Vincenzo, Bianchini Elisabetta, Giannarelli Chiara, Ghiadoni Lorenzo, and Demi Marcello. Real-time measurement system for evaluation of the carotid intima-media thickness with a robust edge operator. Journal of Ultrasound in Medicine, 27 (9): 1353 - 1361, 2008. DOI: 10.7863/jum.2008.27.9.1353
Philip Greenland, Jonathan Abrams, Gerard P. Aurigemma, M. Gene Bond, Luther T. Clark, Michael H. Criqui, John R. Crouse, Lawrence Friedman, Valentin Fuster, David M. Herrington, Lewis H. Kuller, Paul M. Ridker, William C. Roberts, William Stanford, Neil Stone, H. Jeremy Swan, Kathryn A. Taubert, and Lewis Wexler. Prevention conference v: Beyond secondary prevention: identifying the high-risk patient for primary prevention: noninvasive tests of atherosclerotic burden: Writing group iii. Circulation, 101 (1): E16 - 22, 2000.
Antonio Gulli and Sujit Pal. Deep Learning with Keras. Packt Publishing, 2017.
Göran K. Hansson. Inflammation, atherosclerosis, and coronary artery disease. The New England Journal of Medicine, 352 (16): 1685 - 1695, 2005. DOI: 10.1056/nejmra043430
Dana E. Ilea, Caoimhe Duffy, Liam Kavanagh, Alice Stanton, and Paul F. Whelan. Fully automated segmentation and tracking of the intima media thickness in ultrasound video sequences of the common carotid artery. IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 60 (1): 158 - 177, 2013. DOI: 10.1109/tuffc.2013.2547
Wilson Nadruz Junior. Relacção entre subcamadas da parede carotídea, risco cardiovascular e micro RNAs em indivíduos brasileiros. Projeto de pesquisa apresentado ao CNPq para obtencção de Bolsa de Produtividade em Pesquisa, 2017.
Sina Kianoush, Mohammad Yawar Yakoob, Mahmoud Al-Rifai, Andrew P. DeFilippis, Marcio S. Bittencourt, Bruce B. Duncan, Isabela M. Bensenor, Aruni Bhatnagar, Paulo A. Lotufo, and Michael J. Blaha. Associations of cigarette smoking with subclinical inflammation and atherosclerosis: ELSA-Brasil (The Brazilian Longitudinal Study of Adult Health). Journal of the American Heart Association, 6 (6), 2017. DOI: 10.1161/jaha.116.005088
Christos P. Loizou, Andrew Nicolaides, Efthyvoulos Kyriacou, Niki Georghiou, Maura Griffin, and Constantinos S. Pattichis. A comparison of ultrasound intima-media thickness measurements of the left and right common carotid artery. IEEE Journal of Translational Engineering in Health and Medicine, 3:(1900410) 1 - 10, 2015. DOI: 10.1109/jtehm.2015.2450735
Filippo Molinari, Kristen M. Meiburger, Luca Saba, U. Rajendra Acharya, Giuseppe Ledda, Guang Zeng, Sin Yee Stella Ho, Anil T. Ahuja, Suzanne C. Ho, Andrew Nicolaides, and Jasjit S. Suri. Ultrasound IMT measurement on a multi-ethnic and multi-institutional database: our review and experience using four fully automated and one semiautomated methods. Computer Methods and Programs in Biomedicine, 108 (3): 946 - 960,2012. DOI: 10.1016/j.cmpb.2012.05.008
Styliani Petroudi, Christos Loizou, Marios Pantziaris, and Constantinos Pattichis. Segmentation of the common carotid intima-media complex in ultrasound images using active contours. IEEE Transactions on Biomedical Engineering, 59 (11): 3060 - 3069, 2012.
Paolo Pignoli, Elena Tremoli, Andrea Poli, Pierluigi Oreste, and Rodolfo Paoletti. Intimal plus medial thickness of the arterial wall: a direct measurement with ultrasound imaging. Circulation, 74 (6): 1399 - 406, 1986. DOI: 10.1161/01.cir.74.6.1399
Pufa. Higher dha, not epa, associated with lower carotid thickness in japanese men, December https://www.fatsoflife.com/cardiovascularhealth/higher-dha-not-epa-associated-with-lower-carotid-thickness-injapanese-men-2/.
Baoge Qu and Tao Qu. Causes of changes in carotid intima-media thickness: a literature review. Cardiovascular Ultrasound, page 13 : 46, 2015. DOI: 10.1186/s12947-015-0041-4
Antonio Luiz P. Ribeiro, Bruce B. Duncan, Luisa C. C. Brant, Paulo A. Lotufo, José Geraldo Mill, and Sandhi M. Barreto. Cardiovascular health in brazil: trends and perspectives. Circulation, 133 (4): 422 - 433, 2016.
O. Ronneberger, P. Fischer, and T. Brox. U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention (MICCAI), volume 9351 of LNCS, pages 234 - Springer, 2015.
Russell Ross. Atherosclerosis - an inflammatory disease. The New England Journal of Medicine, 340 (2): 115 - 126, 1999. DOI: 10.1056/nejm199901143400207
Amanda V. Sardeli, Arthur F. Gáspari, Guilherme de Rossi, Giovana V. de Souza, Thiago M. F. de Souza, Cláudia R. Cavaglieri, José R. MatosSouza, Wilson Nadruz Jr., and Mara P. T. Chacon-Mikahil. Carotid intima-media thickness is associated with media rather than intima thickness. Atherosclerosis, 261 : 169 - 171, 2017. DOI: 10.1016/j.atherosclerosis.2017.03.033
R. Schreiber, A. V. Campos-Coelho, L. Brandao, R. L. Guimaraes, A. J. Kamada, M. C. Ferreira-Sae, J. R. Matos-Souza, J. A. Cipolli, J. L. de Lima-Filho, S. Crovella, and W. Nadruz. Mannose-binding lectin (mbl2) polymorphisms and inflammation in hypertensive patients. International Journal of Immunogenetics, 38 (6): 525 - 527, 2011. DOI: 10.1111/j.1744-313x.2011.01036.x
Evan Shelhamer, Jonathan Long, and Trevor Darrell. Fully convolutional networks for semantic segmentation. IEEE Trans. Pattern Anal. Mach. Intell., 39 (4): 640 - 651, April 2017. DOI: 10.1109/cvpr.2015.7298965
Stijn C.H. van den Oord, Eric J.G. Sijbrands, Gerrit L. ten Kate, David van Klaveren, Ron T. van Domburg, Antonius F.W. van der Steen, and Arend F.L. Schinkel. Carotid intima-media thickness for cardiovascular risk assessment: systematic review and meta-analysis. Atherosclerosis, 228 (1): 1 - 11, 2013. DOI: 10.1016/j.atherosclerosis.2013.01.025
Patrick Yerly, Pedro Marquès- Vidal, Reza Owlya, Eric Eeckhout, Lukas Kappenberger, Roger Darioli, and Michelè Depairon. The atherosclerosis burden score (ABS): a convenient ultrasound-based score of peripheral atherosclerosis for coronary artery disease prediction. Journal of Cardiovascular Translational Research, 8 (2): 138 - 147, 2015.
Shen Zhao, Zhifan Gao, Heye Zhang, Yaoqin Xie, Jianwen Luo, Dhanjoo Ghista, Zhanghong Wei, Xiaojun Bi, Huahua Xiong, Chenchu Xu, and Shuo Li. Robust segmentation of intima-media borders with different morphologies and dynamics during the cardiac cycle. IEEE Journal of Biomedical and Health Informatics, PP (99): 1 - 11, 2017.
Publicado
09/09/2019
Como Citar
SILVA, Alexandre G.; DA CRUZ, Eryk K.; ARTHUR, Rangel; CARNIELLI, Giulliano P.; DE GODOY, Henri A.; N. JUNIOR, Wilson; ROMANO, Luís F. R. dos S. C..
Automatic Localization of the Carotid Wall in Ultrasound Imaging Based on Convolutional Neural Network. In: WORKSHOP DE VISÃO COMPUTACIONAL (WVC), 15. , 2019, São Bernardo do Campo.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2019
.
p. 97-102.
DOI: https://doi.org/10.5753/wvc.2019.7635.
