Atherosclerosis plaque tissue classification using self-attention-based conditional variational auto-encoder generative adversarial network using OCT plaque image
-
Kowsalyadevi Jagadeesan
and
Geetha Palanisamy
Abstract
Adults with coronary artery disease often have atherosclerosis, this is defined as the accumulation of plaque in the tissues of the arterial wall. Cardiologists utilize optical coherence tomography (OCT), a light-based imaging method, to examine the layers of intracoronary tissue along pathological formations, such as plaque accumulation. Intracoronary cross-sectional images produced by state-of-the-art catheter-based imaging scheme have 10–15 µm high resolution. Nevertheless, interpretation of the obtained images depends on the operator, which takes a lot of time and is exceedingly error-prone from one observer to another. OCT image post-processing that automatically and accurately tags coronary plaques can help the technique become more widely used and lower the diagnostic error rate. To overcome these problems, Atherosclerosis plaque tissue classification using Self-Attention-Based Conditional Variational Auto-Encoder Generative Adversarial Network (APC-OCTPI-SACVAGAN) is proposed which classifies the Atherosclerosis plaque images as Fibro calcific plaque, Fibro atheroma, Thrombus, Fibrous plaque and Micro-vessel. The proposed APC-OCTPI-SACVAGAN technique is executed in MATLAB. The efficiency of proposed APC-OCTPI-SACVAGAN method attains 16.19 %, 17.93 %, 19.81 % and 1.57 % higher accuracy; 16.92 %, 11.54 %, 5.29 % and 1.946 % higher Area under curve; and 28.06 %, 25.32 %, 32.19 % and 39.185 % lower computational time comparing to the existing methods respectively.
-
Research funding: This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
-
Author contributions: Kowsalyadevi Jagadeesan: Conceptualization, methodology, writing original draft preparation. Geetha Palanisamy: Supervision.
-
Competing interests: Authors declare that they have no conflict of interest.
-
Informed consent: Not Applicable.
-
Ethical approval: This article does not contain any studies with human participants performed by any of the authors.
References
1. Jain, PK, Sharma, N, Giannopoulos, AA, Saba, L, Nicolaides, A, Suri, JS. Hybrid deep learning segmentation models for atherosclerotic plaque in internal carotid artery B-mode ultrasound. Comput Biol Med 2021;136:104721. https://doi.org/10.1016/j.compbiomed.2021.104721.Search in Google Scholar PubMed
2. Skandha, SS, Nicolaides, A, Gupta, SK, Koppula, VK, Saba, L, Johri, AM, et al.. A hybrid deep learning paradigm for carotid plaque tissue characterization and its validation in multicenter cohorts using a supercomputer framework. Comput Biol Med 2022;141:105131. https://doi.org/10.1016/j.compbiomed.2021.105131.Search in Google Scholar PubMed
3. Shajin, FH, Rajesh, P, Raja, MR. An efficient VLSI architecture for fast motion estimation exploiting zero motion prejudgment technique and a new quadrant-based search algorithm in HEVC. Circ Syst Signal Process 2022;41:1751–74. https://doi.org/10.1007/s00034-021-01850-2.Search in Google Scholar
4. Rajesh, P, Shajin, FH, Kannayeram, G. A novel intelligent technique for energy management in smart home using internet of things. Appl Soft Comput 2022;128:109442. https://doi.org/10.1016/j.asoc.2022.109442.Search in Google Scholar
5. Shajin, FH, Rajesh, P, Nagoji Rao, VK. Efficient framework for brain tumour classification using hierarchical deep learning neural network classifier. Comput Methods Biomech Biomed Eng Imag Vis 2022;11:750–7.10.1080/21681163.2022.2111719Search in Google Scholar
6. Rajesh, P, Shajin, FH, Kumaran, GK. An efficient IWOLRS control technique of brushless DC motor for torque ripple minimization. Appl Sci Eng Progr 2022;15:5514.10.14416/j.asep.2021.10.004Search in Google Scholar
7. Saba, L, Sanagala, SS, Gupta, SK, Koppula, VK, Laird, JR, Viswanathan, V, et al.. A multicenter study on carotid ultrasound plaque tissue characterization and classification using six deep artificial intelligence models: a stroke application. IEEE Trans Instrum Meas 2021;70:1–2. https://doi.org/10.1109/tim.2021.3052577.Search in Google Scholar
8. Olender, ML, Athanasiou, LS, Michalis, LK, Fotiadis, DI, Edelman, ER. A domain enriched deep learning approach to classify atherosclerosis using intravascular ultrasound imaging. IEEE J Sel Top Signal Process 2020;14:1210–20. https://doi.org/10.1109/jstsp.2020.3002385.Search in Google Scholar PubMed PubMed Central
9. Abdolmanafi, A, Duong, L, Ibrahim, R, Dahdah, N. Intravascular imaging of coronary artery: bridging the gap between clinical needs and technical advances. Med Eng Phys 2021;96:71–80. https://doi.org/10.1016/j.medengphy.2021.09.003.Search in Google Scholar PubMed
10. Ren, X, Zhao, Y, Fan, J, Wu, H, Chen, Q, Kubo, T. Semantic segmentation of superficial layer in intracoronary optical coherence tomography based on cropping-merging and deep learning. Infrared Phys Technol 2023:104542. https://doi.org/10.1016/j.infrared.2022.104542.Search in Google Scholar
11. Mojahed, D, Ha, RS, Chang, P, Gan, Y, Yao, X, Angelini, B, et al.. Fully automated postlumpectomy breast margin assessment utilizing convolutional neural network based optical coherence tomography image classification method. Acad Radiol 2020;27:e81–6. https://doi.org/10.1016/j.acra.2019.06.018.Search in Google Scholar PubMed PubMed Central
12. Abdolmanafi, A, Cheriet, F, Duong, L, Ibrahim, R, Dahdah, N. An automatic diagnostic system of coronary artery lesions in Kawasaki disease using intravascular optical coherence tomography imaging. J Biophot 2020;13:e201900112. https://doi.org/10.1002/jbio.201900112.Search in Google Scholar PubMed
13. Lv, R, Maehara, A, Matsumura, M, Wang, L, Wang, Q, Zhang, C, et al.. Using optical coherence tomography and intravascular ultrasound imaging to quantify coronary plaque cap thickness and vulnerability: a pilot study. Biomed Eng Online 2020;19:1–8. https://doi.org/10.1186/s12938-020-00832-w.Search in Google Scholar PubMed PubMed Central
14. Saba, L, Sanagala, SS, Gupta, SK, Koppula, VK, Laird, JR, Viswanathan, V, et al.. A multicenter study on carotid ultrasound plaque tissue characterization and classification using six deep artificial intelligence models: a stroke application. IEEE Trans Instrum Meas 2021;70:1–2. https://doi.org/10.1109/tim.2021.3052577.Search in Google Scholar
15. Olender, ML, Athanasiou, LS, Michalis, LK, Fotiadis, DI, Edelman, ER. A domain enriched deep learning approach to classify atherosclerosis using intravascular ultrasound imaging. IEEE J Sel Top Signal Process 2020;14:1210–20. https://doi.org/10.1109/jstsp.2020.3002385.Search in Google Scholar PubMed PubMed Central
16. Truong, M, Lennartsson, F, Bibic, A, Sundius, L, Persson, A, Siemund, R, et al.. Classifications of atherosclerotic plaque components with T1 and T2* mapping in 11.7 T MRI. Eur J Radiol Open 2021;8:100323. https://doi.org/10.1016/j.ejro.2021.100323.Search in Google Scholar PubMed PubMed Central
17. Zhang, R, Fan, Y, Qi, W, Wang, A, Tang, X, Gao, T. Current research and future prospects of IVOCT imaging‐based detection of the vascular lumen and vulnerable plaque. J Biophot 2022;15:e202100376. https://doi.org/10.1002/jbio.202100376.Search in Google Scholar PubMed
18. Buckler, AJ, Gotto, AMJr, Rajeev, A, Nicolaou, A, Sakamoto, A, St Pierre, S, et al.. Atherosclerosis risk classification with computed tomography angiography: a radiologic-pathologic validation study. Atherosclerosis 2023;366:42–8. https://doi.org/10.1016/j.atherosclerosis.2022.11.013.Search in Google Scholar PubMed
19. Shibutani, H, Fujii, K, Ueda, D, Kawakami, R, Imanaka, T, Kawai, K, et al.. Automated classification of coronary atherosclerotic plaque in optical frequency domain imaging based on deep learning. Atherosclerosis 2021;328:100–5. https://doi.org/10.1016/j.atherosclerosis.2021.06.003.Search in Google Scholar PubMed
20. Yang, J, Zhang, B, Wang, H, Lin, F, Han, Y, Liu, X. Automated characterization and classification of coronary atherosclerotic plaques for intravascular optical coherence tomography. Biocybern Biomed Eng 2019;39:719–27. https://doi.org/10.1016/j.bbe.2019.06.006.Search in Google Scholar
21. Niu, Y, Olender, ML, Marlevi, D, Nezami, FR, Edelman, ER. Improving automated tissue characterization in optical coherence tomography by melding attenuation compensation with deep learning. In 2021 IEEE EMBS International Conference on Biomedical and Health Informatics (BHI). IEEE; 2021. 1–4.10.1109/BHI50953.2021.9508521Search in Google Scholar
22. Abdolmanafi, A, Duong, L, Ibrahim, R, Dahdah, N. A deep learning‐based model for characterization of atherosclerotic plaque in coronary arteries using optical coherence tomography images. Med Phys 2021;48:3511–24. https://doi.org/10.1002/mp.14909.Search in Google Scholar PubMed
23. Carpenter, HJ, Ghayesh, MH, Zander, AC, Li, J, Di Giovanni, G, Psaltis, PJ. Automated coronary optical coherence tomography feature extraction with application to three-dimensional reconstruction. Tomography 2022;8:1307–49. https://doi.org/10.3390/tomography8030108.Search in Google Scholar PubMed PubMed Central
24. Lee, J, Prabhu, D, Kolluru, C, Gharaibeh, Y, Zimin, VN, Dallan, LA, et al.. Fully automated plaque characterization in intravascular OCT images using hybrid convolutional and lumen morphology features. Sci Rep 2020;10:2596. https://doi.org/10.1038/s41598-020-59315-6.Search in Google Scholar PubMed PubMed Central
25. Ma, W, Cheng, X, Xu, X, Wang, F, Zhou, R, Fenster, A, et al.. Multilevel strip pooling-based convolutional neural network for the classification of carotid plaque echogenicity. Comput Math Methods Med 2021:2021. https://doi.org/10.1155/2021/3425893.Search in Google Scholar PubMed PubMed Central
26. He, C, Wang, J, Yin, Y, Li, Z. Automated classification of coronary plaque calcification in OCT pullbacks with 3D deep neural networks. J Biomed Opt 2020;25:095003. https://doi.org/10.1117/1.jbo.25.9.095003.Search in Google Scholar PubMed PubMed Central
27. Jin, X, Li, Y, Yan, F, Liu, Y, Zhang, X, Li, T, et al.. Automatic coronary plaque detection, classification, and stenosis grading using deep learning and radiomics on computed tomography angiography images: a multi-center multi-vendor study. Eur Radiol 2022;32:5276–86. https://doi.org/10.1007/s00330-022-08664-z.Search in Google Scholar PubMed
28. Sahu, S, Singh, AK, Ghrera, SP, Elhoseny, M. An approach for de-noising and contrast enhancement of retinal fundus image using CLAHE. Opt Laser Technol 2019;110:87–98. https://doi.org/10.1016/j.optlastec.2018.06.061.Search in Google Scholar
29. Satapathy, SC, Sri Madhava Raja, N, Rajinikanth, V, Ashour, AS, Dey, N. Multi-level image thresholding using Otsu and chaotic bat algorithm. Neural Comput Appl 2018;29:1285–307. https://doi.org/10.1007/s00521-016-2645-5.Search in Google Scholar
30. Vashishtha, G, Kumar, R. Pelton wheel bucket fault diagnosis using improved shannon entropy and expectation maximization principal component analysis. J Vib Eng Technol 2022:1–5. https://doi.org/10.1007/s42417-021-00379-7.Search in Google Scholar
31. Chen, Z, Tong, L, Qian, B, Yu, J, Xiao, C. Self-Attention-Based conditional variational auto-encoder generative adversarial networks for hyperspectral classification. Rem Sens 2021;13:3316. https://doi.org/10.3390/rs13163316.Search in Google Scholar
32. Balakrishnan, S, Joseph, PK. Stratification of risk of atherosclerotic plaque using Hu’s moment invariants of segmented ultrasonic images. Biomed Eng/Biomed Tech 2022;67:391–402. https://doi.org/10.1515/bmt-2021-0044.Search in Google Scholar PubMed
© 2023 Walter de Gruyter GmbH, Berlin/Boston
Articles in the same Issue
- Frontmatter
- Review
- Biomechanical testing of osteosynthetic locking plates for proximal humeral shaft fractures – a systematic literature review
- Research Articles
- Instrumented treadmill for run biomechanics analysis: a comparative study
- Computational modelling of the graft-tunnel interaction in single-bundle ACL reconstructed knee
- Biomechanical effects of inclined implant shoulder design in all-on-four treatment concept: a three-dimensional finite element analysis
- Extension of the working time of dental composites due to a new type of white operating lamp
- Modeling the compliance of the human eye with elastic membranes based on a bionic approach
- Region-wise severity analysis of diabetic plantar foot thermograms
- A new method for vital sign detection using FMCW radar based on random body motion cancellation
- Atherosclerosis plaque tissue classification using self-attention-based conditional variational auto-encoder generative adversarial network using OCT plaque image
- A combined impedance compensation strategy applied to external automatic defibrillators
Articles in the same Issue
- Frontmatter
- Review
- Biomechanical testing of osteosynthetic locking plates for proximal humeral shaft fractures – a systematic literature review
- Research Articles
- Instrumented treadmill for run biomechanics analysis: a comparative study
- Computational modelling of the graft-tunnel interaction in single-bundle ACL reconstructed knee
- Biomechanical effects of inclined implant shoulder design in all-on-four treatment concept: a three-dimensional finite element analysis
- Extension of the working time of dental composites due to a new type of white operating lamp
- Modeling the compliance of the human eye with elastic membranes based on a bionic approach
- Region-wise severity analysis of diabetic plantar foot thermograms
- A new method for vital sign detection using FMCW radar based on random body motion cancellation
- Atherosclerosis plaque tissue classification using self-attention-based conditional variational auto-encoder generative adversarial network using OCT plaque image
- A combined impedance compensation strategy applied to external automatic defibrillators
