Abstract
Objectives
Optical coherence tomography (OCT) is a new imaging technology that uses an optical analog of ultrasound imaging for biological tissues. Image segmentation plays an important role in dealing with quantitative analysis of medical images.
Methods
We have proposed a novel framework to deal with the low intensity problem, based on the labeled patches and Bayesian classification (LPBC) model. The proposed method includes training and testing phases. During the training phase, firstly, we manually select the sub-images of background and Region of Interest (ROI) from the training image, and then extract features by patches. Finally, we train the Bayesian model with the features. The segmentation threshold of each patch is computed by the learned Bayesian model.
Results
In addition, we have collected a new dataset of mouse eyes in vivo with OCT, named MEVOCT, which can be found at URL https://17861318579.github.io/LPBC. MEVOCT consists of 20 high-resolution images. The resolution of every image is 2048 × 2048 pixels.
Conclusions
The experimental results demonstrate the effectiveness of the LPBC method on the new MEVOCT dataset. The ROI segmentation is of great importance for the distortion correction.
-
Research ethics: The Bioethics Committee of the Centro de Investigacion Cientifica y de Educacion Superior de Ensenada (Ensenada, Baja California, Mexico) approved this study (No. HUM 2020 03). All procedures performed were approved for studies involving human participants according to the ethical standards of the institutional and/or national research committee and the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.
-
Informed consent: Informed consent was obtained from all individual participants included in the study.
-
Author contributions: Fei Ma and Jing Meng contributed to the conception of the study; Shengbo Wang performed the experiment and con tributed significantly to analysis and manuscript preparation; Fei Ma wrote the manuscript; Cuixia Dai helped perform the analysis with constructive discussions.
-
Competing interests: The authors declare that they have no conflict of interest.
-
Research funding: Partial financial support was received from the Natural Science Foundation of Shandong Province (No: ZR2020MF105) and Qufu Normal University Doctor Fund (No: 20190080).
-
Data availability: MEVOCT dataset and MakeGT for Ground truth can be found at URL: https://17861318579.github.io/LPBC.
References
1. Elsawy, AS, Abdel-Mottaleb, M. PIPE-Net: a pyramidal-input-parallel-encoding network for the segmentation of corneal layer interfaces in OCT images. Comput Biol Med 2022;147:105595. https://doi.org/10.1016/j.compbiomed.2022.105595.Search in Google Scholar PubMed
2. Qin, X, Wang, B, Boegner, D, Gaitan, B, Zheng, Y, Du, X, et al.. Indoor localization of hand-held OCT probe using visual odometry and real-time segmentation using deep learning. IEEE Trans Biomed Eng 2022;69:1378–85. https://doi.org/10.1109/tbme.2021.3116514.Search in Google Scholar
3. Fu, H, Xu, Y, Lin, S, Zhang, X, Wong, D, Liu, J, et al.. Segmentation and quantification for angle-closure glaucoma assessment in anterior segment OCT. IEEE Trans Med Imaging 2017;36:1930–8. https://doi.org/10.1109/tmi.2017.2703147.Search in Google Scholar
4. Viedma, GA, Alonso-Caneiro, D, Read, SA, Collins, MJ. OCT retinal and choroidal layer instance segmentation using mask R-CNN. Sensors 2016;22:2022. https://doi.org/10.3390/s22052016.Search in Google Scholar PubMed PubMed Central
5. Chong, DY, Kim, HJ, Lo, P, Young, S, McNitt-Gray, MF, Abtin, F, et al.. Robustness-driven feature selection in classification of fibrotic interstitial lung disease patterns in computed tomography using 3D texture features. IEEE Trans Med Imaging 2016;35:144–57. https://doi.org/10.1109/tmi.2015.2459064.Search in Google Scholar PubMed
6. Tang, N, Fan, J, Zhang, Y, Shi, G. Correction of refractive and scattered image distortions in optical coherence tomography based on scalpel. J Phys Conf 2021;2024:012021–8. https://doi.org/10.1088/1742-6596/2024/1/012021.Search in Google Scholar
7. Tan, J, Qiu, R, Ding, X, Dai, C, Meng, J, Zhao, J, et al.. Correction of refractive distortion in whole-eye optical coherence tomography imaging of the mouse eye. J Biophotonics 2022;15:1–15. https://doi.org/10.1002/jbio.202200146.Search in Google Scholar PubMed
8. Wang, M, Zhu, W, Shi, F, Su, J, Chen, H, Yu, K, et al.. MsTGANet: automatic drusen segmentation from retinal OCT images. IEEE Trans Med Imaging 2022;41:394–406. https://doi.org/10.1109/tmi.2021.3112716.Search in Google Scholar
9. Bandyopadhyay, T, Kubícek, J, Penhaker, M, Timkovic, J, Oczka, D, Krejcar, O. A semi-supervised learning approach for automatic segmentation of retinal lesions using SURF blob detector and locally adaptive segmentation. In: ACIIDS, vol 2; 2019:311–23 pp.10.1007/978-3-030-14802-7_27Search in Google Scholar
10. Chen, Z, Wang, X, Huang, J, Lu, J, Zheng, J. Deep attention and graphical neural network for multiple sclerosis lesion segmentation from MR imaging sequences. IEEE J Biomed Health Inf 2022;26:1196–207. https://doi.org/10.1109/jbhi.2021.3109119.Search in Google Scholar
11. Ghribi, O, Sellami, L, Slima, M, Hamida, A, Mhiri, C, Mahfoudh, K. An advanced MRI multi-modalities segmentation methodology dedicated to multiple sclerosis lesions exploration and differentiation. IEEE Trans NanoBiosci 2017;8:656–65.10.1109/TNB.2017.2763246Search in Google Scholar PubMed
12. Li, X, Hu, X, Yu, L, Zhu, L, Fu, C, Heng, P. CANet: cross-disease attention network for joint diabetic retinopathy and diabetic macular edema grading. IEEE Trans Med Imaging 2020;5:1483–93. https://doi.org/10.1109/tmi.2019.2951844.Search in Google Scholar
13. Lin, C, Liao, W, Liang, J, Chen, P, Ko, C, Yang, C, et al.. Denoising performance evaluation of automated age-related macular degeneration detection on optical coherence tomography images. IEEE Sensor J 2021;1:790–801. https://doi.org/10.1109/jsen.2020.3014254.Search in Google Scholar
14. Dai, CX, Zhou, CQ, Fan, SH, Chen, Z, Chai, XY, Ren, QS, et al.. Optical coherence tomography for whole eye segment imaging. Opt Express 2012;20:6109–15. https://doi.org/10.1364/oe.20.006109.Search in Google Scholar PubMed
15. Grytz, R, El Hamdaoui, M, Fuchs, PA, Fazio, MA, McNabb, RP, Kuo, AN, et al.. Nonlinear distortion correction for posterior eye segment optical coherence tomography with application to tree shrews. Biomed Opt Express 2022;2:1070–86. https://doi.org/10.1364/boe.447595.Search in Google Scholar PubMed PubMed Central
16. Mithun, N, Panda, R, Roy-Chowdhury, AK. Construction of diverse image datasets from web collections with limited labeling. IEEE Trans Circuits Syst Video Technol 2020;30:1147–61. https://doi.org/10.1109/tcsvt.2019.2898899.Search in Google Scholar
17. Yao, Y, Zhang, J, Shen, F, Liu, L, Zhu, F, Zhang, D, et al.. Towards automatic construction of diverse, high-quality image datasets. IEEE Trans Knowl Data Eng 2020;32:1199–211. https://doi.org/10.1109/tkde.2019.2903036.Search in Google Scholar
18. Bhandari, A, Ghosh, A, Kumar, I. A local contrast fusion based 3D Otsu algorithm for multilevel image segmentation. IEEE/CAA J Autom Sin 2020;1:200–13. https://doi.org/10.1109/jas.2019.1911843.Search in Google Scholar
19. Pang, S, Lu, Z, Jiang, J, Zhao, L, Lin, L, Li, X, et al.. Hippocampus segmentation based on iterative local linear mapping with representative and local structure-preserved feature embedding. IEEE Trans Med Imaging 2019;10:2271–80. https://doi.org/10.1109/TMI.2019.2906727.Search in Google Scholar PubMed
20. Mohsen, G, Vahid, A. Unsupervised change detection in polarimetric SAR data with the hotelling-lawley trace statistic and minimum-error thresholding. IEEE J Sel Top Appl Earth Obs Remote Sens 2018;12:4551–62.10.1109/JSTARS.2018.2882412Search in Google Scholar
21. Zhang, T, Yang, Z, Xu, Z, Li, J. Wheat yellow rust severity detection by efficient DF-UNet and UAV multispectral imagery. IEEE Sensor J 2022;9:9057–68. https://doi.org/10.1109/jsen.2022.3156097.Search in Google Scholar
22. Wang, M, Jiang, H, Shi, T, Yao, Y. HD-RDS-UNet: leveraging spatial-temporal correlation between the decoder feature maps for lymphoma segmentation. IEEE J Biomed Health Inf 2022;3:1116–27.10.1109/JBHI.2021.3102612Search in Google Scholar PubMed
23. Zhang, Y, Wu, J, Liu, Y, Chen, Y, Wu, E, Tang, X. MI-UNet: multi-inputs UNet incorporating brain parcellation for stroke lesion segmentation from T1-weighted magnetic resonance images. IEEE J Biomed Health Inf 2021;2:526–35. https://doi.org/10.1109/jbhi.2020.2996783.Search in Google Scholar
24. Chen, C, Wang, X, Heidari, AA, Yu, H, Chen, H. Multi-threshold image segmentation of maize diseases based on elite comprehensive particle swarm optimization and Otsu. Front Plant Sci 2021;1:789911. https://doi.org/10.3389/fpls.2021.789911.Search in Google Scholar PubMed PubMed Central
25. Yu, Y, Bao, Y, Wang, J, Chu, H, Zhao, N, He, Y, et al.. Crop row segmentation and detection in paddy fields based on treble-classification Otsu and double-dimensional clustering method. Remote Sens 2021;5:901–13. https://doi.org/10.3390/rs13050901.Search in Google Scholar
26. Tao, P, Wei, C, Yi, H, Lou, Y, Ying, Z. A method based on minimum error thresholding for froth image classification. In: 25th Chinese control and decision conference (CCDC), vol 1; 2013:4768–71 pp.10.1109/CCDC.2013.6561796Search in Google Scholar
27. Sayed, MS. Robust fabric defect detection algorithm using entropy filtering and minimum error thresholding. In: IEEE 59th international midwest symposium on circuits and systems (MWSCAS), vol 1; 2016:1–4 pp.10.1109/MWSCAS.2016.7870031Search in Google Scholar
28. Malathi, M, Kalaiselvi, K, Shankarlal, B, Kokila, S, Thenmalar, K, Johny, R. A hybrid deep learning model for effective segmentation and classification of lung nodules from CT images. J Intell 2022;3:2667–79.10.3233/JIFS-212189Search in Google Scholar
29. Kang, S, Iwana, B, Uchida, S. Cascading modular U-nets for document image segmentation. In: International conference on document analysis and recognition (ICDAR), vol 1; 2019:118–30 pp.10.1109/ICDAR.2019.00113Search in Google Scholar
30. Yang, X, Wan, Y. Non-uniform illumination document image segmentation using K-means clustering algorithm. In: IEEE 9th international conference on information, communication and networks (ICICN), vol 1; 2021:506–10 pp.10.1109/ICICN52636.2021.9674011Search in Google Scholar
31. Roy, S, Menapace, W, Oei, S, Luijten, B, Fini, E, Saltori, C, et al.. Deep learning for classification and localization of COVID-19 markers in point-of-care lung ultrasound. IEEE Trans Med Imaging 2020;8:2676–87. https://doi.org/10.1109/tmi.2020.2994459.Search in Google Scholar
32. Kromp, F, Fischer, L, Bozsaky, E, Ambros, IM, Dörr, W, Beiske, K, et al.. Evaluation of deep learning architectures for complex immunofluorescence nuclear image segmentation. IEEE Trans Med Imaging 2021;1:1934–49. https://doi.org/10.1109/tmi.2021.3069558.Search in Google Scholar PubMed
33. Hussein, S, Kandel, P, Bolan, CW, Wallace, MB, Bagci, U. Lung and pancreatic tumor characterization in the deep learning era: novel supervised and unsupervised learning approaches. IEEE Trans Med Imaging 2019;38:1777–87.10.1109/TMI.2019.2894349Search in Google Scholar PubMed
34. Ma, D, Lu, DH, Chen, S, Heisler, M, Dabiri, S, Lee, S, et al.. LF-UNet – a novel anatomical-aware dual-branch cascaded deep neural network for segmentation of retinal layers and fluid from optical coherence tomography images. CMIG (Comput Med Imaging Graph) 2021;94:101988–97. https://doi.org/10.1016/j.compmedimag.2021.101988.Search in Google Scholar PubMed
35. Swalpa, K, Gopal, K, Shiv, R, Bidyut, B. HybridSN: exploring 3-D-2-D CNN feature hierarchy for hyperspectral image classification. IEEE Geosci Remote Sens Lett 2020;17:277–81. https://doi.org/10.1109/lgrs.2019.2918719.Search in Google Scholar
36. Cheng, G, Yan, B, Shi, P, Li, K, Yao, X, Guo, L, et al.. Prototype-CNN for few-shot object detection in remote sensing images. IEEE Trans Geosci Rem Sens 2022;60:1–10. https://doi.org/10.1109/tgrs.2021.3078507.Search in Google Scholar
37. Tan, J, Gao, Y, Liang, Z, Cao, W, Marc, J, Huo, Y, et al.. 3D-GLCM CNN: a 3-dimensional gray-level co-occurrence matrix-based CNN model for polyp classification via CT colonography. IEEE Trans Med Imaging 2020;39:2013–24. https://doi.org/10.1109/tmi.2019.2963177.Search in Google Scholar
38. Ronneberger, O, Fischer, P, Brox, T. U-net: convolutional networks for biomedical image segmentation. In: MICCAI, vol 1; 2015:234–41 pp.10.1007/978-3-319-24574-4_28Search in Google Scholar
39. Mai, Y, Chen, Z, Yu, B, Li, Y, Pang, Z, Han, Z. Non-contact heartbeat detection based on ballistocardiogram using UNet and bidirectional long short-term memory. IEEE J Biomed Health Inf 2022;26:3720–30.10.1109/JBHI.2022.3162396Search in Google Scholar PubMed
40. Steven, G, Amir, A, Siddhartha, S, Parag, V. Fully dense UNet for 2-D sparse photoacoustic tomography artifact removal. IEEE J Biomed Health Inf 2020;24:568–76. https://doi.org/10.1109/jbhi.2019.2912935.Search in Google Scholar PubMed
41. Song, A, Xu, L, Wang, L, Yang, X, Xu, B, Wang, B, et al.. Automatic coronary artery segmentation of CCTA images with an efficient feature-fusion-and-rectification 3D-UNet. IEEE J Biomed Health Inf 2022;26:1–7. https://doi.org/10.1109/jbhi.2022.3169425.Search in Google Scholar PubMed
42. Ali, K, Ali, A, Bagher, R. ISUR: iris segmentation based on UNet and ResNet. In: 2021 11th international conference on computer engineering and knowledge (ICCKE); 2021:1–7 pp.10.1109/ICCKE54056.2021.9721475Search in Google Scholar
43. Abdul, Q, Abdesslam, B, Moona, M, Mohamed, A-N, Domenec, P. Automatic segmentation of head and neck (H N) primary tumors in PET and CT images using 3D-inception-ResNet model. In: HECKTOR@MICCAI; 2021:58–67 pp.10.1007/978-3-030-98253-9_4Search in Google Scholar
44. Aheli, S, Yu-Dong, Z, Suresh, C. Brain tumour segmentation with a muti-pathway ResNet based UNet. J Grid Comput 2021;19:43–53. https://doi.org/10.1007/s10723-021-09590-y.Search in Google Scholar
45. Xiao, X, Lian, S, Luo, Z, Li, S. Weighted res-unet for high-quality retina vessel segmentation. In: ITME, vol 1; 2018:327–31 pp.10.1109/ITME.2018.00080Search in Google Scholar
46. Zhang, Z, Liu, Q, Wang, Y. Road extraction by deep residual UNet. IEEE Geosci Remote Sens Lett 2018;15:749–53. https://doi.org/10.1109/lgrs.2018.2802944.Search in Google Scholar
47. Berrar, D. Bayes’ theorem and naive Bayes classifier encycl. Bioinf Comput Biol 2018;1:403–12.10.1016/B978-0-12-809633-8.20473-1Search in Google Scholar
48. Mansour, EA, Saleh, AI, Mohammed Badawy, M, Ali, HA. Accurate detection of covid-19 patients based on feature correlated naïve Bayes (FCNB) classification strategy. J Ambient Intell Hum Comput 2022;13:41–73. https://doi.org/10.1007/s12652-020-02883-2.Search in Google Scholar PubMed PubMed Central
49. Xiong, Y, Ye, M, Wu, C. Cancer classification with a cost-sensitive naive Bayes stacking ensemble. Comput Math Methods Med 2021;1:1–12. https://doi.org/10.1155/2021/5556992.Search in Google Scholar PubMed PubMed Central
50. Karimi, D, Salcudean, SE. Reducing the Hausdorff distance in medical image segmentation with convolutional neural networks. IEEE Trans Med Imaging 2020;39:499–513. https://doi.org/10.1109/tmi.2019.2930068.Search in Google Scholar
51. Otsu, N. A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern 1979;9:62–6. https://doi.org/10.1109/tsmc.1979.4310076.Search in Google Scholar
52. Xing, JG, Yang, P, Qing, L. Robust 2D Otsu’s algorithm for uneven illumination image segmentation. Comput Intell Neurosci 2020;5047976:1–14.10.1155/2020/5047976Search in Google Scholar PubMed PubMed Central
53. Shaikh, SH, Maiti, AK, Chaki, N. Image segmentation using iterative partitioning: a global thresholding approach. In: ReTIS, vol 1; 2011:281–6 pp.10.1109/ReTIS.2011.6146882Search in Google Scholar
54. Barron, OT. A generalization of Otsu’s method and minimum error thresholding. In: ECCV, vol 5; 2020:455–70 pp.10.1007/978-3-030-58558-7_27Search in Google Scholar
55. Jadon, S. A survey of loss functions for semantic segmentation. In: IEEE international conference on computational intelligence in bioinformatics and computational biology, vol 1; 2020:1–7 pp.10.1109/CIBCB48159.2020.9277638Search in Google Scholar
© 2023 Walter de Gruyter GmbH, Berlin/Boston
Articles in the same Issue
- Frontmatter
- Review
- Computational models of bone fracture healing and applications: a review
- Research Articles
- Assessing standing balance with MOTI: a validation study
- Effect of non-thermal plasma treatment and resin cements on the bond strength of zirconia ceramics with different yttria concentrations
- A new approach towards extracorporeal gas exchange and first in vitro results
- Estimation of heart rate and respiratory rate by monitoring cardiopulmonary signals with flexible sensor
- Hand gesture recognition with deep residual network using Semg signal
- Crowdsourcing image segmentation for deep learning: integrated platform for citizen science, paid microtask, and gamification
- Image segmentation of mouse eye in vivo with optical coherence tomography based on Bayesian classification
- Impact of the new European medical device regulation: a two-year comparison
Articles in the same Issue
- Frontmatter
- Review
- Computational models of bone fracture healing and applications: a review
- Research Articles
- Assessing standing balance with MOTI: a validation study
- Effect of non-thermal plasma treatment and resin cements on the bond strength of zirconia ceramics with different yttria concentrations
- A new approach towards extracorporeal gas exchange and first in vitro results
- Estimation of heart rate and respiratory rate by monitoring cardiopulmonary signals with flexible sensor
- Hand gesture recognition with deep residual network using Semg signal
- Crowdsourcing image segmentation for deep learning: integrated platform for citizen science, paid microtask, and gamification
- Image segmentation of mouse eye in vivo with optical coherence tomography based on Bayesian classification
- Impact of the new European medical device regulation: a two-year comparison