Home Image-based 3D surface approximation of the bladder using structure-from-motion for enhanced cystoscopy based on phantom data
Article
Licensed
Unlicensed Requires Authentication

Image-based 3D surface approximation of the bladder using structure-from-motion for enhanced cystoscopy based on phantom data

  • Quentin Péntek ORCID logo EMAIL logo , Simon Hein , Arkadiusz Miernik and Alexander Reiterer
Published/Copyright: December 4, 2017
Become an author with De Gruyter Brill
Submit Manuscript Author Information
Biomedical Engineering / Biomedizinische Technik
From the journal Biomedical Engineering / Biomedizinische Technik Volume 63 Issue 4

Abstract

Bladder cancer is likely to recur after resection. For this reason, bladder cancer survivors often undergo follow-up cystoscopy for years after treatment to look for bladder cancer recurrence. 3D modeling of the bladder could provide more reliable cystoscopic documentation by giving an overall picture of the organ and tumor positions. However, 3D reconstruction of the urinary bladder based on endoscopic images is challenging. This is due to the small field of view of the endoscope, considerable image distortion, and occlusion by urea, blood or particles. In this paper, we will demonstrate a method for the conversion of uncalibrated, monocular, endoscopic videos of the bladder into a 3D model using structure-from-motion (SfM). First of all, frames are extracted from video sequences. Distortions are then corrected in a calibration procedure. Finally, the 3D reconstruction algorithm generates a sparse surface approximation of the bladder lining based on the corrected frames. This method was tested using an endoscopic video of a phantom that mimics the rich structure of the bladder. The reconstructed 3D model covered a large part of the object, with an average reprojection error of 1.15 pixels and a relative accuracy of 99.4%.

Keywords: bundle adjustment; calibration; endoscopy; monocular camera; phantom

  1. Author Statement

  2. Research funding: Authors state no funding involved.

  3. Conflict of interest: Authors state no conflict of interest.

  4. Informed consent: Informed consent is not applicable.

  5. Ethical approval: The conducted research is not related to either human or animals use.

References

[1] Bergen T, Wittenberg T. Stitching and surface reconstruction from endoscopic image sequences: a review of applications and methods. IEEE J Biomed Health Inform 2016; 20: 304–321.10.1109/JBHI.2014.2384134Search in Google Scholar PubMed

[2] Brischwein M, Wittenberg T, Bergen T. Image based reconstruction for cystoscopy. Curr Direct Biomed Eng 2015; 1: 470–474.10.1515/cdbme-2015-0113Search in Google Scholar

[3] Chang PL, Handa A, Davison AJ, Stoyanov D, Edwards PE. Robust real-time visual odometry for stereo endoscopy using dense quadrifocal tracking. Inf Proc Comput Assist Int 2014; 8498: 11–20.10.1007/978-3-319-07521-1_2Search in Google Scholar

[4] Daul C, Blondel WP, Ben-Hamadou A, et al. From 2D towards 3D cartography of hollow organs, In Proc. 7th Int. Conf. Electr. Eng., Comput. Sci. Autom. Control Mexico 2010; 285–293.10.1109/ICEEE.2010.5608606Search in Google Scholar

[5] Fischler M, Bolles R. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM 1981; 6: 381–395.10.1145/358669.358692Search in Google Scholar

[6] Grasa OG, Bernal E, Casado S, Gil I, Montiel JM. Visual SLAM for handheld monocular endoscope. IEEE Trans Med Imaging 2014; 1: 135–146.10.1109/TMI.2013.2282997Search in Google Scholar PubMed

[7] Lavest JM, Rives G, Lapresté JT. Dry camera calibration for underwater applications. Lect Notes Comput Sci 2003; 1843: 654–668.10.1007/s00138-002-0112-zSearch in Google Scholar

[8] Lowe D. Distinctive image features from scale-invariant keypoints. Int J Comput Vis 2004; 2: 91–110.10.1023/B:VISI.0000029664.99615.94Search in Google Scholar

[9] Maier-Hein L, Mountney P, Bartoli A, et al. Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery. Med Image Anal 2013; 17: 974–996.10.1016/j.media.2013.04.003Search in Google Scholar PubMed

[10] Mueller-Richter UD, Limberger A, Weber P, Ruprecht KW, Spitzer W, Schilling M. Possibilities and limitations of current stereo-endoscopy. Surg Endosc Interv Tech 2004; 18: 942–947.10.1007/s00464-003-9097-6Search in Google Scholar PubMed

[11] Okatani T, Deguchi K. Shape reconstruction from an endoscope image by shape from shading technique for a point light source at the projection center. Comput Vis Image Underst 1997; 66: 119–131.10.1006/cviu.1997.0613Search in Google Scholar

[12] Soper T, Porter M, Seibel E. Surface mosaics of the bladder reconstructed from endoscopic video for automated surveillance. IEEE Trans Biomed Eng 2012; 6: 1670–1680.10.1109/TBME.2012.2191783Search in Google Scholar PubMed

[13] Sturm P. Critical motion sequences for monocular self-calibration and uncalibrated Euclidean reconstruction. IEEE Conf. on Computer Vision and Pattern Recognition 1997; 1100–1105.10.1109/CVPR.1997.609467Search in Google Scholar

[14] Szeliski R. Computer vision: algorithms and applications. London: Springer-Verlag 2010.10.1007/978-1-84882-935-0Search in Google Scholar

[15] Totz J, Fujii K, Mountney P, Yang GZ. Enhanced visualisation for minimally invasive surgery. Int J Comput Assist Radio Surg 2012; 7: 423–432.10.1007/s11548-011-0631-zSearch in Google Scholar PubMed

[16] Triggs B, McLauchlan P, Hartley R, Fitzgibbon A. Bundle adjustment – a modern synthesis. In: Vision algorithms: theory and practice. Berlin: Springer 2000: 298–372.10.1007/3-540-44480-7_21Search in Google Scholar

[17] Wu C. Towards linear-time incremental structure from motion. Int Conf 3D Vis 2013; 127–134.10.1109/3DV.2013.25Search in Google Scholar

[18] Wu C, Jaramaz B. An easy calibration for oblique-viewing endoscopes. IEEE Int Conf Robot Autom 2008; 1424–1429.10.1109/ROBOT.2008.4543402Search in Google Scholar

[19] Yamaguchi T, Nakamoto M, Sato Y, et al. Camera model and calibration procedure for oblique-viewing endoscope. Proc. Med. Imag. Comput. Comput.-Assist. Intervention Canada 2003; 373–381.10.1007/978-3-540-39903-2_46Search in Google Scholar

[20] Zhang Z. A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 2000; 11: 1330–1334.10.1109/34.888718Search in Google Scholar

Received: 2016-09-14
Accepted: 2017-05-16
Published Online: 2017-12-04
Published in Print: 2018-07-26

©2018 Walter de Gruyter GmbH, Berlin/Boston

Articles in the same Issue

  1. Frontmatter
  2. Research articles
  3. A new in vitro spine test rig to track multiple vertebral motions under physiological conditions
  4. In-service characterization of a polymer wick-based quasi-dry electrode for rapid pasteless electroencephalography
  5. Spike detection using a multiresolution entropy based method
  6. Obstacles in using a computer screen for steady-state visually evoked potential stimulation
  7. Classification of pulmonary pathology from breath sounds using the wavelet packet transform and an extreme learning machine
  8. Filtering of ECG signals distorted by magnetic field gradients during MRI using non-linear filters and higher-order statistics
  9. Failure analysis of eleven Gates Glidden drills that fractured intraorally during post space preparation. A retrieval analysis study
  10. Assessing multiple muscle activation during squat movements with different loading conditions – an EMG study
  11. In-vivo monitoring of infection via implantable microsensors: a pilot study
  12. Analysis of structural brain MRI and multi-parameter classification for Alzheimer’s disease
  13. False spectra formation in the differential two-channel scheme of the laser Doppler flowmeter
  14. A priori knowledge integration for the detection of cerebral aneurysm
  15. Is the location of the signal intensity weighted centroid a reliable measurement of fluid displacement within the disc?
  16. Image-based 3D surface approximation of the bladder using structure-from-motion for enhanced cystoscopy based on phantom data
  17. Fused multivariate empirical mode decomposition (MEMD) and inverse solution method for EEG source localization
  18. Quantifying the dynamics of electroencephalographic (EEG) signals to distinguish alcoholic and non-alcoholic subjects using an MSE based K-d tree algorithm
  19. A hybrid active force control of a lower limb exoskeleton for gait rehabilitation
  20. Short communication
  21. Can somatosensory electrical stimulation relieve spasticity in post-stroke patients? A TMS pilot study
https://doi.org/10.1515/bmt-2016-0185
Keywords for this article
bundle adjustment; calibration; endoscopy; monocular camera; phantom

Articles in the same Issue

  1. Frontmatter
  2. Research articles
  3. A new in vitro spine test rig to track multiple vertebral motions under physiological conditions
  4. In-service characterization of a polymer wick-based quasi-dry electrode for rapid pasteless electroencephalography
  5. Spike detection using a multiresolution entropy based method
  6. Obstacles in using a computer screen for steady-state visually evoked potential stimulation
  7. Classification of pulmonary pathology from breath sounds using the wavelet packet transform and an extreme learning machine
  8. Filtering of ECG signals distorted by magnetic field gradients during MRI using non-linear filters and higher-order statistics
  9. Failure analysis of eleven Gates Glidden drills that fractured intraorally during post space preparation. A retrieval analysis study
  10. Assessing multiple muscle activation during squat movements with different loading conditions – an EMG study
  11. In-vivo monitoring of infection via implantable microsensors: a pilot study
  12. Analysis of structural brain MRI and multi-parameter classification for Alzheimer’s disease
  13. False spectra formation in the differential two-channel scheme of the laser Doppler flowmeter
  14. A priori knowledge integration for the detection of cerebral aneurysm
  15. Is the location of the signal intensity weighted centroid a reliable measurement of fluid displacement within the disc?
  16. Image-based 3D surface approximation of the bladder using structure-from-motion for enhanced cystoscopy based on phantom data
  17. Fused multivariate empirical mode decomposition (MEMD) and inverse solution method for EEG source localization
  18. Quantifying the dynamics of electroencephalographic (EEG) signals to distinguish alcoholic and non-alcoholic subjects using an MSE based K-d tree algorithm
  19. A hybrid active force control of a lower limb exoskeleton for gait rehabilitation
  20. Short communication
  21. Can somatosensory electrical stimulation relieve spasticity in post-stroke patients? A TMS pilot study
Sign up now to receive a 20% welcome discount
Institutional Access
How does access work?
Have an idea on how to improve our website?
Please write us.
© 2025 De Gruyter Brill
Downloaded on 26.10.2025 from https://www.degruyterbrill.com/document/doi/10.1515/bmt-2016-0185/html
Scroll to top button