Intraoperative motion correction in neurosurgery: a comparison of intensity- and feature-based methods
-
Fang Chen
,
Jan Müller
Abstract
The intraoperative identification of normal and anomalous brain tissue can be disturbed by pulsatile brain motion and movements of the patient and surgery devices. The performance of four motion correction methods are compared in this paper: Two intensity-based, applying optical flow algorithms, and two feature-based, which take corner features into account to track brain motion. The target registration error with manually selected marking points and the temporal standard deviation of intensity were analyzed in the evaluation. The results reveal the potential of the two types of methods.
Correction note: In the article version published online on September 21, 2018, three authors were inadvertently omitted from the author list. The names of Juliane Müller, Elisa Böhl and Matthias Kirsch were added on September 26, 2018.
Acknowledgments
This work is supported by the European Social Fund (grant no. 100270108) and the Free State of Saxony. In addition, the authors would like to thank Prof. Matthias Kirsch of the University Hospital in Dresden, Germany, for supporting the intraoperative measurements.
Author Statement
Research funding: This work is funded by the European Social Fund (grant no. 100270108).
Conflict of interest: Authors state no conflict of interest.
Informed consent: Informed consent is not applicable.
Ethical approval: The research related to human use complies with all the relevant national regulations, institutional policies and was performed in accordance with the tenets of the Helsinki Declaration, and has been approved by the authors’ institutional review board or equivalent committee (EK 153052012).
References
[1] Gorbach AM, Heiss J, Kufta C, Sato S, Fedio P, Kammerer WA, et al. Intraoperative infrared functional imaging of human brain. Ann Neurol 2003;54:297–309.10.1002/ana.10646Search in Google Scholar
[2] Gorbach AM, Heiss JD, Kopylev L, Oldfield EH. Intraoperative infrared imaging of brain tumors. J Neurosurg 2004;101:960.10.3171/jns.2004.101.6.0960Search in Google Scholar
[3] Steiner G, Sobottka SB, Koch E, Schackert G, Kirsch M. Intraoperative imaging of cortical cerebral perfusion by time-resolved thermography and multivariate data analysis. J Biomed Opt 2011;16:016001.10.1117/1.3528011Search in Google Scholar
[4] Hollmach J, Hoffmann N, Schnabel C, Küchler S, Sobottka S, Kirsch M, et al. Highly sensitive time-resolved thermography and multivariate image analysis of the cerebral cortex for intrasurgical diagnostics. In: Proceedings of SPIE; 2013:8565: 856550. https://doi.org/10.1117/12.200234210.1117/12.2002342Search in Google Scholar
[5] Hoffmann N, Hollmach J, Schnabel C, Radev Y, Kirsch M, Petersohn U, et al. Wavelet subspace analysis of intraoperative thermal imaging for motion filtering. In: Campilho A, Kamel M, editors. ICIAR 2014, PART II. Springer, Cham; 2014:411–20.10.1007/978-3-319-11755-3_46Search in Google Scholar
[6] Senger V, Hoffmann N, Müller J, Hollmach J, Schnabel C, Radev Y, et al. Motion correction of thermographic images in neurosurgery: performance comparison. In: Biomedical Circuits and Systems Conference (BioCAS), Lausanne, 2014 IEEE; 2014:121–4.Search in Google Scholar
[7] Zitova B, Flusser J. Image registration methods: a survey. Image Vision Comput 2003;21:977–1000.10.1016/S0262-8856(03)00137-9Search in Google Scholar
[8] Ji S, Fan X, Roberts DW, Hartov A, Paulsen KD. Tracking Cortical Surface Deformation Using Stereovision. New York, NY: Springer New York; 2013:169–76.10.1007/978-1-4614-4427-5_24Search in Google Scholar
[9] Ji S, Fan X, Roberts DW, Hartov A, Paulsen KD. Cortical surface shift estimation using stereovision and optical flow motion tracking via projection image registration. Med Image Anal 2014;18:1169–83.10.1016/j.media.2014.07.001Search in Google Scholar PubMed PubMed Central
[10] Faria C, Sadowsky O, Bicho E, Ferrigno G, Joskowicz L, Shoham M, et al. Validation of a stereo camera system to quantify brain deformation due to breathing and pulsatility. Med Phys 2014;41:113502.10.1118/1.4897569Search in Google Scholar PubMed
[11] Kumar AN, Miga MI, Pheiffer TS, Chambless LB, Thompson RC, Dawant BM. Automatic tracking of intraoperative brain surface displacements in brain tumor surgery. In: Engineering in Medicine and Biology Society (EMBC), Chicago, 2014 36th Annual International Conference of the IEEE. IEEE; 2014:1509–12.10.1109/EMBC.2014.6943888Search in Google Scholar PubMed PubMed Central
[12] Jiang J, Nakajima Y, Sohma Y, Saito T, Kin T, Oyama H, et al. Marker-less tracking of brain surface deformations by non-rigid registration integrating surface and vessel/sulci features. Int J Comput Assist Radiol Surg 2016;11:1687–701.10.1007/s11548-016-1358-7Search in Google Scholar
[13] Horn BK, Schunck BG. Determining optical flow. Artif Intell 1981;17:185–203.10.1016/0004-3702(81)90024-2Search in Google Scholar
[14] Lucas BD, Kanade T. An iterative image registration technique with an application to stereo vision. In: Proceedings of the 7th International Joint Conference on Artificial Intelligence, Vol. 2, IJCAI’81. San Francisco, CA, USA: Morgan Kaufmann Publishers Inc.; 1981:674–9. http://dl.acm.org/citation.cfm?id=1623264.1623280.Search in Google Scholar
[15] Perona P, Malik J. Scale-space and edge detection using anisotropic diffusion. IEEE Trans Pattern Anal Mach Intell 1990;12:629–39.10.1109/34.56205Search in Google Scholar
[16] Pizer SM, Amburn EP, Austin JD, Cromartie R, Geselowitz A, Greer T, et al. Adaptive histogram equalization and its variations. Comput Vision Graph Image Process 1987;39:355–68.10.1016/S0734-189X(87)80186-XSearch in Google Scholar
[17] Rosten E, Drummond T. Fusing points and lines for high performance tracking. In: IEEE International Conference on Computer Vision, Vol. 2, October; 2005:1508–15.10.1109/ICCV.2005.104Search in Google Scholar
[18] Sdika M, Alston L, Mahieu-Williame L, Guyotat J, Rousseau D, Montcel B. Robust real time motion compensation for intraoperative video processing during neurosurgery. In: Biomedical Imaging (ISBI), 2016 IEEE 13th International Symposium on. IEEE; 2016:1046–9.10.1109/ISBI.2016.7493445Search in Google Scholar
[19] Harris C, Stephens M. A combined corner and edge detector. In: Alvey vision conference, Vol. 15, Citeseer; 1988:10–5244.10.5244/C.2.23Search in Google Scholar
[20] Calonder M, Lepetit V, Strecha C, Fua P. Brief: binary robust independent elementary features. Computer Vision–ECCV 2010;2010:778–92.10.1007/978-3-642-15561-1_56Search in Google Scholar
[21] Shepard D. A two-dimensional interpolation function for irregularly-spaced data. In: Proceedings of the 1968 23rd ACM national conference. ACM; 1968;517–24.10.1145/800186.810616Search in Google Scholar
©2018 Walter de Gruyter GmbH, Berlin/Boston
Articles in the same Issue
- Frontmatter
- Guest Editorial
- Optical imaging methods in medicine: how can we escape the plausibility trap?
- Special Issue Articles
- Diffuse near-infrared imaging of tissue with picosecond time resolution
- A compact hyperspectral camera for measurement of perfusion parameters in medicine
- LED for hyperspectral imaging – a new selection method
- Approaches for calibration and validation of near-infrared optical methods for oxygenation monitoring
- Hyperspectral imaging in perfusion and wound diagnostics – methods and algorithms for the determination of tissue parameters
- Algorithms for mapping kidney tissue oxygenation during normothermic machine perfusion using hyperspectral imaging
- Intraoperative mapping of the sensory cortex by time-resolved thermal imaging
- Intraoperative motion correction in neurosurgery: a comparison of intensity- and feature-based methods
- Optical molecular imaging of corpora amylacea in human brain tissue
- Intraoperative optical imaging of metabolic changes after direct cortical stimulation – a clinical tool for guidance during tumor resection?
- Application of optical and spectroscopic technologies for the characterization of carious lesions in vitro
- Hyperspectral imaging: innovative diagnostics to visualize hemodynamic effects of cold plasma in wound therapy
- Hyperspectral imaging as a possible tool for visualization of changes in hemoglobin oxygenation in patients with deficient hemodynamics – proof of concept
- Cardiovascular assessment by imaging photoplethysmography – a review
Articles in the same Issue
- Frontmatter
- Guest Editorial
- Optical imaging methods in medicine: how can we escape the plausibility trap?
- Special Issue Articles
- Diffuse near-infrared imaging of tissue with picosecond time resolution
- A compact hyperspectral camera for measurement of perfusion parameters in medicine
- LED for hyperspectral imaging – a new selection method
- Approaches for calibration and validation of near-infrared optical methods for oxygenation monitoring
- Hyperspectral imaging in perfusion and wound diagnostics – methods and algorithms for the determination of tissue parameters
- Algorithms for mapping kidney tissue oxygenation during normothermic machine perfusion using hyperspectral imaging
- Intraoperative mapping of the sensory cortex by time-resolved thermal imaging
- Intraoperative motion correction in neurosurgery: a comparison of intensity- and feature-based methods
- Optical molecular imaging of corpora amylacea in human brain tissue
- Intraoperative optical imaging of metabolic changes after direct cortical stimulation – a clinical tool for guidance during tumor resection?
- Application of optical and spectroscopic technologies for the characterization of carious lesions in vitro
- Hyperspectral imaging: innovative diagnostics to visualize hemodynamic effects of cold plasma in wound therapy
- Hyperspectral imaging as a possible tool for visualization of changes in hemoglobin oxygenation in patients with deficient hemodynamics – proof of concept
- Cardiovascular assessment by imaging photoplethysmography – a review
