Abstract
Injuries to the biliary tree during surgical, endoscopic or invasive radiological diagnostic or therapeutic procedures involving the pancreas, liver or organs of the upper gastrointestinal tract give rise to the need to develop a method for clear discrimination of biliary anatomy from surrounding tissue. Hyperspectral imaging (HSI) is an emerging optical technique in disease diagnosis and image-guided surgery with inherent advantages of being a non-contact, non-invasive, and non-ionizing technique. HSI can produce quantitative diagnostic information about tissue pathology, morphology, and chemical composition. HSI was applied in human liver transplantation and compared to porcine model operations to assess the capability of discriminating biliary anatomy from surrounding biological tissue. Absorbance spectra measured from bile ducts, gall bladder, and liver show a dependence on tissue composition and bile concentration, with agreement between human and porcine datasets. The bile pigment biliverdin and structural proteins collagen and elastin were identified as contributors to the bile duct and gall bladder absorbance spectra.
Introduction
Biliary injuries and HSI
Iatrogenic biliary injuries caused by surgical, endoscopic, diagnostic, or therapeutic procedures of the upper gastrointestinal system can severely impact post-operative quality of life and mortality [1]. Common causes of injuries include the visual misperception and differences in biliary anatomy from patient to patient [2]. Traditional intraoperative cholangiography (IOC) requires the use of ionizing radiation and an intraoperative C-Arm. This disrupts surgical workflow and exposes patients and staff to radiation. While there have been recent advancements in biliary visualization methods such as fluorescent IOC [3], these methods still require the administration of exogenous fluorescent dyes.
Hyperspectral imaging (HSI) is an emerging biomedical imaging technique that produces both spatial and spectral information by combining standard imaging with visible and near-infrared (VNIR) spectroscopy. HSI allows for the non-contact and non-invasive characterization of tissue morphology, composition and physiology using endogenous chromophores present in biological tissue [4]. Tissue parameters such as tissue oxygenation saturation (StO2) and tissue perfusion can therefore be calculated and interpreted for the diagnosis of physiology and pathology. HSI has been previously shown to give reliable results in visceral surgery (intestinal resections [5], [6], left liver resections [7], [8], esophagectomy [9]), with various case studies currently in progress.
In this study, HSI data from human liver transplantation procedures and porcine model operations were studied and compared to discriminate biliary structures from surrounding tissue. Chromophores present in bile fluid and tissue composition were explored as cause of characteristic absorbances observed in recorded HSI spectra of liver, gall bladder, and bile ducts.
Bile and biliary tissue composition
Bile is an alkaline aqueous liquid produced continuously by the liver and is stored and concentrated in the gall bladder. The stored bile is discharged into the duodenum via the common bile duct after food intake to aid in the digestion of lipids. Bile mainly constitutes of water (∼95%) with the remaining 5% consisting of various organic and inorganic solutes such as bile salts, cholesterol, immune cells, hormones, and bicarbonate (HCO3−) [10]. However, primary bile salts cholic acid (CA) and chenodeoxycholic acid (CDCA), as well as other small molecules present such as cholesterol and glutathione absorb light within the UV-range (<400 nm). This is not detectable to HSI operating within the VNIR window (500–1,000 nm). Bile is the major route of excretion of bilirubin [10] which along with the intermediate compound biliverdin, are catabolic products of heme from the breakdown of red blood cells in the liver. Bilirubin and biliverdin absorb light at 460 and 675 nm respectively which, although present in small quantities in bile, contributes to its yellow–green appearance. These bile pigments mainly exist in a water-soluble conjugated state which can cause a shift in the observed absorbance [11]. Moreover, the absorption coefficient of biliverdin at 675 nm is greater than oxygenated hemoglobin (HbO2) [12].
The gall bladder contains contractile tissue for the release of bile into the ileum upon signaling, which constitute of the structure proteins collagen and elastin. This contractility differs from the main connective tissue of the liver, Glisson’s Capsule which surrounds the liver and hepatic ducts, arteries, and veins [13]. Both collagen and elastin have broad absorbances in the 500–850 nm range, with local maxima centered around 910 nm [14].
Materials and methods
Liver transplantation data
During liver transplantation procedures (before and after allograft) of n=7 patients (4 male, 3 female) 22 intraoperative hyperspectral images were acquired with the TIVITA® Tissue system (Diaspective Vision GmbH, Am Salzhaff, Germany). This HSI push-broom scanner operates in the visible and near-infrared range (500–1000 nm), having a high spectral resolution (5 nm) with 640 × 480 effective pixels (x-, y-axis). A distance of 50 cm between the object and camera was maintained giving a focal length of 25 mm and an 8 × 6.5 cm2 field of view (FOV). Object illumination is performed by six halogen spots (20 W each) which are integrated into the camera housing. To reduce background light interference, ceiling lights were switched off during imaging recording which takes about 8 s to produce the hyperspectral data cube.
Pig model data
Five intraoperative in vivo hyperspectral images of porcine upper abdomen, including bile duct, liver and gallbladder were similarly acquired using the TIVITA® Tissue system.
Data processing
The location of gall bladder, biliary ducts, liver, peritoneum, and surrounding connective tissues were annotated on the color images by the operating physician which in turn, were used to generate region of interests (ROIs). The data was pre-processed using Microsoft Excel and MATLAB. The Standard Normal Variate (SNV) transformed spectra of ROI were comparted initially for the identification of visible outliers. SNV transformation normalizes a set of spectra and removes the baseline effect, effectively minimizing scatter effects while accentuating spectral features. Outliers include incorrectly annotated tissue, spectra affected by glare or movement artefacts.
After outlier removal, the raw ROI spectra were averaged across all included patients to give average absorption spectra for each of the tissue classes. Subsequently, derivative spectra using a Savitzky–Golay filter (polynomial order=2, window length=5) were produced to reduce the influence of broad absorbance bands resulting from scattering effects.
Results
The averaged absorbance spectra (Figure 1) shows the liver has the highest absolute absorbance in both human and pig datasets. This is evident within the 500–700 nm range, which can be attributed to the high blood concentration of both oxygenated hemoglobin, HbO2 (550 and 600 nm) and deoxygenated, HHb (650 nm) [12].
![Figure 1: Averaged absorbance spectra of human (top) and porcine (bottom) tissue with standard deviations as shaded area and bile absorption coefficient [12] plotted as secondary y-axis.](/document/doi/10.1515/cdbme-2020-0012/asset/graphic/j_cdbme-2020-0012_fig_001.jpg)
Averaged absorbance spectra of human (top) and porcine (bottom) tissue with standard deviations as shaded area and bile absorption coefficient [12] plotted as secondary y-axis.
Both human and pig bile ducts have a similar spectral profile, having weaker relative absorption than liver and gall bladder between 600 and 1,000 nm. This could be due to the lower tissue and bile volume relative to the liver and gall bladder, as well as overlying tissue layers causing greater scattering and thus attenuating the observed absorbance signal. Human and pig gall bladder spectra have a distinct broad absorbance from 600 nm onwards. This reflects the higher bile content expected in the gall bladder and suggests a distinct tissue composition from that of the bile ducts.
The second-order derivative spectra (Figure 2) results in observable negative absorption peaks with minima at the same wavelength as the maxima on the zero-order absorption spectrum. Five distinct bands were identified in the region 645–1,000 nm corresponding to biliverdin, deoxy- and oxy-hemoglobin (HHb and HbO2), lipid and water.

Savizky–Golay 2nd derivative absorbance spectra of human (top) and porcine (bottom) tissue. Vertical lines correspond to biliverdin=675; deoxyhemoglobin (HHb)=760; oxyhemoglobin (HbO2)=800; lipid=930; water=970 nm.
Discussion
The intrahepatic biliary tract is unlikely to be distinguishable given the absorption of the liver (red) is greater than bile ducts (green) at any given wavelength. An exception to this is evident in the human data beyond 930 nm, where an increased absorbance in the bile duct is observed. This absorbance is hypothesized to be caused by the high-water content of bile (∼95%) as well as the high-lipid content [10], which have expected maxima of ca. 970 and 930 nm respectively [15].
Bile is believed to be a cause of the characteristic broad absorbance seen in liver, gall bladder, and bile duct spectra. The reported bile absorption coefficient [12] (secondary y-axis) features a local maximum at 675 nm associated with bile pigment biliverdin. This indicates bile pigments having a greater contribution to the absorption of bile-containing tissue spectra than HbO2 at equal concentrations.
While bile on average is alkaline, it has been shown that the bile contained in the gall bladder becomes increasingly more acidic during fasting periods [16]. In general, gall bladder bile tends to be of a lower pH (6.80–7.65), compared that of the common bile duct (pH=7.50–8.05). These pH variations influence the composition of bile, especially in the formation of conjugates [17]. It has also been demonstrated that at low pH<4 oxidation of bilirubin to biliverdin takes place in pure bile, leading to an increased absorbance of the latter at ca. 700 nm. It is therefore possible that perioperative fasting can lead to a decreased bile pH and increase in biliverdin concentration, which is to be considered when using biliverdin in future biliary classification algorithms. This broad absorbance is evident in both human and pig gall bladder spectra in the range 550–750 nm. However, the proposed contribution of biliverdin to the spectra of liver and gall bladder does not explain the difference observed between 700 and 950 nm.
Given that the liver contains virtually no contractual tissue, it is expected that the spectral contribution of elastin (broad absorption from 550 to 850 nm) is minimal. For the gall bladder both collagen and elastin could contribute to the observed broad absorbance, given the presence of contractual smooth muscle for the expulsion of bile.
Biliverdin (ca. 680 nm) is evident in both gall bladder and bile duct derivative spectra in both human and pig. It is not obvious if the liver peak at ca. 660 nm is a result of another conjugated form of biliverdin or another unidentified chromophore. In both pig and human datasets, the liver (red) has the greatest HHb peak (760 nm). This is attributed to two thirds of the hepatic blood supply being partially deoxygenated venous blood. The pig peritoneum has the strongest lipid peak (930 nm) which is expected. However, the high-lipid content of bile is not apparent in gall bladder or bile duct spectra. This could be due to perioperative fasting reducing the food-related lipid in bile.
Conclusions
HSI in combination with spectral processing has identified the dual contribution of bile and organ tissue composition to the observed spectra of biliary anatomy. The bile pigment biliverdin and structural proteins collagen and elastin were identified as contributors to the absorbance spectra of bile ducts and gall bladder. The concentration of observable biliverdin and lipid content of bile is hypothesized to be influenced by fasting routines prior to operation. This, along with deviations from Beer–Lambert linearity due to scattering or aggregation make the quantification of bile in tissue challenging. This also limits the possibility of using bile as a signature for classification algorithms in image-guided surgery.
One approach to solve this issue is to use deeper-penetrating NIR radiation and to characterize the bile spectrum based on water and lipid content. These water–lipid peaks were the basis of Zuzak et al. [15] analysis in which a laparoscopic hyperspectral imaging system (spectral range of 650–1100 nm) with principle component analysis were used to visualize biliary anatomy of swine. This method along with the inclusion of additional identified chromophores such as biliverdin, could be adapted for the use with the TIVITA® system and the current patient dataset as a method to visualize and classify biliary anatomy intra-operatively.
Research funding: The author states no funding involved.
Author contribution: All the authors have accepted responsibility for the entire content of this submitted manuscript and approved submission.
Conflict of interest: The hyperspectral camera used in this publication was developed by Diaspective Vision GmbH. G. S. Cooney was an employee of this company prior to paper submission. H. Köhler is an employee of this company.
Informed consent: Informed consent was obtained from all individuals included in this study.
Ethical approval: Experimental hyperspectral measurements from patients for the evaluation of new technology have obtained the ethics approval by the Ethics committee of the University Leipzig under 026/18-ek. The study was conducted according to the Helsinki Declaration.
References
1. Bai, L, Jin, C, Wang, S. Diagnosis, treatment, and prevention of iatrogenic injury in the lower part of common bile duct. Gastroenterol Hepatol Lett 2019;1:6–10. https://doi.org/10.18063/ghl.v1i1.237.Search in Google Scholar
2. Stewart, L, Way, LW. The prevention of laparoscopic bile duct injuries: an analysis of 300 cases of from a human factors and cognitive psychology perspective. Proc Hum Factors Ergon Soc 2007;2:617–20. https://doi.org/10.1177/154193120705101103.Search in Google Scholar
3. Ishizawa, T, Bandai, Y, Kokudo, N. Fluorescent cholangiography using indocyanine green for laparoscopic cholecystectomy: an initial experience. Arch Surg 2009;144:381–2. https://doi.org/10.1001/archsurg.2009.9.Search in Google Scholar PubMed
4. Lu, G, Fei, B. Medical hyperspectral imaging: a review. J Biomed Optic 2014;19:010901. https://doi.org/10.1117/1.jbo.19.1.010901.Search in Google Scholar
5. Jansen-Winkeln, B, Holfert, N, Köhler, H, Moulla, Y, Takoh, JP, Rabe, SM, et al. Determination of the transection margin during colorectal resection with hyperspectral imaging (HSI). Int J Colorectal Dis 2019;34:731–9. https://doi.org/10.1007/s00384-019-03250-0.10.1007/s00384-019-03250-0Search in Google Scholar PubMed
6. Jansen-winkeln, B, Maktabi, M, Takoh, JP, Rabe, SM, Barberio, M, Köhler, H, et al. Hyperspectral imaging in gastrointestinal anastomoses. Surgery 2018;89:717–25. https://doi.org/10.1007/s00104-018-0633-2.Search in Google Scholar PubMed
7. Sucher, R, Athanasios, A, Köhler, H, Wagner, T, Brunotte, M, Lederer, A, et al. Hyperspectral Imaging (HSI) in anatomic left liver resection. Int J Surg Case Rep 2019;62:108–11. https://doi.org/10.1016/j.ijscr.2019.08.025.Search in Google Scholar PubMed PubMed Central
8. Urade, T, Felli, E, Barberio, M, Al-Taher, M, Felli, E, Goffin, L, et al. Hyperspectral enhanced reality (HYPER) for anatomical; liver resection. Surg Endosc 2020;34:1745–53. https://doi.org/10.1007/s00464-020-07586-5.Search in Google Scholar PubMed
9. Köhler, H, Jansen-Winkeln, B, Maktabi, M, Barberio, M, Takoh, J, Holfert, N, et al. Evaluation of hyperspectral imaging (HSI) for the measurement of ischemic conditioning effects of the gastric conduit during esophagectomy. Surg Endosc 2019;33:3775–82. https://doi.org/10.1007/s00464-019-06675-4.Search in Google Scholar PubMed
10. Boyer, JL. Bile formation and secretion. Compr Physiol 2013;3:1035–78. https://doi.org/10.1002/cphy.c120027.Search in Google Scholar PubMed PubMed Central
11. Goncharova, I, Jašprová, J, Vítek, L, Urbanová, M. Photo-isomerization and oxidation of bilirubin in mammals is dependent on albumin binding. Anal Biochem 2015;490:34–45. https://doi.org/10.1016/j.ab.2015.08.001.Search in Google Scholar PubMed
12. Nachabé, R, Evers, DJ, Hendriks, BH, Lucassen, GW, van der Voort, M, Wesseling, J, et al. Effect of bile absorption coefficients on the estimation of liver tissue optical properties and related implications in discriminating healthy and tumorous samples. Biomed Optic Express 2011;2:600–14. https://doi.org/10.1364/boe.2.000600.Search in Google Scholar PubMed PubMed Central
13. Chapman, GB, Eagles, DA. Ultrastructural features of Glisson’s capsule and the overlying mesothelium in rat, monkey, and pike liver. Tissue Cell 2007;39:343–51. https://doi.org/10.1016/j.tice.2007.06.005.Search in Google Scholar PubMed
14. Konugolu, S, Sekar, V, Mora, AD. Diffuse optical characterization of collagen absorption from 500 to 1700 nm. J Biomed Optic 2017;22:015006. https://doi.org/10.1007/s00464-019-06675-4.Search in Google Scholar PubMed
15. Zuzak, KJ, Naik, SC, Alexandrakis, G, Hawkins, D, Behbehani, K, Livingston, E. Intraoperative bile duct visualization using near-infrared hyperspectral video imaging. Am J Surg 2008;195:491–7. https://doi.org/10.1016/j.amjsurg.2007.05.044.Search in Google Scholar PubMed
16. Sutor, DJ, Wilkie, LI. Diurnal variations in the pH of pathological gallbladder bile. Gut 1976;17:971–4. https://doi.org/10.1136/gut.17.12.971.Search in Google Scholar PubMed PubMed Central
17. Hofmann, AF, Mysels, KJ. Bile acid solubility and precipitation in vitro and in vivo: the role of conjugation, pH, and Ca2+ ions. J Lipid Res 1992;33:617–26.10.1016/S0022-2275(20)41426-9Search in Google Scholar
© 2020 Gary Sean Cooney et al., published by De Gruyter, Berlin/Boston
This work is licensed under the Creative Commons Attribution 4.0 International License.
Articles in the same Issue
- Proceedings Papers
- 4D spatio-temporal convolutional networks for object position estimation in OCT volumes
- A convolutional neural network with a two-stage LSTM model for tool presence detection in laparoscopic videos
- A novel calibration phantom for combining echocardiography with electromagnetic tracking
- Domain gap in adapting self-supervised depth estimation methods for stereo-endoscopy
- Automatic generation of checklists from business process model and notation (BPMN) models for surgical assist systems
- Automatic stent and catheter marker detection in X-ray fluoroscopy using adaptive thresholding and classification
- Autonomous guidewire navigation in a two dimensional vascular phantom
- Cardiac radiomics: an interactive approach for 4D data exploration
- Catalogue of hazards: a fundamental part for the safe design of surgical robots
- Catheter pose-dependent virtual angioscopy images for endovascular aortic repair: validation with a video graphics array (VGA) camera
- Cinemanography: fusing manometric and cinematographic data to facilitate diagnostics of dysphagia
- Comparison of spectral characteristics in human and pig biliary system with hyperspectral imaging (HSI)
- COMPASS: localization in laparoscopic visceral surgery
- Conceptual design of force reflection control for teleoperated bone surgery
- Data augmentation for computed tomography angiography via synthetic image generation and neural domain adaptation
- Deep learning for semantic segmentation of organs and tissues in laparoscopic surgery
- DL-based segmentation of endoscopic scenes for mitral valve repair
- Endoscopic filter fluorometer for detection of accumulation of Protoporphyrin IX to improve photodynamic diagnostic (PDD)
- EyeRobot: enabling telemedicine using a robot arm and a head-mounted display
- Fluoroscopy-guided robotic biopsy intervention system
- Force effects on anatomical structures in transoral surgery − videolaryngoscopic prototype vs. conventional direct microlaryngoscopy
- Force estimation from 4D OCT data in a human tumor xenograft mouse model
- Frequency and average gray-level information for thermal ablation status in ultrasound B-Mode sequences
- Generalization of spatio-temporal deep learning for vision-based force estimation
- Guided capture of 3-D Ultrasound data and semiautomatic navigation using a mechatronic support arm system
- Improving endoscopic smoke detection with semi-supervised noisy student models
- Infrared marker tracking with the HoloLens for neurosurgical interventions
- Intraventricular flow features and cardiac mechano-energetics after mitral valve interventions – feasibility of an isolated heart model
- Localization of endovascular tools in X-ray images using a motorized C-arm: visualization on HoloLens
- Multicriterial CNN based beam generation for robotic radiosurgery of the prostate
- Needle placement accuracy in CT-guided robotic post mortem biopsy
- New insights in diagnostic laparoscopy
- Robotized ultrasound imaging of the peripheral arteries – a phantom study
- Segmentation of the distal femur in ultrasound images
- Shrinking tube mesh: combined mesh generation and smoothing for pathologic vessels
- Surgical audio information as base for haptic feedback in robotic-assisted procedures
- Surgical phase recognition by learning phase transitions
- Target tracking accuracy and latency with different 4D ultrasound systems – a robotic phantom study
- Towards automated correction of brain shift using deep deformable magnetic resonance imaging-intraoperative ultrasound (MRI-iUS) registration
- Training of patient handover in virtual reality
- Using formal ontology for the representation of morphological properties of anatomical structures in endoscopic surgery
- Using position-based dynamics to simulate deformation in aortic valve replacement procedure
- VertiGo – a pilot project in nystagmus detection via webcam
- Visual guidance for auditory brainstem implantation with modular software design
- Wall enhancement segmentation for intracranial aneurysm
Articles in the same Issue
- Proceedings Papers
- 4D spatio-temporal convolutional networks for object position estimation in OCT volumes
- A convolutional neural network with a two-stage LSTM model for tool presence detection in laparoscopic videos
- A novel calibration phantom for combining echocardiography with electromagnetic tracking
- Domain gap in adapting self-supervised depth estimation methods for stereo-endoscopy
- Automatic generation of checklists from business process model and notation (BPMN) models for surgical assist systems
- Automatic stent and catheter marker detection in X-ray fluoroscopy using adaptive thresholding and classification
- Autonomous guidewire navigation in a two dimensional vascular phantom
- Cardiac radiomics: an interactive approach for 4D data exploration
- Catalogue of hazards: a fundamental part for the safe design of surgical robots
- Catheter pose-dependent virtual angioscopy images for endovascular aortic repair: validation with a video graphics array (VGA) camera
- Cinemanography: fusing manometric and cinematographic data to facilitate diagnostics of dysphagia
- Comparison of spectral characteristics in human and pig biliary system with hyperspectral imaging (HSI)
- COMPASS: localization in laparoscopic visceral surgery
- Conceptual design of force reflection control for teleoperated bone surgery
- Data augmentation for computed tomography angiography via synthetic image generation and neural domain adaptation
- Deep learning for semantic segmentation of organs and tissues in laparoscopic surgery
- DL-based segmentation of endoscopic scenes for mitral valve repair
- Endoscopic filter fluorometer for detection of accumulation of Protoporphyrin IX to improve photodynamic diagnostic (PDD)
- EyeRobot: enabling telemedicine using a robot arm and a head-mounted display
- Fluoroscopy-guided robotic biopsy intervention system
- Force effects on anatomical structures in transoral surgery − videolaryngoscopic prototype vs. conventional direct microlaryngoscopy
- Force estimation from 4D OCT data in a human tumor xenograft mouse model
- Frequency and average gray-level information for thermal ablation status in ultrasound B-Mode sequences
- Generalization of spatio-temporal deep learning for vision-based force estimation
- Guided capture of 3-D Ultrasound data and semiautomatic navigation using a mechatronic support arm system
- Improving endoscopic smoke detection with semi-supervised noisy student models
- Infrared marker tracking with the HoloLens for neurosurgical interventions
- Intraventricular flow features and cardiac mechano-energetics after mitral valve interventions – feasibility of an isolated heart model
- Localization of endovascular tools in X-ray images using a motorized C-arm: visualization on HoloLens
- Multicriterial CNN based beam generation for robotic radiosurgery of the prostate
- Needle placement accuracy in CT-guided robotic post mortem biopsy
- New insights in diagnostic laparoscopy
- Robotized ultrasound imaging of the peripheral arteries – a phantom study
- Segmentation of the distal femur in ultrasound images
- Shrinking tube mesh: combined mesh generation and smoothing for pathologic vessels
- Surgical audio information as base for haptic feedback in robotic-assisted procedures
- Surgical phase recognition by learning phase transitions
- Target tracking accuracy and latency with different 4D ultrasound systems – a robotic phantom study
- Towards automated correction of brain shift using deep deformable magnetic resonance imaging-intraoperative ultrasound (MRI-iUS) registration
- Training of patient handover in virtual reality
- Using formal ontology for the representation of morphological properties of anatomical structures in endoscopic surgery
- Using position-based dynamics to simulate deformation in aortic valve replacement procedure
- VertiGo – a pilot project in nystagmus detection via webcam
- Visual guidance for auditory brainstem implantation with modular software design
- Wall enhancement segmentation for intracranial aneurysm