Home Medicine EyeGuidance – a computer controlled system to guide eye movements
Article Open Access

EyeGuidance – a computer controlled system to guide eye movements

  • Bernd Köhler EMAIL logo , Georg Bretthauer , Rudolf F. Guthoff , Klaus-Martin Reichert , Ingo Sieber , Oliver Stachs , Lorenzo Toso and Stephan Allgeier
Published/Copyright: September 30, 2016

Abstract

The densely innervated human cornea is the only superficial tissue of the human body in which nerve fibres are accessible in vivo by corneal confocal microscopy (CCM). Morphological parameters of the corneal sub-basal nerve plexus (SNP) derived from CCM images can potentially serve as a sensitive biomarker for early diagnosis of various neurodegenerative diseases. The evaluation of a single image with a typical field of view of 0.16 mm2 is insufficient for robust morphometric assessment. Mosaicking approaches have therefore been proposed to examine the SNP on a larger scale. Here we present a highly automated technique that significantly facilitates the generation of mosaic images of the SNP and is suitable for clinical tests.

1 Introduction

The cornea is one of the most densely innervated superficial tissues in the human body. Being nearly perfectly transparent, the cornea is also the only part of the human body in which nerve structures are accessible in vivo to microscopic imaging techniques, such as confocal microscopy. While corneal confocal microscopy (CCM) has been used for in vivo imaging of cellular structures throughout the entire depth of the cornea, its highest potential may be in imaging the corneal sub-basal nerve plexus (SNP). CCM of the SNP represents a novel, non-invasive means to directly assess and quantify nerve fibre damage and repair. Numerous studies have been aimed at establishing morphometric features of the SNP as a sensitive marker for various ocular and systemic disorders [1]. However, due to high local variance of the nerve fibre distribution [2], evaluation of a single image with a typical field of view of 0.16 mm2 is insufficient for reliable morphometric characterization of the SNP. In [3] we described the EyeGuidance (EG) system, which uses an additional display in front of the non-examined eye to guide the patient’s gaze direction. It implements a highly automated technique to facilitate the acquisition and the generation of a mosaic image of an extended area of the SNP. This contribution presents a novel, enhanced EG setup with improved image quality of the display and simplified system handling.

2 Material and methods

A confocal microscope HRT (Heidelberg Retina Tomograph) in conjunction with the Rostock Cornea Module (both Heidelberg Engineering GmbH, Heidelberg, Germany) is used for CCM. A display showing a moving fixation target is arranged in front of the non-examined eye (see Figure 1). The position and track of the fixation target is controlled and can be adapted online by the EG software. Due to the synchronous eye movements, the gaze direction of the eye examined by CCM can thus be controlled indirectly.

Figure 1 Schematic illustration of the EyeGuidance setup.
Figure 1

Schematic illustration of the EyeGuidance setup.

2.1 Hardware

The feasibility study described in [3] was conducted using a small display that had been dismantled from multimedia video glasses (Cinemizer, Carl Zeiss AG, Oberkochen, Germany). Based on these experiences and results obtained during that study, we specified the requirements for a system suitable for a clinical study:

  • ciliary muscle of the eye should be relaxed viewing the EG display

  • ametropia should be compensated in the range of ±10 dioptres

  • angle of view >35°

  • display size: 4′′–5.5′′

  • length of the optical path <400 mm

  • no restriction on CCM operation

  • easy alignment in front of the non-examined eye

  • easy change of the examined eye (left, right)

A lens combination that meets the optical requirements was determined using the simulation software ZEMAX (Zemax LLC, Kirkland, Washington, DC, USA). The resulting optical setup is composed of a system of four convex lenses (see Figure 2). The lenses L1, L2 and L4 are fixed in their position. The lens L3 can be moved linearly along the optical axis to compensate refractive errors in the specified range of ±10 dioptres. In order to minimize intrusion of the EG hardware into the geometrical space required for CCM handling, the major part of the optical setup is arranged vertically by means of a mirror located between the lenses L2 and L3 (see Figure 3).

Figure 2 Optical layout of the EyeGuidance system simulated by ZEMAX V.13.
Figure 2

Optical layout of the EyeGuidance system simulated by ZEMAX V.13.

Figure 3 EyeGuidance hardware setup.
Figure 3

EyeGuidance hardware setup.

A smartphone (Motorola Moto G, Motorola Mobility Germany GmbH, Idstein, Germany) is used as display. The 4.5′′ display has a pixel resolution of 1280 × 720 and although the lenses have a magnifying effect, no individual pixels are recognizable because of the high pixel density (329 ppi) of the display.

2.2 Alignment process

Using the three axes (see Figure 3), the EG system can be aligned in front of the non-examined eye. Whereas the patient’s participation was helpful, if not necessary, for the precise alignment in the feasibility study [3], the operator is supported by a camera of a second, identical smartphone (EG camera in Figure 4) in the present setup. The smartphone used as display (EG display in Figure 4) has to be rotated sideways (see Figure 4) to make use of the EG camera; the operator can observe the alignment of the EG system using the camera App of the EG camera. The zoom factor of the camera should be set to 4.0× for this purpose and the graphical circle defining the central focus area of the camera can be used as an alignment aid. The EG system is well aligned when the pupil is located centrally (concentric with the graphical circle) while the viewing direction of the patient is straight ahead. After the alignment procedure the smartphone for the display is rotated back in.

Figure 4 Alignment of the EyeGuidance system.
Figure 4

Alignment of the EyeGuidance system.

2.3 Image recording and mosaicking

The image recording process is completely controlled via the HRT computer using specially adapted HRT software. After focussing the HRT on the SNP layer the operator starts the image acquisition and recording process. Being automatically triggered via the built-in communication interface (see Figure 1), the fixation target starts moving in a spiral pattern [3] on the EG display while the image data is concurrently streamed to a file with 30 fps. During the recording process the HRT software calculates a continuously increasing mosaic image and the operator can assess the image size and quality. As soon as the mosaic image size is large enough or an error occurs (no further growth of the mosaic image size, imaging other tissue than SNP, lost contact of the examined eye) the operator stops the recording process.

The final, high-quality mosaic image is calculated from the recorded image sequence in a post-processing step using the algorithms described in [4], [5].

3 Results and conclusion

The new EG system fulfils the requirements specified in Section 2.1 and we successfully tested the system with 13 volunteers. Compared to the first prototype system described in [3] the alignment process is simplified significantly by the new three axes system and the introduction of the EG camera. The new EG display has a much higher resolution and increased brightness and contrast. Furthermore the optical setup provides an extended field of view and the ability to compensate refractive errors in the range of ±10 dioptres.

The EG system is intended to be applied without establishing physical contact between the patient and any part of the EGM hardware. However, the ocular needs to be positioned in close proximity to the contralateral eye in order to achieve the specified field of view. Depending on individual facial anatomy, slight physical contact between the housing of the ocular and the skin in the area of the nose and/or eyebrow cannot be ruled out completely.

This contribution presents a highly automated technique that significantly facilitates the generation of extended mosaic images of the SNP. With the novel setup the EG system is ready for clinical use.

Author’s Statement

Research funding: The work was supported in part by the DFG (German Research Foundation, Grant KO 5003/1-1) and the Helmholtz Association. Conflict of interest: Authors state no conflict of interest. Material and Methods: Informed consent: Informed consent has been obtained from all individuals included in this study. Ethical approval: The research related to human use complies with all the relevant national regulations, institutional policies and was performed in accordance with the tenets of the Helsinki Declaration, and has been approved by the authors’ institutional review board or equivalent committee.

References

[1] Wang E, Misra S, Dipika V. Patel D. In vivo confocal microscopy of the human cornea in the assessment of peripheral neuropathy and systemic diseases. Biomed Res Int. 2015;2015:951081.10.1155/2015/951081Search in Google Scholar PubMed PubMed Central

[2] Winter K, Scheibe P, Köhler B, Allgeier S, Guthoff RF, Stachs O. Local variability of parameters for characterization of the corneal subbasal nerve plexus. Curr Eye Res. 2016;41:186–98.10.3109/02713683.2015.1010686Search in Google Scholar PubMed

[3] Allgeier S, Maier S, Mikut R, Peschel S, Reichert KM, Stachs O, et al. Mosaicking the subbasal nerve plexus by guided eye movements. Invest Ophthalmol Vis Sci. 2014;55:6082–9.10.1167/iovs.14-14698Search in Google Scholar PubMed

[4] Allgeier S, Köhler B, Eberle F, Maier S, Stachs O, Zhivov A, et al. Elastic registration of in vivo CLSM images of the cornea [Elastische Registrierung von in-vivo-CLSM-Aufnahmen der Kornea]. In: Handels H, Ehrhardt J, Deserno TM, Meinzer HP, Tolxdorff T, editors. Bildverarbeitung für die Medizin 2011. Berlin, Heidelberg: Springer; 2011. pp. 149–53.10.1007/978-3-642-19335-4_32Search in Google Scholar

[5] Toso L, Allgeier S, Eberle F, Maier S, Reichert KM, Köhler B. Iterative algorithms to generate large scale mosaic images. In: Handels H, Deserno TM, Meinzer HP, Tolxdorff T, editors. Bildverarbeitung für die Medizin 2015. Berlin, Heidelberg: Springer; 2015. pp. 203–8.10.1007/978-3-662-46224-9_36Search in Google Scholar

Published Online: 2016-9-30
Published in Print: 2016-9-1

©2016 Bernd Köhler et al., licensee De Gruyter.

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Articles in the same Issue

  1. Synthesis and characterization of PIL/pNIPAAm hybrid hydrogels
  2. Novel blood protein based scaffolds for cardiovascular tissue engineering
  3. Cell adhesion and viability of human endothelial cells on electrospun polymer scaffolds
  4. Effects of heat treatment and welding process on superelastic behaviour and microstructure of micro electron beam welded NiTi
  5. Long-term stable modifications of silicone elastomer for improved hemocompatibility
  6. The effect of thermal treatment on the mechanical properties of PLLA tubular specimens
  7. Biocompatible wear-resistant thick ceramic coating
  8. Protection of active implant electronics with organosilicon open air plasma coating for plastic overmolding
  9. Examination of dielectric strength of thin Parylene C films under various conditions
  10. Open air plasma deposited antimicrobial SiOx/TiOx composite films for biomedical applications
  11. Systemic analysis about residual chloroform in PLLA films
  12. A macrophage model of osseointegration
  13. Towards in silico prognosis using big data
  14. Technical concept and evaluation of a novel shoulder simulator with adaptive muscle force generation and free motion
  15. Usability evaluation of a locomotor therapy device considering different strategies
  16. Hypoxia-on-a-chip
  17. Integration of a semi-automatic in-vitro RFA procedure into an experimental setup
  18. Fabrication of MEMS-based 3D-μECoG-MEAs
  19. High speed digital interfacing for a neural data acquisition system
  20. Bionic forceps for the handling of sensitive tissue
  21. Experimental studies on 3D printing of barium titanate ceramics for medical applications
  22. Patient specific root-analogue dental implants – additive manufacturing and finite element analysis
  23. 3D printing – a key technology for tailored biomedical cell culture lab ware
  24. 3D printing of hydrogels in a temperature controlled environment with high spatial resolution
  25. Biocompatibility of photopolymers for additive manufacturing
  26. Biochemical piezoresistive sensors based on pH- and glucose-sensitive hydrogels for medical applications
  27. Novel wireless measurement system of pressure dedicated to in vivo studies
  28. Portable auricular device for real-time swallow and chew detection
  29. Detection of miRNA using a surface plasmon resonance biosensor and antibody amplification
  30. Simulation and evaluation of stimulation scenarios for targeted vestibular nerve excitation
  31. Deep brain stimulation: increasing efficiency by alternative waveforms
  32. Prediction of immediately occurring microsleep events from brain electric signals
  33. Determining cardiac vagal threshold from short term heart rate complexity
  34. Classification of cardiac excitation patterns during atrial fibrillation
  35. An algorithm to automatically determine the cycle length coverage to identify rotational activity during atrial fibrillation – a simulation study
  36. Deriving respiration from high resolution 12-channel-ECG during cycling exercise
  37. Reducing of gradient induced artifacts on the ECG signal during MRI examinations using Wilcoxon filter
  38. Automatic detection and mapping of double potentials in intracardiac electrograms
  39. Modeling the pelvic region for non-invasive pelvic intraoperative neuromonitoring
  40. Postprocessing algorithm for automated analysis of pelvic intraoperative neuromonitoring signals
  41. Best practice: surgeon driven application in pelvic operations
  42. Vasomotor assessment by camera-based photoplethysmography
  43. Classification of morphologic changes in photoplethysmographic waveforms
  44. Novel computation of pulse transit time from multi-channel PPG signals by wavelet transform
  45. Efficient design of FIR filter based low-pass differentiators for biomedical signal processing
  46. Nonlinear causal influences assessed by mutual compression entropy
  47. Comparative study of methods for solving the correspondence problem in EMD applications
  48. fNIRS for future use in auditory diagnostics
  49. Semi-automated detection of fractional shortening in zebrafish embryo heart videos
  50. Blood pressure measurement on the cheek
  51. Derivation of the respiratory rate from directly and indirectly measured respiratory signals using autocorrelation
  52. Left cardiac atrioventricular delay and inter-ventricular delay in cardiac resynchronization therapy responder and non-responder
  53. An automatic systolic peak detector of blood pressure waveforms using 4th order cumulants
  54. Real-time QRS detection using integrated variance for ECG gated cardiac MRI
  55. Preprocessing of unipolar signals acquired by a novel intracardiac mapping system
  56. In-vitro experiments to characterize ventricular electromechanics
  57. Continuous non-invasive monitoring of blood pressure in the operating room: a cuffless optical technology at the fingertip
  58. Application of microwave sensor technology in cardiovascular disease for plaque detection
  59. Artificial blood circulatory and special Ultrasound Doppler probes for detecting and sizing gaseous embolism
  60. Detection of microsleep events in a car driving simulation study using electrocardiographic features
  61. A method to determine the kink resistance of stents and stent delivery systems according to international standards
  62. Comparison of stented bifurcation and straight vessel 3D-simulation with a prior simulated velocity profile inlet
  63. Transient Euler-Lagrange/DEM simulation of stent thrombosis
  64. Automated control of the laser welding process of heart valve scaffolds
  65. Automation of a test bench for accessing the bendability of electrospun vascular grafts
  66. Influence of storage conditions on the release of growth factors in platelet-rich blood derivatives
  67. Cryopreservation of cells using defined serum-free cryoprotective agents
  68. New bioreactor vessel for tissue engineering of human nasal septal chondrocytes
  69. Determination of the membrane hydraulic permeability of MSCs
  70. Climate retainment in carbon dioxide incubators
  71. Multiple factors influencing OR ventilation system effectiveness
  72. Evaluation of an app-based stress protocol
  73. Medication process in Styrian hospitals
  74. Control tower to surgical theater
  75. Development of a skull phantom for the assessment of implant X-ray visibility
  76. Surgical navigation with QR codes
  77. Investigation of the pressure gradient of embolic protection devices
  78. Computer assistance in femoral derotation osteotomy: a bottom-up approach
  79. Automatic depth scanning system for 3D infrared thermography
  80. A service for monitoring the quality of intraoperative cone beam CT images
  81. Resectoscope with an easy to use twist mechanism for improved handling
  82. In vitro simulation of distribution processes following intramuscular injection
  83. Adjusting inkjet printhead parameters to deposit drugs into micro-sized reservoirs
  84. A flexible standalone system with integrated sensor feedback for multi-pad electrode FES of the hand
  85. Smart control for functional electrical stimulation with optimal pulse intensity
  86. Tactile display on the remaining hand for unilateral hand amputees
  87. Effects of sustained electrical stimulation on spasticity assessed by the pendulum test
  88. An improved tracking framework for ultrasound probe localization in image-guided radiosurgery
  89. Improvement of a subviral particle tracker by the use of a LAP-Kalman-algorithm
  90. Learning discriminative classification models for grading anal intraepithelial neoplasia
  91. Regularization of EIT reconstruction based on multi-scales wavelet transforms
  92. Assessing MRI susceptibility artefact through an indicator of image distortion
  93. EyeGuidance – a computer controlled system to guide eye movements
  94. A framework for feedback-based segmentation of 3D image stacks
  95. Doppler optical coherence tomography as a promising tool for detecting fluid in the human middle ear
  96. 3D Local in vivo Environment (LivE) imaging for single cell protein analysis of bone tissue
  97. Inside-Out access strategy using new trans-vascular catheter approach
  98. US/MRI fusion with new optical tracking and marker approach for interventional procedures inside the MRI suite
  99. Impact of different registration methods in MEG source analysis
  100. 3D segmentation of thyroid ultrasound images using active contours
  101. Designing a compact MRI motion phantom
  102. Cerebral cortex classification by conditional random fields applied to intraoperative thermal imaging
  103. Classification of indirect immunofluorescence images using thresholded local binary count features
  104. Analysis of muscle fatigue conditions using time-frequency images and GLCM features
  105. Numerical evaluation of image parameters of ETR-1
  106. Fabrication of a compliant phantom of the human aortic arch for use in Particle Image Velocimetry (PIV) experimentation
  107. Effect of the number of electrodes on the reconstructed lung shape in electrical impedance tomography
  108. Hardware dependencies of GPU-accelerated beamformer performances for microwave breast cancer detection
  109. Computer assisted assessment of progressing osteoradionecrosis of the jaw for clinical diagnosis and treatment
  110. Evaluation of reconstruction parameters of electrical impedance tomography on aorta detection during saline bolus injection
  111. Evaluation of open-source software for the lung segmentation
  112. Automatic determination of lung features of CF patients in CT scans
  113. Image analysis of self-organized multicellular patterns
  114. Effect of key parameters on synthesis of superparamagnetic nanoparticles (SPIONs)
  115. Radiopacity assessment of neurovascular implants
  116. Development of a desiccant based dielectric for monitoring humidity conditions in miniaturized hermetic implantable packages
  117. Development of an artifact-free aneurysm clip
  118. Enhancing the regeneration of bone defects by alkalizing the peri-implant zone – an in vitro approach
  119. Rapid prototyping of replica knee implants for in vitro testing
  120. Protecting ultra- and hyperhydrophilic implant surfaces in dry state from loss of wettability
  121. Advanced wettability analysis of implant surfaces
  122. Patient-specific hip prostheses designed by surgeons
  123. Plasma treatment on novel carbon fiber reinforced PEEK cages to enhance bioactivity
  124. Wear of a total intervertebral disc prosthesis
  125. Digital health and digital biomarkers – enabling value chains on health data
  126. Usability in the lifecycle of medical software development
  127. Influence of different test gases in a non-destructive 100% quality control system for medical devices
  128. Device development guided by user satisfaction survey on auricular vagus nerve stimulation
  129. Empirical assessment of the time course of innovation in biomedical engineering: first results of a comparative approach
  130. Effect of left atrial hypertrophy on P-wave morphology in a computational model
  131. Simulation of intracardiac electrograms around acute ablation lesions
  132. Parametrization of activation based cardiac electrophysiology models using bidomain model simulations
  133. Assessment of nasal resistance using computational fluid dynamics
  134. Resistance in a non-linear autoregressive model of pulmonary mechanics
  135. Inspiratory and expiratory elastance in a non-linear autoregressive model of pulmonary mechanics
  136. Determination of regional lung function in cystic fibrosis using electrical impedance tomography
  137. Development of parietal bone surrogates for parietal graft lift training
  138. Numerical simulation of mechanically stimulated bone remodelling
  139. Conversion of engineering stresses to Cauchy stresses in tensile and compression tests of thermoplastic polymers
  140. Numerical examinations of simplified spondylodesis models concerning energy absorption in magnetic resonance imaging
  141. Principle study on the signal connection at transabdominal fetal pulse oximetry
  142. Influence of Siluron® insertion on model drug distribution in the simulated vitreous body
  143. Evaluating different approaches to identify a three parameter gas exchange model
  144. Effects of fibrosis on the extracellular potential based on 3D reconstructions from histological sections of heart tissue
  145. From imaging to hemodynamics – how reconstruction kernels influence the blood flow predictions in intracranial aneurysms
  146. Flow optimised design of a novel point-of-care diagnostic device for the detection of disease specific biomarkers
  147. Improved FPGA controlled artificial vascular system for plethysmographic measurements
  148. Minimally spaced electrode positions for multi-functional chest sensors: ECG and respiratory signal estimation
  149. Automated detection of alveolar arches for nasoalveolar molding in cleft lip and palate treatment
  150. Control scheme selection in human-machine- interfaces by analysis of activity signals
  151. Event-based sampling for reducing communication load in realtime human motion analysis by wireless inertial sensor networks
  152. Automatic pairing of inertial sensors to lower limb segments – a plug-and-play approach
  153. Contactless respiratory monitoring system for magnetic resonance imaging applications using a laser range sensor
  154. Interactive monitoring system for visual respiratory biofeedback
  155. Development of a low-cost senor based aid for visually impaired people
  156. Patient assistive system for the shoulder joint
  157. A passive beating heart setup for interventional cardiology training
Downloaded on 27.2.2026 from https://www.degruyterbrill.com/document/doi/10.1515/cdbme-2016-0096/html
Scroll to top button