Skip to main content
Article Open Access

Usability in the lifecycle of medical software development

A current view on human-centered design activities in German enterprises
  • EMAIL logo and
Published/Copyright: September 30, 2016

Abstract

A close cooperation with users is necessary to ensure that interactive systems are robust, easy to use and accepted. Therefore, in medical technology, standards for usability are of fundamental importance. We investigated with the presented study how the concept of usability is currently understood and implemented in medical software companies. Interviews were conducted with 21 employees of German enterprises. Furthermore we extended an already existing quantitative online survey where 53 companies (including 24 from the health industry sector) participated in. Results show that the importance of usability is recognized by most of the respondents. Moreover, a wide variety of methods and approaches is known and implemented for exploring user needs and evaluating system prototypes. However, it was observed that human-centered design activities mainly focus on functionality, risk prevention and accessibility. Hedonic user needs and subjective perceptions (“user experience”) still play a minor role. Based on the results, practical requirements are derived and a “best case” for methodological approach is introduced.

1 Introduction

The medical technology market has been growing for many years. Forecasts of annual growth rates confirm that this trend will be maintained in the next 5 years for the global market (5.0%–5.2% per annum) [1]. Medical technology is also one of the most innovative industries with about 11.000 patent applications in Europe [2]. The growing demand is caused by demographic changes, aging societies and an increasing use of interactive technologies, smart devices, software, and mobile applications [i.e. [3], [4], [5]].

The most important key to success for medical technology is the close cooperation with its users. A human-centered design approach helps to prevent incorrect operations through optimizing the usability at early stages of product development. Usability comprises “the effectiveness, efficiency and satisfaction with which specified users achieve specified goals in particular environments” [6]. The complete documentation of a usability-oriented design process is a necessary precondition for successful authorization procedures of medical devices [6]. Therefore, a conscientious realization of relevant standards is of fundamental importance in medical technology.

However, standards are rather general in this sector, basically determining the main requirements for products and usability-oriented procedures. So it is often up to the developer to decide which methods and instruments will be implemented for exploring specific contexts of usage as well as for evaluating product solutions. Standards neither describe the extent of measures nor when the process will be completed. Moreover, standards do not specify disciplinary background and expertise of the for the sector responsible employees.

These preconditions led to the research question how usability standards are currently implemented in German medical technology. A sub-goal was to identify perceived barriers in the realization of usability-oriented activities. A third goal was to investigate whether the consideration of an appropriate “user experience” is an important aspect in the development of medical software solutions. While usability is mainly performance oriented, user experience also includes “soft criteria” such as appearance and feelings, user emotions and motivation, acceptance as well as integrating the product in everyday life.

2 Material and methods

2.1 Method

21 Telephone interviews with German medical software producing companies were conducted. 11 enterprises were small or medium-sized (SME) and 10 were large. For the interview a semi-standardized interview guide was developed. Questions included the main phases of the software development process and the applied usability methods. Furthermore, respondents were asked to assess the importance of different product attributes. At the end, barriers and problems regarding the implementation of usability methods were collected.

2.2 Results

The results show that on a scale from 1 (“no knowledge”) to 5 (“highest knowledge”) respondents evaluate their knowledge about usability slightly higher than their practical experience with usability (M = 3.48 vs. M = 3.10).

Based on a synopsis of all the information about the three main phases of product development provided by the interviewees a summarized best case model for human-centered design methods was created (see Figure 1).

Figure 1: Best case model for named human centered design methods divided in main/sub-phases, usability-methods and invested resources.
Figure 1:

Best case model for named human centered design methods divided in main/sub-phases, usability-methods and invested resources.

Post hoc, the main phases were categorized as context of use and specification (1), design and testing (2) and reverse engineering (3). In Figure 1 the applied usability methods are shown next to the main phases. The percentages of the invested resources (time, financial costs and human resources) show that most of the resources are located in the second phase design and testing. According to the user-centered design process [7], iteration cycles within the first two phases might be necessary.

When comparing small or medium-sized businesses (SME) with large enterprises, it was apparent that the practical experience of implementing usability measures is significantly higher in case of large enterprises (d = 1.07, p = 0.03). Moreover, in large medical software enterprises the number of usability employees is significantly higher (d = 2.39, p = 0.03). While large enterprises employ nine usability professionals on average, SME only employ five.

With respect to the percentage distribution of invested resources, SME tend to invest most of their usability budget in the design and testing phase, while large companies use the budget approximately equally distributed over the three main phases. Especially for the context of use and specification (phase 1), large enterprises are in a position to invest a greater proportion of their budget (29% vs. 20.5% for SME).

When asked about the importance of different product related aspects, interviewees assessed reliability, safety and user requirements as most important aspects in the development of medical software solutions, while hedonic product attributes, such as emotions, fun and motivation are of lower importance (see Figure 2).

Figure 2: Importance of product aspects within usability-practice: 1 = very important; 2 = fairly important; 3 = rather unimportant; 4 = very unimportant (this category is not occupied).
Figure 2:

Importance of product aspects within usability-practice: 1 = very important; 2 = fairly important; 3 = rather unimportant; 4 = very unimportant (this category is not occupied).

The most important problems and barriers of the interviewees for the implementation of usability-methods mentioned were:

  • Lack of acceptance of usability

  • Lack of resources

  • Lack of evidence of the usefulness of usability

  • Lack of communication within the organisation

  • Early integration of usability in the product development process.

3 Online survey

3.1 Methods

The online survey aimed to compare the view on usability between the medical technology industry and other industries. For the assessment of usability-related aspects an online self-test developed by the Usability in Germany e.V. has been used. This online test is based on the Usability Maturity Model of Woywode et al. [8] and contains 15 items, measuring for example the usability-acceptance, and the use of standards. The self-test is available under the following link: http://www.usability-in-germany.de/aktuelles/usability-selbsttest. In the present study 24 medical software companies and 29 software companies from a non-medical background participated.

3.2 Results

The statistical analysis shows that the usability-acceptance is significantly higher in case of the medical software companies (p = 0.03). Furthermore, the interviewed medical software companies evaluated the number of applied methods higher than the companies in other areas (p = 0.02). No other differences are statistically relevant.

4 Discussion

The growing importance of usability is reaching a high level of awareness in the field of medical technology, as our results indicate. Compared to other industries medical companies stated a higher usability acceptance. In addition, respondents assessed their knowledge and practical expertise more than the average. First and foremost human-centered design methods are applied in order to enhance safety and to prevent errors in patient’s treatment. Based on the results a best case model was introduced illustrating that a wide range of well-established methods are known and used at different stages of the software development lifecycle.

Nevertheless, the interview study also revealed that certain barriers and problems are perceived. In particular, the lack of acceptance on management level and very limited resources were reported by most of the respondents. In practice, both aspects are frequently interrelated with the lack of an objective, reliable, and holistic criterion of success for human-centered design activities [9]. Future research has to find appropriate solutions in providing low-threshold procedure models which offer the opportunity to gain a realistic view on the outcome of usability measures [10].

Large companies as well as SME have recognized the importance of design and testing medical software solutions. The underlying trend shows that SME invest slightly less of their usability resources in early development phases. Engaging end users in early stages is not only valuable for finding innovative product solutions, but also a fundamental base for determining, validating, and prioritizing functional as well as non-functional requirements from a user’s point of view. Since the best case model is a synopsis of all the information provided by the interviewees, it should be noted that all companies which participated in the study differ more or less in their individual number of methods and the proportions of invested resources. Therefore, the positive comprehensive view must not hide the fact that some health systems are developed without regard to user requirements, or without the aid of any user-centered design guidelines [11].

Finally, the findings of the study show that the concept of “user experience”, including the consideration of non-task related product attributes, is a slightly unattended area in medical technology. However, the systematic investigation, design, and evaluation of a consistent user experience is not only an essential factor for maintaining competitive advantages in the market. For most interactive technologies it rather represents a very important key aspect that determines if a product is used at all and therefore directly influences the effectiveness of a patient’s treatment. A coherent experience is necessary for stimulating motivation and intention to use, e.g. in the case of medical products that patients have to apply for themselves over a longer period. Moreover, positive experiences during interaction with a system may contribute to dispel fears and prejudices that may be associated with specific treatments. While by now the concept of usability seems to be widely recognized in medical technology, user experience has to be considered even more in the future. There is a need for adapting and developing specific methods and instruments for measuring subjective experiences with interactive medical products. Extended guidelines and standards should help developers to integrate user experience more efficiently in the product design and evaluation process. Current efforts in bringing together basic requirements for the development of medical software by unifying different standards is a first step (i.e. Medical Spice, VDI). However, the consideration of a holistic experiential perspective is a challenging demand that still is to be met in the future.

Acknowledgement

The authors would like to thank Achim Oberg and Olaf Kellermeier from Usability in Germany e.V. for the successful cooperation.

Author’s Statement

Research funding: As a part of research project BeMobil the authors would like to thank the German Federal Ministry of education and research (Project number: V4ICR01). Conflict of interest: Authors state no conflict of interest. Material and methods: Informed consent: Informed consent is not applicable. Ethical approval: The conducted research is not related to either human or animal use.

References

[1] Evaluate (n.d.). Total medical technology growth per year from 2008 to 2020. Statista - The Statista Portal. Available from http://www.statista.com/ statistics/320948/worldwide-medical-technology-growth-per-year/. Retrieved April 5, 2016.Search in Google Scholar

[2] MedTech Europe (n.d.). The European Medical Technology industry in Figures. Retrieved April 5, 2016, from http://www.medtecheurope.org/sites/default/files /resource_items/files/MEDTECH_FactFigures_ONLINE3.pdf.Search in Google Scholar

[3] Rieger A, Friess H, Martignoni ME. 15 Augmented Reality–Realität und Virtualität in der Medizin. Der virtuelle Patient 1 2014.10.1515/9783110335668.190Search in Google Scholar

[4] Minge M, Lorenz K, Dannehl S, Trauzettel F, Thüring M. U (X) in Health Design. State-of-the-Art und Herausforderungen bei der nutzer-gerechten Gestaltung therapeutischer Unterstützungssysteme. Mensch und Computer Workshopband; 2015.10.1515/9783110443905-011Search in Google Scholar

[5] Kramme R, Kramme H. Die Rolle der Technik in der Medizin und ihre gesundheitspolitische Bedeutung. Medizintechnik—Verfahren, Systeme und Informationsverarbeitung: Ein anwenderorientierter Querschnitt für Ausbildung und Praxis 3 2013.10.1007/978-3-540-34103-1_1Search in Google Scholar

[6] DIN EN ISO 62366. Medizinprodukte – Anwendung der Gebrauchstauglichkeit auf Medizinprodukte. Berlin: Beuth Verlag; 2008.Search in Google Scholar

[7] EUROPÄISCHE NORM, E. N. ISO 9241-11: Ergonomische Anforderungen für Bürotätigkeiten mit Bildschirmgeräten; Teil 11: Anforderungen an die Gebrauchstauglichkeit-Leitsätze. DIN Deutsches Institut für Normung eV. 1999.Search in Google Scholar

[8] Woywode M, Mädche A, Wallach D, Plach M. Gebrauchstauglichkeit von Anwendungssoftware als Wettbewerbsfaktor für kleine und mittlere Unternehmen (KMU): Abschlussbericht; 2012.Search in Google Scholar

[9] Reckin R, Schweig J, Brandenburg S. Performance indicators for usability measures – Striving for a working framework beyond Return on Investment. 11. Berliner Werkstatt Mensch-Maschine-Systeme Tagungsband; 2015.Search in Google Scholar

[10] Stade MJ, Reckin R, Brandenburg S, Thüring M. Usability in KMU etablieren: Von schneller Problemlösung zu ressourcenorientiertem Usability Engineering. In: Mensch & Computer Workshopband; 2013. p. 19–27.10.1524/9783486781236.19Search in Google Scholar

[11] Anders SH, Dexheimer JW. Incorporating usability testing into the development of healthcare technologies. Social Media and Mobile Technologies for Healthcare; 2014;32.10.4018/978-1-4666-6150-9.ch003Search in Google Scholar

Published Online: 2016-9-30
Published in Print: 2016-9-1

©2016 Franziska Trauzettel et al., licensee De Gruyter.

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Articles in the same Issue

  1. Synthesis and characterization of PIL/pNIPAAm hybrid hydrogels
  2. Novel blood protein based scaffolds for cardiovascular tissue engineering
  3. Cell adhesion and viability of human endothelial cells on electrospun polymer scaffolds
  4. Effects of heat treatment and welding process on superelastic behaviour and microstructure of micro electron beam welded NiTi
  5. Long-term stable modifications of silicone elastomer for improved hemocompatibility
  6. The effect of thermal treatment on the mechanical properties of PLLA tubular specimens
  7. Biocompatible wear-resistant thick ceramic coating
  8. Protection of active implant electronics with organosilicon open air plasma coating for plastic overmolding
  9. Examination of dielectric strength of thin Parylene C films under various conditions
  10. Open air plasma deposited antimicrobial SiOx/TiOx composite films for biomedical applications
  11. Systemic analysis about residual chloroform in PLLA films
  12. A macrophage model of osseointegration
  13. Towards in silico prognosis using big data
  14. Technical concept and evaluation of a novel shoulder simulator with adaptive muscle force generation and free motion
  15. Usability evaluation of a locomotor therapy device considering different strategies
  16. Hypoxia-on-a-chip
  17. Integration of a semi-automatic in-vitro RFA procedure into an experimental setup
  18. Fabrication of MEMS-based 3D-μECoG-MEAs
  19. High speed digital interfacing for a neural data acquisition system
  20. Bionic forceps for the handling of sensitive tissue
  21. Experimental studies on 3D printing of barium titanate ceramics for medical applications
  22. Patient specific root-analogue dental implants – additive manufacturing and finite element analysis
  23. 3D printing – a key technology for tailored biomedical cell culture lab ware
  24. 3D printing of hydrogels in a temperature controlled environment with high spatial resolution
  25. Biocompatibility of photopolymers for additive manufacturing
  26. Biochemical piezoresistive sensors based on pH- and glucose-sensitive hydrogels for medical applications
  27. Novel wireless measurement system of pressure dedicated to in vivo studies
  28. Portable auricular device for real-time swallow and chew detection
  29. Detection of miRNA using a surface plasmon resonance biosensor and antibody amplification
  30. Simulation and evaluation of stimulation scenarios for targeted vestibular nerve excitation
  31. Deep brain stimulation: increasing efficiency by alternative waveforms
  32. Prediction of immediately occurring microsleep events from brain electric signals
  33. Determining cardiac vagal threshold from short term heart rate complexity
  34. Classification of cardiac excitation patterns during atrial fibrillation
  35. An algorithm to automatically determine the cycle length coverage to identify rotational activity during atrial fibrillation – a simulation study
  36. Deriving respiration from high resolution 12-channel-ECG during cycling exercise
  37. Reducing of gradient induced artifacts on the ECG signal during MRI examinations using Wilcoxon filter
  38. Automatic detection and mapping of double potentials in intracardiac electrograms
  39. Modeling the pelvic region for non-invasive pelvic intraoperative neuromonitoring
  40. Postprocessing algorithm for automated analysis of pelvic intraoperative neuromonitoring signals
  41. Best practice: surgeon driven application in pelvic operations
  42. Vasomotor assessment by camera-based photoplethysmography
  43. Classification of morphologic changes in photoplethysmographic waveforms
  44. Novel computation of pulse transit time from multi-channel PPG signals by wavelet transform
  45. Efficient design of FIR filter based low-pass differentiators for biomedical signal processing
  46. Nonlinear causal influences assessed by mutual compression entropy
  47. Comparative study of methods for solving the correspondence problem in EMD applications
  48. fNIRS for future use in auditory diagnostics
  49. Semi-automated detection of fractional shortening in zebrafish embryo heart videos
  50. Blood pressure measurement on the cheek
  51. Derivation of the respiratory rate from directly and indirectly measured respiratory signals using autocorrelation
  52. Left cardiac atrioventricular delay and inter-ventricular delay in cardiac resynchronization therapy responder and non-responder
  53. An automatic systolic peak detector of blood pressure waveforms using 4th order cumulants
  54. Real-time QRS detection using integrated variance for ECG gated cardiac MRI
  55. Preprocessing of unipolar signals acquired by a novel intracardiac mapping system
  56. In-vitro experiments to characterize ventricular electromechanics
  57. Continuous non-invasive monitoring of blood pressure in the operating room: a cuffless optical technology at the fingertip
  58. Application of microwave sensor technology in cardiovascular disease for plaque detection
  59. Artificial blood circulatory and special Ultrasound Doppler probes for detecting and sizing gaseous embolism
  60. Detection of microsleep events in a car driving simulation study using electrocardiographic features
  61. A method to determine the kink resistance of stents and stent delivery systems according to international standards
  62. Comparison of stented bifurcation and straight vessel 3D-simulation with a prior simulated velocity profile inlet
  63. Transient Euler-Lagrange/DEM simulation of stent thrombosis
  64. Automated control of the laser welding process of heart valve scaffolds
  65. Automation of a test bench for accessing the bendability of electrospun vascular grafts
  66. Influence of storage conditions on the release of growth factors in platelet-rich blood derivatives
  67. Cryopreservation of cells using defined serum-free cryoprotective agents
  68. New bioreactor vessel for tissue engineering of human nasal septal chondrocytes
  69. Determination of the membrane hydraulic permeability of MSCs
  70. Climate retainment in carbon dioxide incubators
  71. Multiple factors influencing OR ventilation system effectiveness
  72. Evaluation of an app-based stress protocol
  73. Medication process in Styrian hospitals
  74. Control tower to surgical theater
  75. Development of a skull phantom for the assessment of implant X-ray visibility
  76. Surgical navigation with QR codes
  77. Investigation of the pressure gradient of embolic protection devices
  78. Computer assistance in femoral derotation osteotomy: a bottom-up approach
  79. Automatic depth scanning system for 3D infrared thermography
  80. A service for monitoring the quality of intraoperative cone beam CT images
  81. Resectoscope with an easy to use twist mechanism for improved handling
  82. In vitro simulation of distribution processes following intramuscular injection
  83. Adjusting inkjet printhead parameters to deposit drugs into micro-sized reservoirs
  84. A flexible standalone system with integrated sensor feedback for multi-pad electrode FES of the hand
  85. Smart control for functional electrical stimulation with optimal pulse intensity
  86. Tactile display on the remaining hand for unilateral hand amputees
  87. Effects of sustained electrical stimulation on spasticity assessed by the pendulum test
  88. An improved tracking framework for ultrasound probe localization in image-guided radiosurgery
  89. Improvement of a subviral particle tracker by the use of a LAP-Kalman-algorithm
  90. Learning discriminative classification models for grading anal intraepithelial neoplasia
  91. Regularization of EIT reconstruction based on multi-scales wavelet transforms
  92. Assessing MRI susceptibility artefact through an indicator of image distortion
  93. EyeGuidance – a computer controlled system to guide eye movements
  94. A framework for feedback-based segmentation of 3D image stacks
  95. Doppler optical coherence tomography as a promising tool for detecting fluid in the human middle ear
  96. 3D Local in vivo Environment (LivE) imaging for single cell protein analysis of bone tissue
  97. Inside-Out access strategy using new trans-vascular catheter approach
  98. US/MRI fusion with new optical tracking and marker approach for interventional procedures inside the MRI suite
  99. Impact of different registration methods in MEG source analysis
  100. 3D segmentation of thyroid ultrasound images using active contours
  101. Designing a compact MRI motion phantom
  102. Cerebral cortex classification by conditional random fields applied to intraoperative thermal imaging
  103. Classification of indirect immunofluorescence images using thresholded local binary count features
  104. Analysis of muscle fatigue conditions using time-frequency images and GLCM features
  105. Numerical evaluation of image parameters of ETR-1
  106. Fabrication of a compliant phantom of the human aortic arch for use in Particle Image Velocimetry (PIV) experimentation
  107. Effect of the number of electrodes on the reconstructed lung shape in electrical impedance tomography
  108. Hardware dependencies of GPU-accelerated beamformer performances for microwave breast cancer detection
  109. Computer assisted assessment of progressing osteoradionecrosis of the jaw for clinical diagnosis and treatment
  110. Evaluation of reconstruction parameters of electrical impedance tomography on aorta detection during saline bolus injection
  111. Evaluation of open-source software for the lung segmentation
  112. Automatic determination of lung features of CF patients in CT scans
  113. Image analysis of self-organized multicellular patterns
  114. Effect of key parameters on synthesis of superparamagnetic nanoparticles (SPIONs)
  115. Radiopacity assessment of neurovascular implants
  116. Development of a desiccant based dielectric for monitoring humidity conditions in miniaturized hermetic implantable packages
  117. Development of an artifact-free aneurysm clip
  118. Enhancing the regeneration of bone defects by alkalizing the peri-implant zone – an in vitro approach
  119. Rapid prototyping of replica knee implants for in vitro testing
  120. Protecting ultra- and hyperhydrophilic implant surfaces in dry state from loss of wettability
  121. Advanced wettability analysis of implant surfaces
  122. Patient-specific hip prostheses designed by surgeons
  123. Plasma treatment on novel carbon fiber reinforced PEEK cages to enhance bioactivity
  124. Wear of a total intervertebral disc prosthesis
  125. Digital health and digital biomarkers – enabling value chains on health data
  126. Usability in the lifecycle of medical software development
  127. Influence of different test gases in a non-destructive 100% quality control system for medical devices
  128. Device development guided by user satisfaction survey on auricular vagus nerve stimulation
  129. Empirical assessment of the time course of innovation in biomedical engineering: first results of a comparative approach
  130. Effect of left atrial hypertrophy on P-wave morphology in a computational model
  131. Simulation of intracardiac electrograms around acute ablation lesions
  132. Parametrization of activation based cardiac electrophysiology models using bidomain model simulations
  133. Assessment of nasal resistance using computational fluid dynamics
  134. Resistance in a non-linear autoregressive model of pulmonary mechanics
  135. Inspiratory and expiratory elastance in a non-linear autoregressive model of pulmonary mechanics
  136. Determination of regional lung function in cystic fibrosis using electrical impedance tomography
  137. Development of parietal bone surrogates for parietal graft lift training
  138. Numerical simulation of mechanically stimulated bone remodelling
  139. Conversion of engineering stresses to Cauchy stresses in tensile and compression tests of thermoplastic polymers
  140. Numerical examinations of simplified spondylodesis models concerning energy absorption in magnetic resonance imaging
  141. Principle study on the signal connection at transabdominal fetal pulse oximetry
  142. Influence of Siluron® insertion on model drug distribution in the simulated vitreous body
  143. Evaluating different approaches to identify a three parameter gas exchange model
  144. Effects of fibrosis on the extracellular potential based on 3D reconstructions from histological sections of heart tissue
  145. From imaging to hemodynamics – how reconstruction kernels influence the blood flow predictions in intracranial aneurysms
  146. Flow optimised design of a novel point-of-care diagnostic device for the detection of disease specific biomarkers
  147. Improved FPGA controlled artificial vascular system for plethysmographic measurements
  148. Minimally spaced electrode positions for multi-functional chest sensors: ECG and respiratory signal estimation
  149. Automated detection of alveolar arches for nasoalveolar molding in cleft lip and palate treatment
  150. Control scheme selection in human-machine- interfaces by analysis of activity signals
  151. Event-based sampling for reducing communication load in realtime human motion analysis by wireless inertial sensor networks
  152. Automatic pairing of inertial sensors to lower limb segments – a plug-and-play approach
  153. Contactless respiratory monitoring system for magnetic resonance imaging applications using a laser range sensor
  154. Interactive monitoring system for visual respiratory biofeedback
  155. Development of a low-cost senor based aid for visually impaired people
  156. Patient assistive system for the shoulder joint
  157. A passive beating heart setup for interventional cardiology training
Downloaded on 21.4.2026 from https://www.degruyterbrill.com/document/doi/10.1515/cdbme-2016-0129/html
Scroll to top button