IVDCheckR – simplifying documentation for laboratory developed tests according to IVDR requirements by introducing a new digital tool
-
Yadwinder Kaur
, Daniel Rosenkranz, Anna Bloemer
, Ozan Aykurt , Gunnar Brandhorst, Folker Spitzenberger
and Astrid Petersmann
Abstract
Objectives
A recent challenge for clinical laboratories is the lack of clear guidelines for handling significant modifications of CE-marked assays. The modifications may involve, for example, extending measurement intervals, changing dilution procedures or using non-validated sample materials. The challenge arises due to the amended Regulation (EU) 2017/746 on in vitro diagnostic medical devices (IVDR), which is now poised for implementation, despite the extended transition periods. The IVDR application imposes challenges not only for diagnostic companies but also for clinical laboratories when using laboratory developed tests (LDTs), often referred to as in-house assays. In this context, a coherent and meticulously structured LDT documentation is highly beneficial. While laboratories are obliged to meet the IVDR requirements, the absence of a streamlined framework or guideline hampers the ability to gain a comprehensive overview on the requirements and possible options for their fulfilment.
Methods
To address this issue, we introduce a web based digital tool powered by an R Shiny web application. This tool facilitates a seamless implementation of IVDR requirements for LDTs across diverse laboratory environments in terms of their transparency and validity. Our approach focuses on adequate handling of significant modifications of CE-marked in vitro diagnostic medical devices (IVD).
Results
IVDRCheckR is an open-source tool that is easily accessible and free from system dependencies. The tool promotes a seamless process and a guide to enhance transparency, reliability, and validity of laboratory examination results based on LDTs. Additionally, the tool further provides modules for evaluating quality control data and quantitative method comparison data.
Conclusions
Our Shiny web application-based platform is a digitised, user-friendly tool that simplifies the documentation for LDTs according to IVDR requirements with special emphasis on solutions for handling modifications to CE-marked assays.
-
Research ethics: Not applicable.
-
Informed consent: Not applicable.
-
Author contributions: The authors have accepted responsibility for the entire content of this manuscript and approved its submission.
-
Competing interests: The authors state no competing interests.
-
Research funding: None declared.
-
Data availability: The full code is available online (https://github.com/kola8513/IVDCheckR).
References
1. EU Regulations. Regulation (EU) 2017/746 of the European Parliament and of the Council of 5 April 2017 on in vitro diagnostic medical devices and repealing Directive 98/79/EC and Commission Decision 2010/227/EU [Online]; 2017. Available from: https://eur-lex.europa.eu/eli/reg/2017/746/oj.Search in Google Scholar
2. EU Regulations. Regulation (EU) 2022/112 of the European Parliament and of the Council of 25 January 2022 amending Regulation (EU) 2017/746 as regards transitional provisions for certain in vitro diagnostic medical devices and the deferred application of conditions for in-house devices [Online]; 2022. Available from: https://eur-lex.europa.eu/eli/reg/2022/112/oj.Search in Google Scholar
3. Spitzenberger, F, Patel, J, Gebuhr, I, Kruttwig, K, Safi, A, Meisel, C. Laboratory-developed tests: design of a regulatory strategy in compliance with the international state-of-the-art and the regulation (EU) 2017/746 (EU IVDR [in vitro diagnostic medical device regulation]). Ther Innov Regul Sci 2022;56:47–64. https://doi.org/10.1007/s43441-021-00323-7.Search in Google Scholar PubMed PubMed Central
4. Carpenter, RE, Tamrakar, VK, Almas, S, Brown, E, Sharma, R. COVIDSeq as laboratory developed test (LDT) for diagnosis of SARS-CoV-2 variants of concern (VOC). Arch Clin Biomed Res 2022;6:954–70. https://doi.org/10.26502/acbr.50170309.Search in Google Scholar PubMed PubMed Central
5. Lieberman, JA, Pepper, G, Naccache, SN, Huang, ML, Jerome, KR, Greninger, AL. Comparison of commercially available and laboratory-developed assays for in vitro detection of SARS-CoV-2 in clinical laboratories. J Clin Microbiol 2020;58:e00821–20. https://doi.org/10.1128/jcm.00821-20.Search in Google Scholar PubMed PubMed Central
6. ISO/DIS 5649:2024-02. Medical laboratories – concepts and specifications for the design, development, implementation, and use of laboratory-developed tests [Online]; 2024. Available from: https://www.iso.org/standard/81506.html.Search in Google Scholar
7. R Core Team. R: a language and environment for statistical computing [Online]. R Foundation for Statistical Computing; 2024. Available from: https://www.R-project.org/.Search in Google Scholar
8. Chang, W, Cheng, J, Allaire, JJ, Sievert, C, Schloerke, B, Xie, Y, et al.. Shiny: web application framework for R. R package version 1.8.1.1 [Online]; 2024. Available from: https://cran.r-project.org/web/packages/shiny/.Search in Google Scholar
9. Wilkes, EH. veRification: an R Shiny application for laboratory method verification and validation. Clin Chem Lab Med 2023;61:1730–9. https://doi.org/10.1515/cclm-2023-0158.Search in Google Scholar PubMed
10. Chang, W, Borges Ribeiro, B. shinydashboard: create dashboards with ‘Shiny’. R package version 0.7.2 [Online]; 2024. Available from: https://cran.r-project.org/web/packages/shinydashboard/.Search in Google Scholar
11. Aden-Buie, G, Sievert, C, Iannone, R, Allaire, J, Borges, B.: R markdown format for flexible dashboards. R package version 0.6.2 [Online]; 2024. Available from: https://cran.r-project.org/web/packages/flexdashboard/.Search in Google Scholar
12. Granjon, D. shinydashboardPlus: add more ‘AdminLTE2’ components to ‘shinydashboard’. R package version 2.0.4 [Online]; 2024. Available from: https://cran.r-project.org/web/packages/shinydashboardPlus/.Search in Google Scholar
13. Attali, D. shinyjs: easily improve the user experience of your Shiny apps in seconds. R package version 2.1.0 [Online]; 2024. Available from: https://cran.r-project.org/web/packages/shinyjs/.Search in Google Scholar
14. Allaire, J, Xie, Y, Dervieux, C, McPherson, J, Luraschi, J, Ushey, K, et al.. rmarkdown: dynamic documents for R. R package version 2.26 [Online]; 2024. Available from: https://cran.r-project.org/web/packages/rmarkdown/.Search in Google Scholar
15. Nakazawa, M. fmsb: functions for medical statistics book with some demographic data. R package version 0.7.6 [Online]; 2024. Available from: https://cran.r-project.org/web/packages/fmsb/.Search in Google Scholar
16. Potapov, S, Model, F, Schuetzenmeister, A, Manuilova, E, Dufey, F, Raymaekers, J, et al.. mcr: method comparison regression. R package version 1.3.3 [Online]; 2024. Available from: https://cran.r-project.org/web/packages/mcr/.Search in Google Scholar
17. Owen, J, Allen, J, Xie, Y, Martoglio, E, Ger, I, Marcin, W. rhandsontable: interface to the ‘Handsontable.js’ library. R package version 0.3.8 [Online]; 2024. Available from: https://cran.r-project.org/web/packages/rhandsontable/.Search in Google Scholar
18. Bablok, W, Passing, H. Application of statistical procedures in analytical instrument testing. J Automat Chem 1985;7:74–9. https://doi.org/10.1155/s1463924685000177.Search in Google Scholar PubMed PubMed Central
19. Bland, JM, Altman, D. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986;1:307–10.10.1016/S0140-6736(86)90837-8Search in Google Scholar
20. Medical Device Coordination Group. Update – MDCG 2020-16 Rev.2 – guidance on classification rules for in vitro diagnostic medical devices under regulation (EU) 2017/746. [Online]; 2023. Available from: https://health.ec.europa.eu/.Search in Google Scholar
21. Medical Device Coordination Group. MDCG 2023-1 guidance on the health institution exemption under article 5 (5) of the Regulation (EU) 2017/745 and Regulation (EU) 2017/746 [Online]; 2023. Available from: https://health.ec.europa.eu/.Search in Google Scholar
22. Hoffmüller, P, Spitzenberger, F. Template for IVDR-Art. 5 documentation. [Online]; 2024. Available from: https://gfhev.de/de/diagnostik_genetische-beratung/q-2021_IVDR-Art.5(5-g-e)_Dokumentation_v.01.pdf.Search in Google Scholar
23. Haeckel, R, Wosniok, W, Al Shareef, N. Permissible performance limits of regression analyses in method comparisons. Clin Chem Lab Med 2011;49:1805–16. https://doi.org/10.1515/cclm.2011.668.Search in Google Scholar
24. Pum, J. A practical guide to validation and verification of analytical methods in the clinical laboratory. Adv Clin Chem 2019;90:215–81. https://doi.org/10.1016/bs.acc.2019.01.006.Search in Google Scholar PubMed
25. Medical Device Coordination Group. MDCG 2022-6 guidance on significant changes regarding the transitional provision under Article 110(3) of the IVDR. [Online]; 2022. Available from: https://health.ec.europa.eu/.Search in Google Scholar
Supplementary Material
This article contains supplementary material (https://doi.org/10.1515/cclm-2024-0477).
© 2024 Walter de Gruyter GmbH, Berlin/Boston
Articles in the same Issue
- Frontmatter
- Editorial
- CD34+ progenitor cells meet metrology
- Reviews
- Venous blood collection systems using evacuated tubes: a systematic review focusing on safety, efficacy and economic implications of integrated vs. combined systems
- The correlation between serum angiopoietin-2 levels and acute kidney injury (AKI): a meta-analysis
- Opinion Papers
- Advancing value-based laboratory medicine
- Clostebol and sport: about controversies involving contamination vs. doping offence
- Direct-to-consumer testing as consumer initiated testing: compromises to the testing process and opportunities for quality improvement
- Perspectives
- An improved implementation of metrological traceability concepts is needed to benefit from standardization of laboratory results
- Genetics and Molecular Diagnostics
- Comparative analysis of BCR::ABL1 p210 mRNA transcript quantification and ratio to ABL1 control gene converted to the International Scale by chip digital PCR and droplet digital PCR for monitoring patients with chronic myeloid leukemia
- General Clinical Chemistry and Laboratory Medicine
- IVDCheckR – simplifying documentation for laboratory developed tests according to IVDR requirements by introducing a new digital tool
- Analytical performance specifications for trace elements in biological fluids derived from six countries federated external quality assessment schemes over 10 years
- The effects of drone transportation on routine laboratory, immunohematology, flow cytometry and molecular analyses
- Accurate non-ceruloplasmin bound copper: a new biomarker for the assessment and monitoring of Wilson disease patients using HPLC coupled to ICP-MS/MS
- Construction of platelet count-optical method reflex test rules using Micro-RBC#, Macro-RBC%, “PLT clumps?” flag, and “PLT abnormal histogram” flag on the Mindray BC-6800plus hematology analyzer in clinical practice
- Evaluation of serum NFL, T-tau, p-tau181, p-tau217, Aβ40 and Aβ42 for the diagnosis of neurodegenerative diseases
- An immuno-DOT diagnostic assay for autoimmune nodopathy
- Evaluation of biochemical algorithms to screen dysbetalipoproteinemia in ε2ε2 and rare APOE variants carriers
- Reference Values and Biological Variations
- Allowable total error in CD34 cell analysis by flow cytometry based on state of the art using Spanish EQAS data
- Clinical utility of personalized reference intervals for CEA in the early detection of oncologic disease
- Agreement of lymphocyte subsets detection permits reference intervals transference between flow cytometry systems: direct validation using established reference intervals
- Cancer Diagnostics
- Atypical cells in urine sediment: a novel biomarker for early detection of bladder cancer
- External quality assessment-based tumor marker harmonization simulation; insights in achievable harmonization for CA 15-3 and CEA
- Cardiovascular Diseases
- Evaluation of the analytical and clinical performance of a high-sensitivity troponin I point-of-care assay in the Mersey Acute Coronary Syndrome Rule Out Study (MACROS-2)
- Analytical verification of the Atellica VTLi point of care high sensitivity troponin I assay
- Infectious Diseases
- Synovial fluid D-lactate – a pathogen-specific biomarker for septic arthritis: a prospective multicenter study
- Targeted MRM-analysis of plasma proteins in frozen whole blood samples from patients with COVID-19: a retrospective study
- Letters to the Editor
- Generative artificial intelligence (AI) for reporting the performance of laboratory biomarkers: not ready for prime time
- Urgent need to adopt age-specific TSH upper reference limit for the elderly – a position statement of the Belgian thyroid club
- Sigma metric is more correlated with analytical imprecision than bias
- Utility and limitations of monitoring kidney transplants using capillary sampling
- Simple flow cytometry method using a myeloma panel that easily reveals clonal proliferation of mature B-cells
- Is sweat conductivity still a relevant screening test for cystic fibrosis? Participation over 10 years
- Hb D-Iran interference on HbA1c measurement
Articles in the same Issue
- Frontmatter
- Editorial
- CD34+ progenitor cells meet metrology
- Reviews
- Venous blood collection systems using evacuated tubes: a systematic review focusing on safety, efficacy and economic implications of integrated vs. combined systems
- The correlation between serum angiopoietin-2 levels and acute kidney injury (AKI): a meta-analysis
- Opinion Papers
- Advancing value-based laboratory medicine
- Clostebol and sport: about controversies involving contamination vs. doping offence
- Direct-to-consumer testing as consumer initiated testing: compromises to the testing process and opportunities for quality improvement
- Perspectives
- An improved implementation of metrological traceability concepts is needed to benefit from standardization of laboratory results
- Genetics and Molecular Diagnostics
- Comparative analysis of BCR::ABL1 p210 mRNA transcript quantification and ratio to ABL1 control gene converted to the International Scale by chip digital PCR and droplet digital PCR for monitoring patients with chronic myeloid leukemia
- General Clinical Chemistry and Laboratory Medicine
- IVDCheckR – simplifying documentation for laboratory developed tests according to IVDR requirements by introducing a new digital tool
- Analytical performance specifications for trace elements in biological fluids derived from six countries federated external quality assessment schemes over 10 years
- The effects of drone transportation on routine laboratory, immunohematology, flow cytometry and molecular analyses
- Accurate non-ceruloplasmin bound copper: a new biomarker for the assessment and monitoring of Wilson disease patients using HPLC coupled to ICP-MS/MS
- Construction of platelet count-optical method reflex test rules using Micro-RBC#, Macro-RBC%, “PLT clumps?” flag, and “PLT abnormal histogram” flag on the Mindray BC-6800plus hematology analyzer in clinical practice
- Evaluation of serum NFL, T-tau, p-tau181, p-tau217, Aβ40 and Aβ42 for the diagnosis of neurodegenerative diseases
- An immuno-DOT diagnostic assay for autoimmune nodopathy
- Evaluation of biochemical algorithms to screen dysbetalipoproteinemia in ε2ε2 and rare APOE variants carriers
- Reference Values and Biological Variations
- Allowable total error in CD34 cell analysis by flow cytometry based on state of the art using Spanish EQAS data
- Clinical utility of personalized reference intervals for CEA in the early detection of oncologic disease
- Agreement of lymphocyte subsets detection permits reference intervals transference between flow cytometry systems: direct validation using established reference intervals
- Cancer Diagnostics
- Atypical cells in urine sediment: a novel biomarker for early detection of bladder cancer
- External quality assessment-based tumor marker harmonization simulation; insights in achievable harmonization for CA 15-3 and CEA
- Cardiovascular Diseases
- Evaluation of the analytical and clinical performance of a high-sensitivity troponin I point-of-care assay in the Mersey Acute Coronary Syndrome Rule Out Study (MACROS-2)
- Analytical verification of the Atellica VTLi point of care high sensitivity troponin I assay
- Infectious Diseases
- Synovial fluid D-lactate – a pathogen-specific biomarker for septic arthritis: a prospective multicenter study
- Targeted MRM-analysis of plasma proteins in frozen whole blood samples from patients with COVID-19: a retrospective study
- Letters to the Editor
- Generative artificial intelligence (AI) for reporting the performance of laboratory biomarkers: not ready for prime time
- Urgent need to adopt age-specific TSH upper reference limit for the elderly – a position statement of the Belgian thyroid club
- Sigma metric is more correlated with analytical imprecision than bias
- Utility and limitations of monitoring kidney transplants using capillary sampling
- Simple flow cytometry method using a myeloma panel that easily reveals clonal proliferation of mature B-cells
- Is sweat conductivity still a relevant screening test for cystic fibrosis? Participation over 10 years
- Hb D-Iran interference on HbA1c measurement