Abstract
Objectives
Clinical laboratories face limitations in implementing advanced quality control (QC) methods with existing systems. This study aimed to develop a web-based application to addresses this gap, and improve QC practices.
Methods
QC Constellation, a web application built using Python 3.11, integrates various statistical QC modules. These include Levey-Jennings charts with Westgard rules, sigma-metric calculations, exponentially weighted moving average (EWMA) and cumulative sum (CUSUM) charts, and method decision charts. Additionally, it offers a risk-based QC section and a patient-based QC module aligning with modern QC practices. The codes and the web application links for QC Constellation were shared at https://github.com/hikmetc/QC_Constellation, and http://qcconstellation.com, respectively.
Results
Using synthetic data, QC Constellation demonstrated effective implementation of Levey-Jennings charts with user-friendly features like checkboxes for Westgard rules and customizable moving averages graphs. Sigma-metric calculations for hypothetical performance values of serum total cholesterol were successfully performed using allowable total error and maximum allowable measurement uncertainty goals, and displayed on method decision charts. The utility of the risk-based QC module was exemplified by assessing QC plans for serum total cholesterol, showcasing the application’s capability in calculating risk-based QC parameters including maximum unreliable final patient results, risk management index, and maximum run size and offering risk-based QC recommendations. Similarly, the patient-based QC and optimization modules were demonstrated using simulated sodium results.
Conclusions
In conclusion, QC Constellation emerges as a pivotal tool for laboratory professionals, streamlining the management of quality control and analytical performance monitoring, while enhancing patient safety through optimized QC processes.
Acknowledgments
I express my gratitude to Oğuzhan Zengi for sharing recent literature knowledge.
-
Research ethics: Not applicable.
-
Informed consent: Not applicable.
-
Author contributions: The author has accepted responsibility for the entire content of this manuscript and approved its submission.
-
Competing interests: The author states no conflict of interest.
-
Research funding: None declared.
-
Data availability: The codes of the application were shared at https://github.com/hikmetc/QC_Constellation.
References
1. Westgard, JO. Internal quality control: planning and implementation strategies. Ann Clin Biochem 2003;40:593–611. https://doi.org/10.1258/000456303770367199.Search in Google Scholar PubMed
2. Clinical and Laboratory Standards Institute. Statistical quality control for quantitative measurement procedures: principles and definitions. CLSI guideline C24. Wayne, Pennsylvania, USA: Clinical and Laboratory Standards Institute; 2016.Search in Google Scholar
3. Carson, PK, Yeh, AB. Exponentially weighted moving average (EWMA) control charts for monitoring an analytical process. Ind Eng Chem Res 2008;47:405–11. https://doi.org/10.1021/ie070589b.Search in Google Scholar
4. Çubukçu, HC. The weighting factor of exponentially weighted moving average chart. Turk J Biochem 2020;45:639–41. https://doi.org/10.1515/tjb-2019-0368.Search in Google Scholar
5. Topcu, DI, Çubukçu, HC. Optimization of patient-based real-time quality control based on the Youden index. Clin Chim Acta 2022;534:50–6. https://doi.org/10.1016/j.cca.2022.06.028.Search in Google Scholar PubMed
6. Page, ES. Continuous inspection schemes. Biometrika 1954;41:100–15. https://doi.org/10.1093/biomet/41.1-2.100.Search in Google Scholar
7. Montgomery, DC. Introduction to statistical quality control, 7th ed. Danvers: John Wiley & Sons; 2013.Search in Google Scholar
8. Çubukçu, HC. Performance evaluation of internal quality control rules, EWMA, CUSUM, and the novel machine learning model. Turk J Biochem 2021;46:661–70. https://doi.org/10.1515/tjb-2021-0199.Search in Google Scholar
9. Badrick, T, Bietenbeck, A, Cervinski, MA, Katayev, A, van Rossum, HH, Loh, TP, et al.. Patient-based real-time quality control: review and recommendations. Clin Chem 2019;65:962–71. https://doi.org/10.1373/clinchem.2019.305482.Search in Google Scholar PubMed
10. Charuruks, N. Sigma metrics across the total testing process. Clin Lab Med 2017;37:97–117. https://doi.org/10.1016/j.cll.2016.09.009.Search in Google Scholar PubMed
11. Westgard, JO, Bayat, H, Westgard, S. Advanced QC strategies, 1st ed Madison, Wisconsin: Westgard QC; 2022.10.1016/j.cca.2021.08.028Search in Google Scholar PubMed
12. Gülbahar, Ö, Kocabıyık, M, Çıracı, MZ, Demirtaş, C, Uçar, F, Bayraktar, N, et al.. The use of six sigma methodology to evaluate the analytical performances of clinical chemistry analyzers. Turk J Biochem 2018;43:1–8. https://doi.org/10.1515/tjb-2016-0223.Search in Google Scholar
13. Clinical and Laboratory Standards Institute. EP23-ED2:2023 – laboratory quality control based on risk management. USA: Clinical and Laboratory Standards Institute; 2023.Search in Google Scholar
14. Clinical and Laboratory Standards Institute. C24-ED4:2016 statistical quality control for quantitative measurement procedures: principles and definitions, 4th ed Wayne, PA: Clinical and Laboratory Standards Institute; 2016.Search in Google Scholar
15. Parvin, CA. Assessing the impact of the frequency of quality control testing on the quality of reported patient results. Clin Chem 2008;54:2049–54. https://doi.org/10.1373/clinchem.2008.113639.Search in Google Scholar PubMed
16. Westgard, JO, Bayat, H, Westgard, SA. Planning risk-based SQC schedules for bracketed operation of continuous production analyzers. Clin Chem 2018;64:289–96. https://doi.org/10.1373/clinchem.2017.278291.Search in Google Scholar PubMed
17. Bayat, H, Westgard, SA, Westgard, JO. Planning risk-based statistical quality control strategies: graphical tools to support the new clinical and laboratory standards institute C24-ed4 guidance. J Appl Lab Med 2017;2:211–21. https://doi.org/10.1373/jalm.2017.023192.Search in Google Scholar PubMed
18. Parvin, CA. Planning statistical quality control to minimize patient risk: it’s about time. Clin Chem 2018;64:249–50. https://doi.org/10.1373/clinchem.2017.282038.Search in Google Scholar PubMed
19. Sepulveda, JL, Young, DS. The ideal laboratory information system. Arch Pathol Lab Med 2013;137:1129–40. https://doi.org/10.5858/arpa.2012-0362-ra.Search in Google Scholar
20. Van Rossum, G, Drake, FL. Python 3 reference manual. Scotts Valley, CA: CreateSpace; 2009.Search in Google Scholar
21. The pandas development team. pandas-dev/pandas: Pandas. Zenodo; 2020. https://doi.org/10.5281/zenodo.10957263.Search in Google Scholar
22. Harris, CR, Millman, KJ, van der Walt, SJ, Gommers, R, Virtanen, P, Cournapeau, D, et al.. Array programming with NumPy. Nature 2020;585:357–62. https://doi.org/10.1038/s41586-020-2649-2.Search in Google Scholar PubMed PubMed Central
23. Collaborative data science Publisher: Plotly Technologies Inc; 2015. https://plot.ly [Accessed 21 Jun 2023].Search in Google Scholar
24. Streamlit • A faster way to build and share data apps. https://streamlit.io/ [Accessed 12 Apr 2023].Search in Google Scholar
25. Lucas, JM, Saccucci, MS. Exponentially weighted moving average control schemes: properties and enhancements. Technometrics 1990;32:1–12. https://doi.org/10.2307/1269835.Search in Google Scholar
26. Westgard, JO, Westgard, SA. Six sigma quality management system and design of risk-based statistical quality control. Clin Lab Med 2017;37:85–96. https://doi.org/10.1016/j.cll.2016.09.008.Search in Google Scholar PubMed
27. Oosterhuis, WP, Coskun, A. Sigma metrics in laboratory medicine revisited: we are on the right road with the wrong map. Biochem Med 2018;28:020503. https://doi.org/10.11613/bm.2018.020503.Search in Google Scholar PubMed PubMed Central
28. Aarsand, AK, Fernandez-Calle, P, Webster, C, Coskun, A, Gonzales-Lao, E, Diaz-Garzon, J, Jonker, N, Simon, M, Braga, F, Perich, C, Boned, B, Marques-Garcia, F, Carobene, A, Aslan, B, Sezer, E, Bartlett, WA, Sandberg, S. The EFLM biological variation database. Available from: https://biologicalvariation.eu/. [Accessed 10 November 2023]Search in Google Scholar
29. Çubukçu, HC, Vanstapel, F, Thelen, M, van Schrojenstein Lantman, M, Bernabeu-Andreu, FA, Meško Brguljan, P, et al.. APS calculator: a data-driven tool for setting outcome-based analytical performance specifications for measurement uncertainty using specific clinical requirements and population data. Clin Chem Lab Med 2023;62:597–607. https://doi.org/10.1515/cclm-2023-0740.Search in Google Scholar PubMed
30. Panteghini, M. Analytical performance specifications for combined uncertainty budget in the implementation of metrological traceability. Clin Chem Lab Med 2024;62:1497–504. https://doi.org/10.1515/cclm-2023-1325.Search in Google Scholar PubMed
31. Zhang, Y, Ren, B, Zou, G, Yang, L. A spreadsheet tool for designing statistical quality control programs based on patient risk parameters. Clin Biochem 2023;116:52–8. https://doi.org/10.1016/j.clinbiochem.2023.03.009.Search in Google Scholar PubMed
32. Virtanen, P, Gommers, R, Oliphant, TE, Haberland, M, Reddy, T, Cournapeau, D, et al.. SciPy 1.0: fundamental algorithms for scientific computing in Python. Nat Methods 2020;17:261–72. https://doi.org/10.1038/s41592-019-0686-2.Search in Google Scholar PubMed PubMed Central
33. Yundt-Pacheco, J, Parvin, CA. Validating the performance of QC procedures. Clin Lab Med 2013;33:75–88. https://doi.org/10.1016/j.cll.2012.11.006.Search in Google Scholar PubMed
34. Westgard, SA, Bayat, H, Westgard, JO. A multi-test planning model for risk based statistical quality control strategies. Clin Chim Acta 2021;523:216–23. https://doi.org/10.1016/j.cca.2021.09.020.Search in Google Scholar PubMed
35. International Organization for Standardization. ISO 14971:2019 Medical devices – application of risk management to medical devices; 2019.Search in Google Scholar
36. International Organization for Standardization. ISO 24971:2020 Medical devices — guidance on the application of ISO 14971; 2020.Search in Google Scholar
37. Karnutsch, D, Occhipinti, F, Tumiatti, D, Mueller, T. Evaluation of the impact of changing quality control rules and frequency on the risk management index: results from the clinical routine of a medical laboratory. Lab Med 2021;52:211–18. https://doi.org/10.1093/labmed/lmaa064.Search in Google Scholar PubMed
38. Parvin, CA, Baumann, NA. Assessing quality control strategies for HbA1c measurements from a patient risk perspective. J Diabetes Sci Technol 2018;12:786–91. https://doi.org/10.1177/1932296818758768.Search in Google Scholar PubMed PubMed Central
39. CLIA requirements for analytical quality 2024. https://www.westgard.com/clia-a-quality/quality-requirements/125-clia.html [Accessed 27 January 2024].Search in Google Scholar
40. Sinard, JH, Castellani, WJ, Wilkerson, ML, Henricks, WH. Stand-alone laboratory information systems versus laboratory modules incorporated in the electronic health record. Arch Pathol Lab Med 2015;139:311–8. https://doi.org/10.5858/arpa.2013-0711-so.Search in Google Scholar PubMed
41. Roland, K, Yakimec, J, Markin, T, Chan, G, Hudoba, M. Customized middleware experience in a tertiary care hospital hematology laboratory. J Pathol Inform 2022;13:100143. https://doi.org/10.1016/j.jpi.2022.100143.Search in Google Scholar PubMed PubMed Central
42. Riben, M. Laboratory automation and middleware. Surg Pathol Clin 2015;8:175–86. https://doi.org/10.1016/j.path.2015.02.012.Search in Google Scholar PubMed
43. Li, X, Eckert, M, Martinez, JF, Rubio, G. Context aware middleware architectures: survey and challenges. Sensors 2015;15:20570–607. https://doi.org/10.3390/s150820570.Search in Google Scholar PubMed PubMed Central
44. Cervinski, MA, Bietenbeck, A, Katayev, A, Loh, TP, van Rossum, HH, Badrick, T. Advances in clinical chemistry patient-based real-time quality control (PBRTQC). Adv Clin Chem 2023;117:223–61. https://doi.org/10.1016/bs.acc.2023.08.003.Search in Google Scholar PubMed
45. Coskun, A, Serteser, M, Ünsal, I. Sigma metric revisited: true known mistakes. Biochem Med 2019;29:010902. https://doi.org/10.11613/bm.2019.010902.Search in Google Scholar PubMed PubMed Central
46. Westgard, S, Bayat, H, Westgard, JO. Mistaken assumptions drive new Six Sigma model off the road. Biochem Med 2019;29:010903. https://doi.org/10.11613/bm.2019.010903.Search in Google Scholar PubMed PubMed Central
47. Panteghini, M. Reply to Westgard et al.: ‘Keep your eyes wide … as the present now will later be past’. Clin Chem Lab Med 2022;60:e202–3. https://doi.org/10.1515/cclm-2022-0557.Search in Google Scholar PubMed
48. Yago, M, Alcover, S. Selecting statistical procedures for quality control planning based on risk management. Clin Chem 2016;62:959–65. https://doi.org/10.1373/clinchem.2015.254094.Search in Google Scholar PubMed
49. Yago, M, López-Escribano, H. Establishing commonsense-based statistical quality control practices. Am J Clin Pathol 2019;151:350–2. https://doi.org/10.1093/ajcp/aqy162.Search in Google Scholar PubMed
50. Yago, M. Risk-based statistical quality control planning should be based more on patient risk. J Appl Lab Med 2018;2:970–1. https://doi.org/10.1373/jalm.2017.024844.Search in Google Scholar PubMed
51. Bietenbeck, A, Cervinski, MA, Katayev, A, Loh, TP, van Rossum, HH, Badrick, T, et al.. Understanding patient-based real-time quality control using simulation modeling. Clin Chem 2020;66:1072–83. https://doi.org/10.1093/clinchem/hvaa094.Search in Google Scholar PubMed
Supplementary Material
This article contains supplementary material (https://doi.org/10.1515/cclm-2024-0156).
© 2024 Walter de Gruyter GmbH, Berlin/Boston
Articles in the same Issue
- Frontmatter
- Editorial
- Circulating tumor DNA measurement: a new pillar of medical oncology?
- Reviews
- Circulating tumor DNA: current implementation issues and future challenges for clinical utility
- Circulating tumor DNA methylation: a promising clinical tool for cancer diagnosis and management
- Opinion Papers
- The final part of the CRESS trilogy – how to evaluate the quality of stability studies
- The impact of physiological variations on personalized reference intervals and decision limits: an in-depth analysis
- Computational pathology: an evolving concept
- Perspectives
- Dynamic mirroring: unveiling the role of digital twins, artificial intelligence and synthetic data for personalized medicine in laboratory medicine
- General Clinical Chemistry and Laboratory Medicine
- Macroprolactin in mothers and their babies: what is its origin?
- The influence of undetected hemolysis on POCT potassium results in the emergency department
- Quality control in the Netherlands; todays practices and starting points for guidance and future research
- QC Constellation: a cutting-edge solution for risk and patient-based quality control in clinical laboratories
- OILVEQ: an Italian external quality control scheme for cannabinoids analysis in galenic preparations of cannabis oil
- Using Bland-Altman plot-based harmonization algorithm to optimize the harmonization for immunoassays
- Comparison of a two-step Tempus600 hub solution single-tube vs. container-based, one-step pneumatic transport system
- Evaluating the HYDRASHIFT 2/4 Daratumumab assay: a powerful approach to assess treatment response in multiple myeloma
- Insight into the status of plasma renin and aldosterone measurement: findings from 526 clinical laboratories in China
- Reference Values and Biological Variations
- Reference values for plasma and urine trace elements in a Swiss population-based cohort
- Stimulating thyrotropin receptor antibodies in early pregnancy
- Within- and between-subject biological variation estimates for the enumeration of lymphocyte deep immunophenotyping and monocyte subsets
- Diurnal and day-to-day biological variation of salivary cortisol and cortisone
- Web-accessible critical limits and critical values for urgent clinician notification
- Cancer Diagnostics
- Thyroglobulin measurement is the most powerful outcome predictor in differentiated thyroid cancer: a decision tree analysis in a European multicenter series
- Cardiovascular Diseases
- Interaction of heparin with human cardiac troponin complex and its influence on the immunodetection of troponins in human blood samples
- Diagnostic performance of a point of care high-sensitivity cardiac troponin I assay and single measurement evaluation to rule out and rule in acute coronary syndrome
- Corrigendum
- Reference intervals of 24 trace elements in blood, plasma and erythrocytes for the Slovenian adult population
- Letters to the Editor
- Disturbances of calcium, magnesium, and phosphate homeostasis: incidence, probable causes, and outcome
- Validation of the enhanced liver fibrosis (ELF)-test in heparinized and EDTA plasma for use in reflex testing algorithms for metabolic dysfunction-associated steatotic liver disease (MASLD)
- Detection of urinary foam cells diagnosing the XGP with thrombopenia preoperatively: a case report
- Methemoglobinemia after sodium nitrite poisoning: what blood gas analysis tells us (and what it might not)
- Novel thiopurine S-methyltransferase (TPMT) variant identified in Malay individuals
- Congress Abstracts
- 56th National Congress of the Italian Society of Clinical Biochemistry and Clinical Molecular Biology (SIBioC – Laboratory Medicine)
Articles in the same Issue
- Frontmatter
- Editorial
- Circulating tumor DNA measurement: a new pillar of medical oncology?
- Reviews
- Circulating tumor DNA: current implementation issues and future challenges for clinical utility
- Circulating tumor DNA methylation: a promising clinical tool for cancer diagnosis and management
- Opinion Papers
- The final part of the CRESS trilogy – how to evaluate the quality of stability studies
- The impact of physiological variations on personalized reference intervals and decision limits: an in-depth analysis
- Computational pathology: an evolving concept
- Perspectives
- Dynamic mirroring: unveiling the role of digital twins, artificial intelligence and synthetic data for personalized medicine in laboratory medicine
- General Clinical Chemistry and Laboratory Medicine
- Macroprolactin in mothers and their babies: what is its origin?
- The influence of undetected hemolysis on POCT potassium results in the emergency department
- Quality control in the Netherlands; todays practices and starting points for guidance and future research
- QC Constellation: a cutting-edge solution for risk and patient-based quality control in clinical laboratories
- OILVEQ: an Italian external quality control scheme for cannabinoids analysis in galenic preparations of cannabis oil
- Using Bland-Altman plot-based harmonization algorithm to optimize the harmonization for immunoassays
- Comparison of a two-step Tempus600 hub solution single-tube vs. container-based, one-step pneumatic transport system
- Evaluating the HYDRASHIFT 2/4 Daratumumab assay: a powerful approach to assess treatment response in multiple myeloma
- Insight into the status of plasma renin and aldosterone measurement: findings from 526 clinical laboratories in China
- Reference Values and Biological Variations
- Reference values for plasma and urine trace elements in a Swiss population-based cohort
- Stimulating thyrotropin receptor antibodies in early pregnancy
- Within- and between-subject biological variation estimates for the enumeration of lymphocyte deep immunophenotyping and monocyte subsets
- Diurnal and day-to-day biological variation of salivary cortisol and cortisone
- Web-accessible critical limits and critical values for urgent clinician notification
- Cancer Diagnostics
- Thyroglobulin measurement is the most powerful outcome predictor in differentiated thyroid cancer: a decision tree analysis in a European multicenter series
- Cardiovascular Diseases
- Interaction of heparin with human cardiac troponin complex and its influence on the immunodetection of troponins in human blood samples
- Diagnostic performance of a point of care high-sensitivity cardiac troponin I assay and single measurement evaluation to rule out and rule in acute coronary syndrome
- Corrigendum
- Reference intervals of 24 trace elements in blood, plasma and erythrocytes for the Slovenian adult population
- Letters to the Editor
- Disturbances of calcium, magnesium, and phosphate homeostasis: incidence, probable causes, and outcome
- Validation of the enhanced liver fibrosis (ELF)-test in heparinized and EDTA plasma for use in reflex testing algorithms for metabolic dysfunction-associated steatotic liver disease (MASLD)
- Detection of urinary foam cells diagnosing the XGP with thrombopenia preoperatively: a case report
- Methemoglobinemia after sodium nitrite poisoning: what blood gas analysis tells us (and what it might not)
- Novel thiopurine S-methyltransferase (TPMT) variant identified in Malay individuals
- Congress Abstracts
- 56th National Congress of the Italian Society of Clinical Biochemistry and Clinical Molecular Biology (SIBioC – Laboratory Medicine)