Abstract
Objectives
Few studies have reported on delta checks for tumour markers, even though these markers are often evaluated serially. Therefore, this study aimed to establish a practical delta check limit in different clinical settings for five tumour markers: alpha-fetoprotein, cancer antigen 19-9, cancer antigen 125, carcinoembryonic antigen, and prostate-specific antigen.
Methods
Pairs of patients’ results (current and previous) for five tumour markers between 2020 and 2021 were retrospectively collected from three university hospitals. The data were classified into three subgroups, namely: health check-up recipient (subgroup H), outpatient (subgroup O), and inpatient (subgroup I) clinics. The check limits of delta percent change (DPC), absolute DPC (absDPC), and reference change value (RCV) for each test were determined using the development set (the first 18 months, n=179,929) and then validated and simulated by applying the validation set (the last 6 months, n=66,332).
Results
The check limits of DPC and absDPC for most tests varied significantly among the subgroups. Likewise, the proportions of samples requiring further evaluation, calculated by excluding samples with both current and previous results within the reference intervals, were 0.2–2.9% (lower limit of DPC), 0.2–2.7% (upper limit of DPC), 0.3–5.6% (absDPC), and 0.8–35.3% (RCV99.9%). Furthermore, high negative predictive values >0.99 were observed in all subgroups in the in silico simulation.
Conclusions
Using real-world data, we found that DPC was the most appropriate delta-check method for tumour markers. Moreover, Delta-check limits for tumour markers should be applied based on clinical settings.
Funding source: The Asan Institute for Life Sciences, Asan Medical Center, Seoul, Korea.
Award Identifier / Grant number: 2023IP0003-1
-
Research funding: This study was supported by a grant (2023IP0003-1) from the Asan Institute for Life Sciences, Asan Medical Center, Seoul, Korea.
-
Author contributions: All authors have accepted responsibility for the entire content of this manuscript and approved its submission.
-
Competing interests: Authors state no conflict of interest.
-
Informed consent: Informed consent was waived due to the retrospective nature of this study.
-
Ethical approval: This research involving human subjects complied with all relevant national regulations, institutional policies and is in accordance with the tenets of the Helsinki Declaration (as revised in 2013), and has been was approved by our Institutional Review Board (2210-023-120, HPIRB 2022-09-017, ISPAIK 2022-09-031).
References
1. Markus, C, Tan, RZ, Loh, TP. Evidence-based approach to setting delta check rules. Crit Rev Clin Lab Sci 2021;58:49–59. https://doi.org/10.1080/10408363.2020.1800585.Search in Google Scholar PubMed
2. Tan, RZ, Markus, C, Choy, KW, Doery, JCG, Loh, TP. Optimized delta check rules for detecting misidentified specimens in children. Am J Clin Pathol 2020;153:605–12. https://doi.org/10.1093/ajcp/aqz201.Search in Google Scholar PubMed
3. CLSI EP33. Use of delta checks in the medical laboratory. Wayne, PA, USA: Clinical and Laboratory Standards Institute; 2016.Search in Google Scholar
4. Ikai, I, Arii, S, Kojiro, M, Ichida, T, Makuuchi, M, Matsuyama, Y, et al.. Reevaluation of prognostic factors for survival after liver resection in patients with hepatocellular carcinoma in a Japanese nationwide survey. Cancer 2004;101:796–802. https://doi.org/10.1002/cncr.20426.Search in Google Scholar PubMed
5. Bruix, J, Cheng, AL, Meinhardt, G, Nakajima, K, De Sanctis, Y, Llovet, J. Prognostic factors and predictors of sorafenib benefit in patients with hepatocellular carcinoma: analysis of two phase III studies. J Hepatol 2017;67:999–1008. https://doi.org/10.1016/j.jhep.2017.06.026.Search in Google Scholar PubMed
6. Galle, PR, Foerster, F, Kudo, M, Chan, SL, Llovet, JM, Qin, S, et al.. Biology and significance of alpha-fetoprotein in hepatocellular carcinoma. Liver Int 2019;39:2214–29. https://doi.org/10.1111/liv.14223.Search in Google Scholar PubMed
7. Nolen, BM, Lokshin, AE. Protein biomarkers of ovarian cancer: the forest and the trees. Future Oncol 2012;8:55–71. https://doi.org/10.2217/fon.11.135.Search in Google Scholar PubMed PubMed Central
8. Ferraro, S, Panteghini, M. Making new biomarkers a reality: the case of serum human epididymis protein 4. Clin Chem Lab Med 2019;57:1284–94. https://doi.org/10.1515/cclm-2018-1111.Search in Google Scholar PubMed
9. Sagi-Dain, L, Lavie, O, Auslander, R, Sagi, S. CEA in evaluation of adnexal mass: retrospective cohort analysis and review of the literature. Int J Biol Markers 2015;30:e394–400. https://doi.org/10.5301/jbm.5000158.Search in Google Scholar PubMed
10. Dorizzi, RM, Caruso, B, Meneghelli, S, Rizzotti, P. The DNSev™ expert system in the auto-verification of tumour markers and hormones results. Accred Qual Assur 2006;11:303–7. https://doi.org/10.1007/s00769-006-0160-6.Search in Google Scholar
11. Fraser, CG. Reference change values. Clin Chem Lab Med 2011;50:807–12. https://doi.org/10.1515/cclm.2011.733.Search in Google Scholar PubMed
12. Marques-Garcia, F, Boned, B, González-Lao, E, Braga, F, Carobene, A, Coskun, A, et al.. Critical review and meta-analysis of biological variation estimates for tumor markers. Clin Chem Lab Med 2022;60:494–504. https://doi.org/10.1515/cclm-2021-0725.Search in Google Scholar PubMed
13. Coşkun, A, Aarsand, AK, Sandberg, S, Guerra, E, Locatelli, M, Díaz-Garzón, J, et al.. Within- and between-subject biological variation data for tumor markers based on the European Biological Variation Study. Clin Chem Lab Med 2022;60:543–52. https://doi.org/10.1515/cclm-2021-0283.Search in Google Scholar PubMed
14. Carobene, A, Guerra, E, Locatelli, M, Cucchiara, V, Briganti, A, Aarsand, AK, et al.. Biological variation estimates for prostate specific antigen from the European Biological Variation Study; Consequences for diagnosis and monitoring of prostate cancer. Clin Chim Acta 2018;486:185–91. https://doi.org/10.1016/j.cca.2018.07.043.Search in Google Scholar PubMed
15. Bottani, M, Aarsand, AK, Banfi, G, Locatelli, M, Coskun, A, Diaz-Garzon, J, et al.. European Biological Variation Study (EuBIVAS): within- and between-subject biological variation estimates for serum thyroid biomarkers based on weekly samplings from 91 healthy participants. Clin Chem Lab Med 2022;60:523–32. https://doi.org/10.1515/cclm-2020-1885.Search in Google Scholar PubMed
16. Straseski, JA, Strathmann, FG. Patient data algorithms. Clin Lab Med 2013;33:147–60. https://doi.org/10.1016/j.cll.2012.11.009.Search in Google Scholar PubMed
17. Karger, AB. To delta check or not to delta check? That is the question. J Appl Lab Med 2017;1:457–9. https://doi.org/10.1373/jalm.2016.022020.Search in Google Scholar PubMed
18. Gruenberg, JM, Stein, TA, Karger, AB. Determining the utility of creatinine delta checks: a large retrospective analysis. Clin Biochem 2018;53:139–42. https://doi.org/10.1016/j.clinbiochem.2018.01.023.Search in Google Scholar PubMed
19. Park, SH, Kim, SY, Lee, W, Chun, S, Min, WK. New decision criteria for selecting delta check methods based on the ratio of the delta difference to the width of the reference range can be generally applicable for each clinical chemistry test item. Ann Lab Med 2012;32:345–54. https://doi.org/10.3343/alm.2012.32.5.345.Search in Google Scholar PubMed PubMed Central
20. Aarsand, AK, Fernandez-Calle, P, Webster, C, Coskun, A, Gonzales-Lao, E, Diaz-Garzon, J, et al.. EFLM Biological Variation Database. https://biologicalvariation.eu/ [Accessed 27 Jan 2023].Search in Google Scholar
21. Randell, EW, Yenice, S. Delta checks in the clinical laboratory. Crit Rev Clin Lab Sci 2019;56:75–97. https://doi.org/10.1080/10408363.2018.1540536.Search in Google Scholar PubMed
22. Wang, H-Y, Chen, C-H, Shi, S, Chung, C-R, Wen, Y-H, Wu, M-H, et al.. Improving multi-tumor biomarker health check-up tests with machine learning algorithms. Cancers 2020;12:1442. https://doi.org/10.3390/cancers12061442.Search in Google Scholar PubMed PubMed Central
23. Bae, H, Lee, SA, Choi, JW, Hwang, SH, Park, S, Park, MS. Effectiveness of hepatocellular carcinoma surveillance and an optimal surveillance interval: nationwide cohort of Korea. Yonsei Med J 2021;62:758–66. https://doi.org/10.3349/ymj.2021.62.8.758.Search in Google Scholar PubMed PubMed Central
24. van Rossum, HH, Meng, QH, Ramanathan, LV, Holdenrieder, S. A word of caution on using tumor biomarker reference change values to guide medical decisions and the need for alternatives. Clin Chem Lab Med 2022;60:553–5. https://doi.org/10.1515/cclm-2021-0933.Search in Google Scholar PubMed
25. Doctor, JN, Strylewicz, G. Detecting ’wrong blood in tube’ errors: evaluation of a Bayesian network approach. Artif Intell Med 2010;50:75–82. https://doi.org/10.1016/j.artmed.2010.05.008.Search in Google Scholar PubMed PubMed Central
26. Yamashita, T, Ichihara, K, Miyamoto, A. A novel weighted cumulative delta-check method for highly sensitive detection of specimen mix-up in the clinical laboratory. Clin Chem Lab Med 2013;51:781–9. https://doi.org/10.1515/cclm-2012-0752.Search in Google Scholar PubMed
27. Rosenbaum, MW, Baron, JM. Using machine learning-based multianalyte delta checks to detect wrong blood in tube errors. Am J Clin Pathol 2018;150:555–66. https://doi.org/10.1093/ajcp/aqy085.Search in Google Scholar PubMed
28. Ovens, K, Naugler, C. How useful are delta checks in the 21 century? A stochastic-dynamic model of specimen mix-up and detection. J Pathol Inf 2012;3:5. https://doi.org/10.4103/2153-3539.93402.Search in Google Scholar PubMed PubMed Central
29. Zhou, R, Liang, YF, Cheng, HL, Wang, W, Huang, DW, Wang, Z, et al.. A highly accurate delta check method using deep learning for detection of sample mix-up in the clinical laboratory. Clin Chem Lab Med 2022;60:1984–92. https://doi.org/10.1515/cclm-2021-1171.Search in Google Scholar PubMed
30. Tan, RZ, Markus, C, Loh, TP. Relationship between biological variation and delta check rules performance. Clin Biochem 2020;80:42–7. https://doi.org/10.1016/j.clinbiochem.2020.03.017.Search in Google Scholar PubMed
Supplementary Material
This article contains supplementary material (https://doi.org/10.1515/cclm-2022-1098).
© 2023 Walter de Gruyter GmbH, Berlin/Boston
Articles in the same Issue
- Frontmatter
- Editorial
- Laboratory Medicine: from just testing to saving lives
- Reviews
- Serum biomarkers of remodeling in severe asthma with fixed airway obstruction and the potential role of KL-6
- Safety monitoring of drug-induced muscle injury and rhabdomyolysis: a biomarker-guided approach for clinical practice and drug trials
- Mini Review
- Concise review on the combined use of immunocapture, mass spectrometry and liquid chromatography for clinical applications
- Opinion Paper
- Recommendation for the design of stability studies on clinical specimens
- General Clinical Chemistry and Laboratory Medicine
- Assessment of WHO 07/202 reference material and human serum pools for commutability and for the potential to reduce variability among soluble transferrin receptor assays
- veRification: an R Shiny application for laboratory method verification and validation
- Impact of storage temperature and time before analysis on electrolytes (Na+, K+, Ca2+), lactate, glucose, blood gases (pH, pO2, pCO2), tHb, O2Hb, COHb and MetHb results
- The stability of blood gases and CO-oximetry under slushed ice and room temperature conditions
- Elevated levels of renal function tests conferred increased risks of developing various pregnancy complications and adverse perinatal outcomes: insights from a population-based cohort study
- Poor comparability of plasma renin activity measurement in determining patient samples: the status quo and recommendations for harmonization
- Salivary cortisol and cortisone in diagnosis of Cushing’s syndrome – a comparison of six different analytical methods
- Improved diagnostics of purine and pyrimidine metabolism disorders using LC-MS/MS and its clinical application
- Analytical evaluation of a GAD65 antibodies chemiluminescence immunoassay for CSF in neurological syndromes
- Reference Values and Biological Variations
- Evaluation of low-density lipoprotein cholesterol equations by cross-platform assessment of accuracy-based EQA data against SI-traceable reference value
- Highly sensitive tandem mass spectrometric measurement of serum estradiol without derivatization and pediatric reference intervals in children and adolescents
- Cancer Diagnostics
- Practical delta check limits for tumour markers in different clinical settings
- Comparison between free β subunit of human chorionic gonadotropin (hCG) and total hCG assays in adults with testicular cancer
- Hematology and Coagulation
- Value of monocyte distribution width for predicting severe cholecystitis: a retrospective cohort study
- Performance of digital morphology analyzer Medica EasyCell assistant
- Validation of non-invasive point of care blood content analysis using the TensorTip™ MTX device: a method comparison study
- Infectious Diseases
- Kinetics and ability of binding antibody and surrogate virus neutralization tests to predict neutralizing antibodies against the SARS-CoV-2 Omicron variant following BNT162b2 booster administration
- Letters to the Editor
- The first case of VEXAS syndrome in Austria
- Acetylcholine receptor and muscle-specific tyrosine kinase antibodies detection: is it time for a change?
- Performance of the 2009 CKDEPI, 2021 CKDEPI, and EKFC equations among high-risk patients in Denmark
- Biotin interference in immunoassays: water under the bridge?
- The new synthetic benzimidazole opioid etonitazepipne: an emerging fatal harm and a challenge for laboratory medicine
- Unexplained increase of serum carcinoembryonic antigen: don’t forget the thyroid!
- Falsely elevated cortisol serum levels in preterm infants due to use of immunoassay
- Misdiagnosis of Hb Bart’s disease: prenatal screening and diagnosis of thalassemia in special population
Articles in the same Issue
- Frontmatter
- Editorial
- Laboratory Medicine: from just testing to saving lives
- Reviews
- Serum biomarkers of remodeling in severe asthma with fixed airway obstruction and the potential role of KL-6
- Safety monitoring of drug-induced muscle injury and rhabdomyolysis: a biomarker-guided approach for clinical practice and drug trials
- Mini Review
- Concise review on the combined use of immunocapture, mass spectrometry and liquid chromatography for clinical applications
- Opinion Paper
- Recommendation for the design of stability studies on clinical specimens
- General Clinical Chemistry and Laboratory Medicine
- Assessment of WHO 07/202 reference material and human serum pools for commutability and for the potential to reduce variability among soluble transferrin receptor assays
- veRification: an R Shiny application for laboratory method verification and validation
- Impact of storage temperature and time before analysis on electrolytes (Na+, K+, Ca2+), lactate, glucose, blood gases (pH, pO2, pCO2), tHb, O2Hb, COHb and MetHb results
- The stability of blood gases and CO-oximetry under slushed ice and room temperature conditions
- Elevated levels of renal function tests conferred increased risks of developing various pregnancy complications and adverse perinatal outcomes: insights from a population-based cohort study
- Poor comparability of plasma renin activity measurement in determining patient samples: the status quo and recommendations for harmonization
- Salivary cortisol and cortisone in diagnosis of Cushing’s syndrome – a comparison of six different analytical methods
- Improved diagnostics of purine and pyrimidine metabolism disorders using LC-MS/MS and its clinical application
- Analytical evaluation of a GAD65 antibodies chemiluminescence immunoassay for CSF in neurological syndromes
- Reference Values and Biological Variations
- Evaluation of low-density lipoprotein cholesterol equations by cross-platform assessment of accuracy-based EQA data against SI-traceable reference value
- Highly sensitive tandem mass spectrometric measurement of serum estradiol without derivatization and pediatric reference intervals in children and adolescents
- Cancer Diagnostics
- Practical delta check limits for tumour markers in different clinical settings
- Comparison between free β subunit of human chorionic gonadotropin (hCG) and total hCG assays in adults with testicular cancer
- Hematology and Coagulation
- Value of monocyte distribution width for predicting severe cholecystitis: a retrospective cohort study
- Performance of digital morphology analyzer Medica EasyCell assistant
- Validation of non-invasive point of care blood content analysis using the TensorTip™ MTX device: a method comparison study
- Infectious Diseases
- Kinetics and ability of binding antibody and surrogate virus neutralization tests to predict neutralizing antibodies against the SARS-CoV-2 Omicron variant following BNT162b2 booster administration
- Letters to the Editor
- The first case of VEXAS syndrome in Austria
- Acetylcholine receptor and muscle-specific tyrosine kinase antibodies detection: is it time for a change?
- Performance of the 2009 CKDEPI, 2021 CKDEPI, and EKFC equations among high-risk patients in Denmark
- Biotin interference in immunoassays: water under the bridge?
- The new synthetic benzimidazole opioid etonitazepipne: an emerging fatal harm and a challenge for laboratory medicine
- Unexplained increase of serum carcinoembryonic antigen: don’t forget the thyroid!
- Falsely elevated cortisol serum levels in preterm infants due to use of immunoassay
- Misdiagnosis of Hb Bart’s disease: prenatal screening and diagnosis of thalassemia in special population