Sigma metrics used to assess analytical quality of clinical chemistry assays: importance of the allowable total error (TEa) target
-
Koen Hens
und
Sten Westgard
Abstract
Background: Six Sigma metrics were used to assess the analytical quality of automated clinical chemistry and immunoassay tests in a large Belgian clinical laboratory and to explore the importance of the source used for estimation of the allowable total error. Clinical laboratories are continually challenged to maintain analytical quality. However, it is difficult to measure assay quality objectively and quantitatively.
Methods: The Sigma metric is a single number that estimates quality based on the traditional parameters used in the clinical laboratory: allowable total error (TEa), precision and bias. In this study, Sigma metrics were calculated for 41 clinical chemistry assays for serum and urine on five ARCHITECT c16000 chemistry analyzers. Controls at two analyte concentrations were tested and Sigma metrics were calculated using three different TEa targets (Ricos biological variability, CLIA, and RiliBÄK).
Results: Sigma metrics varied with analyte concentration, the TEa target, and between/among analyzers. Sigma values identified those assays that are analytically robust and require minimal quality control rules and those that exhibit more variability and require more complex rules. The analyzer to analyzer variability was assessed on the basis of Sigma metrics.
Conclusions: Six Sigma is a more efficient way to control quality, but the lack of TEa targets for many analytes and the sometimes inconsistent TEa targets from different sources are important variables for the interpretation and the application of Sigma metrics in a routine clinical laboratory. Sigma metrics are a valuable means of comparing the analytical quality of two or more analyzers to ensure the comparability of patient test results.
Acknowledgments
The technical support by Ilse Van Gysel and Patrick Rosiers was much appreciated. We also thank Frank Heyvaert for his professional cooperation.
Conflict of interest statement
Authors’ conflict of interest disclosure: The authors stated that there are no conflicts of interest regarding the publication of this article. Employment and fees for lecturing played no role in thestudy design; in the collection, analysis, and interpretationof data; in the writing of the report; or in the decision tosubmit the report for publication.
Research funding: None declared.
Employment or leadership: Mario Berth: has received fees from Abbott for lecturing. Dave Armbruster: is employed by Abbott Diagnostics; receives salary from and holds stock from Abbott. Sten Westgard: has received fees from Abbott for lecturing and preparing educational materials.
Honorarium: None declared.
References
1. Lasky FD, Boser RB. Designing in quality through design control: a manufacturer′s perspective. Clin Chem 1997;43:866–72.10.1093/clinchem/43.5.866Suche in Google Scholar
2. Stankovic AK, Romeo P. The role of in vitro diagnostics companies in reducing laboratory error. Clin Chem Lab Med 2007;45:781–8.Suche in Google Scholar
3. Gras JM, Philippe M. Application of the Six Sigma concept in clinical laboratories: a review. Clin Chem Lab Med 2007;45: 789–96.Suche in Google Scholar
4. Llopis MA, Trujillo G, Llovet MI, Tarrés E, Ibarz M, Biosca C, et al. Quality indicators and specifications for key analytical- extranalytical processes in the clinical laboratory. Five years’ experience using the Six Sigma concept. Clin Chem Lab Med 2011;49:463–70.10.1515/CCLM.2011.067Suche in Google Scholar PubMed
5. Kinns H, Pitkin S, Housley D, Freedman DB. Internal quality control: best practices. J Clin Pathol 2013;66:1027–32.10.1136/jclinpath-2013-201661Suche in Google Scholar PubMed
6. CLSI EP5-A2. Evaluation of precision performance of quantitative measurement methods; approved guideline – 2nd ed. Wayne, PA: CLSI, 2004.Suche in Google Scholar
7. Fraser CG, Petersen PH, Ricos C, Haeckel R. Proposed quality specifications for the imprecision and inaccuracy of analytical systems for clinical chemistry. Eur J Clin Chem Clin Biochem 1992;30:311–7.Suche in Google Scholar
8. Ricós C, Alvarez V, Cava F, García-Lario JV, Hernández A, Jiménez CV, et al. Current databases on biological variation: pros, cons and progress. Scand J Clin Lab Invest 1999;59:491–500.10.1080/00365519950185229Suche in Google Scholar PubMed
9. Westgard JO. Internal quality control: planning and implementation strategies. Ann Clin Biochem 2003;40:593–611.10.1258/000456303770367199Suche in Google Scholar PubMed
10. Westgard JO, Darcy T. The truth about quality: medical usefulness and analytical reliability of laboratory tests. Clin Chim Acta 2004;346:3–11.10.1016/j.cccn.2003.12.034Suche in Google Scholar PubMed
11. Gras JM, Goffinet P, Bormans F. Practical internal QC protocol based on Six Sigma and biological variation in a routine clinical chemistry laboratory. Clin Chem 2009;55(Suppl):A32.Suche in Google Scholar
12. Friedecky B, Kratochiva J, Budina M. Why do different EQA schemes have apparently different limits of acceptability? Clin Chem Lab Med 2011;49:743–5.10.1515/CCLM.2011.105Suche in Google Scholar PubMed
13. Armbruster DA. Accuracy controls: assessing trueness (bias). In: Westgard JO, Westgard S, editors. Clinics in laboratory medicine, quality control in the age of risk management, 1st ed. Vol 33. Philadelphia, PA: Elsevier, 2013:125–37.Suche in Google Scholar
©2014 by Walter de Gruyter Berlin/Boston
Artikel in diesem Heft
- Frontmatter
- Editorial
- Diagnosis of diabetes mellitus: reiterated responsibilities for the clinical laboratory
- Review
- The association between plasminogen activator inhibitor type 1 (PAI-1) levels, PAI-1 4G/5G polymorphism, and myocardial infarction: a Mendelian randomization meta-analysis
- Opinion Papers
- Harmonization of quality indicators in laboratory medicine. A preliminary consensus
- Cardiac biomarkers and risk assessment in patients undergoing major non-cardiac surgery: time to revise the guidelines?
- General Clinical Chemistry and Laboratory Medicine
- A statistical basis for harmonization of thyroid stimulating hormone immunoassays using a robust factor analysis model
- Sigma metrics used to assess analytical quality of clinical chemistry assays: importance of the allowable total error (TEa) target
- Combined light chain immunofixation to detect monoclonal gammopathy: a comparison to standard electrophoresis in serum and urine
- Automated indirect immunofluorescence microscopy enables the implementation of a quantitative internal quality control system for anti-nuclear antibody (ANA) analysis
- Peripheral blood lymphocytes from patients with bipolar disorder demonstrate apoptosis and differential regulation of advanced glycation end products and S100B
- Coefficient of energy balance, a new parameter for basic investigation of the cerebrospinal fluid
- Interconversion of stone composition profiles from two recurrent stone episodes in stone formers
- Reference Values
- Complete blood count reference intervals and age- and sex-related trends of North China Han population
- Cancer Diagnostics
- The quantification of HER2 and MYC gene fragments in cell-free plasma as putative biomarkers for gastric cancer diagnosis
- Cardiovascular Diseases
- Novel sensitive cardiac troponin I immunoassay free from troponin I-specific autoantibody interference
- Interleukin-6 receptor Asp358Ala gene polymorphism is associated with plasma C-reactive protein levels and severity of aortic valve stenosis
- Diabetes
- Stability of glucose in plasma with different anticoagulants
- Plasma glucose measurement in diabetes: impact and implications of variations in sample collection procedures with a focus on the first hour after sample collection
- Changing from glucose to HbA1c for diabetes diagnosis: predictive values of one test and importance of analytical bias and imprecision
- System accuracy evaluation of systems for point-of-care testing of blood glucose: a comparison of a patient-use system with six professional-use systems
- Letter to the Editors
- Reply to the article entitled “Identification of an 18 bp deletion in the TWIST1 gene by CO-amplification at lower denaturation temperature-PCR (COLD-PCR) for non-invasive prenatal diagnosis of craniosynostosis: first case report” by Galbiati et al., Clin Chem Lab Med 2014;52(4):505–9
- Further considerations concerning non-invasive prenatal diagnosis of craniosynostosis based on the identification of an 18 bp deletion in the TWIST1 gene by COLD-PCR
- Sensible use of laboratory testing requires active laboratory involvement
- Digoxin overdose – an accurate method for determining free digoxin concentrations on general chemistry analysers post DigiFab treatment
- Method-specific differences in β-isomerised carboxy-terminal cross-linking telopeptide of type I collagen and procollagen type I amino-terminal propeptide using two fully automated immunoassays
- Evaluation of mutation profiling by matrix-assisted laser desorption ionization time-of-flight (MALDI-TOF) mass spectrometry in fine needle aspirations from papillary thyroid cancer
- Evaluation of Calfast® immunochromatographic quantitative assay for the measurement of calprotectin in faeces
- Measurement error in estimated average glucose: a novel approach
- Feasibility of an EQAS for HbA1c in Italy using fresh blood samples
- Congress Abstracts
- 5th Annual International Symposium on Kallikreins and Kallikrein-Related Peptidases
Artikel in diesem Heft
- Frontmatter
- Editorial
- Diagnosis of diabetes mellitus: reiterated responsibilities for the clinical laboratory
- Review
- The association between plasminogen activator inhibitor type 1 (PAI-1) levels, PAI-1 4G/5G polymorphism, and myocardial infarction: a Mendelian randomization meta-analysis
- Opinion Papers
- Harmonization of quality indicators in laboratory medicine. A preliminary consensus
- Cardiac biomarkers and risk assessment in patients undergoing major non-cardiac surgery: time to revise the guidelines?
- General Clinical Chemistry and Laboratory Medicine
- A statistical basis for harmonization of thyroid stimulating hormone immunoassays using a robust factor analysis model
- Sigma metrics used to assess analytical quality of clinical chemistry assays: importance of the allowable total error (TEa) target
- Combined light chain immunofixation to detect monoclonal gammopathy: a comparison to standard electrophoresis in serum and urine
- Automated indirect immunofluorescence microscopy enables the implementation of a quantitative internal quality control system for anti-nuclear antibody (ANA) analysis
- Peripheral blood lymphocytes from patients with bipolar disorder demonstrate apoptosis and differential regulation of advanced glycation end products and S100B
- Coefficient of energy balance, a new parameter for basic investigation of the cerebrospinal fluid
- Interconversion of stone composition profiles from two recurrent stone episodes in stone formers
- Reference Values
- Complete blood count reference intervals and age- and sex-related trends of North China Han population
- Cancer Diagnostics
- The quantification of HER2 and MYC gene fragments in cell-free plasma as putative biomarkers for gastric cancer diagnosis
- Cardiovascular Diseases
- Novel sensitive cardiac troponin I immunoassay free from troponin I-specific autoantibody interference
- Interleukin-6 receptor Asp358Ala gene polymorphism is associated with plasma C-reactive protein levels and severity of aortic valve stenosis
- Diabetes
- Stability of glucose in plasma with different anticoagulants
- Plasma glucose measurement in diabetes: impact and implications of variations in sample collection procedures with a focus on the first hour after sample collection
- Changing from glucose to HbA1c for diabetes diagnosis: predictive values of one test and importance of analytical bias and imprecision
- System accuracy evaluation of systems for point-of-care testing of blood glucose: a comparison of a patient-use system with six professional-use systems
- Letter to the Editors
- Reply to the article entitled “Identification of an 18 bp deletion in the TWIST1 gene by CO-amplification at lower denaturation temperature-PCR (COLD-PCR) for non-invasive prenatal diagnosis of craniosynostosis: first case report” by Galbiati et al., Clin Chem Lab Med 2014;52(4):505–9
- Further considerations concerning non-invasive prenatal diagnosis of craniosynostosis based on the identification of an 18 bp deletion in the TWIST1 gene by COLD-PCR
- Sensible use of laboratory testing requires active laboratory involvement
- Digoxin overdose – an accurate method for determining free digoxin concentrations on general chemistry analysers post DigiFab treatment
- Method-specific differences in β-isomerised carboxy-terminal cross-linking telopeptide of type I collagen and procollagen type I amino-terminal propeptide using two fully automated immunoassays
- Evaluation of mutation profiling by matrix-assisted laser desorption ionization time-of-flight (MALDI-TOF) mass spectrometry in fine needle aspirations from papillary thyroid cancer
- Evaluation of Calfast® immunochromatographic quantitative assay for the measurement of calprotectin in faeces
- Measurement error in estimated average glucose: a novel approach
- Feasibility of an EQAS for HbA1c in Italy using fresh blood samples
- Congress Abstracts
- 5th Annual International Symposium on Kallikreins and Kallikrein-Related Peptidases
