Expressing analytical performance from multi-sample evaluation in laboratory EQA
-
Marc H.M. Thelen
,
Rob T.P. Jansen
Abstract
Background:
To provide its participants with an external quality assessment system (EQAS) that can be used to check trueness, the Dutch EQAS organizer, Organization for Quality Assessment of Laboratory Diagnostics (SKML), has innovated its general chemistry scheme over the last decade by introducing fresh frozen commutable samples whose values were assigned by Joint Committee for Traceability in Laboratory Medicine (JCTLM)-listed reference laboratories using reference methods where possible. Here we present some important innovations in our feedback reports that allow participants to judge whether their trueness and imprecision meet predefined analytical performance specifications.
Methods:
Sigma metrics are used to calculate performance indicators named ‘sigma values’. Tolerance intervals are based on both Total Error allowable (TEa) according to biological variation data and state of the art (SA) in line with the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) Milan consensus.
Results:
The existing SKML feedback reports that express trueness as the agreement between the regression line through the results of the last 12 months and the values obtained from reference laboratories and calculate imprecision from the residuals of the regression line are now enriched with sigma values calculated from the degree to which the combination of trueness and imprecision are within tolerance limits. The information and its conclusion to a simple two-point scoring system are also graphically represented in addition to the existing difference plot.
Conclusions:
By adding sigma metrics-based performance evaluation in relation to both TEa and SA tolerance intervals to its EQAS schemes, SKML provides its participants with a powerful and actionable check on accuracy.
Author contributions: All the authors have accepted responsibility for the entire content of this submitted manuscript and approved submission.
Research funding: None declared.
Employment or leadership: None declared.
Honorarium: None declared.
Competing interests: The funding organization(s) played no role in the study design; in the collection, analysis, and interpretation of data; in the writing of the report; or in the decision to submit the report for publication.
References
1. Braga F, Panteghini M. Verification of in vitro medical diagnostics (IVD) metrological traceability: responsibilities and strategies. Clin Chim Acta 2014;432:55–61.10.1016/j.cca.2013.11.022Suche in Google Scholar PubMed
2. Miller GW, Jones GR, Horowitz GL, Weykamp C. Proficiency testing/external quality assessment: current challenges and future directions. Clin Chem 2011;57:1670–80.10.1373/clinchem.2011.168641Suche in Google Scholar PubMed
3. Jansen R, Jassam N, Thomas A, Perich C, Fernandez-Calle P, Faria AP, et al. A category 1 EQA scheme for comparison of laboratory performance and method performance: an international pilot study in the framework of the Calibration 2000 project. Clin Chim Acta 2014;432:90–8.10.1016/j.cca.2013.11.003Suche in Google Scholar PubMed
4. Sandberg S, Fraser C, Horvath A, Jansen R, Jones G, Oosterhuis W, et al. Defining analytical performance specifications: consensus Statement from the 1st Strategic Conference of the European Federation of Clinical Chemistry and Laboratory Medicine. Clin Chem Lab Med 2015;53:833–5.10.1515/cclm-2015-0067Suche in Google Scholar PubMed
5. Sciacovelli L, O’Kane M, Skaik YA, Caciagli P, Pellegrini C, Da Rin G, et al. Quality Indicators in Laboratory Medicine: From theory to practice: Preliminary data from the IFCC Working Group Project “laboratory Errors and Patient Safety”. Clin Chem Lab Med 2011;49:835–44.10.1515/CCLM.2011.128Suche in Google Scholar PubMed
6. Weykamp C, Franck P, Klein Gunnewiek J, de Jonge R, Kuypers A, van Loon D, et al. Harmonisation of seven common enzyme results through EQA. Clin Chem Lab Med 2014;52:1549–55.10.1515/cclm-2014-0458Suche in Google Scholar PubMed
7. Drion I, Cobbaert C, Groenier KH, Weykamp C, Bilo H, Wetzels J, et al. Clinical evaluation of analytical variations in serum creatinine measurements: why laboratories should abandon Jaffe techniques. BMC Nephrol 2012;13:133.10.1186/1471-2369-13-133Suche in Google Scholar PubMed PubMed Central
8. Cobbaert C, Weykamp C, Franck P, de Jonge R, Kuypers A, Steigstra H, et al. Systematic monitoring of standardization and harmonization status with commutable EQA-samples-Five year experience from the Netherlands. Clin Chim Acta 2012;414:234–40.10.1016/j.cca.2012.09.027Suche in Google Scholar PubMed
9. Perich C, Ricós C, Alvarez V, Biosca C, Boned B, Cava F, et al. External quality assurance programs as a tool for verifying standardization of measurement procedures: pilot collaboration in Europe. Clin Chim Acta 2014;432:82–9.10.1016/j.cca.2013.11.005Suche in Google Scholar PubMed
10. Fraser C. General strategies to set quality specifications for reliability performance characteristics. Scand J Clin Lab Invest 1999;59:487–90.10.1080/00365519950185210Suche in Google Scholar PubMed
11. Minchinela J, Ricós C, Perich C, Fernández-Calle P, Alvarez V, Domenech M, et al. Biological variation database, and quality specifications for imprecision, bias and total error (desirable and minimum). The 2014 update http://www.westgard.com/biodatabase1.htm biodatabase-2014-update. Accessed 14 Feb 2016.Suche in Google Scholar
12. Fraser C. Reference change values. Clin Chem Lab Med 2011;50:807–12.10.1515/cclm.2011.733Suche in Google Scholar
13. Petersen P, Jørgensen L, Brandslund I, De Fine Olivarius N, Stahl M. Consequences of bias and imprecision in measurements of glucose and Hba1c for the diagnosis and prognosis of diabetes mellitus. Scand J Clin Lab Invest Suppl 2005;240:51–60.10.1080/00365510500236135Suche in Google Scholar PubMed
14. Oosterhuis W. Gross overestimation of total allowable error based on biological variation. Clin Chem 2011;57:1334–6.10.1373/clinchem.2011.165308Suche in Google Scholar PubMed
15. Westgard J. Advanced quality management/six SIGMA Translating Method Validation Data into Sigma Metrics. https://www.westgard.com/lesson78.htm. Accessed 14 Feb 2016.Suche in Google Scholar
Supplemental Material:
The online version of this article (DOI: https://doi.org/10.1515/cclm-2016-0970) offers supplementary material, available to authorized users.
©2017 Walter de Gruyter GmbH, Berlin/Boston
Artikel in diesem Heft
- Frontmatter
- Editorials
- Reporting LDL-cholesterol levels in the era of intensive lipid management: a clarion call
- The challenges of genetic risk scores for the prediction of coronary heart disease
- Reviews
- Advanced lipoprotein testing for cardiovascular diseases risk assessment: a review of the novel approaches in lipoprotein profiling
- A review of the challenge in measuring and standardizing BCR-ABL1
- Mini Review
- Challenges in the analysis of epigenetic biomarkers in clinical samples
- Opinion Paper
- Defining a roadmap for harmonizing quality indicators in Laboratory Medicine: a consensus statement on behalf of the IFCC Working Group “Laboratory Error and Patient Safety” and EFLM Task and Finish Group “Performance specifications for the extra-analytical phases”
- Genetics and Molecular Diagnostics
- Assessment of EGFR mutation status using cell-free DNA from bronchoalveolar lavage fluid
- General Clinical Chemistry and Laboratory Medicine
- A survey of patients’ views from eight European countries of interpretive support from Specialists in Laboratory Medicine
- Verification of examination procedures in clinical laboratory for imprecision, trueness and diagnostic accuracy according to ISO 15189:2012: a pragmatic approach
- Expressing analytical performance from multi-sample evaluation in laboratory EQA
- A candidate reference method for serum potassium measurement by inductively coupled plasma mass spectrometry
- Practical motives are prominent in test-ordering in the Emergency Department
- Technical and clinical validation of the Greiner FC-Mix glycaemia tube
- Comparison of pneumatic tube system with manual transport for routine chemistry, hematology, coagulation and blood gas tests
- Accuracy of cerebrospinal fluid Aβ1-42 measurements: evaluation of pre-analytical factors using a novel Elecsys immunosassay
- Evaluation of cannabinoids concentration and stability in standardized preparations of cannabis tea and cannabis oil by ultra-high performance liquid chromatography tandem mass spectrometry
- Analytical performance and diagnostic accuracy of six different faecal calprotectin assays in inflammatory bowel disease
- Novel immunoassays for detection of CUZD1 autoantibodies in serum of patients with inflammatory bowel diseases
- Hematology and Coagulation
- Critical appraisal of discriminant formulas for distinguishing thalassemia from iron deficiency in patients with microcytic anemia
- Reference Values and Biological Variations
- Reference ranges of thromboelastometry in healthy full-term and pre-term neonates
- Cancer Diagnostics
- Immunoparesis in IgM gammopathies as a useful biomarker to predict disease progression
- Cardiovascular Diseases
- Assessment of the clinical utility of adding common single nucleotide polymorphism genetic scores to classical risk factor algorithms in coronary heart disease risk prediction in UK men
- Time and age dependent decrease of NT-proBNP after septal myectomy in hypertrophic obstructive cardiomyopathy
- Infectious Diseases
- Higher serum caspase-cleaved cytokeratin-18 levels during the first week of sepsis diagnosis in non-survivor patients
- Letters to the Editor
- Data mining for age-related TSH reference intervals in adulthood
- Intra-laboratory variation and its effect on gestational diabetes diagnosis
- Evaluation of long-term imprecision of automated complete blood cell count on the Sysmex XN-9000 system
- Sensitivity of the Sysmex XN9000 WPC-channel for detection of monoclonal B-cell populations
- Evaluation of biotin interference on immunoassays: new data for troponin I, digoxin, NT-Pro-BNP, and progesterone
- Stability of procalcitonin in cerebrospinal fluid
- Between-laboratory analysis of IgG antibodies against Aspergillus fumigatus in paired quality control samples
- Mass spectrometry vs. immunoassay in clinical and forensic toxicology: qui modus in rebus est?
- Great need for changes in higher education in Greece
- A note from the Editor in Chief regarding the Letter to the Editor “Great need for changes in higher education in Greece”
Artikel in diesem Heft
- Frontmatter
- Editorials
- Reporting LDL-cholesterol levels in the era of intensive lipid management: a clarion call
- The challenges of genetic risk scores for the prediction of coronary heart disease
- Reviews
- Advanced lipoprotein testing for cardiovascular diseases risk assessment: a review of the novel approaches in lipoprotein profiling
- A review of the challenge in measuring and standardizing BCR-ABL1
- Mini Review
- Challenges in the analysis of epigenetic biomarkers in clinical samples
- Opinion Paper
- Defining a roadmap for harmonizing quality indicators in Laboratory Medicine: a consensus statement on behalf of the IFCC Working Group “Laboratory Error and Patient Safety” and EFLM Task and Finish Group “Performance specifications for the extra-analytical phases”
- Genetics and Molecular Diagnostics
- Assessment of EGFR mutation status using cell-free DNA from bronchoalveolar lavage fluid
- General Clinical Chemistry and Laboratory Medicine
- A survey of patients’ views from eight European countries of interpretive support from Specialists in Laboratory Medicine
- Verification of examination procedures in clinical laboratory for imprecision, trueness and diagnostic accuracy according to ISO 15189:2012: a pragmatic approach
- Expressing analytical performance from multi-sample evaluation in laboratory EQA
- A candidate reference method for serum potassium measurement by inductively coupled plasma mass spectrometry
- Practical motives are prominent in test-ordering in the Emergency Department
- Technical and clinical validation of the Greiner FC-Mix glycaemia tube
- Comparison of pneumatic tube system with manual transport for routine chemistry, hematology, coagulation and blood gas tests
- Accuracy of cerebrospinal fluid Aβ1-42 measurements: evaluation of pre-analytical factors using a novel Elecsys immunosassay
- Evaluation of cannabinoids concentration and stability in standardized preparations of cannabis tea and cannabis oil by ultra-high performance liquid chromatography tandem mass spectrometry
- Analytical performance and diagnostic accuracy of six different faecal calprotectin assays in inflammatory bowel disease
- Novel immunoassays for detection of CUZD1 autoantibodies in serum of patients with inflammatory bowel diseases
- Hematology and Coagulation
- Critical appraisal of discriminant formulas for distinguishing thalassemia from iron deficiency in patients with microcytic anemia
- Reference Values and Biological Variations
- Reference ranges of thromboelastometry in healthy full-term and pre-term neonates
- Cancer Diagnostics
- Immunoparesis in IgM gammopathies as a useful biomarker to predict disease progression
- Cardiovascular Diseases
- Assessment of the clinical utility of adding common single nucleotide polymorphism genetic scores to classical risk factor algorithms in coronary heart disease risk prediction in UK men
- Time and age dependent decrease of NT-proBNP after septal myectomy in hypertrophic obstructive cardiomyopathy
- Infectious Diseases
- Higher serum caspase-cleaved cytokeratin-18 levels during the first week of sepsis diagnosis in non-survivor patients
- Letters to the Editor
- Data mining for age-related TSH reference intervals in adulthood
- Intra-laboratory variation and its effect on gestational diabetes diagnosis
- Evaluation of long-term imprecision of automated complete blood cell count on the Sysmex XN-9000 system
- Sensitivity of the Sysmex XN9000 WPC-channel for detection of monoclonal B-cell populations
- Evaluation of biotin interference on immunoassays: new data for troponin I, digoxin, NT-Pro-BNP, and progesterone
- Stability of procalcitonin in cerebrospinal fluid
- Between-laboratory analysis of IgG antibodies against Aspergillus fumigatus in paired quality control samples
- Mass spectrometry vs. immunoassay in clinical and forensic toxicology: qui modus in rebus est?
- Great need for changes in higher education in Greece
- A note from the Editor in Chief regarding the Letter to the Editor “Great need for changes in higher education in Greece”
