Achieving harmonised results for our clinical users has become a high priority in the laboratory medicine community [1]. There are a number of reasons for this, but foremost is that patients receiving results from different laboratories should be getting similar results to facilitate optimal care by their healthcare provider [1]. The healthcare community has entrusted laboratory professionals with this task. We have numerous tools to help us achieve this objective, and certainly for those analytes that can be measured with defined reference methods, we should be able to achieve harmonisation within acceptable precision targets [2]. The recent consensus statements on setting these precision targets have reinforced the criteria we should be striving for [3]. However, from a practical perspective, most of us will be applying biological variability-derived targets in our clinical laboratories rather than one from the two other models [3].
One tool for evaluating bias for our laboratory tests is through the participation in external quality control/proficiency testing programs (EQA/PT). Most of these programs are not designed to truly assess bias, as many programs and in fact many analytes lack reference measurement procedures (RMPs). Nonetheless, these EQA programs do help us facilitate a degree of confidence in our testing process and do play an important role in providing optimal laboratory results. Recently, it has been proposed that EQA/PT schemes that offer assigned targets (established by RMPs) and that use commutable samples that are repeated in different cycles be graded as level 1 EQA/PT schemes [4].
In this issue of the Journal, Weykamp and colleagues evaluate the use of such samples (i.e. commutable and with reference targets) from a level 1 EQA/PT program across five countries through national EQA/PT schemes [5]. The authors assessed 17 general chemistry analytes, all of which have RMPs. They applied biological variation derived total error (TE) targets and rated performance per the categories of optimum, desirable, minimum and failed (not meeting) [6].
The study demonstrates that these samples from a level 1 EQA/PT program can be used with success in five countries analysed by seven different and frequently used manufacturer platforms. The data was analysed by both country of analysis and by instrument platform. The finding that there were no significant differences between the country of analysis and the instrument platform for each analyte confirms that the sample used was commutable. This is an important contribution to our confidence in using such a material for EQA/PT schemes and should encourage the wider adoption of such material by EQA/PT providers, as this will improve the ability of laboratory tests to become harmonised.
By choosing to evaluate the data against an RMP target, the authors have also been able to provide a snapshot of how well we are doing in our clinical laboratories against biological variability targets. Here, things are not looking so good. Only 11 of 17 assays met or were more than the minimum level of performance. For the elements analysed (Na, Cl, Ca, Mg, K), only K achieved a TE below the minimum percentage of total allowable error (% TAE) across all manufacturers and countries. One may take this finding as further proof that the manufacturers of our assays and reference materials need to continue to develop more rigorous technology to match the accuracy that is required for clinical use. Or alternatively, one could argue that these failures were perhaps due to an overly stringent % TAE criteria for these analytes. For example, the minimum % TAE is largest for K at 8.4% and smallest for Na at 1.1%. Using these criteria in the following equation, TE=bias (B)+2CV (coefficient of variation), if the B was set to equal 0, the CV for Na would have to be <0.6% to meet the minimum, while in the same circumstance, the CV for K would have to be <4.2%. In practice, a Na CV=0.6% would be considered quite acceptable, whereas a K CV=4.2% would not. Looking across the six analytes that failed to meet the minimum specification, five of the six had minimum % TAE<7.2%, with only one enzyme failing to meet the minimum % TAE. Thus, the higher the % TAE based on biological variability, the more equivalent assays appear to be within the allowable percent difference from the target values. In either case, these findings should be of great interest to the manufacturers, as greater attention to the commutability of their reference materials and standards [7] as well as tightening up reagent and calibrator lot variability through the production process should be encouraged.
Where this becomes impossible, we as a community of laboratory professionals may need to consider how we define our allowable error. If achieving biological variability targets is not possible with excellent precision, we may need to change our mindset from biological variation model to the “state-of-the-art” model. These state-of-the-art criteria may well be defined after consideration of data produced by samples such as the one circulated by Weykamp et al. [5]. Defining allowable error based on multiple instrument platforms across multiple countries and a number of samples may provide a more realistic picture of what is actually achievable in laboratory medicine.
References
1. Plebani M. Harmonization in laboratory medicine: requests, samples, measurements and reports. Crit Rev Clin Lab Sci 2016;53:184–96.10.3109/10408363.2015.1116851Search in Google Scholar PubMed
2. Miller WG, Eckfeldt JH, Passarelli J, Rosner W, Young IS. Harmonization of test results: what are the challenges; how can we make it better? Clin Chem 2013;60:923–7.10.1373/clinchem.2012.201186Search in Google Scholar PubMed
3. Sandberg S, Fraser CG, Horvath AR, Jansen R, Jones G, Oosterhuis W, et al. Defining analytical performance specifications: consensus statement from the 1st Strategic Conference of the European Federation of Clinical Chemistry and Laboratory Medicine. Clin Chem Lab Med 2015;53:833–5.10.1515/cclm-2015-0067Search in Google Scholar PubMed
4. Miller WG, Jones GR, Horowitz GL, Weykamp C. Proficiency testing/external quality assessment: current challenges and future directions. Clin Chem 2011;57:1670–80.10.1373/clinchem.2011.168641Search in Google Scholar PubMed
5. Weykamp C, Secchiero S, Plebani M, Thelen M, Cobbaert C, Thomas A, et al. Analytical performance of 17 general chemistry analytes across countries and across manufacturers in the INPUtS project of EQA organizers in Italy, the Netherlands, Portugal, United Kingdom and Spain. Clin Chem Lab Med 2016. doi: 10.1515/cclm-2016-0220. [Epub ahead of print].Search in Google Scholar PubMed
6. Fraser CG. Biological variation: from principles to practice. Washington, DC: AACC Press, 2001:151.Search in Google Scholar
7. Miller WG, Myers GL. Commutability still matters. Clin Chem 2013;59:1291–3.10.1373/clinchem.2013.208785Search in Google Scholar PubMed
©2017 Walter de Gruyter GmbH, Berlin/Boston
Articles in the same Issue
- Frontmatter
- Editorial
- Commutable samples with assigned target concentrations may help us harmonise general chemistry results
- Reviews
- Performance of point-of-care HbA1c test devices: implications for use in clinical practice – a systematic review and meta-analysis
- Cardiac troponins and mortality in type 1 and 2 myocardial infarction
- Opinion Paper
- Criteria for assigning laboratory measurands to models for analytical performance specifications defined in the 1st EFLM Strategic Conference
- Genetics and Molecular Diagnostics
- External quality assessment for human papillomavirus 16/18 DNA detection and genotyping in Shanghai, China
- General Clinical Chemistry and Laboratory Medicine
- Analytical performance of 17 general chemistry analytes across countries and across manufacturers in the INPUtS project of EQA organizers in Italy, the Netherlands, Portugal, United Kingdom and Spain
- Commutability of proficiency testing material containing tobramycin: a study within the framework of the Dutch Calibration 2.000 project
- Optimization and validation of moving average quality control procedures using bias detection curves and moving average validation charts
- Extending laboratory automation to the wards: effect of an innovative pneumatic tube system on diagnostic samples and transport time
- Smart management of sample dilution using an artificial neural network to achieve streamlined processes and saving resources: the automated nephelometric testing of serum free light chain as case study
- An integrated proteomic and peptidomic assessment of the normal human urinome
- An alternative inhibition method for determining cross-reactive allergens
- Validation of a new assay for α-synuclein detection in cerebrospinal fluid
- Reference Values and Biological Variations
- Intra-individual variation of plasma trimethylamine-N-oxide (TMAO), betaine and choline over 1 year
- Cancer Diagnostics
- Predictive performance of TPA testing for recurrent disease during follow-up after curative intent surgery for colorectal carcinoma
- Cardiovascular Diseases
- Mid-regional pro-adrenomedullin (MR-proADM) and mid-regional pro-atrial natriuretic peptide (MR-proANP) in severe aortic valve stenosis: association with outcome after transcatheter aortic valve implantation (TAVI)
- Association between apolipoprotein E polymorphisms and premature coronary artery disease: a meta-analysis
- Urinary orosomucoid: a novel, early biomarker of sepsis with promising diagnostic performance
- Letters to the Editor
- CT or MRI
- Reply to: CT or MRI in the diagnosis of right lower quadrant abdominal pain?
- Quantification of daratumumab in the serum protein electrophoresis
- Response to: Interference of daratumumab on the serum protein electrophoresis
- Glycated albumin: correlation to HbA1c and preliminary reference interval evaluation
- Using “big data” to describe the effect of seasonal variation in thyroid-stimulating hormone
- IgE multiple myeloma: a new case report
- Therapeutic decision-making process in the intensive care unit: role of biological point-of-care testing
- How can we evaluate differences between serial measurements on the same sample? A new approach based on within-subject biological variation
Articles in the same Issue
- Frontmatter
- Editorial
- Commutable samples with assigned target concentrations may help us harmonise general chemistry results
- Reviews
- Performance of point-of-care HbA1c test devices: implications for use in clinical practice – a systematic review and meta-analysis
- Cardiac troponins and mortality in type 1 and 2 myocardial infarction
- Opinion Paper
- Criteria for assigning laboratory measurands to models for analytical performance specifications defined in the 1st EFLM Strategic Conference
- Genetics and Molecular Diagnostics
- External quality assessment for human papillomavirus 16/18 DNA detection and genotyping in Shanghai, China
- General Clinical Chemistry and Laboratory Medicine
- Analytical performance of 17 general chemistry analytes across countries and across manufacturers in the INPUtS project of EQA organizers in Italy, the Netherlands, Portugal, United Kingdom and Spain
- Commutability of proficiency testing material containing tobramycin: a study within the framework of the Dutch Calibration 2.000 project
- Optimization and validation of moving average quality control procedures using bias detection curves and moving average validation charts
- Extending laboratory automation to the wards: effect of an innovative pneumatic tube system on diagnostic samples and transport time
- Smart management of sample dilution using an artificial neural network to achieve streamlined processes and saving resources: the automated nephelometric testing of serum free light chain as case study
- An integrated proteomic and peptidomic assessment of the normal human urinome
- An alternative inhibition method for determining cross-reactive allergens
- Validation of a new assay for α-synuclein detection in cerebrospinal fluid
- Reference Values and Biological Variations
- Intra-individual variation of plasma trimethylamine-N-oxide (TMAO), betaine and choline over 1 year
- Cancer Diagnostics
- Predictive performance of TPA testing for recurrent disease during follow-up after curative intent surgery for colorectal carcinoma
- Cardiovascular Diseases
- Mid-regional pro-adrenomedullin (MR-proADM) and mid-regional pro-atrial natriuretic peptide (MR-proANP) in severe aortic valve stenosis: association with outcome after transcatheter aortic valve implantation (TAVI)
- Association between apolipoprotein E polymorphisms and premature coronary artery disease: a meta-analysis
- Urinary orosomucoid: a novel, early biomarker of sepsis with promising diagnostic performance
- Letters to the Editor
- CT or MRI
- Reply to: CT or MRI in the diagnosis of right lower quadrant abdominal pain?
- Quantification of daratumumab in the serum protein electrophoresis
- Response to: Interference of daratumumab on the serum protein electrophoresis
- Glycated albumin: correlation to HbA1c and preliminary reference interval evaluation
- Using “big data” to describe the effect of seasonal variation in thyroid-stimulating hormone
- IgE multiple myeloma: a new case report
- Therapeutic decision-making process in the intensive care unit: role of biological point-of-care testing
- How can we evaluate differences between serial measurements on the same sample? A new approach based on within-subject biological variation