Comparison of four methods of establishing control limits for monitoring quality controls in infectious disease serology testing
-
Wayne Dimech
,
Marina Karakaltsas
Abstract
Background:
A general trend towards conducting infectious disease serology testing in centralized laboratories means that quality control (QC) principles used for clinical chemistry testing are applied to infectious disease testing. However, no systematic assessment of methods used to establish QC limits has been applied to infectious disease serology testing.
Methods:
A total of 103 QC data sets, obtained from six different infectious disease serology analytes, were parsed through standard methods for establishing statistical control limits, including guidelines from Public Health England, USA Clinical and Laboratory Standards Institute (CLSI), German Richtlinien der Bundesärztekammer (RiliBÄK) and Australian QConnect. The percentage of QC results failing each method was compared.
Results:
The percentage of data sets having more than 20% of QC results failing Westgard rules when the first 20 results were used to calculate the mean±2 standard deviation (SD) ranged from 3 (2.9%) for R4S to 66 (64.1%) for 10X rule, whereas the percentage ranged from 0 (0%) for R4S to 32 (40.5%) for 10X when the first 100 results were used to calculate the mean±2 SD. By contrast, the percentage of data sets with >20% failing the RiliBÄK control limits was 25 (24.3%). Only two data sets (1.9%) had more than 20% of results outside the QConnect Limits.
Conclusions:
The rate of failure of QCs using QConnect Limits was more applicable for monitoring infectious disease serology testing compared with UK Public Health, CLSI and RiliBÄK, as the alternatives to QConnect Limits reported an unacceptably high percentage of failures across the 103 data sets.
Author contributions: All the authors have accepted responsibility for the entire content of this submitted manuscript and approved submission.
Research funding: None declared.
Employment or leadership: None declared.
Honorarium: None declared.
Competing interests: The funding organization(s) played no role in the study design; in the collection, analysis and interpretation of data; in the writing of the report; or in the decision to submit the report for publication.
References
1. Australian Standards. Medical laboratories – requirements for quality and competence. Vol. AS ISO 15189-2013. Sydney, Australia: Standards Australia, 2013.Suche in Google Scholar
2. CLSI. Laboratory quality control based on risk management; approved guideline. Vol. EP23-A. Wayne, PA: CLSI, 2011.Suche in Google Scholar
3. CLSI. Statistical quality control for quantitative measurement procedures: principles and definitions; approved guidelines, 3rd ed. Vol. C24-A3. Wayne, PA: CSLI, 2006.Suche in Google Scholar
4. Public Health England. Quality assurance in the diagnostic virology and serology laboratory. In: Standards Unit MS, editor, Vol. Colindale, UK: Public Health England, 2015.Suche in Google Scholar
5. Parvin CA. Quality-control (QC) performance measures and the QC planning process. Clin Chem 1997;43:602–7.10.1093/clinchem/43.4.602Suche in Google Scholar
6. Kinns H, Pitkin S, Housley D, Freedman DB. Internal quality control: best practice. J Clin Pathol 2013;66:1027–32.10.1136/jclinpath-2013-201661Suche in Google Scholar PubMed
7. CLSI. Statistical quality control for quantitative measurement procedures: principles and definitions. Vol. CLSI Guideline C24. 4th ed. Wayne, PA: Clinical and Laboratory Standards Institute, 2016.Suche in Google Scholar
8. Westgard JO. Selecting appropriate quality-control rules. Clin Chem 1994;40:499–501.10.1093/clinchem/40.3.499Suche in Google Scholar
9. Westgard JO, Barry PL, Hunt MR, Groth T. A multi-rule Shewhart chart for quality control in clinical chemistry. Clin Chem 1981;27:493–501.10.1093/clinchem/27.3.493Suche in Google Scholar
10. German Medical Association. Revision of the “Guideline of the German Medical Association on Quality Assurance in Medical Laboratory Examinations – Rili-BAEK” (unauthorized translation). J Lab Med 2015;39:26–69.Suche in Google Scholar
11. Dimech W, Walker S, Read S, Smeh K, Karakaltsas M, Dent B, et al. Comprehensive quality control programme for serology and nucleic acid testing using an internet-based application. Accred Qual Assur 2004;9:148–51.10.1007/s00769-003-0734-5Suche in Google Scholar
12. Walker S, Dimech W, Kiely P, Smeh K, Francis B, Karakaltsas M, et al. An international quality control programme for prism chemiluminescent immunoassays in blood service and blood product laboratories. Vox Sang 2009;97:309–16.10.1111/j.1423-0410.2009.01218.xSuche in Google Scholar PubMed
13. Dimech W, Vincini G, Karakaltsas M. Determination of quality control limits for serological infectious disease testing using historical data. Clin Chem Lab Med 2015;53:329–36.10.1515/cclm-2014-0546Suche in Google Scholar PubMed
14. Westgard JO. Internal quality control: planning and implementation strategies. Ann Clin Biochem 2003;40:593–611.10.1258/000456303770367199Suche in Google Scholar PubMed
15. Badrick T. The quality control system. Clin Biochem Rev 2008;29(Suppl 1):S67–70.Suche in Google Scholar
16. Parvin CA, Jones JB. QC design: it’s easier than you think. MLO Med Lab Obs 2013;45:18, 20, 22.Suche in Google Scholar
17. Westgard JO. Statistical quality control procedures. Clin Lab Med 2013;33:111–24.10.1016/j.cll.2012.10.004Suche in Google Scholar PubMed
18. Westgard JO, Westgard SA. Quality control review: implementing a scientifically based quality control system. Ann Clin Biochem 2016;53:32–50.10.1177/0004563215597248Suche in Google Scholar PubMed
19. Algeciras-Schimnich A, Bruns DE, Boyd JC, Bryant SC, La Fortune KA, Grebe SK. Failure of current laboratory protocols to detect lot-to-lot reagent differences: findings and possible solutions. Clin Chem 2013;59:1187–94.10.1373/clinchem.2013.205070Suche in Google Scholar
20. Gray JJ, Wreghitt TG, McKee TA, McIntyre P, Roth CE, Smith DJ, et al. Internal quality assurance in a clinical virology laboratory. II. Internal quality control. J Clin Pathol 1995;48:198–202.10.1136/jcp.48.3.198Suche in Google Scholar
21. Green GA, Carey RN, Westgard JO, Carten T, Shablesky L, Achord D, et al. Quality control for qualitative assays: quantitative QC procedure designed to assure analytical quality required for an ELISA of hepatitis B surface antigen. Clin Chem 1997;43:1618–21.10.1093/clinchem/43.9.1618Suche in Google Scholar
22. Kim J, Swantee C, Lee B, Gunning H, Chow A, Sidaway F, et al. Identification of performance problems in a commercial human immunodeficiency virus type 1 enzyme immunoassay by multiuser external quality control monitoring and real-time data analysis. J Clin Microbiol 2009;47:3114–20.10.1128/JCM.00892-09Suche in Google Scholar
23. Kruk T, Ratnam S, Preiksaitis J, Lau A, Hatchette T, Horsman G, et al. Results of continuous monitoring of the performance of rubella virus IgG and hepatitis B virus surface antibody assays using trueness controls in a multicenter trial. Clin Vaccine Immunol 2012;19:1624–32.10.1128/CVI.00294-12Suche in Google Scholar
24. Howanitz PJ, Tetrault GA, Steindel SJ. Clinical laboratory quality control: a costly process now out of control. Clin Chim Acta 1997;260:163–74.10.1016/S0009-8981(96)06494-7Suche in Google Scholar
Supplementary Material:
The online version of this article offers supplementary material (https://doi.org/10.1515/cclm-2018-0351).
©2018 Walter de Gruyter GmbH, Berlin/Boston
Artikel in diesem Heft
- Frontmatter
- Editorial
- New biomarkers and traditional cardiovascular risk scores: any crystal ball for current effective advice and future exact prediction?
- Reviews
- Laboratory sample stability. Is it possible to define a consensus stability function? An example of five blood magnitudes
- Updated review of postmortem biochemical exploration of hypothermia with a presentation of standard strategy of sampling and analyses
- Long non-coding RNA-mediated regulation of signaling pathways in gastric cancer
- Opinion Paper
- Long story short: an introduction to the short-term and longterm Six Sigma quality and its importance in laboratory medicine for the management of extra-analytical processes
- EFLM Paper
- The European Federation of Clinical Chemistry and Laboratory Medicine syllabus for postgraduate education and training for Specialists in Laboratory Medicine: version 5 – 2018
- General Clinical Chemistry and Laboratory Medicine
- Early availability of laboratory results increases same day ward discharge rates
- Evaluation of the clinical implementation of a large-scale online e-learning program on venous blood specimen collection guideline practices
- Improved prospective risk analysis for clinical laboratories compensated for the throughput in processes
- National surveys on internal quality control for blood gas analysis and related electrolytes in clinical laboratories of China
- Clinical validation of S100B in the management of a mild traumatic brain injury: issues from an interventional cohort of 1449 adult patients
- A quantitative LC-MS/MS method for insulin-like growth factor 1 in human plasma
- Development and validation of a mass spectrometry-based assay for quantification of insulin-like factor 3 in human serum
- Anti-ganglioside antibodies: experience from the Italian Association of Neuroimmunology external quality assessment scheme
- Reference Values and Biological Variations
- Improving IBD diagnosis and monitoring by understanding preanalytical, analytical and biological fecal calprotectin variability
- Establishing normal values of total testosterone in adult healthy men by the use of four immunometric methods and liquid chromatography-mass spectrometry
- Cancer Diagnostics
- Exploring the potential of mucin 13 (MUC13) as a biomarker for carcinomas and other diseases
- Cardiovascular Diseases
- Prognostic implications of detectable cardiac troponin I below the 99th percentile in patients admitted to an emergency department without acute coronary syndrome
- Osteocalcin value to identify subclinical atherosclerosis over atherosclerotic cardiovascular disease (ASCVD) risk score in middle-aged and elderly Chinese asymptomatic men
- Infectious Diseases
- Comparison of four methods of establishing control limits for monitoring quality controls in infectious disease serology testing
- Letter to the Editor
- Letter to the Editor relative to Clin Chem Lab Med 2018;56(3):360–372
- Update in diagnosis and management of primary aldosteronism: reply to a Letter to the Editor
- Can calculated total nitrogen replace Kjeldahl total nitrogen measurements in 24-h urine samples?
- Analytical performance of the single well titer function of NOVA View®: good enough to omit ANA IIF titer analysis?
- Assessment of Architect cSystems Abbott® for the colorimetric measurement of lithium in urines and dyalisates
- β-Trace protein in hemodialysis – comparison of different therapy modalities and high flux dialyzers
- Orbitrap™ high-resolution mass spectrometry for the identification of amoxicillin crystalluria
- High fluorescence cell count in ascitic body fluids for carcinomatosis screening
- The International Society for Enzymology: a glorious history, a golden legacy
- Congress Abstracts
- 10th National Congress of the Portuguese Society of Clinical Chemistry, Genetics and Laboratory Medicine
- 5th EFLM-UEMS European Joint Congress in Laboratory Medicine
Artikel in diesem Heft
- Frontmatter
- Editorial
- New biomarkers and traditional cardiovascular risk scores: any crystal ball for current effective advice and future exact prediction?
- Reviews
- Laboratory sample stability. Is it possible to define a consensus stability function? An example of five blood magnitudes
- Updated review of postmortem biochemical exploration of hypothermia with a presentation of standard strategy of sampling and analyses
- Long non-coding RNA-mediated regulation of signaling pathways in gastric cancer
- Opinion Paper
- Long story short: an introduction to the short-term and longterm Six Sigma quality and its importance in laboratory medicine for the management of extra-analytical processes
- EFLM Paper
- The European Federation of Clinical Chemistry and Laboratory Medicine syllabus for postgraduate education and training for Specialists in Laboratory Medicine: version 5 – 2018
- General Clinical Chemistry and Laboratory Medicine
- Early availability of laboratory results increases same day ward discharge rates
- Evaluation of the clinical implementation of a large-scale online e-learning program on venous blood specimen collection guideline practices
- Improved prospective risk analysis for clinical laboratories compensated for the throughput in processes
- National surveys on internal quality control for blood gas analysis and related electrolytes in clinical laboratories of China
- Clinical validation of S100B in the management of a mild traumatic brain injury: issues from an interventional cohort of 1449 adult patients
- A quantitative LC-MS/MS method for insulin-like growth factor 1 in human plasma
- Development and validation of a mass spectrometry-based assay for quantification of insulin-like factor 3 in human serum
- Anti-ganglioside antibodies: experience from the Italian Association of Neuroimmunology external quality assessment scheme
- Reference Values and Biological Variations
- Improving IBD diagnosis and monitoring by understanding preanalytical, analytical and biological fecal calprotectin variability
- Establishing normal values of total testosterone in adult healthy men by the use of four immunometric methods and liquid chromatography-mass spectrometry
- Cancer Diagnostics
- Exploring the potential of mucin 13 (MUC13) as a biomarker for carcinomas and other diseases
- Cardiovascular Diseases
- Prognostic implications of detectable cardiac troponin I below the 99th percentile in patients admitted to an emergency department without acute coronary syndrome
- Osteocalcin value to identify subclinical atherosclerosis over atherosclerotic cardiovascular disease (ASCVD) risk score in middle-aged and elderly Chinese asymptomatic men
- Infectious Diseases
- Comparison of four methods of establishing control limits for monitoring quality controls in infectious disease serology testing
- Letter to the Editor
- Letter to the Editor relative to Clin Chem Lab Med 2018;56(3):360–372
- Update in diagnosis and management of primary aldosteronism: reply to a Letter to the Editor
- Can calculated total nitrogen replace Kjeldahl total nitrogen measurements in 24-h urine samples?
- Analytical performance of the single well titer function of NOVA View®: good enough to omit ANA IIF titer analysis?
- Assessment of Architect cSystems Abbott® for the colorimetric measurement of lithium in urines and dyalisates
- β-Trace protein in hemodialysis – comparison of different therapy modalities and high flux dialyzers
- Orbitrap™ high-resolution mass spectrometry for the identification of amoxicillin crystalluria
- High fluorescence cell count in ascitic body fluids for carcinomatosis screening
- The International Society for Enzymology: a glorious history, a golden legacy
- Congress Abstracts
- 10th National Congress of the Portuguese Society of Clinical Chemistry, Genetics and Laboratory Medicine
- 5th EFLM-UEMS European Joint Congress in Laboratory Medicine
