Quality assessment of interpretative commenting and competency comparison of comment providers in China
-
Yuzhu Huang
, Wei Wang , Haijian Zhao , Yuxuan Du , Jiali Liu , Falin He , Kun Zhong , Shuai Yuan und Zhiguo Wang
Abstract
Background
This study aimed to evaluate the ability of comment providers who were responsible for interpreting results in clinical laboratories in China and to improve the quality of interpretative comments.
Methods
Basic information and interpretative comments for five cases of 1912 routine chemistry External Quality Assessment (EQA) participant laboratories were collected by web-based EQA system in May 2018. EQA organizers assigned scores to each key phrase of comments based on predetermined marking scale and calculated total scores for each participant’s answer. Final scores and ranking were calculated according to scores of cases. Finally, we comprehensively analyzed the type of hospital and the professional title of participants.
Results
In total, 772 clinical laboratories, 1472 participants, from different Chinese provinces submitted interpretative comments. Median scores, interquartile ranges and score ranges of the five cases were 13 (11–15, 1–20), 13 (10–16, 0–20), 15 (12–17, 0–21), 7 (5–9, −2 to 14) and 12 (10–13, −2 to 18). The final scores and ranking of participants that came from tertiary hospitals were higher than those from secondary and other hospitals; however, there were no significant differences (0.774). When grouped by professional title, we found that although no significant variability existed among senior, intermediate, junior and others (0.699), it existed between laboratory physicians and technicians, as the median final scores of the former were higher than the latter.
Conclusions
Practice and quality of interpretative comments are indeed different among different laboratories and participants in China. Laboratories should train and assess the interpretative ability of personnel. EQA organizers should also improve the scoring method and establish peer assessors team through this survey.
Acknowledgments
We appreciate the UK National External Quality Assessment Scheme (NEQAS), the Interpretative Comments Educational Programme 2011 of Asian and Pacific Federation of Clinical Biochemistry (APFCB) and Dr. Gordon Challand for giving us copyright permissions of cases for this study. We appreciate the participant laboratories and institutions that participated in the EQA schemes for this survey. We also thank the personnel of the Clinet website (www.clinet.com.cn) who gave computer technology support to establish the network platform for the survey and relevant services.
Author contributions: All the authors have accepted responsibility for the entire content of this submitted manuscript and approved submission.
Research funding: None declared.
Employment or leadership: None declared.
Honorarium: None declared.
Competing interests: The funding organization(s) played no role in the study design; in the collection, analysis and interpretation of data; in the writing of the report; or in the decision to submit the report for publication.
References
1. Vasikaran SD. Anatomy and history of an External Quality Assessment program for interpretative comments in clinical biochemistry. Clin Biochem 2015;48:467–71.10.1016/j.clinbiochem.2014.12.014Suche in Google Scholar
2. Van Cott EM. Laboratory test interpretations and algorithms in utilization management. Clin Chim Acta 2014;427:188–92.10.1016/j.cca.2013.09.025Suche in Google Scholar
3. Plebani M. Interpretative commenting: a tool for improving the laboratory-clinical interface. Clin Chim Acta 2009;404:46–51.10.1016/j.cca.2009.03.012Suche in Google Scholar
4. Vasikaran SD, Lai LC, Sethi S, Lopez JB, Sikaris KA. Quality of interpretative commenting on common clinical chemistry results in the Asia-Pacific region and Africa. Clin Chem Lab Med 2009;47:963–70.10.1515/CCLM.2009.225Suche in Google Scholar
5. International Organization for Standardization. Medical laboratories-requirements for quality and competence. International Organization for Standardization (ISO 15189:2012). Available at: https://www.iso.org/obp/ui/#iso:std:iso:15189:ed-3:v2:en. Accessed: 3 July 2018.Suche in Google Scholar
6. Wang F, Qi Z, Cui W. From laboratory to clinic: job responsibility of laboratory physician. Chin J Clin Lab Mgt 2016;4:73–7.Suche in Google Scholar
7. Lu X, Gu H. Exploration for a new model of training for laboratory physicians. Natl Med J China 2014;94:2481–4.Suche in Google Scholar
8. Katoch V. Recognizing the laboratory physicians. J Lab Physicians 2009;1:1.10.4103/0974-2727.54799Suche in Google Scholar
9. Wang P, Tai S, Shi Y, Jia L. The current situation of cultivation for laboratory physicians. Med Lab Sci Clin 2017;28:63–4.Suche in Google Scholar
10. Vasikaran S, Sikaris K, Kilpatrick E, French J, Badrick T, Osypiw J, et al. Assuring the quality of interpretative comments in clinical chemistry. Clin Chem Lab Med 2016;54:1901–11.10.1515/cclm-2016-0709Suche in Google Scholar
11. Bezzegh A, Takács I, Ajzner E. Toward harmonization of interpretive commenting of common laboratory tests. Clin Biochem 2017;50:612–6.10.1016/j.clinbiochem.2017.05.012Suche in Google Scholar
12. International Organization for Standardization. Conformity assessment – general requirements for proficiency testing (ISO 17043:2010). Available at: https://www.iso.org/standard/29366.html. Accessed: 17 July 2018.Suche in Google Scholar
13. Challand G, Osypiw J. Interpretation in clinical biochemistry: an external quality assurance scheme. Available at: http://www.ifcc.org/ifccfiles/docs/150206200405.pdf. Accessed: 17 July 2018.Suche in Google Scholar
14. Sciacovelli L, Zardo L, Secchiero S, Zaninotto M, Plebani M. Interpretative comments and reference ranges in EQA programs as a tool for improving laboratory appropriateness and effectiveness. Clin Chim Acta 2003;333:209–19.10.1016/S0009-8981(03)00188-8Suche in Google Scholar
15. UK NEQAS for Interpretative comment. http://www.ukneqasmicro.org.uk/new-participant-enquiries/interpretative-comments/interpretative-comments-information. Accessed: 17 July 2018.Suche in Google Scholar
16. Interpretative Comments Educational Programme 2011. http://www.apfcb.org/publications.html. Accessed: 17 July 2018.Suche in Google Scholar
17. Challand GS. Case for Comment, for education and for audit. Int Fed Clin Chem 1998;10:53–5.Suche in Google Scholar
18. Marshall WJ, Challand GS. Provision of interpretative comments on biochemical report forms. Ann Clin Biochem 2000;37:758–63.10.1258/0004563001900066Suche in Google Scholar PubMed
19. Challand GS, Vasikaran SD. The assessment of interpretation in clinical biochemistry: a personal view. Ann Clin Biochem 2007;44:101–5.10.1258/000456307780118163Suche in Google Scholar PubMed
20. Vasikaran SD, Penberthy L, Gill J, Scott S, Sikaris KA. Review of a pilot quality assessment program for interpretative commenting. Ann Clin Biochem 2002;39:261–72.10.1258/0004563021901955Suche in Google Scholar PubMed
21. Lim EM, Sikaris KA, Gill J, Calleja J, Hickman PE, Beilby J, et al. Quality assessment of interpretative commenting in clinical chemistry. Clin Chem 2004;50:632–70.10.1373/clinchem.2003.024877Suche in Google Scholar PubMed
22. Sciacovelli L, Aita A, Padoan A, Pelloso M, Antonelli G, Piva E, et al. Performance criteria and quality indicators for the post-analytical phase. Clin Chem Lab Med 2016;54:1169–76.10.1515/cclm-2015-0897Suche in Google Scholar PubMed
23. International Federation of Clinical Chemistry and Laboratory Medicine Working Group “Laboratory Errors and Patient Safety”. MQI-Support-Revision 1. Available at: http://www.ifccmqi.com/MqiWeb/resources/doc/Quality_Indicators_Support_Processes.pdf. Accessed: 3 July 2018.Suche in Google Scholar
24. Coulson C, Kelly AM. Interpretative comments scheme comes of age. ACB News 2011;576:23.Suche in Google Scholar
25. Li P, Challand GS. Experience with assessing the quality of comments on clinical biochemistry reports. Ann Clin Biochem 1999;36:759–65.10.1177/000456329903600610Suche in Google Scholar PubMed
Supplementary Material
The online version of this article offers supplementary material (https://doi.org/10.1515/cclm-2018-0877).
©2019 Walter de Gruyter GmbH, Berlin/Boston
Artikel in diesem Heft
- Frontmatter
- Obituary
- Professor Howard A. Morris
- Editorial
- The silk road to total quality in Laboratory Medicine
- Reviews
- Moving average quality control: principles, practical application and future perspectives
- Serum α-fetoprotein in pediatric oncology: not a children’s tale
- Mini Review
- Value-based healthcare: the role of laboratory medicine
- Opinion Paper
- Advantages and limitations of total laboratory automation: a personal overview
- General Clinical Chemistry and Laboratory Medicine
- Analysis and evaluation of the external quality assessment results of quality indicators in laboratory medicine all over China from 2015 to 2018
- A pilot study for establishing quality indicators in molecular diagnostics according to the IFCC WG-LEPS initiative: preliminary findings in China
- Quality assessment of interpretative commenting and competency comparison of comment providers in China
- Lower creatinine concentration values and lower inter-laboratory variation among Swedish hospital laboratories in 2014 compared to 1996: results from the Equalis external quality assessment program
- Development of the Point-of-Care Key Evidence Tool (POCKET): a checklist for multi-dimensional evidence generation in point-of-care tests
- Analytical and clinical performance evaluation of two POC tests for therapeutic drug monitoring of infliximab
- Hematology and Coagulation
- Provisional standardization of hepcidin assays: creating a traceability chain with a primary reference material, candidate reference method and a commutable secondary reference material
- Danger of false negative (exclusion) or false positive (diagnosis) for ‘congenital thrombophilia’ in the age of anticoagulants
- Point-of-care haemostasis monitoring during liver transplantation is cost effective
- Reference Values and Biological Variations
- Evaluation of reference intervals of haematological and biochemical markers in an Austrian adolescent study cohort
- Cancer Diagnostics
- A novel machine learning-derived decision tree including uPA/PAI-1 for breast cancer care
- Cardiovascular Diseases
- Evaluation of analytical performances using standardized analytical protocols and comparison of clinical results of the new ADVIA BNP and NT-proBNP immunoassays for the Centaur XPT platform
- Infectious Diseases
- Improvement in detecting sepsis using leukocyte cell population data (CPD)
- Letters to the Editor
- The biological variation of plasma proenkephalin: data from a stable heart failure cohort
- Hemoglobin variants found in relation to HbA1c testing: high occurrence of Hb Athens-Georgia in the Northern Jutland, Denmark
- Eltrombopag interferes with the measurement of plasma total bilirubin in pediatric patients in an automated colorimetric method
- A challenging case: highly variable TSH in a mother and her two children
- Suppressing all test results in grossly hemolyzed samples: is this approach appropriate in every case?
- Prozone effect observed for heavy chain α in the serum immunofixation electrophoresis of a patient with monoclonal IgA-λ gammopathy
- Significant allelic dropout phenomenon of Oncomine BRCA Research Assay on Ion Torrent S5
- Evaluation of immature platelet fraction in patients with myelodysplastic syndromes. Association with poor prognosis factors
- Influence of temperature of transport of whole blood on plasma Cu, I, Mn, Se and Zn and Mg concentrations in erythrocytes
- Absorbent materials to collect urine can affect proteomics and metabolomic biomarker concentrations
Artikel in diesem Heft
- Frontmatter
- Obituary
- Professor Howard A. Morris
- Editorial
- The silk road to total quality in Laboratory Medicine
- Reviews
- Moving average quality control: principles, practical application and future perspectives
- Serum α-fetoprotein in pediatric oncology: not a children’s tale
- Mini Review
- Value-based healthcare: the role of laboratory medicine
- Opinion Paper
- Advantages and limitations of total laboratory automation: a personal overview
- General Clinical Chemistry and Laboratory Medicine
- Analysis and evaluation of the external quality assessment results of quality indicators in laboratory medicine all over China from 2015 to 2018
- A pilot study for establishing quality indicators in molecular diagnostics according to the IFCC WG-LEPS initiative: preliminary findings in China
- Quality assessment of interpretative commenting and competency comparison of comment providers in China
- Lower creatinine concentration values and lower inter-laboratory variation among Swedish hospital laboratories in 2014 compared to 1996: results from the Equalis external quality assessment program
- Development of the Point-of-Care Key Evidence Tool (POCKET): a checklist for multi-dimensional evidence generation in point-of-care tests
- Analytical and clinical performance evaluation of two POC tests for therapeutic drug monitoring of infliximab
- Hematology and Coagulation
- Provisional standardization of hepcidin assays: creating a traceability chain with a primary reference material, candidate reference method and a commutable secondary reference material
- Danger of false negative (exclusion) or false positive (diagnosis) for ‘congenital thrombophilia’ in the age of anticoagulants
- Point-of-care haemostasis monitoring during liver transplantation is cost effective
- Reference Values and Biological Variations
- Evaluation of reference intervals of haematological and biochemical markers in an Austrian adolescent study cohort
- Cancer Diagnostics
- A novel machine learning-derived decision tree including uPA/PAI-1 for breast cancer care
- Cardiovascular Diseases
- Evaluation of analytical performances using standardized analytical protocols and comparison of clinical results of the new ADVIA BNP and NT-proBNP immunoassays for the Centaur XPT platform
- Infectious Diseases
- Improvement in detecting sepsis using leukocyte cell population data (CPD)
- Letters to the Editor
- The biological variation of plasma proenkephalin: data from a stable heart failure cohort
- Hemoglobin variants found in relation to HbA1c testing: high occurrence of Hb Athens-Georgia in the Northern Jutland, Denmark
- Eltrombopag interferes with the measurement of plasma total bilirubin in pediatric patients in an automated colorimetric method
- A challenging case: highly variable TSH in a mother and her two children
- Suppressing all test results in grossly hemolyzed samples: is this approach appropriate in every case?
- Prozone effect observed for heavy chain α in the serum immunofixation electrophoresis of a patient with monoclonal IgA-λ gammopathy
- Significant allelic dropout phenomenon of Oncomine BRCA Research Assay on Ion Torrent S5
- Evaluation of immature platelet fraction in patients with myelodysplastic syndromes. Association with poor prognosis factors
- Influence of temperature of transport of whole blood on plasma Cu, I, Mn, Se and Zn and Mg concentrations in erythrocytes
- Absorbent materials to collect urine can affect proteomics and metabolomic biomarker concentrations