Determination of 21-hydroxylase autoantibodies: inter-laboratory concordance in the Euradrenal International Serum Exchange Program
-
Alberto Falorni
, Vittorio Bini
, Corrado Betterle , Annalisa Brozzetti , Luis Castaño , Marta Fichna , Olle Kämpe , Gunnar Mellgren , Pärt Peterson , Shu Chen , Johan Rönnelid , Jochen Seissler , Claudio Tiberti , Raivo Uibo , Liping Yu , Åke Lernmark and Eystein Husebye
Abstract
Background: 21-Hydroxylase autoantibodies (21OHAb) are markers of an adrenal autoimmune process that identifies individuals with autoimmune Addison’s disease (AAD). Quality and inter-laboratory agreement of various 21OHAb tests are incompletely known. The objective of the study was to determine inter-laboratory concordance for 21OHAb determinations.
Methods: Sixty-nine sera from 51 patients with AAD and 51 sera from 51 healthy subjects were blindly coded by a randomization center and distributed to 14 laboratories that determined 21OHAb, either by an “in-house” assay (n=9) using in vitro-translated 35S-21OH or luciferase-labeled 21OH or a commercial kit with 125I-21OH (n=5). Main outcome measures were diagnostic accuracy of each participating laboratory and inter-laboratory agreement of 21OHAb assays.
Results: Intra-assay coefficient of variation ranged from 2.6% to 5.3% for laboratories using the commercial kit and from 5.1% to 23% for laboratories using “in-house” assays. Diagnostic accuracy, expressed as area under ROC curve (AUC), varied from 0.625 to 0.947 with the commercial kit and from 0.562 to 0.978 with “in-house” methods. Cohen’s κ of inter-rater agreement was 0.603 among all 14 laboratories, 0.691 among “in-house” laboratories, and 0.502 among commercial kit users. Optimized cutoff levels, calculated on the basis of AUCs, increased the diagnostic accuracy of every laboratory (AUC >0.9 for 11/14 laboratories) and increased the Cohen’s κ of inter-rater agreement. Discrepancies in quantitation of 21OHAb levels among different laboratories increased with increasing autoantibody levels.
Conclusions: The quality of 21OHAb analytical procedures is mainly influenced by selection of cutoff value and correct handling of assay materials. A standardization program is needed to identify common standard sera and common measuring units.
Acknowledgments
A.F. is chairing a Sub-Committee on Organ-Specific Autoantibodies of the IUIS Committee on Quality Assessment and Standardization (www.iuisonline.org) and received an unconditioned support from IUIS. We wish to thank Jose Ramón Bilbao, Åsa Hallgren, Hege Hoff Skavøy, Kai Kisand, Belinda Lind, Dongmei Miao, Maire Pihlap, Bernard Rees-Smith, Koit Reimand, and Ingrid Wigheden for valuable discussion and technical help.
Author contributions: All the authors have accepted responsibility for the entire content of this submitted manuscript and approved submission.
Financial support: The study was supported by EU FP7 (grant number 201167), Euradrenal, and in part by NIH grant DK32083.
Disclosure statement: RSR Ltd is a manufacturer of medical diagnostics including kits for 21OH autoantibodies.
Employment or leadership: None declared.
Honorarium: None declared.
Competing interests: The funding organization(s) played no role in the study design; in the collection, analysis, and interpretation of data; in the writing of the report; or in the decision to submit the report for publication.
References
1. Winqvist O, Karlsson FA, Kämpe O. 21-Hydroxylase, a major autoantigen in idiopathic Addison’s disease. Lancet 1992;339:1559–62.10.1016/0140-6736(92)91829-WSearch in Google Scholar
2. Husebye ES, Allolio B, Arlt W, Badenhoop K, Bensing S, Betterle C, et al. Consensus statement on the diagnosis, treatment and follow-up of patients with primary adrenal insufficiency. J Internal Medicine 2014;275:104–15.10.1111/joim.12162Search in Google Scholar
3. Arlt W. The approach to the adult with newly diagnosed adrenal insufficiency. J Clin Endocrinol Metab 2009;94:1059–67.10.1210/jc.2009-0032Search in Google Scholar
4. Falorni A, Laureti S, De Bellis A, Zanchetta R, Tiberti C, Arnaldi G, et al. Italian Addison Network Study: update of diagnostic criteria for the etiological classification of primary adrenal insufficiency. J Clin Endocrinol Metab 2004;89:1598–604.10.1210/jc.2003-030954Search in Google Scholar
5. Falorni A, Laureti S, Candeloro P, Perrino S, Coronella C, Bizzarro A, et al. Steroid-cell autoantibodies are preferentially expressed in women with premature ovarian failure who have adrenal autoimmunity. Fertil Steril 2002;78:270–9.10.1016/S0015-0282(02)03205-3Search in Google Scholar
6. Dal Pra C, Chen S, Furmaniak J, Smith BR, Pedini B, Moscon A, et al. Autoantibodies to steroidogenic enzymes in patients with premature ovarian failure with and without Addison’s disease. Eur J Endocrinol 2003;148:565–70.10.1530/eje.0.1480565Search in Google Scholar PubMed
7. Bakalov VK, Anasti JN, Calis KA, Vanderhoof VH, Premkumar A, Chen S, et al. Autoimmune oophoritis as a mechanism of follicular dysfunction in women with 46,XX spontaneous premature ovarian failure. Fertil Steril 2005;84:958–65.10.1016/j.fertnstert.2005.04.060Search in Google Scholar PubMed
8. La Marca A, Brozzetti A, Sighinolfi G, Marzotti S, Volpe A, Falorni A. Primary ovarian insufficiency: autoimmune causes. Curr Opin Obstet Gynecol 2010;22:277–82.10.1097/GCO.0b013e32833b6c70Search in Google Scholar PubMed
9. Tanaka H, Perez MS, Powell M, Sanders JF, Sawicka J, Chen S, et al. Steroid 21-hydroxylase autoantibodies: measurements with a new immunoprecipitation assay. J Clin Endocrinol Metab 1997;82:1440–6.10.1210/jc.82.5.1440Search in Google Scholar
10. Falorni A, Nikoshkov A, Laureti S, Grenbäck E, Hulting AL, Casucci G, et al. High diagnostic accuracy for idiopathic Addison’s disease with a sensitive radiobinding assay for autoantibodies against recombinant human 21-hydroxylase. J Clin Endocrinol Metab 1995;80:2752–5.Search in Google Scholar
11. Colls J, Betterle C, Volpato M, Prentice L, Smith BR, Furmaniak J. Immunoprecipitation assay for autoantibodies to steroid 21-hydroxylase in autoimmune adrenal diseases. Clin Chem 1995;41:375–80.10.1093/clinchem/41.3.375Search in Google Scholar
12. Falorni A, Chen S, Zanchetta R, Yu L, Tiberti C, Bacosi ML, et al. Measuring adrenal autoantibody response: interlaboratory concordance in the first international serum exchange for the determination of 21-hydroxylase autoantibodies. Clin Immunol 2011;140:291–9.10.1016/j.clim.2011.04.012Search in Google Scholar PubMed
13. Laureti S, De Bellis A, Muccitelli VI, Calcinaro F, Bizzarro A, Rossi R, et al. Levels of adrenocortical autoantibodies correlate with the degree of adrenal dysfunction in subjects with preclinical Addison’s disease. J Clin Endocrinol Metab 1998;83:3507–11.10.1210/jc.83.10.3507Search in Google Scholar
14. Coco G, Dal Pra C, Presotto F, Albergoni MP, Canova C, Pedini B, et al. Estimated risk for developing autoimmune Addison’s disease in patients with adrenal cortex autoantibodies. J Clin Endocrinol Metab 2006;91:1637–45.10.1210/jc.2005-0860Search in Google Scholar PubMed
15. Nomura K, Depura H, Saruta T. Addison’s disease in Japan: characteristics and changes revealed in a nationwide survey. Intern Med 1994;33:602–6.10.2169/internalmedicine.33.602Search in Google Scholar PubMed
16. do Carmo Silva R, Kater CE, Dib SA, Laureti S, Forini F, Cosentino A, et al. Autoantibodies against recombinant human steroidogenic enzyme 21-hydroxylase, side-chain cleavage and 17α-hydroxylase in Addison’s disease and autoimmune polyendocrine syndrome type III. Eur J Endocrinol 2000;142:187–94.10.1530/eje.0.1420187Search in Google Scholar PubMed
17. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982;143:29–36.10.1148/radiology.143.1.7063747Search in Google Scholar PubMed
18. Fichna M, Fichna P, Gryczyńska M, Walkowiak J, Zurawek M, Sowiński J. Screening for associated autoimmune disorders in Polish patients with Addison’s disease. Endocrine 2010;37:349–60.10.1007/s12020-010-9312-xSearch in Google Scholar PubMed
19. Seissler J, Schott M, Steinbrenner H, Peterson P, Scherbaum WA. Autoantibodies to adrenal cytochrome P450 antigens in isolated Addison’s disease and autoimmune polyendocrine syndrome type II. Exp Clin Endocrinol Diabetes 1999;107:208–213.10.1055/s-0029-1212100Search in Google Scholar PubMed
20. Peterson P, Uibo R, Peränen J, Krohn K. Immunoprecipitation of steroidogenic enzyme autoantigens with autoimmune polyglandular syndrome type I (APS I) sera; further evidence for independent humoral immunity to P450c17 and P450c21. Clin Exp Immunol 1997;107:335–40.10.1111/j.1365-2249.1997.282-ce1175.xSearch in Google Scholar PubMed PubMed Central
21. Yu L, Brewer KW, Gates S, Wu A, Wang T, Babu SR, et al. DRB1*04 and DQ alleles: expression of 21-hydroxylase autoantibodies and risk of progression to Addison’s disease. J Clin Endocrinol Metab 1999;84:328–35.Search in Google Scholar
22. Myhre AG, Undlien DE, Løvås K, Uhlving S, Nedrebø BG, Fougner KJ, et al. Autoimmune adrenocortical failure in Norway autoantibodies and human leukocyte antigen class II associations related to clinical features. J Clin Endocrinol Metab 2002;87:618–23.10.1210/jcem.87.2.8192Search in Google Scholar PubMed
23. Söderbergh A, Myhre AG, Ekwall O, Gebre-Medhin G, Hedstrand H, Landgren E, et al. Prevalence and clinical associations of 10 defined autoantibodies in autoimmune polyendocrine syndrome type I. J Clin Endocrinol Metab 2004;89:557–62.10.1210/jc.2003-030279Search in Google Scholar PubMed
24. Burbelo PD, Goldman R, Mattson TL. A simplified immunoprecipitation method for quantitatively measuring antibody responses in clinical sera samples by using mammalian-produced Renilla luciferase-antigen fusion proteins. BMC Biotechnol 2005;5:22.10.1186/1472-6750-5-22Search in Google Scholar PubMed PubMed Central
25. Warrens JM. Inequalities between multi-rater kappas. Adv Data Anal Classif 2010;4:271–86.10.1007/s11634-010-0073-4Search in Google Scholar
26. Cantor SB, Kattan MW. Determining the area under the ROC curve for a binary diagnostic test. Med Decis Making 2000;20:468–70.10.1177/0272989X0002000410Search in Google Scholar PubMed
27. Hanley JA, McNeil BJ. A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology 1983;148:839–43.10.1148/radiology.148.3.6878708Search in Google Scholar PubMed
28. Robin X, Turck N, Hainard A, Tiberti N, Lisacek F, Sanchez JC, et al. pROC: an open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics 2011;12:77.10.1186/1471-2105-12-77Search in Google Scholar PubMed PubMed Central
29. Altman DG. Practical statistics for medical research. Chapman & Hall: London, 1995:403–9.Search in Google Scholar
30. Fleiss JL, Cuzick J. The reliability of dichotomous judgements: unequal numbers of judges per subject. Appl Psychol Meas 1979;3:537–42.10.1177/014662167900300410Search in Google Scholar
31. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;33:159–74.10.2307/2529310Search in Google Scholar
32. Verge CF, Stenger D, Bonifacio E, Colman PG, Pilcher C, Bingley PJ, et al. Combined use of autoantibodies (IA-2 autoantibody, GAD autoantibody, insulin autoantibody, cytoplasmic islet cell antibodies) in type 1 diabetes: Combinatorial Islet Autoantibody Workshop. Diabetes 1998;47:1857–66.10.2337/diabetes.47.12.1857Search in Google Scholar PubMed
33. Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull 1979;86:420–7.10.1037/0033-2909.86.2.420Search in Google Scholar
34. Falorni A, Minarelli V, Morelli S. Therapy of adrenal insufficiency: an update. Endocrine 2013;43:514–28.10.1007/s12020-012-9835-4Search in Google Scholar PubMed
35. Betterle C, Scarpa R, Garelli S, Morlin L, Lazzarotto F, Presotto F, et al. Addison’s disease: a survey of 633 patients in Padova. Eur J Endocrinol 2013;169:773–84.10.1530/EJE-13-0528Search in Google Scholar PubMed
36. Falorni A, Brozzetti A, Calcinaro F, Marzotti S, Santeusanio F. Recent advances in adrenal autoimmunity. Exp Rev Clin Endocrinol Metab 2009;4:333–48.10.1586/eem.09.20Search in Google Scholar PubMed
Supplemental Material:
The online version of this article (DOI: 10.1515/cclm-2014-1106) offers supplementary material, available to authorized users.
©2015 by De Gruyter
Articles in the same Issue
- Frontmatter
- Editorials
- Laboratory medicine does matter in science (and medicine)… yet many seem to ignore it
- The standardization of the urine albumin assays: no longer deferrable
- Reviews
- The role of telomeres and vitamin D in cellular aging and age-related diseases
- Atypical hemolytic uremic syndrome: from diagnosis to treatment
- Clinical relevance and contemporary methods for counting blood cells in body fluids suspected of inflammatory disease
- EFLM Opinion Paper
- How to assess the quality of your analytical method?
- Genetics and Molecular Diagnostics
- Validation of CFTR intronic variants identified during cystic fibrosis population screening by a minigene splicing assay
- General Clinical Chemistry and Laboratory Medicine
- Uncertainty in measurement for 43 biochemistry, immunoassay, and hemostasis routine analytes evaluated by a method using only external quality assessment data
- A study examining the bias of albumin and albumin/creatinine ratio measurements in urine
- National survey on appropriateness of clinical biochemistry reporting in China
- Potentiometric measurement of urinary iodine concentration in patients with thyroid diseases with and without previous exposure to non-radioactive iodine
- Determination of 21-hydroxylase autoantibodies: inter-laboratory concordance in the Euradrenal International Serum Exchange Program
- Value of a commercial kit for detecting anti-C1q autoantibodies and correlation with immunological and clinical activity of lupus nephritis
- Comparison of the bead-based simultaneous analysis of specific platelet antibodies assay (SASPA) and Pak Lx Luminex technology with the monoclonal antibody immobilization of platelet antigens assay (MAIPA) to detect platelet alloantibodies
- Measurement of the inflammatory response in the early postoperative period after hip and knee arthroplasty
- Whole blood thromboelastometry profiles in women with preeclampsia
- Increased plasma soluble urokinase plasminogen activator receptor levels in systemic sclerosis: possible association with microvascular abnormalities and extent of fibrosis
- Reference Values and Biological Variations
- Reference ranges of serum bile acids in children and adolescents
- Infectious Diseases
- Elevated circulating ghrelin, but not peptide YY(3-36) levels, in term neonates with infection
- Cardiovascular Diseases
- Head-to-head comparison of 10 natriuretic peptide assays
- Prognostic role of BNP in children undergoing surgery for congenital heart disease: analysis of prediction models incorporating standard risk factors
- Elevations of inflammatory markers PTX3 and sST2 after resuscitation from cardiac arrest are associated with multiple organ dysfunction syndrome and early death
- Identification of molecular species of oxidized triglyceride in plasma and its distribution in lipoproteins
- A new formula for estimation of low-density lipoprotein cholesterol in an ethnic Chinese population
- Letter to the Editors
- Laboratory medicine: let’s say it is the mirror of science (and medicine)
- The economic burden of hemolysis
- Acute effects of conventional and extended hemodialysis and hemodiafiltration on high-sensitivity cardiac troponins
- Cuvette carryover with the gentamicin assay on the Beckman AU480 analyser
- Comparison study of two commercially available methods for the determination of golimumab and anti-golimumab antibody levels in patients with rheumatic diseases
- Automated alkaline-pH electrophoresis followed by densitometry does not correlate with cation-exchange (CE)-HPLC in quantification of HbA2 and variant hemoglobins
- Progression from light chain myeloma to secondary plasma cell leukemia accompanied by peripheral blood eosinophilia
- Harmonization of results has not been fully achieved for serum immunoglobulin measurements
- The risk of macrovascular complications in subjects genotyped for common IL-6 gene and TNF-α gene variants
- Comparison of nucleated red blood cell count with four commercial hematological analyzers
- Reply to: The risk of macrovascular complications in subjects genotyped for common IL-6 gene and TNF-α gene variants
- Congress Abstracts
- Congress of Clinical Chemistry and Laboratory Medicine
- 47th National Congress of the Italian Society of Clinical Biochemistry and Clinical Molecular Biology (SIBioC – Laboratory Medicine)
- 15th EFLM Continuous Postgraduate Course in Clinical Chemistry and Laboratory Medicine
Articles in the same Issue
- Frontmatter
- Editorials
- Laboratory medicine does matter in science (and medicine)… yet many seem to ignore it
- The standardization of the urine albumin assays: no longer deferrable
- Reviews
- The role of telomeres and vitamin D in cellular aging and age-related diseases
- Atypical hemolytic uremic syndrome: from diagnosis to treatment
- Clinical relevance and contemporary methods for counting blood cells in body fluids suspected of inflammatory disease
- EFLM Opinion Paper
- How to assess the quality of your analytical method?
- Genetics and Molecular Diagnostics
- Validation of CFTR intronic variants identified during cystic fibrosis population screening by a minigene splicing assay
- General Clinical Chemistry and Laboratory Medicine
- Uncertainty in measurement for 43 biochemistry, immunoassay, and hemostasis routine analytes evaluated by a method using only external quality assessment data
- A study examining the bias of albumin and albumin/creatinine ratio measurements in urine
- National survey on appropriateness of clinical biochemistry reporting in China
- Potentiometric measurement of urinary iodine concentration in patients with thyroid diseases with and without previous exposure to non-radioactive iodine
- Determination of 21-hydroxylase autoantibodies: inter-laboratory concordance in the Euradrenal International Serum Exchange Program
- Value of a commercial kit for detecting anti-C1q autoantibodies and correlation with immunological and clinical activity of lupus nephritis
- Comparison of the bead-based simultaneous analysis of specific platelet antibodies assay (SASPA) and Pak Lx Luminex technology with the monoclonal antibody immobilization of platelet antigens assay (MAIPA) to detect platelet alloantibodies
- Measurement of the inflammatory response in the early postoperative period after hip and knee arthroplasty
- Whole blood thromboelastometry profiles in women with preeclampsia
- Increased plasma soluble urokinase plasminogen activator receptor levels in systemic sclerosis: possible association with microvascular abnormalities and extent of fibrosis
- Reference Values and Biological Variations
- Reference ranges of serum bile acids in children and adolescents
- Infectious Diseases
- Elevated circulating ghrelin, but not peptide YY(3-36) levels, in term neonates with infection
- Cardiovascular Diseases
- Head-to-head comparison of 10 natriuretic peptide assays
- Prognostic role of BNP in children undergoing surgery for congenital heart disease: analysis of prediction models incorporating standard risk factors
- Elevations of inflammatory markers PTX3 and sST2 after resuscitation from cardiac arrest are associated with multiple organ dysfunction syndrome and early death
- Identification of molecular species of oxidized triglyceride in plasma and its distribution in lipoproteins
- A new formula for estimation of low-density lipoprotein cholesterol in an ethnic Chinese population
- Letter to the Editors
- Laboratory medicine: let’s say it is the mirror of science (and medicine)
- The economic burden of hemolysis
- Acute effects of conventional and extended hemodialysis and hemodiafiltration on high-sensitivity cardiac troponins
- Cuvette carryover with the gentamicin assay on the Beckman AU480 analyser
- Comparison study of two commercially available methods for the determination of golimumab and anti-golimumab antibody levels in patients with rheumatic diseases
- Automated alkaline-pH electrophoresis followed by densitometry does not correlate with cation-exchange (CE)-HPLC in quantification of HbA2 and variant hemoglobins
- Progression from light chain myeloma to secondary plasma cell leukemia accompanied by peripheral blood eosinophilia
- Harmonization of results has not been fully achieved for serum immunoglobulin measurements
- The risk of macrovascular complications in subjects genotyped for common IL-6 gene and TNF-α gene variants
- Comparison of nucleated red blood cell count with four commercial hematological analyzers
- Reply to: The risk of macrovascular complications in subjects genotyped for common IL-6 gene and TNF-α gene variants
- Congress Abstracts
- Congress of Clinical Chemistry and Laboratory Medicine
- 47th National Congress of the Italian Society of Clinical Biochemistry and Clinical Molecular Biology (SIBioC – Laboratory Medicine)
- 15th EFLM Continuous Postgraduate Course in Clinical Chemistry and Laboratory Medicine