Home Evaluation of an ELISA for SARS-CoV-2 antibody testing: clinical performances and correlation with plaque reduction neutralization titer
Article Open Access

Evaluation of an ELISA for SARS-CoV-2 antibody testing: clinical performances and correlation with plaque reduction neutralization titer

  • Andrea Padoan ORCID logo , Francesco Bonfante , Laura Sciacovelli ORCID logo , Chiara Cosma , Daniela Basso and Mario Plebani ORCID logo EMAIL logo
Published/Copyright: August 10, 2020
Download Article (PDF)
Become an author with De Gruyter Brill
Submit Manuscript Author Information
Clinical Chemistry and Laboratory Medicine (CCLM)
From the journal Clinical Chemistry and Laboratory Medicine (CCLM) Volume 58 Issue 11

Keywords: antibodies; clinical performances; immunoassays; neutralization; SARS-CoV-2; serology

To the Editor,

The pandemic of coronavirus disease 2019 (COVID-19), caused by severe respiratory syndrome coronavirus 2 (SARS-CoV-2), continues to spread all around the world, with an exponential increase in the number of cases and deaths. An accurate and timely detection of SARS-CoV-2 is essential not only for diagnosing the infection, but also for establishing of infection control measures and preventing further contagions [1]. Although real-time reverse transcription polymerase chain reaction (rRT-PCR) using nasopharyngeal swabs is considered the reference method for diagnosis of acute SARS-CoV-2 infection, especially in asymptomatic and mildly symptomatic individuals, this technique is biased by several pre-analytical and analytical vulnerabilities [2]. Serological assays for SARS-CoV-2 are principally aimed to measure the antibody (Ab) response against the virus, thus allowing to estimate the prevalence of infection in a general population or in subpopulations of high-risk subjects (e.g., healthcare workers), as well as for screening potential convalescent donors and for complementing nucleic acid amplification tests (NAATs) in patients with indefinite results [3]. Both laboratory-based (chemiluminescent [CLIA] and enzyme-linked immunosorbent assays [ELISA]) and point-of-care tests (lateral flow assays [LFA]) are performed using recombinant antigens, typically encompassing the spike protein and/or its receptor binding domain (RBD), or the viral nucleoprotein (N) [4]. The purpose of this study was to evaluate an ELISA (ENZY-WELL SARS-CoV-2) detecting specific anti-SARS-CoV-2 IgM, IgA, and IgG antibodies based on native antigen obtained from Vero E6 cells infected with SARS-Cov-2, strain “2019-nCoV/Italy-INMI1” and developed by Diesse Diagnostica Senese [5]. According to the manufacturer’s claims, imprecision and repeatability vary between 2.6 and 14.7% for all antibodies (IgA, IgM, and IgG) across a media index ranging from 0.5 to 1.9.

A total of 233 leftover serum samples from 152 COVID-19 patients (nine asymptomatic/mildly symptomatic, who recovered at home with supportive care and isolation, and 143 hospitalized, classified with moderate or severe disease following WHO interim guidance [6]), 81 SARS-CoV-2 negative subjects (60 healthcare workers, 13 autoimmune patients, eight pregnant women) were included in the study. All subjects underwent nasopharyngeal swab testing, analyzed by rRT-PCR as described elsewhere [7]. Briefly, RNA was extracted using an automated platform (Magna Pure 96 Instrument, Roche Diagnostics, USA) and then used for rRT-PCR, which was performed in separate reactions with SARS-CoV-2 gene E and RNaseP analyses by ABI prism® AB 7900 or 7900HT or QuantStudio™ 5 real-time PCR Systems (Applied Biosystems, USA). The threshold cycle (Ct) of SARS-CoV-2 gene E and of RNaseP was obtained after standardization of the rRT-PCR instruments software settings as follows: baseline calculated in the cycle range 3–15; fixed threshold at 0.2. Healthcare workers were considered negative (Neg-HW) on the basis of at least three negative sequential rRT-PCR results obtained between February 26th and May 29th, 2020. For SARS-CoV-2 positive patients, the median time from symptoms onset and sample collection was 24 days (interquartile range [IQR], 14–29 days; overall range 4–93 days). For a subgroup of 52 samples collected from SARS-CoV-2 positive subjects, plaque reduction neutralization test (PRNT) was also performed, according to a slightly modified protocol from Suthar et al. [8]. In this assay, neutralization titer was defined as reciprocal of the highest dilution resulting in a reduction of the control plaque count >50% (PRNT50). Stata v 16.1 (StataCorp, LakeWay Drive, TX) was used for the statistical analyses. The study protocol (number 23307) was approved by the Ethics Committee of the University-Hospital of Padova (Padova, Italy).

The diagnostic performance of ENZY-WELL SARS-CoV-2, evaluated by calculating the area under the receiver operating characteristics curve (AUC) over the entire study period (overall data), revealed comparable results for IgA (AUC 0.935 [95%CI: 0.904–0.967]), IgM (AUC 0.921 [95%CI: 0.887–0.954]) and IgG (AUC 0.942 [95%CI: 0.911–0.972]). Overlapping confidence intervals indicated that AUC results were not significantly different. Diagnostic sensitivity and specificity were then assessed on the overall data, in two period (<12 days and ≥12 days) and with two different cut-offs, as shown in Table 1. Specificity was found to be optimal for all immunoglobulin classes assays and for each period, being always >96%. The lowest sensitivity was found for IgMs <12 days, whilst the highest sensitivity was observed for IgGs ≥12 days. Positive and negative likelihood ratios were also calculated, and the best results were found for IgG. According to Colavita et al., performance significantly varies considering the two period <12 days and ≥12 days, especially for IgM and IgG [5]. This is expected, since several studies demonstrated that, although immunoglobulin rise could be considered significant from 6–7 days after symptom onset, the vast majority of patients had positive IgGs after day 11th [9], [10]. As concerns the neutralization PRNT50 values, the highest correlation was found with IgMs (rho = 0.732; p<0.001), followed by IgG (rho = 0.541; p<0.001) and IgA (rho = 0.480; p<0.001). These results are in keeping with data published by Perera et al., who also showed highly significant correlation between PRNT50 and IgM ELISA results [11].

Table 1:

Clinical performances of ENZY-WELL SARS-CoV-2 IgA, IgM and IgG, obtained using 1.1 Signal/Cut-off index (S/CO) (claimed by manufacture’s insert) and 0.8 S/CO as thresholds.

Assay Threshold Time-frame Sensitivitya (95% CI) Specificitya (95% CI) PLR (95% CI) NLR (95% CI)
SARS-CoV-2 IgA 1.1 S/CO <12 d 45.2 (27.3–64.0) 98.8 (93.3–100.0) 36.6 (5.0–266.6) 0.56 (0.40–0.76)
≥12 d 79.2 (71.0–85.9) 64.1 (9.1–450.9) 0.21 (0.15–0.30)
Overall 73.0 (65.2–79.9) 59.1 (8.4–415.8) 0.27 (0.21–0.36)
0.8 S/CO <12 d 64.5 (45.4–80.8) 96.3 (89.6–99.2) 17.4 (5.6–54.5) 0.37 (0.23–0.59)
≥ 12 d 86.4 (79.1–91.9) 23.3 (7.7–71.0) 0.14 (0.09–0.22)
Overall 82.2 (75.2–88.0) 22.2 (7.3–67.6) 0.18 (0.13–0.26)
SARS-CoV-2 IgM 1.1 S/CO <12 d 25.8 (11.9–44.6) 98.8 (93.3–100.0) 20.9 (2.7–160.3) 0.75 (0.61–0.93)
≥12 d 56.0 (46.8–64.9) 45.3 (6.4–320.1) 0.45 (0.37–0.54)
Overall 50.7 (42.4–58.9) 41.0 (5.8–289.6) 0.50 (0.42–0.59)
0.8 S/CO <12 d 25.8 (11.9–44.6) 97.5 (91.4–99.7) 10.4 (2.3–46.5) 0.76 (0.62–0.94)
≥12 d 75.2 (66.7–82.5) 30.5 (7.7–120.1) 0.25 (0.19–0.35)
Overall 66.4 (58.3–73.9) 26.9 (6.8–106.3) 0.34 (0.27–0.43)
SARS-CoV-2 IgG 1.1 S/CO <12 d 48.4 (30.2–66.9) 100.0 (95.5–100.0) 79.4 (4.9–288.6) 0.52 (0.37–0.73)
≥12 d 93.6 (87.8–97.2) 152.9 (9.6–2425.4) 0.07 (0.04–0.13)
Overall 84.2 (77.4–89.6) 137.7 (8.7–2185.4) 0.16 (0.11–0.23)
0.8 S/CO <12 d 54.8 (36.0–72.7) 100.0 (95.5–100.0) 89.7 (5.6–1447.5) 0.46 (0.31–0.67)
≥12 d 95.2 (89.8–98.2) 155.5 (9.8–2466.5) 0.05 (0.02–0.11)
Overall 86.8 (80.4–91.8) 142.0 (8.9–2253.1) 0.13 (0.09–0.20)

  1. PLR, positive likelihood ratio; NLR, negative likelihood ratio; d, days. Subjects included in the analyses: Overall, n=233; time frame <12 d, n=112 (31 positive and 81 negative to SARS-CoV-2 rRT-PCT); time frame ≥ 12 d, n=206 (125 positive and 81 negative to SARS-CoV-2 rRT-PCR). aSensitivities and specificities values are expressed as percentages.

For an additional series of seven SARS-CoV-2 positive patients with severe/moderate disease, time kinetics of IgAs, IgMs, and IgGs were evaluated. Up to five repeated samples were available for these patients (n=4 for one and n=5 for six patients), collected in a period of time ranging between 4 and 24 days (Figure 1). Although comparable findings were found for the kinetics of IgAs and IgGs, evidence suggests that IgAs responds seemingly earlier than IgGs in moderate/severe SARS-CoV-2 patients (Figure 1). These findings are aligned with those previously published by our group, using a different immunoassay [10]. Notably, IgM titers appeared lower compared to those of IgA and IgG values. Moreover, IgM titer remained below 1.1 S/CO (i.e., manufacturer’s cut-off) in two of seven patients.

Figure 1: Spaghetti plot of IgA, IgM, and IgG levels of the seven patients with up to five serial antibody determinations after the onset of symptoms. Dotted lines showed the manufacturer’s cut-off (1.1 S/CO).
Figure 1:

Spaghetti plot of IgA, IgM, and IgG levels of the seven patients with up to five serial antibody determinations after the onset of symptoms.

Dotted lines showed the manufacturer’s cut-off (1.1 S/CO).

In conclusion, ENZY-WELL SARS-CoV-2 immunoassay displayed excellent performance, especially for the IgGs, showing high sensitivity (lower 95% confidence interval >89%) and specificity (lower 95% confidence interval >95%). Neutralization titers were instead strongly correlated with IgM assays values. These results might be attributable to the assay design, and the use of native antigen, obtained from Vero E6 cells infected with the SARS-Cov-2, strain “2019-nCoV/Italy-INMI1”. Finally, time kinetics suggests that a detectable IgA immune response may develop early during the infection, though the clinical role of this class of antibodies requires further scrutiny.

Corresponding author: Prof. Mario Plebani, MD, Department of Medicine-DIMED, Medical School, University of Padova, Padova, Italy; and Department of Laboratory Medicine, University-Hospital of Padova, Via Giustiniani 2, 35128, Padova, Italy. Phone: +39 0498212792, E-mail:

  1. Research funding: None declared.

  2. Author contributions: All authors have accepted responsibility for the entire content of this manuscript and approved its submission.

  3. Competing interests: Authors state no conflict of interest.

  4. Ethical approval: The study protocol (number 23307) was approved by the Ethics Committee of the University-Hospital of Padova (Padova, Italy).

References

1. Bohn, MK, Lippi, G, Lippi, G, Horvath, A, Horvath, A, Sethi, S, et al. Molecular, serological, and biochemical diagnosis and monitoring of COVID-19: IFCC taskforce evaluation of the latest evidence. Clin Chem Lab Med 2020;58:1037–52. https://doi.org/10.1515/cclm-2020-0722.10.1515/cclm-2020-0722Search in Google Scholar PubMed

2. Lippi, G, Simundic, AM, Plebani, M. Potential preanalytical and analytical vulnerabilities in the laboratory diagnosis of coronavirus disease 2019 (COVID-19). Clin Chem Lab Med 2020;58:1070–6. https://doi.org/10.1515/cclm-2020-0285.10.1515/cclm-2020-0285Search in Google Scholar PubMed

3. Krammer, F, Simon, V. Serology assays to manage COVID-19. Science 2020;368:1060–1. https://doi.org/10.1126/science.abc1227.10.1126/science.abc1227Search in Google Scholar PubMed

4. Plebani, M, Padoan, A, Negrini, D, Carpinteri, B, Sciacovelli, L. Diagnostic performances and thresholds: the key to harmonization in serological SARS-CoV-2 assays?. Clin Chim Acta 2020;509:1–7. https://doi.org/10.1016/j.cca.2020.05.050.10.1016/j.cca.2020.05.050Search in Google Scholar PubMed PubMed Central

5. Colavita, F, Brogi, A, Lapa, D, Bordi, L, Matusali, G, Meschi, S, et al. Evaluation of ELISA tests for the qualitative determination of IgG IgM and IgA to SARS-CoV-2. Medrxiv 2020. Available from: http://medrxiv.org/cgi/content/short/2020.05.24.20111682.Search in Google Scholar

6. World Health Organization. Clinical management of COVID-19, interim guidance; 2020. Available from: https://www.who.int/publications/i/item/clinical-management-of-covid-19.Search in Google Scholar

7. Basso, D, Aita, A, Navaglia, F, Franchin, E, Fioretto, P, Moz, S, et al. SARS-CoV-2 RNA identification in nasopharyngeal swabs: issues in pre-analytics. Clin Chem Lab Med 2020;58:1579-86.10.1515/cclm-2020-0749Search in Google Scholar PubMed

8. Suthar, MS, Zimmerman, M, Kauffman, R, Mantus, G, Linderman, S, Vanderheiden, A, et al. Rapid generation of neutralizing antibody responses in COVID-19 patients. MedRxiv 2020. https://doi.org/10.1101/2020.05.03.20084442.10.1016/j.xcrm.2020.100040Search in Google Scholar PubMed PubMed Central

9. Padoan, A, Cosma, C, Sciacovelli, L, Faggian, D, Plebani, M. Analytical performances of a chemiluminescence immunoassay for SARS-CoV-2 IgM/IgG and antibody kinetics. Clin Chem Lab Med 2020;58:1081–8. https://doi.org/10.1515/cclm-2020-0443.10.1515/cclm-2020-0443Search in Google Scholar PubMed

10. Padoan, A, Sciacovelli, L, Basso, D, Negrini, D, Zuin, S, Cosma, C, et al. IgA-Ab response to spike glycoprotein of SARS-CoV-2 in patients with COVID-19: a longitudinal study. Clin Chim Acta 2020;507:164–6. https://doi.org/10.1016/j.cca.2020.04.026.10.1016/j.cca.2020.04.026Search in Google Scholar PubMed PubMed Central

11. Perera, RAPM, Mok, CKP, Tsang, OTY, Lv, H, Ko, RLW, Wu, NC, et al. Serological assays for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Euro Surveill 2020;25:2000421. https://doi.org/10.2807/1560-7917.es.2020.25.16.2000421.10.2807/1560-7917.ES.2020.25.16.2000421Search in Google Scholar PubMed PubMed Central

Received: 2020-07-16
Accepted: 2020-07-20
Published Online: 2020-08-10
Published in Print: 2020-10-25

© 2020 Andrea Padoan et al., published by De Gruyter, Berlin/Boston

This work is licensed under the Creative Commons Attribution 4.0 International License.

Articles in the same Issue

  1. Frontmatter
  2. Editorial
  3. Biotin interference in cardiac troponin immunoassay – where the wild things are?
  4. Review
  5. Laboratory-related issues in the measurement of cardiac troponins with highly sensitive assays
  6. Mini Review
  7. Chromatographic methods development for clinical practice: requirements and limitations
  8. Opinion Paper
  9. Harmonising EQA schemes the next frontier: challenging the status quo
  10. Genetics and Molecular Diagnostics
  11. Direct comparison study between droplet digital PCR and a combination of allele-specific PCR, asymmetric rapid PCR and melting curve analysis for the detection of BRAF V600E mutation in plasma from melanoma patients
  12. A novel mitochondrial m.14430A>G (MT-ND6, p.W82R) variant causes complex I deficiency and mitochondrial Leigh syndrome
  13. Obesity status modifies the association between rs7556897T>C in the intergenic region SLC19A3-CCL20 and blood pressure in French children
  14. General Clinical Chemistry and Laboratory Medicine
  15. Influence of reagent lots and multiple measuring systems on estimating the coefficient of variation from quality control data; implications for uncertainty estimation and interpretation of QC results
  16. Electrophoretic α1-globulin for screening of α1-antitrypsin deficient variants
  17. A continued method performance monitoring approach for the determination of pediatric renin samples – application within a European clinical trial
  18. Pilot study for cystic fibrosis neonatal screening: the Cuban experience
  19. Validation of the analytical performance of the NOVEOS™ System, a system which improves upon the third-generation in vitro allergy testing technology
  20. IgE cross-reactivity measurement of cashew nut, hazelnut and peanut using a novel IMMULITE inhibition method
  21. Sexual dimorphism in the cerebrospinal fluid total protein content
  22. Current state of the morphological assessment of urinary erythrocytes in The Netherlands: a nation-wide questionnaire
  23. Reference Values and Biological Variations
  24. Within-subject and between-subject biological variation of first morning void urine amino acids in 12 healthy subjects
  25. Proenkephalin as a new biomarker for pediatric acute kidney injury – reference values and performance in children under one year of age
  26. Hematology and Coagulation
  27. Quality performance for indirect Xa inhibitor monitoring in patients using international external quality data
  28. Cardiovascular Diseases
  29. Clinical risk assessment of biotin interference with a high-sensitivity cardiac troponin T assay
  30. Short- and long-term biological variation of cardiac troponin I in healthy individuals, and patients with end-stage renal failure requiring haemodialysis or cardiomyopathy
  31. Infectious Diseases
  32. Monocyte distribution width (MDW) as a screening tool for sepsis in the Emergency Department
  33. Performance of a Toxo IgM prototype assay for the diagnosis of maternal and congenital Toxoplasma infections
  34. Letters to the Editors
  35. Evaluation of an ELISA for SARS-CoV-2 antibody testing: clinical performances and correlation with plaque reduction neutralization titer
  36. Preliminary evaluation of Roche Cobas Elecsys Anti-SARS-CoV-2 chemiluminescence immunoassay
  37. Hypoalbuminemia and elevated D-dimer in COVID-19 patients: a call for result harmonization
  38. Total pathway to method validation
  39. Derivation of performance specifications for uncertainty of serum C-reactive protein measurement according to the Milan model 3 (state of the art)
  40. FGF23 measurement in burosumab-treated patients: an emerging treatment may induce a new analytical interference
  41. Use of a modified IDS-ISYS intact PTH assay for intraoperative PTH measurements
  42. Agreement of dried blood spot lyso-Gb3 concentrations obtained from different laboratories in patients with Fabry disease
  43. Influence of delayed separation of plasma from whole blood and centrifugation protocol on Zn plasma concentration
  44. A survey of order of draw on inpatient wards and adherence to EFLM-COLABIOCLI recommendations
  45. Successful implementations of automated minimum re-test intervals to overcome ferritin over-requesting in a Spanish hospital laboratory
  46. Remarkable pseudoleucocytosis induced by mild cryoglobulinemia
  47. Massive hemolysis due to Clostridium perfringens: a laboratory’s perspective
https://doi.org/10.1515/cclm-2020-1096
Keywords for this article
antibodies; clinical performances; immunoassays; neutralization; SARS-CoV-2; serology
Creative Commons
BY 4.0

Articles in the same Issue

  1. Frontmatter
  2. Editorial
  3. Biotin interference in cardiac troponin immunoassay – where the wild things are?
  4. Review
  5. Laboratory-related issues in the measurement of cardiac troponins with highly sensitive assays
  6. Mini Review
  7. Chromatographic methods development for clinical practice: requirements and limitations
  8. Opinion Paper
  9. Harmonising EQA schemes the next frontier: challenging the status quo
  10. Genetics and Molecular Diagnostics
  11. Direct comparison study between droplet digital PCR and a combination of allele-specific PCR, asymmetric rapid PCR and melting curve analysis for the detection of BRAF V600E mutation in plasma from melanoma patients
  12. A novel mitochondrial m.14430A>G (MT-ND6, p.W82R) variant causes complex I deficiency and mitochondrial Leigh syndrome
  13. Obesity status modifies the association between rs7556897T>C in the intergenic region SLC19A3-CCL20 and blood pressure in French children
  14. General Clinical Chemistry and Laboratory Medicine
  15. Influence of reagent lots and multiple measuring systems on estimating the coefficient of variation from quality control data; implications for uncertainty estimation and interpretation of QC results
  16. Electrophoretic α1-globulin for screening of α1-antitrypsin deficient variants
  17. A continued method performance monitoring approach for the determination of pediatric renin samples – application within a European clinical trial
  18. Pilot study for cystic fibrosis neonatal screening: the Cuban experience
  19. Validation of the analytical performance of the NOVEOS™ System, a system which improves upon the third-generation in vitro allergy testing technology
  20. IgE cross-reactivity measurement of cashew nut, hazelnut and peanut using a novel IMMULITE inhibition method
  21. Sexual dimorphism in the cerebrospinal fluid total protein content
  22. Current state of the morphological assessment of urinary erythrocytes in The Netherlands: a nation-wide questionnaire
  23. Reference Values and Biological Variations
  24. Within-subject and between-subject biological variation of first morning void urine amino acids in 12 healthy subjects
  25. Proenkephalin as a new biomarker for pediatric acute kidney injury – reference values and performance in children under one year of age
  26. Hematology and Coagulation
  27. Quality performance for indirect Xa inhibitor monitoring in patients using international external quality data
  28. Cardiovascular Diseases
  29. Clinical risk assessment of biotin interference with a high-sensitivity cardiac troponin T assay
  30. Short- and long-term biological variation of cardiac troponin I in healthy individuals, and patients with end-stage renal failure requiring haemodialysis or cardiomyopathy
  31. Infectious Diseases
  32. Monocyte distribution width (MDW) as a screening tool for sepsis in the Emergency Department
  33. Performance of a Toxo IgM prototype assay for the diagnosis of maternal and congenital Toxoplasma infections
  34. Letters to the Editors
  35. Evaluation of an ELISA for SARS-CoV-2 antibody testing: clinical performances and correlation with plaque reduction neutralization titer
  36. Preliminary evaluation of Roche Cobas Elecsys Anti-SARS-CoV-2 chemiluminescence immunoassay
  37. Hypoalbuminemia and elevated D-dimer in COVID-19 patients: a call for result harmonization
  38. Total pathway to method validation
  39. Derivation of performance specifications for uncertainty of serum C-reactive protein measurement according to the Milan model 3 (state of the art)
  40. FGF23 measurement in burosumab-treated patients: an emerging treatment may induce a new analytical interference
  41. Use of a modified IDS-ISYS intact PTH assay for intraoperative PTH measurements
  42. Agreement of dried blood spot lyso-Gb3 concentrations obtained from different laboratories in patients with Fabry disease
  43. Influence of delayed separation of plasma from whole blood and centrifugation protocol on Zn plasma concentration
  44. A survey of order of draw on inpatient wards and adherence to EFLM-COLABIOCLI recommendations
  45. Successful implementations of automated minimum re-test intervals to overcome ferritin over-requesting in a Spanish hospital laboratory
  46. Remarkable pseudoleucocytosis induced by mild cryoglobulinemia
  47. Massive hemolysis due to Clostridium perfringens: a laboratory’s perspective
Sign up now to receive a 20% welcome discount
Institutional Access
How does access work?
Have an idea on how to improve our website?
Please write us.
© 2025 De Gruyter Brill
Downloaded on 11.9.2025 from https://www.degruyterbrill.com/document/doi/10.1515/cclm-2020-1096/html
Scroll to top button