Antibody tests for COVID-19: drawing attention to the importance of analytical specificity

Phedias Diamandis; Ioannis Prassas; Eleftherios P. Diamandis

doi:10.1515/cclm-2020-0554

Article Publicly Available

Antibody tests for COVID-19: drawing attention to the importance of analytical specificity

Phedias Diamandis , Ioannis Prassas and Eleftherios P. Diamandis

Published/Copyright: May 9, 2020

Published by

Become an author with De Gruyter Brill

Submit Manuscript Author Information

From the journal Clinical Chemistry and Laboratory Medicine (CCLM) Volume 58 Issue 7

Keywords: antibody; COVID-19; serological Ab tests; widespread testing

To the Editor,

It is widely believed that return to normalcy after the COVID-19 pandemic will include widespread testing for both active (presence of viral nucleic acids) and recovered (presence of anti-SARS CoV2 immunoglobulins) infections [1]. The latter can inform if individuals were exposed to the virus and if they presumably developed immunity. The required analytical performance characteristics of COVID-19 antibody (Ab) tests have not been discussed in detail. Suboptimal analytical performance can create confusion and may lead to false reassurances, especially when carried out on large populations that have yet to be exposed to the virus and in the absence of a gold standard comparative method [2]. Here, we analyze the importance of assay specificity and calculate the required threshold for the tests to provide clinically relevant information.

Most discrete clinical tests provide two types of results: positive or negative for a specific parameter of interest. Positive results can be true positives (TP; positive with assayed parameter present) or false positives (FP; positive without assayed parameter present). Negative results can be true negatives (TN; negative without assayed parameter present) or false negatives (FN; negative with assayed parameter present). The analytical requirements for the adoption of a clinical test depend on its intended use. It is widely claimed that COVID-19 serological Ab tests could be used for the safe return of presumably immune people to normalcy. In this case, FN Ab results are almost inconsequential as the tested individuals will be told that they are negative and thus have no presumed immunity, when, in fact, they do, leading at most to some unnecessary extension of their isolation practices, but not viral spread. But FP results are consequential as these individuals may be reassured of presumed immunity that they do not have, rendering them vulnerable to infection and viral spread. The rate of FP results depends on the analytical specificity of the assay.

The analytical parameter that reflects the required analytical specificity in order to adopt such a test or not (based on the FP/FN ratio) is the positive predictive value (PPV). The % PPV reflects somebody’s chances of having the disease if the test is positive and equals: PPV=TP/(TP+FP)×100. The required PPV value depends on the intended use of the test and the presumed risk/benefit value of its application. The PPV is dependent not only on the sensitivity and specificity of the test but also on the disease prevalence. Below, we present simulation data for COVID-19 infection based on two US prevalence values. The one at 0.2% (one infected per 500 individuals) and another one at 1% (one infected per 100 individuals) are based on preliminary estimations of prevalence in some countries (we remind that prevalence varies widely among countries, regions, cities, etc. and is continuously changing). We also fixed the sensitivity of the test to 100% (no FN, as a best case scenario) and varied the specificity from 90% onward, calculating the PPV in each case (Table 1). These data show that in order to achieve a minimum of 90% PPV (allowing one FP out of every nine TP), the analytical specificity of the COVID-19 Ab test must exceed 99.9% in both scenarios. With most clinical tests, such exquisite specificities are quite rare and particularly challenging to achieve.

Table 1:

Positive predictive value of a test with a 100% sensitivity and variable specificity, at two disease prevalences.

% Specificity at 100% sensitivity	Cases per 100,000 people	True positives (TP)	True negatives (TN)	False positives (FP)	False negatives (FN)	Positive predictive value (PPV), %
Prevalence 1:500
90	200	200	89,820	9980	0	2.0
95	200	200	94,810	4990	0	3.8
98	200	200	97,804	1996	0	9.1
99	200	200	98,802	998	0	16.6
99.5	200	200	99,301	499	0	28.6
99.9	200	200	99,700	100	0	66.9
99.95	200	200	99,750	50	0	80
Prevalence 1:100
90	1000	1000	89,100	9900	0	9.1
95	1000	1000	94,050	4950	0	16.8
98	1000	1000	97,020	1980	0	33.6
99	1000	1000	98,010	990	0	50.2
99.5	1000	1000	98,505	495	0	69
99.9	1000	1000	98,901	99	0	90.1
99.95	1000	1000	98,950	50	0	95.2

The % PPV was calculated as TP/(TP+FP)×100. For comments see text.

We urge COVID-19 Ab kit manufacturers to check thoroughly the specificity of their COVID-19 Ab assays by using sera from patients with various autoimmune conditions (about 5% prevalence in the US population) [3] and patients positive for heterophilic antibodies [4] (about 1% prevalence in the general population; these patients have serum antibodies with broad and unpredictable specificities against human and animal antibodies) and other infections with diverse viruses (optimally including SARS-CoV and other ‘common-cold’ CoVs), to make sure of no cross-reactivity [5]. Universal standardizations and assay harmonizations would contribute tremendously to minimal analytical variability between kits [6].

The high urgency for new SARS CoV-2 serological tests should not compromise assay quality standards. FP results could lead to vital errors both in prevalence prediction studies and in misleadingly reassuring patients of presumed immunity, thus allowing them to return to societal activities at a great risk of getting infected and further spreading the virus.

Corresponding author: Eleftherios P. Diamandis, PhD, MD, Department of Laboratory Medicine and Pathobiology, University of Toronto, Toronto, Canada; Department of Pathology and Laboratory Medicine, Mount Sinai Hospital, Toronto, Canada; Department of Clinical Biochemistry, University Health Network, Toronto, Canada; and Lunenfeld-Tanenbaum Research Institute, Mount Sinai Hospital, 60 Murray St [Box 32], Flr 6 – Rm L6-201-1, Toronto, ON, M5T 3L9, Canada, Phone: +416-586-8443, Fax: +416-619-5521

Research funding: None declared.
Author contributions: All authors have accepted responsibility for the entire content of this manuscript and approved its submission.
Competing interests: Authors state no conflict of interest.

References

1. Petherick A. Developing antibody tests for SARS-CoV-2. Lancet 2020;395:1101–2.10.1016/S0140-6736(20)30788-1Search in Google Scholar

2. Trevethan R. Sensitivity, specificity, and predictive values: foundations, pliabilities, and pitfalls in research and practice. Front Public Health 2017;5:307–12.10.3389/fpubh.2017.00307Search in Google Scholar

3. Cooper GS, Stroehla BC. The epidemiology of autoimmune diseases. Autoimmun Rev 2003;2:119–25.10.1016/S1568-9972(03)00006-5Search in Google Scholar

4. Preissner CM, Dodge LA, O’Kane DJ, Singh RJ, Grebe SK. Prevalence of heterophilic antibody interference in eight automated tumor marker immunoassays. Clin Chem 2005;51: 208–10.10.1373/clinchem.2004.040501Search in Google Scholar PubMed

5. Tate J, Ward G. Interferences in immunoassay. Clin Biochem Rev 2004;25:105–20.Search in Google Scholar

6. Tate J, Myers GL. Harmonization of clinical laboratory test results. eJIFCC 2016;27:5–14.Search in Google Scholar

Received: 2020-04-21

Accepted: 2020-04-22

Published Online: 2020-05-09

Published in Print: 2020-06-25

Articles in the same Issue

https://doi.org/10.1515/cclm-2020-0554

Keywords for this article

antibody; COVID-19; serological Ab tests; widespread testing