Home Evaluation of a Treponema IgG ELISA alone and in combination with an IgM ELISA as substitutes for Treponema pallidum particle agglutination (TPPA) as confirmatory tests in a two-tier diagnostic algorithm for diagnosis of syphilis infection
Article Open Access

Evaluation of a Treponema IgG ELISA alone and in combination with an IgM ELISA as substitutes for Treponema pallidum particle agglutination (TPPA) as confirmatory tests in a two-tier diagnostic algorithm for diagnosis of syphilis infection

  • Nele Wellinghausen ORCID logo EMAIL logo , Teresa Esthela Rangel Vivar and Dietmar Plonné
Published/Copyright: February 26, 2024
Become an author with De Gruyter Brill

Abstract

Objectives

The Treponema pallidum particle agglutination (TPPA) has been used for decades for serological diagnostics of syphilis but is no longer available. Therefore, we evaluated the Treponema IgG ELISA (TpG) alone and in combination with the Treponema IgM ELISA (TpG+M, both from Euroimmun) as possible substitutes for TPPA as a confirmatory test in a two-tier syphilis screening algorithm. Furthermore, we investigated whether a TPPA titer of 5,120 which is used as cut-off for therapeutic decision in pregnant women in Germany can be transferred to an appropriate cut-off value of the TpG.

Methods

All serum samples with reactive syphilis screening test (CLIA, Diasorin) within a 13-months period were included (n=739). In addition to TPPA and rapid plasma reagin test both ELISA tests were done in all samples.

Results

Sensitivity, specificity, positive and negative predictive values were 92.2, 100, 100, and 74.5 % for TpG, and 93.2, 85.4, 96.6, and 74.1 % for TpG+M. By ROC analysis the cut-off of TpG corresponding to a TPPA titer ≥5,120 was calculated to be 54 RU/mL with a sensitivity of 99.6 % and a resulting specificity of 58.6 %.

Conclusions

TpG appears suitable to substitute TPPA as a confirmatory test for syphilis diagnostics but TpG-negative samples have to be evaluated by further tests like FTA-Abs or immunoblot. Treponema IgM determined in addition to TpG did not improve the test performance compared to the TPPA as a reference standard. Valid prediction of a TPPA titer ≥5,120 from TpG result appears not reasonable.

Introduction

Syphilis, caused by the spirochete Treponema pallidum spp. pallidum, is a re-emerging sexually transmitted disease in several European countries including Germany [1]. Serology remains the mainstay of laboratory diagnosis of syphilis and is usually done by a stepwise approach [2], [3], [4]. As screening tests polyvalent immunoassays like ELISA or CLIA and CMIA tests which can be run on automated random-access systems are commonly used. For serological confirmation of syphilis a two-tier approach is recommended in German guidelines [25]. A reactive result in a syphilis screening test should be confirmed by a second Treponema-specific test, like immunoblot, fluorescent T. pallidum absorption test (FTA-abs test), T. pallidum particle agglutination (TPPA) test, or another immunoassay [25, 6]. In addition, a non-treponemal test like the rapid plasma reagin (RPR) test is used to determine activity of syphilis and success of antimicrobial therapy. Treponema-specific IgM antibodies are determined routinely by immunoassay or immunoblot for detection of recent infection and, in addition to RPR, for evaluation of activity of infection [7]. In early primary syphilis infection Treponema-specific IgM antibodies appear 2–3 weeks after infection while IgG antibodies appear some days after IgM. A positive RPR test is seen 4–6 weeks after infection, i.e. 2–3 weeks after the appearance of Treponema-specific IgM antibodies [5]. In recurrent syphilis infection as well as in special patient groups like HIV-positive patients the dynamics of IgM and RPR can vary, for instance Treponema-specific IgM antibodies are frequently negative in recurrent infection. A test for detection of Treponema-specific IgM and RPR are both done routinely in samples with a positive polyvalent syphilis screening test in most laboratories.

The TPPA test has been commonly used as a syphilis screening test as well as for confirmation of a reactive immunoassay screening test since it is very sensitive and specific [5, 6, 8] but it is no longer available on the market. Therefore, many laboratories had to revise their algorithm for serological syphilis diagnostics. Enzyme-linked immunosorbent assays (ELISA) which allow investigation of large amounts of samples with little hands-on time by automated ELISA processors may be an alternative for TPPA [5, 8, 9]. The aim of this study was to evaluate the performance of the Treponema IgG ELISA alone and in combination with the Treponema IgM ELISA (Euroimmun, Germany) as possible substitutes for the TPPA confirmatory test in a two-tier syphilis screening algorithm. In Germany, the TPPA titer has also been used to guide antibiotic therapy in pregnant women: A TPPA titer of 5,120 was the previous suggested cut-off for the therapeutic decision in pregnant women with negative Treponema-specific IgM and non-reactive RPR [2]. Therefore, it should be clarified whether the TPPA titer of 5,120 can be transferred to an appropriate cut-off value of the Treponema IgG ELISA.

Materials and methods

Diagnostic tests and algorithm

All serum samples submitted to our laboratory between December 1st 2021 and December 31st 2022 with a request for serological syphilis diagnostics were eligible for this study. Diagnostic algorithm for serological syphilis testing included a polyvalent chemiluminescence immunoassay (CLIA) run on the LIAISON® XL system, the LIAISON® Treponema Screen assay (Diasorin, Dietzenbach, Germany), as a screening test. This T. pallidum-specific one-step sandwich CLIA contains recombinant antigen of T. pallidum (TpN17) which is used to bind T. pallidum-specific IgM and IgG antibodies. The results are reported qualitatively but an index value is reported by the analytical system. An index value of <0.9 is interpreted as negative, while an index value >1.1 is considered positive. Results between 0.9 and 1.1 including the interval limits are considered borderline according to the manufacturer. All samples with an index ≥0.9 in the LIAISON® Treponema Screen assay (CLIA) were subjected to TPPA test (Fujirebio, Tokyo, Japan), Treponema IgG ELISA, Treponema IgM ELISA (both from Euroimmun, Lübeck, Germany), and RPR (Becton Dickinson, Sparks, MD, USA).

A serological diagnosis of syphilis using TPPA as confirmatory test was established according to the algorithm in Figure 1. TPPA was done according to the instructions of the manufacturer. All samples were tested in initial dilutions of 1:80 and 1:2,560 in order to exclude prozone phenomenon. All samples with a TPPA titer <80 were defined as being seronegative and all with a TPPA titer ≥80 as being seropositive. In positive samples the final titer was determined. The Treponema IgG ELISA (EI 2111-9601 G) and the Treponema IgM ELISA (EI 2111-9601 M) were performed on the automated EUROLab workstation ELISA (Euroimmun). Both ELISA tests utilize recombinant p15, p17, p47, and TmpA as antigens. Results of the Treponema IgM are expressed as index values (sample optical density (OD) divided by calibrator OD), with an index <0.8 regarded negative, 0.8–<1.1 euqivocal, and an index ≥1.1 positive according to the instructions of the manufacturer. In our study, index ≥0.8 was regarded positive. Treponema IgG levels are measured in relative units (RU)/ml, with <16 RU/mL interpreted as negative, 16–<22 RU/mL as equivocal, and ≥22 RU/mL as positive according to the manufacturer. In our study, ≥16 RU/mL was regarded positive. Samples with results exceeding the linear range of the IgG ELISA test (>166 RU/mL) were measured repeatedly in a dilution of 1:10. In samples with an equivocal or positive Treponema IgM ELISA an IgM immunoblot (recomLine Treponema IgM, Mikrogen, Neuried, Germany) was done as a confirmatory test. If result of Treponema IgG ELISA and TPPA test were discrepant, Treponema IgM and IgG immunoblot (recomline Treponema IgM and IgG, Mikrogen) were done for further evaluation. The recomline blots were run on an automated blot processing system (Dynablot, Mikrogen) and interpretation was done both by the automated Recomscan® software (Mikrogen) according to the interpretation criteria of the manufacturer. In addition, all blot results were confirmed by eye. RPR was done according to the instructions of the manufacturer (Becton Dickinson, Sparks, MD, USA) in dilutions of 1:1 and 1:4 in order to exclude prozone phenomenon. A titer ≥4 is considered positive according to German diagnostic guidelines [5]. In positive samples the final titer was determined by investigation of further dilutions.

Figure 1: 
Diagnostic algorithm for syphilis infection used in this study.
Figure 1:

Diagnostic algorithm for syphilis infection used in this study.

In addition to Treponema IgG alone, the results of the combination of Treponema IgG ELISA and Treponema IgM ELISA were analysed. The outcome of this combination was considered negative if both tests were negative and positive if at least one of the two tests was positive.

Statistical analysis

Statistical analyses were performed using R Statistical Software (v4.3.0, R Core Team 2023, https://www.r-project.org/), RStudio (2023.09.0 Build 463) and the packages DTComPair [10], cutpointr [11], and epiR [12].

The results of the TPPA confirmatory test have been used as the true state reference for cross-tabulation and performance analysis of the alternative tests under evaluation. The diagnostic performance (sensitivity, specificity, Cohen‘s kappa) of the index tests (Treponema IgG ELISA, combination of Treponema IgG ELISA + IgM ELISA) was compared to the TPPA reference standard with 95 % confidence intervals (CI). The kappa statistics were determined to assess the agreement between the TPPA reference standard and the index tests.

Receiver operating characteristic (ROC) analysis was done to evaluate the areas under the ROC curve (AUC) and to predict the cut-off values for treatment decision in pregnant women for Treponema IgG ELISA. The TPPA titer served as the reference standard for treatment decision, with patients having a TPPA titer <5,120 being categorized as not requiring treatment and those with a TPPA titer ≥5,120 as requiring treatment according to German guidelines [2], see also above. To ensure a very high sensitivity of the predicted cut-off for the Treponema IgG ELISA, the cut-off was calculated at a sensitivity of at least 99 %. A p-value <0.05 was considered statistically significant.

Results

Characteristics of the study population

In total, 739 serum samples were reactive in the Treponema Screen assay (CLIA) during the study period, including 44 samples with equivocal and 695 samples with positive results. Using the TPPA as confirmatory test, 602 samples (598 positive and four equivocal in the Treponema Screen assay) were confirmed as positive for the presence of antibodies, while 137 samples (97 positive and 40 equivocal in Treponema Screen assay) were found to be negative, resulting in a false positive rate of 18.5 % for the CLIA when borderline results are considered positive.

Among the 602 samples confirmed as seropositive, 349 samples (58 %) were RPR negative, while 253 samples (42 %) were RPR positive (titer ≥4).

Performance characteristics of the assays

Treponema IgG ELISA

All 137 TPPA-negative samples were negative in the Treponema IgG ELISA, resulting in a specificity of 100 %. Out of the 602 TPPA-positive samples, 47 samples were negative in the IgG ELISA, indicating a sensitivity for Treponema IgG ELISA of 92.2 % (Table 1). All 47 samples with negative Treponema IgG ELISA had a TPPA titer ≤640. The PPV of for the Treponema IgG ELISA was excellent (100 %) but the NPV was only 74.5 % (Table 1).

Table 1:

Performance characteristics and comparison of ELISA (Treponema IgG ELISA, combination of Treponema IgG ELISA and IgM ELISA) with TPPA as reference standard.

TPPAa
Neg Pos Total Sensitivity (%) (95 % CI) Specificity (%) (95 % CI) PPVb (95 % CI) NPVc (95 % CI) Kappa value (95 % CI)
Treponema IgG 92.2 (89.8–94.2) 100.0 (97.3–100.0) 100.0 (99.3–100.0) 74.5 (67.5–80.6) 0.814 (0.763–0.866)
Neg 137 47 184
Pos 0 555 555
Total 137 602 739
Combination of Treponema IgG and IgM 93.2 (90.9–95.1) 85.4 (78.4–90.8) 96.6 (94.7–97.9) 74.1 (66.5–80.7) 0.742 (0.680–0.804)
Neg 117 41 158
Pos 20 561 581
Total 137 602 739
  1. aTPPA, Treponema pallidum particle agglutination; bPPV, positive predictive value; cNPV, negative predictive value.

Combination of the Treponema IgG ELISA and the IgM ELISA.

The combination of the two tests Treponema IgG ELISA and IgM ELISA resulted in a sensitivity of 93.2 % (41 false negative findings out of 602 TPPA positive samples) and a specificity of 85.4 % (20 false positive findings out of 137 TPPA negative samples, see Table 1). The PPV was 96.6 % and the NPV was comparable to that of the Treponema IgG ELISA alone (74.1 %, see Table 1).

The Treponema IgM ELISA was positive in 242 of the 602 TPPA positive samples (40.2 %) and Treponema IgM immunoblot confirmed presence of Treponema IgM in 211 of these 242 samples (87.2 %). Regarding the 137 TPPA negative samples Treponema IgM ELISA was positive in 20 (14.6 %) and IgM was confirmed by immunoblot in only three (15.0 %). In the 47 TPPA positive but Treponema IgG ELISA negative samples (see above), Treponema IgM ELISA was positive in 6 (12.8 %) but Treponema IgM was confirmed by immunoblot in only three of them.

Comparison of the tests.

The consistency analysis showed that kappa coefficient between Treponema IgG ELISA and TPPA was not significantly different from that between the combination of Treponema IgG ELISA plus IgM ELISA (0.814 (CI 0.763–0.866) vs. 0.742 (0.680–0.804), Table 1).

The sensitivity of the combination of Treponema IgG ELISA plus IgM ELISA was 1 % higher than the sensitivity of the Treponema IgG ELISA alone (p=0.0143). The specificity of the IgG ELISA was significantly higher (p<0.0001) than that of the combination of the Treponema IgG ELISA plus IgM ELISA (proportion difference=14.6 %).

ROC analysis

AUC was calculated with TPPA as the confirmatory test for treatment decision in pregnant women at decision threshold of titer 5,120. The AUC of the Treponema IgG ELISA was 0.955 (0.941–0.967), see Figure 2. For the Treponema IgG ELISA, the cut-off for treatment decision in pregnant women was calculated to be 54 RU/mL at a sensitivity of 99.6 % and a resulting specificity of 58.8 %, see Figure 2.

Figure 2: 
ROC analysis of Treponema IgG ELISA with TPPA at decision threshold of titer 5,120 as the confirmatory test for treatment decision in pregnant women.
Figure 2:

ROC analysis of Treponema IgG ELISA with TPPA at decision threshold of titer 5,120 as the confirmatory test for treatment decision in pregnant women.

Discussion

The TPPA test was a well-established integral part in diagnostic algorithms for serological workup of syphilis infection but is no longer available on the market. The aim of this study was to evaluate the performance of ELISA tests as possible substitutes for the TPPA confirmatory test in a two-tier syphilis screening algorithm based on an automated CLIA as screening test. Compared to TPPA as a second-line confirmatory test Treponema IgG ELISA had a sensitivity of 92.2 % and a specificity of 100 %. The combination of the separately measured Treponema IgG and IgM was comparable to the Treponema IgG ELISA alone in terms of sensitivity but had a significantly poorer specificity of 85.4 %. Thus, the Treponema IgM determined in addition to the Treponema IgG did not improve the test performance compared to the TPPA as a reference standard.

Our study shows that the Treponema IgG ELISA can substitute the TPPA test as a confirmatory test in serum samples with reactive syphilis screening assay (CLIA). However, due to its lower sensitivity Treponema IgG negative samples have to be evaluated by further Treponema-specific tests like immunoblot or FTA-Abs test. In addition, Treponema-specific IgM should be tested in order to detect cases of very early syphilis in these samples. This serological constellation was observed in 6.4 % of TPPA positive but Treponema IgG negative samples (data not shown).

The IgG cut-off value for treatment decision in pregnant women was calculated by performing ROC analysis using TPPA titer 5,120 as the reference cut-off value. With a cut-off of 54 RU/mL in the Treponema IgG ELISA, 99.6 % of pregnant women would be treated in accordance with the TPPA titer recommendation of ≥5,120. But in addition, about 41 % of pregnant women would receive therapy that is unnecessary according to former TPPA criteria. On the other hand, using such a cut-off, about 19 % of TPPA positive pregnant women could be spared from unnecessary therapy (IgG 16 to <54 RU/mL). Guidance of antibiotic therapy in pregnant women by the ELISA result appears in our opinion not reasonable since (1) only a minority of pregnant women would benefit from the determined cut-off and (2) the TPPA cut-off of 5,120 is not evidence-based but was established by expert consensus [13], [14], [15]. Recommendation of antibiotic therapy to all pregnant women with serologically confirmed syphilis infection without past antibiotic therapy would be a possible approach until current German guidelines regarding syphilis treatment in pregnant women have been revised. Alternatively, indications for antibiotic treatment of syphilis infection in pregnancy could be adapted to the recommendations of non-pregnant patients following the European guideline [3]. For this procedure, recommendation of therapy could be limited to women with a clear positive IgG result ≥22 RU/mL, since this cut-off is still below the determined cut-off of 54 RU/mL.

Although we included a large amount of serum samples our study has some limitations. Anamnestic data of the patients concerning possible previous laboratory results and antibiotic therapies were not available. Therefore, we analyzed the data on an individual sample basis. This approach best reflects the analytical work-up in a diagnostic laboratory where clinical and anamnestic data are not routinely available. In addition, Treponema IgM immunoblot was not done in all samples and, thus, sensitivity and specificity of the Treponema IgM ELISA could not be calculated. In a recent study, sensitivity of the Treponema IgM ELISA (Euroimmun) was 89.4 % in initial diagnosis of syphilis in a study population of mainly HIV-positive patients [7]. Finally, the transfer of the therapeutic TPPA cut-off for pregnant women to the Treponema IgG ELISA result was done on a non-selected population of samples from syphilis patients since a sufficient number of samples from pregnant women with syphilis was not available.


Corresponding author: Nele Wellinghausen, MD, MVZ Labor Ravensburg, Elisabethenstr. 11, 88212 Ravensburg, Germany, E-mail:

  1. Research ethics: The local Institutional Review Board deemed the study exempt from review. The study was conducted in accordance with the Declaration of Helsinki (as revised in 2013).

  2. Informed consent: Not applicable.

  3. Author contributions: The author(s) have (has) accepted responsibility for the entire content of this manuscript and approved its submission.

  4. Competing interests: All other authors state no conflict of interest.

  5. Research funding: None declared.

  6. Data availability: The raw data can be obtained on request from the corresponding author.

References

1. Mitja, O, Padovese, V, Folch, C, Rossoni, I, Marks, M, Rodriguez, IAM, et al.. Epidemiology and determinants of reemerging bacterial sexually transmitted infections (STIs) and emerging STIs in Europe. Lancet Reg Health Eur 2023;34:100742. https://doi.org/10.1016/j.lanepe.2023.100742.Search in Google Scholar PubMed PubMed Central

2. AWMF S2k Guideline 059/002. Diagnosis and therapy of syphilis (Diagnostik und Therapie der Syphilis). https://register.awmf.org/assets/guidelines/059-002l_S2k_Diagnostik_Therapie_Syphilis_2021_06.pdf.2021.Search in Google Scholar

3. Janier, M, Unemo, M, Dupin, N, Tiplica, GS, Potocnik, M, Patel, R. 2020 European guideline on the management of syphilis. J Eur Acad Dermatol Venereol 2021;35:574–88, https://doi.org/10.1111/jdv.16946.Search in Google Scholar PubMed

4. Kingston, M, French, P, Higgins, S, McQuillan, O, Sukthankar, A, Stott, C, et al.. UK national guidelines on the management of syphilis 2015. Int J STD AIDS 2016;27:421–46. https://doi.org/10.1177/0956462415624059.Search in Google Scholar PubMed

5. Wellinghausen, N, Abele-Horn, M, Donoso Mantke, O, Enders, M, Fingerle, V, Gaertner, B, et al.. Treponema pallidum. In: INSTAND, editors. MiQ Immunological methods for the detection of infectious diseases, 1st ed. Oberhaching: Dustri Verlag; 2023:96–101 pp.Search in Google Scholar

6. Malm, K, Andersson, S, Fredlund, H, Norrgren, H, Biague, A, Mansson, F, et al.. Analytical evaluation of nine serological assays for diagnosis of syphilis. J Eur Acad Dermatol Venereol 2015;29:2369–76. https://doi.org/10.1111/jdv.13237.Search in Google Scholar PubMed

7. Osbak, KK, Tsoumanis, A, De Baetselier, I, Van Esbroek, M, Smet, H, Kenyon, CR, et al.. Role of IgM testing in the diagnosis and post-treatment follow-up of syphilis: a prospective cohort study. BMJ Open 2020;10:e035838. https://doi.org/10.1136/bmjopen-2019-035838.Search in Google Scholar PubMed PubMed Central

8. Park, IU, Tran, A, Pereira, L, Fakile, Y. Sensitivity and specificity of treponemal-specific tests for the diagnosis of syphilis. Clin Infect Dis 2020;71:S13–20. https://doi.org/10.1093/cid/ciaa349.Search in Google Scholar PubMed PubMed Central

9. Sonmez, C, Sezen, F, Kilic, S. Performance evaluation of nine different syphilis serological tests in comparison with the FTA-abs test. J Immunol Methods 2019;464:9–14. https://doi.org/10.1016/j.jim.2018.08.007.Search in Google Scholar PubMed

10. Stock, C, Hielscher, T, Discacciati, A. DTComPair: comparison of binary diagnostic tests in a paired study design. R package, version 1 2 2 2023.Search in Google Scholar

11. Thiele, C, Hirschfeld, G. Improved estimation and validation of optimal cutpoints in R. J Stat Softw 2021;98:1–27. https://doi.org/10.18637/jss.v098.i11.Search in Google Scholar

12. Stevenson, M, Sergeant, E, Firestone, S. epiR: tools for the analysis of epidemiological data. R package version 2 0 65 2023.Search in Google Scholar

13. Enders, M, Knaub, I, Gohl, M, Pieper, I, Bialek, C, Hagedorn, HJ. Konnatale Syphilis trotz Mutterschaftsvorsorge? Eine Evaluierung von 14 Fällen. Z Geburtshilfe Neonatol 2006;210:141–6. https://doi.org/10.1055/s-2006-947218.Search in Google Scholar PubMed

14. Hagedorn, H-J, Brockmeyer, NH, Hunfeld, KP, Münstermann, D, Potthoff, A, Schöfer, H. Syphilis, Mikrobiologisch-infektiologische Qualitätsstandards (MiQ) 16. Munich: Urban & Fischer; 2012.Search in Google Scholar

15. Robert-Koch-Institut. Praktische Empfehlungen zur Serodiagnostik der Syphilis. Epidem Bull 2003;2003:1–2.Search in Google Scholar

Received: 2023-11-27
Accepted: 2024-02-01
Published Online: 2024-02-26
Published in Print: 2024-04-25

© 2024 the author(s), published by De Gruyter, Berlin/Boston

This work is licensed under the Creative Commons Attribution 4.0 International License.

Downloaded on 5.10.2025 from https://www.degruyterbrill.com/document/doi/10.1515/labmed-2023-0142/html
Scroll to top button