ABSTRACT
Oral fluid (hereafter saliva) offers a non-invasive sampling method for the detection of SARS-CoV-2 antibodies. However, data comparing performance of salivary tests against commercially-available serologic and neutralizing antibody (nAb) assays are lacking. This study compared the performance of a multiplex salivary SARS-CoV-2 IgG assay targeting antibodies to nucleocapsid (N), receptor binding domain (RBD) and spike (S) antigens to three commercially-available SARS-CoV-2 serology enzyme immunoassays (EIAs) (Ortho Vitros, Euroimmun, and BioRad) and nAb. Paired saliva and plasma samples were collected from 101 eligible COVID-19 convalescent plasma (CCP) donors >14 days since PCR+ confirmed diagnosis. Concordance was evaluated using positive (PPA) and negative (NPA) percent agreement, overall percent agreement (PA), and Cohen’s kappa coefficient. The range between salivary and plasma EIAs for SARS-CoV-2-specific N was PPA: 54.4-92.1% and NPA: 69.2-91.7%, for RBD was PPA: 89.9-100% and NPA: 50.0-84.6%, and for S was PPA: 50.6-96.6% and NPA: 50.0-100%. Compared to a plasma nAb assay, the multiplex salivary assay PPA ranged from 62.3% (N) and 98.6% (RBD) and NPA ranged from 18.8% (RBD) to 96.9% (S). Combinations of N, RBD, and S and a summary algorithmic index of all three (N/RBD/S) in saliva produced ranges of PPA: 87.6-98.9% and NPA: 50-91.7% with the three EIAs and ranges of PPA: 88.4-98.6% and NPA: 21.9-34.4% with the nAb assay. A multiplex salivary SARS-CoV-2 IgG assay demonstrated comparable performance to three commercially-available plasma EIAs and a nAb assay, and may be a viable alternative to assist in screening CCP donors and monitoring population-based seroprevalence and vaccine antibody response.
INTRODUCTION
As coronavirus disease 2019 (COVID-19) emerged, there were limited diagnostic and treatment options; COVID-19 convalescent plasma (CCP) emerged early as one of the leading therapies. On August 23, 2020, the U.S. Food and Drug Administration (FDA) issued Emergency Use Authorization (EUA) approval for CCP; by December 2020 over 25,000 units of CCP were being transfused weekly in the United States (1, 4). According to the EUA, CCP units are required to be labeled as either high or low titer (11). This distinction is based on the signal to cut-off (S/C) ratio using a single assay i.e. the Ortho Vitros SARS-CoV-2 IgG assay. High and low titer is based on a signal to cutoff (S/CO) of ≥12 or <12 respectively (11).
Antibody titers can be determined by testing blood using commercially available enzyme immunoassays (EIAs) that typically measure antibody responses to a single antigen. Alternatively, microneutralization assays can be employed to determine a neutralizing antibody (nAb) titer. However, microneutralization requires both intensive biosecurity measures and substantial time, which are not amenable to high throughput donor screening.
Antibodies to SARS-CoV-2 have been evaluated in oral fluid (hereafter saliva), but little is known about how antibody titers in saliva correlate with those measured using plasma serologic assays for detection of SARS-CoV-2-specific IgG and nAb activity (12, 21, 25). If comparable performance were to be shown, saliva would offer several advantages over blood-based testing: collection is non-invasive and can be self-administered. These advantages would improve the scale and efficiency of CCP donor screening, population-based surveillance and assessment of vaccine responsiveness. This study sought to evaluate the performance of a multiplex salivary SARS-CoV-2 IgG assay relative to three commercially-available EIAs, and a nAb assay.
METHODS
Ethics statement
This study used stored samples and data from two parent studies that were approved by The Johns Hopkins University School of Medicine Institutional Review Board. All samples were de-identified prior to laboratory testing, and all participants provided informed consent. Both studies were conducted according to the ethical standards of the Helsinki Declaration of the World Medical Association.
Study specimens
The stored plasma specimens that were used in this study had been collected from a convenience sample of potential CCP donors. The donors were recruited in the greater Baltimore, MD and Washington D.C. metropolitan areas from April to December 2020 (8, 15, 20). Saliva collection was undertaken in this cohort, starting in June 2020. Individuals were eligible for enrollment if they had a documented history of a positive molecular assay test result for SARS-CoV-2 infection (confirmed by medical chart review or the donor provided clinical documentation) and met standard self-reported eligibility criteria for blood donation. Only individuals who had both plasma and saliva collected on the same day were included in this study (n=108). The study used a complete case analysis approach, whereby 5 samples with missing values and 2 that did not pass QC were not used. Thus, 101 paired samples were included in the analysis. The study was cross-sectional and none of the subjects contributed more than one paired saliva / serum sample. All plasma samples were stored at −80°C until testing was performed.
Saliva was collected using the OraSure® Oral Antibody Collection Device (OraSure Technologies, Inc., Bethlehem, PA, USA). The saliva sample was processed according to manufacturer’s instructions, which involves adding the saliva contained in the Oral Antibody Collection Device foam paddle into 800 μL of OraSure® sample storage buffer immediately after the collection from participants. All samples were heated to 56°C for 1 hour to inactivate SARS-CoV-2 and stored at −80°C until analyzed. Archived pre-pandemic negative saliva samples were collected using the Oracol+ S14 collection device (Malvern Medical Developments, Ltd, Worcester, United Kingdom). These Oracol+ S14 samples were collected in multiple research studies prior to December 2019 and involved adult participants representing a diverse range of sociodemographic characteristics (18). Pre-pandemic negative saliva samples from prior to December 2019 were also heat-inactivated prior to testing with the multiplex assay.
SARS-CoV-2 EIAs
Plasma specimens were analyzed using three commercially available EIAs: the Euroimmun Anti-SARS-CoV-2 ELISA (Mountain Lakes, NJ), the BioRad Platelia SARS-CoV-2 Total Ab (BioRad Laboratories, Hercules, CA), and the Ortho Vitros SARS-CoV-2 IgG EIA (Ortho-Clinical Diagnostics Inc, Rochester, NY). All EIAs were purchased from the manufacturer and conducted according to the manufacturers’ instructions, except for the Ortho Vitros EIA in which plasma—rather than serum as recommended—was used. The BioRad EIA measures IgG, IgM and IgA specific for SARS-CoV-2 nucleocapsid protein, whereas the Euroimmun and Ortho Vitros EIAs only measure anti-SARS-CoV-2 IgG specific to spike (S). The EIAs results are reported as follows: the Euroimmun EIA provides an arbitrary unit ratio (AU, which is the optical density [OD] of the sample divided by calibrator provided), the Ortho Vitros EIA provides a S/CO ratio, and the BioRad EIA provides an OD.
Microneutralization Assay
Quantitation of nAb titers against 100 fifty percent tissue culture infectious doses (TCID50) was performed using a nAb assay (15). The nAb area under the curve (AUC) values were estimated using the exact number of wells protected from infection at every plasma dilution; samples that had no NT activity were assigned an arbitrary value of one-half of the lowest nAb AUC.
Total salivary IgG ELISA
The total IgG concentration in each participant’s collected saliva (i.e., saliva added to OraSure sample storage buffer) was determined using Salimetrics Salivary Human Total IgG ELISA Kit (Salimetrics, LLC, Carlsbad, CA, USA) according to the manufacturer’s instructions with the following modification: the sample incubation and the detection antibody incubation times were reduced to 1 hour instead of 2 hours. This modification was approved by the manufacturer.
Multiplex SARS-CoV-2 IgG test
Saliva samples were tested using a multiplex SARS-CoV-2 IgG immunoassay as previously described, based on Luminex technology (21). The multiplex assay included magnetic bead sets (MagPlex microspheres) coupled covalently with antigen (5 μg antigen per 1 million beads) (21). The assay included SARS-CoV-2 nucleocapsid (N), receptor binding domain (RBD), and spike (S) antigens (Supplemental Table 1). Briefly, saliva was centrifuged for 5 minutes at 20,000 g. Because all CCP saliva samples were collected using the OraSure® Oral Antibody Collection Device (OraSure Technologies, Inc., Bethlehem, PA, USA), which includes 800 μL of OraSure® sample storage buffer, the saliva contained in the collection device (foam paddle) is diluted (estimated 4-fold dilution compared to our prior testing of Oracol-collected saliva samples). Thus, instead of 10 μL as described previously (21), 40 μL of this combined saliva / OraSure sample buffer was added to each well along with 10 μL PBST/1% BSA (assay buffer) containing 1,000 beads per bead set for a final volume of 50 μL. Each assay plate contained 1-2 blank wells with OraSure sample buffer instead of samples that were used for background subtraction. A positive control was created by spiking a during-pandemic saliva sample that was highly positive for SARS-CoV-2-specific IgG into a pre-pandemic negative control saliva sample. The same pre-pandemic saliva was used as a negative control. Because the pre-pandemic saliva samples were collected using the Oracol+ S14 device, which does not contain any sample storage buffer, 10 μL of undiluted saliva was added to each well along with 40 μL PBST/1% BSA (assay buffer) containing 1,000 beads per bead set for a final volume of 50 μL. Phycoerythrin-labeled anti-human IgG diluted 1:100 in assay buffer was used to detect IgG binding to antigens. The plates were read on a Luminex MAGPIX instrument.
Statistical analysis
For salivary SARS-CoV-2 multiplex assay results, the blank-subtracted (“net”) median fluorescence intensity (MFI) was used for statistical analyses. Cutoffs to discriminate IgG positive from IgG negative samples for each individual antigen and for combinations of multiple antigens (algorithms) had previously been calculated using the average net MFI plus three standard deviations of pre-COVID-19 era negative control specimens (n=265). The sensitivity and specificity for individual and for combinations of SARS-CoV-2 antigens had been calculated using saliva samples collected >14 days after COVID-19 symptoms onset and pre-COVID-19 era saliva samples as described elsewhere (21)]. Highest accuracy (98.6% sensitivity [143/145] and 99.2% specificity [263/265] was achieved using a summary index of SARS-CoV-2-specific IgG S/CO to seven N, RBD and S antigens [unpublished data] and by applying a minimum sample quality control (QC) threshold based on total salivary IgG concentration (μg/mL). A total salivary IgG QC threshold was applied to samples that were negative for the summary index of SARS-CoV-2-specific IgG S/CO to seven N, RBD and S antigens. As with pre-pandemic Oracol-collected saliva samples, any OraSure-collected saliva sample containing less than 0.15 μg total IgG per 50-μL assay reaction was considered to not pass sample QC and was excluded from the analysis if the summary index of SARS-CoV-2-specific IgG S/CO to seven N, RBD and S antigens did not cross the cutoff of 6. This quality control measure excludes samples that could potentially be classified as false negatives as a result of improper saliva sample collection or insufficient total salivary IgG concentration.
The concordance of the multiplex salivary SARS-Cov-2 IgG assay with 3 blood-based EIAs (using manufacturer’s cutoffs) and nAb titers (using AUC of 20 as cutoff) was examined using positive percent agreement (PPA), negative percent agreement (NPA), percent agreement (PA) and Cohen’s kappa coefficient. Indeterminate and borderline results of Euroimmun and BioRad were considered to be negative. Spearman’s rank correlation coefficients (ρ) were used to examine the correlation of the multiplex salivary EIA’s signal to cut off (S/CO) and blood-based test values (Ortho Vitros S/CO, Euroimmun AU, BioRad OD and nAb AUC); 95% confidence intervals (CI) were estimated by 1,000 bootstrap iterations. Concordance of each antigen-specific component of the salivary assay and the final algorithmic result were examined to evaluate the driving component of the final result. The concordance and correlation between each blood-based test were also examined. To calculate the area under the receiver operating characteristic (AUROC), receiver operating characteristic (ROC) analysis for the multiplex salivary summary index S/CO ratio for N/RBD/S at various thresholds to detect SARS-CoV-2 high antibody titers were performed. Statistical analyses were conducted in R 4.0.3 (R Core Team, Vienna, Austria).
RESULTS
Specimen characteristics
Demographic information for the subjects that contributed specimens for this analysis is shown in Supplemental Table 2 (n=101). The median age was 44 years (interquartile range [IQR]=34-56), 42.6% were male, and the majority of the participants (72.3%) were non-Hispanic White. Only 14.9% were hospitalized due to COVID-19. There was a median of 50 days (IQR=40-70 days) between diagnostic PCR+ assay and sample collection for this study.
Comparative performance of saliva to detect antibodies to SARS-CoV-2
In comparison to the three commercial serological EIAs, performance was generally best for the RBD antigens within the multiplex salivary SARS-CoV-2 IgG assay and the Ortho Vitros EIA (Table 1). The highest percent agreement was between the Ortho Vitros EIA and the multiplex salivary SARS-CoV-2 IgG assay’s GenScript RBD-specific IgG (PPA=97.7%; NPA=76.9%; PA=95.0%) and sum of all three RBD-specific IgG S/CO values (PPA=98.9%, NPA=76.9%; PA=96.0%) (Table 1). The sum of all N, S, and RBD antigen S/CO values (summary index) also demonstrated good percent agreement with the Ortho Vitros EIA (PPA=98.9%; NPA=53.8; PA=93.1%) (Table 1). Good percent agreement was also observed between the multiplex salivary SARS-CoV-2 IgG assay’s RBD antigens and the Euroimmun (PPA range: 91.1 %-98.9%; NPA range: 54.5%-81.8%; PA range: 90.1%-94.1%) and BioRad (PPA range: 89.9%-98.9%; NPA range: 50.0%-66.7%; PA range: 87.1%-93.1%) serological EIAs (Table 1).
In comparison to a nAb assay (considering an area under the curve [AUC] <20 as a negative result and ≥20 as a positive result), the best performance was observed for the multiplex salivary SARS-CoV-2 IgG assay’s Mt. Sinai whole spike-specific IgG result (PPA=65.2%; NPA=96.9%; PA=75.2%). The next best comparative performance with nAb was followed closely by the multiplex salivary SARS-CoV-2 IgG assay’s Sino Bio ECD antigen (PPA=97.1%; NPA=25.0%; PA=74.3%) and the NAC N and all 3 RBD antigens (PA range: 72.3%-73.3%) (Table 1). The concordance between each component of the multiplex SARS-CoV-2 antibody assay with the final algorithmic result in the multiplex salivary assay is presented in Supplemental Table 3.
The concordance between SARS-CoV-2 plasma antibody tests is shown in Supplemental Table 4. The comparative performance of the Ortho Vitros EIA (PPA=75.0%; NPA=76.9%; PA=75.2%), Euroimmun EIA (PPA=98.6%; NPA=31.3%; PA=77.2%) and BioRad EIA (PPA=95.7%; NPA=28.1%; PA=74.3%) with nAb was similar to several of the antigens in the multiplex salivary SARS-CoV-2 IgG assay, particularly Mt. Sinai whole spike, all 3 RBDs and NAC N. The comparative performance of the multiplex salivary SARS-CoV-2 assay with Ortho Vitros EIA was slightly lower than that of the Euroimmun EIA with the OrthoVitros EIA (PPA=100.0%; NPA=84.6%; PA=98.0%) but higher than that of the BioRad EIA with OrthoVitros EIA (PPA=95.5%; NPA=61.5%; PA=91.1%)
The multiplex SARS-CoV-2 IgG assay’s three RBD antigens and Mt. Sinai whole S antigen demonstrated the highest correlations with the three commercially available serological EIAs and nAb (Spearman rank correlation coefficient [ρ] range for Ortho Vitros=0.81-0.86, Euroimmun=0.79-0.83, BioRad=0.39-0.44, and nAb=0.75-0.77) (Supplemental Table 5). The integrated sum of all three RBD S/CO values was most strongly correlated with the Ortho Vitros EIA (ρ=0.86; 95% confidence interval [CI]=0.76, 0.91; p<0.001), followed by Euroimmun (ρ=0.83; 95% CI=0.74, 0.89; p<0.001) and nAb (ρ=0.77; 95% CI=0.66, 0.85; p<0.001) (Figure 1). Correlations between SARS-CoV-2 plasma antibody tests are shown in Supplemental Table 6. Correlations with nAb AUC were better for the Ortho Vitros EIA S/CO (ρ=0.83; 95% CI=0.74, 0.89; p<0.001) and Euroimmun EIA AU (ρ=0.80; 95% CI=0.72, 0.86; p<0.001) than those for the multiplex salivary assay and nAb AUC.
When compared to a S/CO value of 12 or greater using the Ortho Vitros EIA (i.e., the requirement for high-titer designation under the EUA), the receiver operating characteristic (ROC) area under the curve (AUC) for the multiplex salivary assay’s sum of S/CO ratios for N/RBD/S antigens was 0.92 (Figure 2).
DISCUSSION
In this study of eligible CCP donors, a multiplex salivary SARS-CoV-2 IgG assay’s performance was comparable to three commercially-available SARS-CoV-2 serological tests that are commonly used to qualify high-titer CCP and as surrogates of nAb activity. Importantly, as a surrogate of nAb activity, the multiplex salivary SARS-CoV-2 IgG assay appeared to demonstrate equivalent or slightly better percent agreement than the three commercially-available serological EIAs. The high comparative performance of the salivary multiplex SARS-CoV-2 IgG assay is evident in the higher percent agreement for S components of the multiplex and the Ortho Vitros and Euroimmun EIAs (which both measure S-specific IgG responses) and N components of the multiplex and the BioRad EIA (which measures N-specific IgG responses).
Saliva has become an important specimen type for the diagnosis of both active and previous infection with SARS-CoV-2. For one, saliva collection is minimally-invasive when compared to other commonly used sampling approaches such as phlebotomy and nasopharyngeal-, mid-turbinate-, or anterior nares swabs. Saliva has been shown to be a robust alternative to nasopharyngeal swabs for SARS-CoV-2 RNA testing, which lends itself to population-level diagnosis and/or surveillance (6, 19, 28, 29). Specifically, collection can be self-administered without technical expertise or oversight. A recent study suggested that salivary SARS-CoV-2 viral load can serve as a dynamic correlate of COVID-19 severity and mortality(24). The utility of SARS-CoV-2 RNA detection in saliva has emerged in parallel with proofs-of-principle to detect SARS-CoV-2-specific antibody responses in saliva, which could serve as a surrogate of SARS-CoV-2 serological tests (10, 12, 17, 21). SARS-CoV-2-specific IgG in saliva reflects the blood-derived transudate in the oral cavity; by contrast, SARS-CoV-2-specific IgA in saliva may represent a localized mucosal IgA response to infection (2, 22, 27).
Because salivary matrix effects are complex and IgG antibodies are present at lower concentrations than in blood, maintaining the diagnostic accuracy – particularly high sensitivity or PPA – of a salivary “serological” assay relative to blood-based serological assays has proven challenging. Our multiplex assay approach produces robust signals for combinations of SARS-CoV-2 N, RBD, and S antigens within a single saliva sample. This facilitates optimization of algorithms that can produce both high sensitivity and specificity(21). Furthermore, the semi-quantitative nature of the S/CO values generated by the salivary SARS-CoV-2 multiplex IgG assay could offer insight into factors driving the duration and magnitude of SARS-CoV-2 IgG seropositivity in high risk and general populations (5, 7, 9, 23).
Saliva can be used to investigate vaccine immunogenicity (i.e., responsiveness) and population seroprevalence. It can also be beneficial for screening of donors for collection of CCP. In the US, CCP has emerged as one of the major treatments for those hospitalized with COVID-19, whereby efficacy has been demonstrated, particularly when units are high-titer and are administered early in the disease course (13, 16, 26). Despite rapid scale up of CCP collection in 2020, enabling procurement of 25,000-30,000 units of CCP per week, the national inventory of CCP is declining, owing to ongoing clinical demand. Clinical trials are currently underway to evaluate the efficacy of CCP as post-exposure prophylaxis and early treatment. If those trials show positive results, the demand for CCP could increase significantly. In addition, the FDA requires the labelling units of CCP as high- or low-titer under the EUA; this further detracts from CCP inventories given that only a subset of donors will satisfy criteria for high-titer. Given the ease of collection, saliva can be used to enhance screening, thereby favorably impacting CCP collections.
This study has several limitations. First, the sample size was relatively small and the cross-sectional design precluded evaluation of antibody dynamics over time, particularly given the relatively short period during which sample collection was undertaken (i.e. relative to symptom resolution). Nonetheless, this is consistent with most CCP collections and study populations, which provided insight into SARS-CoV-2 immunopathogenesis and screening options(3, 14). Second, the study population was primarily focused around Baltimore, MD and Washington DC, thus potentially limiting generalizability of the findings. Third, the Ortho Vitros EIA was validated for serum rather than plasma; while we do not believe that this impacted the results, it is a departure from the manufacturer’s instructions. Finally, a different saliva collection device (OraSure, Bethlehem, PA, USA) was used to establish the negative threshold for the multiplex SARS-CoV-2 IgG assay (Oracol+ S14, Malvern Medical Developments, Worcester, UK). A larger study is recommended to test reproducibility of the findings following the manufacturer instructions for the assay kits and using the same saliva collection devices. Nonetheless, the study employed a robust multiplex saliva assay approach to detect antibodies against SARS-CoV-2, demonstrating favorable performance both against several commercial EIAs, including the Ortho Vitros, as well as formal viral neutralization.
When applied to saliva, the highly-adaptable multiplex approach enables detection of a diverse range of SARS-CoV-2 antigen-specific IgG responses using a minimally-invasive biospecimen that can be self-collected at home. If the findings are replicated in larger studies, this could support a large scale-up of potential CCP donor screening as well as of general population SARS-CoV-2 serosurveillance. This saliva-based approach could improve population-scale understanding of the extent of SARS-CoV-2 transmission, identify areas with gaps in immunity, and also support monitoring of the magnitude and duration of natural infection. These data may be used to guide vaccination decision-making.
Data Availability
A de-identified dataset may be made available upon request.
FUNDING
This work was supported in part by the Division of Intramural Research, National Institute of Allergy and Infectious Diseases (NIAID) (O.L., A.D.R., T.C.Q.), as well as extramural support from NIAID (R01AI120938, R01AI120938S1 and R01AI128779 to A.A.R.T; R01AI05273 and R01AI152078 to A.C.; T32AI102623 for supporting E.U.P.; and NIH Center of Excellence in Influenza Research and Surveillance HHSN272201400007C to A.P.), National Heart Lung and Blood Institute (K23HL151826 to E.M.B and R01HL059842 to A.C.), Bloomberg Philanthropies (A.C.) and Department of Defense (W911QY2090012 to D.S.), Johns Hopkins COVID-19 Research and Response Program, the FIA Foundation, a gift from the GRACE Communications Foundation (C.D.H., P.R.R., N.P., K.K.), NIAID grants R21AI139784 (C.D.H. and N.P), National Institute of Environmental Health Sciences (NIEHS) grant R01ES026973 (C.D.H., N.P., K.K.), NIAID grant R01AI130066 and NIH grant U24OD023382 (C.D.H), and NIH grant from NCATS U24TR001609 (D.H.). The funders had no role in study design, data analysis, decision to publish, or preparation of the manuscript.
ACKNOWLEDGEMENTS
We acknowledge all of the participants who contributed specimens to this study and the study staff without whom this study would not have been possible. We thank Florian Krammer, Icahn School of Medicine at Mt. Sinai for providing S and S-RBD protein. We also thank the National Institute of Infectious Diseases, Japan, for providing VeroE6TMPRSS2 cells and acknowledge the Centers for Disease Control and Prevention, BEI Resources, NIAID, NIH for SARS-Related Coronavirus 2, Isolate USA-WA1/2020, NR-5228.
Footnotes
↵* Shared Senior Authors
Conflicts of interest: The authors declare no potential conflicts of interest.