Abstract
Background The Elecsys® Anti-SARS-CoV-2 S immunoassay (Roche Diagnostics International Ltd, Rotkreuz, Switzerland) has been developed for the in vitro quantitative detection of antibodies to the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) spike (S) protein. We evaluated the performance of this assay using samples from seven sites in Germany, Austria, and Switzerland.
Methods Anonymized frozen, residual serum, or plasma samples from blood donation centers or routine diagnostic testing were used for this study. For specificity and sensitivity analyses, presumed negative samples collected before October 2019 and SARS-CoV-2 PCR-confirmed single or sequential samples were tested, respectively. The performance of the Elecsys Anti-SARS-CoV-2 S immunoassay was also compared with other commercial immunoassays.
Results The overall specificity (n=7880 pre-pandemic samples) and sensitivity (n=240 PCR-positive samples [≥14 days post-PCR]) for the Elecsys Anti-SARS-CoV-2 S immunoassay were 99.95% (95% confidence interval [CI]: 99.87–99.99) and 97.92% (95% CI: 95.21– 99.32), respectively. Compared with seven other immunoassays, the Elecsys Anti-SARS-CoV-2 S assay had comparable or greater specificity and sensitivity. The Elecsys Anti-SARS-CoV-2 S immunoassay had significantly higher specificity compared with the LIAISON® SARS-CoV-2 S1/S2 IgG, ADVIA Centaur® SARS-CoV-2 Total, ARCHITECT SARS-CoV-2 IgG, iFlash-SARS-CoV-2 IgM, and EUROIMMUN Anti-SARS-CoV-2 IgG and IgA assays, and significantly higher sensitivity (≥14 days post-PCR) compared with the ARCHITECT SARS-CoV-2 IgG, iFlash-SARS-CoV-2 IgG and IgM, and EUROIMMUN Anti-SARS-CoV-2 IgG assays.
Conclusion The Elecsys Anti-SARS-CoV-2 S assay demonstrated a robust and favorable performance across samples from multiple European sites, with a very high specificity and sensitivity for the detection of anti-S antibodies.
Introduction
In December 2019 a novel coronavirus emerged (1), named severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), which is the causative agent of the disease, COVID-19 (2, 3). SARS-CoV-2 is an enveloped, single-stranded RNA virus of the family Coronaviridae; its genome encodes 16 nonstructural proteins and four structural proteins: spike (S), envelope (E), membrane (M), and nucleocapsid (N) (4). The most prominent protein component on the viral surface is the S glycoprotein – a large transmembrane protein that assembles into trimers to form the distinctive surface spikes of coronaviruses (5, 6). Each S monomer consists of two subunits, S1 and S2, which mediate receptor binding (via the receptor-binding domain [RBD] located in S1) and membrane fusion, respectively, leading to entry into host cells (6-8).
Following infection with SARS-CoV-2, the host mounts an immune response against the virus, including production of specific antibodies against viral antigens (9). Understanding the dynamics of the antibody response to the virus is critical in establishing a relevant time window to use for serology testing (9). Studies into the kinetics of antibodies to SARS-CoV-2 are rapidly emerging and, based on current evidence, both immunoglobulin M (IgM) and G (IgG) antibodies have been detected as early as day 0 to 5 after symptom onset (10, 11). The chronological order of appearance and levels of IgM and IgG appears to be highly variable and often simultaneous (12-14). Several studies have observed median seroconversion at day 10–13 after symptom onset for IgM and day 12–15 for IgG, with maximum seroconversion for IgM, IgG, and total antibodies occurring at week 2–3, week 2– 4, and around week 2, respectively (13-16).
Emergence of the COVID-19 pandemic has resulted in an urgent and unmet need to develop reliable serological tests to determine past exposure to the virus and the seroprevalence in a given population (17). This information is crucial to support diagnosis, contact tracing, epidemiology studies, and vaccine development to enable characterization of pre-vaccination immune status and vaccine-induced immune response (9, 18-20). There are currently 242 candidate SARS-CoV-2 vaccines in development (21) and, of these, 10 are currently in early, limited, or fully approved use (status February 09, 2021) (22). The majority of the vaccines in use are based on the S protein, with the goal of eliciting protective neutralizing antibodies; the rest are based on whole inactivated SARS-CoV-2 (23, 24). Serology assays are also needed for the identification of neutralizing antibodies from convalescent plasma donors (25).
The Elecsys® Anti-SARS-CoV-2 S (Roche Diagnostics International Ltd, Rotkreuz, Switzerland) is an electrochemiluminescence immunoassay (ECLIA), which has been developed for the in vitro quantitative detection of antibodies, including IgG, against the SARS-CoV-2 S protein RBD in human serum and plasma (26).
The objective of this multicenter European study was to evaluate the specificity and sensitivity of the Elecsys Anti-SARS-CoV-2 S immunoassay using pre-pandemic samples (from routine diagnostics or blood donation) and PCR-positive samples, respectively, as well as compare the performance of this quantitative test with other commercially available immunoassays in terms of specificity and sensitivity.
Materials and methods
Study design
The study was executed from August 17, 2020 to September 1, 2020 with samples tested at four European sites: Labor Augsburg MVZ GmbH, Augsburg, Germany; MVZ Labor Dr. Limbach & Kollegen GbR, Heidelberg, Germany; Interregionale Blutspende SRK AG (SRK Bern), Bern, Switzerland; and Krankenhaus Barmherzige Brüder, Regensburg, Germany. Samples were collected from those four sites, as well as from three additional sites: Labor Berlin – Charité Vivantes GmbH, Berlin, Germany; Tirol Kliniken, Innsbruck, Austria; and Deutsches Rotes Kreuz Blutspendedienst West, Hagen, Germany.
Samples from Augsburg and Heidelberg included those referred to the respective study site by physicians. Heidelberg also tested samples from employees and hospitalized patients, including a subset from patients receiving dialysis. All samples provided by the study site in Berlin were collected from hospitalized patients, including a subset from patients monitored in the intensive care unit (ICU). Samples tested in Regensburg were taken from employees and pediatric patients referred to the site by physicians.
These samples were collected and tested in accordance with applicable regulations, including relevant European Union directives and regulations, and the principles of the Declaration of Helsinki. All samples from Augsburg, Heidelberg, Berlin, and Hagen were anonymized. A statement was obtained from the Ethics Committee (EC) of the Landesärztekammer Bayern confirming that there are no objections to the use of anonymized leftover samples. From the internal EC at the study site in Bern (Switzerland) a waiver was received and from the internal EC at the study site in Innsbruck (Austria) an approval was received. For Regensburg (Germany), EC approvals were already in place, amendments were submitted to notify the EC about Elecsys Anti-SARS-CoV-2 S testing. At Augsburg, Heidelberg, and Bern the assays were performed on the cobas e 801 analyzer (Roche Diagnostics International Ltd, Rotkreuz, Switzerland), whereas at Regensburg the assays were performed on the cobas e 601 analyzer (Roche Diagnostics International Ltd, Rotkreuz, Switzerland).
Serum and plasma samples
Anonymized frozen, residual samples from blood donation centers or routine laboratory diagnostics, as well as banked samples, were used for this study. For specificity analysis of the Elecsys Anti-SARS-CoV-2 S assay, 7880 presumed negative samples (5056 blood donor and 2824 diagnostic routine samples) that were collected before October 2019 were tested. The diagnostic routine cohort included samples from pregnancy screening and pediatrics. For the sensitivity analysis of the Elecsys Anti-SARS-CoV-2 S assay, 827 PCR-confirmed single or sequential samples from 272 different patients, with known time difference between blood draw and positive PCR test, were tested. Of these presumed negative and PCR-confirmed samples, 7903 were tested on the commercially available Elecsys® Anti-SARS-CoV-2 assay (Roche Diagnostics International Ltd, Rotkreuz, Switzerland) (27). Additionally, a number of these samples were tested on other commercially available assays: LIAISON® SARS-CoV-2 S1/S2 IgG (DiaSorin) (28), 2052 samples; EUROIMMUN Anti-SARS-CoV-2 IgG (29) and IgA assays (EUROIMMUN) (30), 1618 and 1624 samples, respectively; ARCHITECT SARS-CoV-2 IgG (Abbott) (31), 3068 samples; ADVIA Centaur® SARS-CoV-2 Total (Siemens Healthineers) (32), 1064 samples; iFlash-SARS-CoV-2 IgG and IgM assays (Shenzhen YHLO Biotech Co) (33), both 1062 samples.
Elecsys Anti-SARS-CoV-2 S assay
The Elecsys Anti-SARS-CoV-2 S immunoassay is a quantitative ECLIA that detects high-affinity antibodies to the SARS-CoV-2 S protein RBD and has a low risk of detecting weakly cross-reactive and unspecific antibodies. Results are automatically reported as the analyte concentration of each sample in U/mL, with <0.80 U/mL interpreted as negative for anti-SARS-CoV-2 S antibodies and ≥0.80 U/mL interpreted as positive for anti-SARS-CoV-2 S antibodies (Roche Diagnostics GmbH. Elecsys Anti-SARS-CoV-2 S assay method sheet. 2020; version 01) (26).
Comparator assays
Specimens were analyzed using eight comparator immunoassays according to the manufacturer’s instructions. Interpretation of results was performed according to the manufacturer’s instructions.
The Elecsys Anti-SARS-CoV-2 assay is an ECLIA for the in vitro qualitative detection of antibodies, including IgG, against SARS-CoV-2, using a recombinant protein representing the nucleocapsid (N) antigen (27). Results are automatically calculated in the form of a cutoff index (COI), with COI values <1.0 interpreted as non-reactive (negative) for anti-SARS-CoV-2 N antibodies and ≥1.0 as reactive (positive) for anti-SARS-CoV-2 N antibodies (27).
The LIAISON SARS-CoV-2 S1/S2 IgG assay is an indirect chemiluminescence immunoassay (CLIA) for the quantitative detection of IgG anti-S1 and IgG anti-S2 antibodies to SARS-CoV-2 (28). Results are automatically calculated, with antibody concentrations expressed as arbitrary units (AU/mL). Concentrations of <12.0 AU/mL are interpreted as negative, ≥12.0 to <15.0 AU/mL are interpreted as equivocal, and ≥15.0 AU/mL are interpreted as positive (28). Equivocal values are referred to as ‘gray zone’ results.
The EUROIMMUN Anti-SARS-CoV-2 IgG and IgA assays are separate enzyme-linked immunosorbent assay (ELISAs) that detect IgG or IgA anti-S1 antibodies to SARS-CoV-2 (29, 30). Results are evaluated semi-quantitatively by calculation of a ratio in which the absorbance values of the controls or patient samples are related to the absorbance value of the calibrator (29, 30). For both assays, ratio results <0.8 are interpreted as negative, ≥0.8 to <1.1 are borderline, and ≥1.1 are positive (29, 30). Borderline values are referred to as ‘gray zone’ results.
The ARCHITECT SARS-CoV-2 IgG assay is a chemiluminescent microparticle immunoassay (CMIA) used for the qualitative detection of IgG antibodies against the N antigen (31). Results are expressed in signal-to-cutoff (S/CO) values, with <1.4 results interpreted as negative and ≥1.4 results interpreted as positive (31).
The ADVIA Centaur SARS-CoV-2 Total assay is a CLIA intended for the qualitative detection of antibodies against the RBD of the S1 protein (32). Results are reported in index values, with <1.0 interpreted as non-reactive (negative) for anti-SARS-CoV-2 antibodies and ≥1.0 interpreted as reactive (positive) for anti-SARS-CoV-2 antibodies (32).
The iFlash-SARS-CoV-2 IgM and IgG assays (33) are separate CLIAs used for the qualitative detection of IgM or IgG against the S and N proteins. The iFlash system automatically calculates the analytic concentration of each sample, with <10 AU/mL interpreted as non-reactive and ≥10 AU/mL interpreted as reactive for anti-SARS-CoV-2 IgM or IgG antibodies.
Statistical analysis
Sample size estimations for specificity and sensitivity analyses were based on formulae proposed previously (34). Assuming specificities between 0.998 and 0.999 and a sensitivity of 0.999, samples sizes of 1698 to 20964 and 32 to 50 respectively, would be required to obtain a significance level of 0.05 and a power of 0.8. For specificity and sensitivity calculations, point estimates and two-sided 95% confidence intervals (CIs) using the exact method were computed employing R version 3.4.0 (35). In the sensitivity evaluation, assay results were assigned to the respective week after positive PCR result. In the comparison with other commercially available assays, only samples with paired measurements were included in the respective analyses. For the differences in estimated specificities and sensitivities between Elecsys Anti-SARS-CoV-2 S assay and the comparator assays, two-sided 95% Wald CIs were calculated as previously recommended (36). If these CIs did not include zero, differences were considered as statistically significant.
Data availability
Qualified researchers may request access to individual patient level data through the clinical study data request platform (https://vivli.org/). Further details on Roche’s criteria for eligible studies are available here: https://vivli.org/members/ourmembers/. For further details on Roche’s Global Policy on the Sharing of Clinical Information and how to request access to related clinical study documents, see here: https://www.roche.com/research_and_development/who_we_are_how_we_work/clinical_trials/our_commitment_to_data_sharing.htm.
Results
Overall performance of the Elecsys Anti-SARS-CoV-2 S assay
Specificity in different target cohorts
Specificity of the Elecsys Anti-SARS-CoV-2 S assay was evaluated at three European sites (with samples from five European sites) using 7880 evaluable residual samples from blood donors and routine diagnostic testing; all of which were collected before October 2019 and presumed negative for SARS-CoV-2 antibodies. The overall specificity for all samples was 99.95% (95% CI: 99.87–99.99) (Table 1). There were four samples with reactive results of 1.790 U/mL, 0.900 U/mL, 0.870 U/mL, and 1.130 U/mL. Three of these reactive samples were from blood donor samples, of which one was collected in March 2016 (influenza season) at Innsbruck, Austria and two were collected in July/August 2018 (outside influenza season) at Bern, Switzerland (Table 1). There was no statistically significant difference in specificity between blood donor samples collected during or outside influenza season. The other reactive sample was from the pregnancy screening cohort in Augsburg (Table 1).
Sensitivity in different target cohorts
In total, 827 evaluable single and sequential samples from 272 SARS-CoV-2 PCR-confirmed patients were evaluated at three European sites (with samples from four European sites). The time span of samples collected after positive PCR was between day 0 and day 120. For subjects with sequential blood draws with more than one sample per time interval, only the result of the last blood draw per given time interval was used for the respective sensitivity calculation. The sensitivity of the Elecsys Anti-SARS-CoV-2 S assay ≥14 days post-PCR (n=240) was 97.92% (95% CI: 95.21–99.32) (Table 2a). The resulting site-specific sensitivities for Augsburg, Berlin, Heidelberg, and Regensburg samples collected ≥14 days post-PCR confirmation were 100.00% (95% CI: 95.89–100.00), 100.00% (95% CI: 91.40– 100.00), 98.72% (95% CI: 93.06–99.97%), and 87.88% (95% CI: 71.80–96.60), respectively (Table 2b).
Visualization of seroconversions and/or titer visualization
For all subjects with at least two sequential blood draws, trajectories were plotted to visualize antibody titer development from day 0 to 78 post-PCR-positive test (Figure 1). Most trajectories show a rapid increase in antibody titer and no considerable decline of antibody titer can be seen for the early and later blood draws. Once detected reactive, none of the subsequent samples drawn per subject showed a decline of titer below the cutoff.
Comparison with Elecsys Anti-SARS-CoV-2 assay
A direct method comparison between the Elecsys Anti-SARS-CoV-2 S assay and the commercially available Elecsys Anti-SARS-CoV-2 assay was performed. This included a total of 7903 samples comprising both confirmed positive samples from sensitivity testing and presumed positive samples with at least one positive antibody result (n=1011), as well as presumed negative samples from specificity testing cohort samples (n= 6892: n=4068 blood donors; n=2824 routine diagnostic). For all samples, the overall percent agreement (OPA) between the Elecsys Anti-SARS-CoV-2 S assay and the Elecsys Anti-SARS-CoV-2 assay was 99.30% (95% CI: 99.10–99.48) (Table S1a). For presumed negative samples and confirmed positive samples, the negative percent agreement (NPA) and positive percent agreement (PPA), respectively, between the S- and N-assays were >99% (Table S1b–c).
Comparison with other commercially available assays
The performance of the Elecsys Anti-SARS-CoV-2 S immunoassay was compared with seven other commercially available SARS-CoV-2 assays, and sensitivity and specificity results, along with percent agreement, were recorded.
The OPA between the Elecsys Anti-SARS-CoV-2 S assay and other comparator tests was recorded (Table S2). The Elecsys Anti-SARS-CoV-2 S test had the highest OPA with the ARCHITECT SARS-CoV-2 IgG (N-assay), at 99.19% (95% CI: 98.80–99.47), and the lowest OPA with the ADVIA Centaur SARS-CoV-2 Total (S-assay), at 88.25% (95% CI: 86.16– 90.13) (Table S2).
Specificity
The specificity of the Elecsys Anti-SARS-CoV-2 S assay was comparable or higher than the specificity of all tested comparator assays (Table 3). The specificity of the Elecsys Anti-SARS-CoV-2 S test was significantly higher compared with the LIAISON SARS-CoV-2 S1/S2 IgG, ADVIA Centaur SARS-CoV-2 Total, ARCHITECT SARS-CoV-2 IgG, iFlash-SARS-CoV-2 IgM, and EUROIMMUN Anti-SARS-CoV-2 IgG and IgA assays (Table S3a). No statistically significant difference was observed between the specificity of the Elecsys Anti-SARS-CoV-2 S assay compared with the iFlash-SARS-CoV-2 IgG assay (Table S3a).
Sensitivity
The sensitivity of the Elecsys Anti-SARS-CoV-2 S assay for detecting seropositive results was compared with six comparator assays; analysis compared with the LIAISON SARS-CoV-2 S1/S2 IgG test could not be performed due to a small sample size. Sensitivity was recorded for samples collected between 0–6, 7–13, and ≥14 days post-PCR-positive test. The sensitivity of the Elecsys Anti-SARS-CoV-2 S assay was equal to or higher than the sensitivity for all tested IgM, IgG, and total antibody assays at all time intervals (Table 4). The EUROIMMUN Anti-SARS-CoV-2 IgA assay showed a higher sensitivity in the 0–6 and 7–13 days post-PCR time intervals and a lower sensitivity in the ≥14 days post-PCR time interval compared with the Elecsys Anti-SARS-CoV-2 S assay (Table 4). The sensitivity of the Elecsys Anti-SARS-CoV-2 S assay at detecting antibodies ≥14 days post-PCR was significantly higher compared with the ARCHITECT SARS-CoV-2 IgG, iFlash-SARS-CoV-2 IgG and IgM, and EUROIMMUN Anti-SARS-CoV-2 IgG assays (Table S3b).
Discussion
Due to the COVID-19 pandemic, there is a pressing need to develop highly specific and sensitive serology tests to assist with the diagnosis of, and to reveal past exposure to, the SARS-CoV-2 virus (17), as well as to support the development of vaccines through distinguishing natural infection-induced immunity from vaccine-induced immunity (9, 18). This was the first multicenter study to demonstrate the performance of the automated Elecsys Anti-SARS-CoV-2 S immunoassay, which detects antibodies against the SARS-CoV-2 S protein RBD. Antibodies against the RBD have previously been shown to correlate strongly with protective neutralizing antibodies (37).
The results from our study revealed that the Elecsys Anti-SARS-CoV-2 S immunoassay displays a robust and favorable performance under routine conditions at multiple sites in Europe, with a very high specificity (99.95%) and sensitivity (97.92%) for the detection of anti-S antibodies. The point estimates for specificity and sensitivity are comparable to the values reported in the package insert of the Elecsys Anti-SARS-CoV-2 S assay (99.98% and 98.8%, respectively) (26). In addition, the Elecsys Anti-SARS-CoV-2 S assay showed a performance comparable with the commercially available Elecsys Anti-SARS-CoV-2 (N-assay), with 95% CIs that overlap (99.69–99.88% for specificity and 97.0–100% for sensitivity); both assays had a very high overall percent agreement. The Elecsys Anti-SARS-CoV-2 assay has a previously reported specificity and sensitivity ≥14 days post-confirmation of 99.8% and 99.5%, respectively (38).
The overall specificity of >99.9% determined in this study demonstrated that the Elecsys Anti-SARS-CoV-2 S is a highly specific assay for the detection of antibodies against SARS-CoV-2. Notably, this analysis included 2424 samples from pregnant women and pediatric populations. The availability of an accurate SARS-CoV-2 serology assay is particularly important for the pregnant population, considering the changes in the immune system that occur during pregnancy, which may increase the woman’s susceptibility to severe infection (39). Additionally, an antibody assay with a high specificity is imperative to reduce the risk of false-positive results, which may inaccurately indicate a past SARS-CoV-2 infection (40). The Elecsys Anti-SARS-CoV-2 S immunoassay demonstrated good specificity and sensitivity in direct comparison with other commercially available assays; both performance measurements were equal to or greater than those for all other evaluated comparator assays. These other assays have also been assessed in previous studies (17, 41-44). However, it is important to note that, for a direct comparison of sensitivity, the available assays differ with respect to assay designs (e.g. antibody classes used) as well as the targets (anti-N and anti-S) that they detect.
A multicenter comparison of seven serology assays, including the Elecsys Anti-SARS-CoV-2 assay, revealed a subpopulation of PCR-confirmed SARS-CoV-2 individuals who were persistently seronegative, which represents a proportion of patients that may be at risk for re-infection (45). Within the group of PCR-confirmed samples in our study, for which there was at least one S and one N antibody result from another comparator assay, there were samples from five patients all of which had a reactive Elecsys Anti-SARS-CoV-2 S test result, a reactive or ‘gray zone’ EUROIMMUN test result and a reactive ADVIA Centaur test result (S-assays), and a non-reactive Elecsys Anti-SARS-CoV-2 and ARCHITECT SARS-CoV-2 IgG test result (N-assays). There was only one sample that was commonly non-reactive in all S-based assays and reactive in all N-based assays. However, the blood draw was taken very early, at the same day as the PCR was done, and the follow-up sample was reactive with the Elecsys Anti-SARS-CoV-2 S assay. Data indicating differences in the kinetics of serology assays are ambiguous and there is little difference in the timing of these responses (42, 46-49). However, differences between N- and S- antigen-based assays should be taken into consideration when interpreting results.
A major strength of this study is the large cohort of presumed negative samples from multiple sites used to determine the specificity of the assay, as well as the multiple method comparison analyses performed and the various population cohorts used, with samples from pediatric and pregnant woman. Further studies should be performed to determine the sensitivity of the Elecsys Anti-SARS-CoV-2 S immunoassay on a larger sample group.
Conclusion
This study demonstrated the performance of the Elecsys Anti-SARS-CoV-2 S immunoassay, with a very high specificity of 99.95% and sensitivity of 97.92% in samples ≥14 days post-PCR confirmation, which was equal to or greater than the performance of seven other commercially available immunoassays. Therefore, these data support the use of the Elecsys Anti-SARS-CoV-2 S immunoassay for reliable identification of past exposure to SARS-CoV-2 in various populations, and highlight the potential for the use of this assay in determining immune status during vaccine efficacy studies.
Data Availability
Qualified researchers may request access to individual patient level data through the clinical study data request platform (https://vivli.org/). Further details on Roche's criteria for eligible studies are available here: https://vivli.org/members/ourmembers/. For further details on Roche's Global Policy on the Sharing of Clinical Information and how to request access to related clinical study documents, see here: https://www.roche.com/research_and_development/who_we_are_how_we_work/clinical_trials/our_commitment_to_data_sharing.htm
Funding
This study was funded by Roche Diagnostics GmbH (Mannheim, Germany).
Conflicts of interest
ER and AA report grants from Roche Diagnostics, during the conduct of the study and personal fees from Roche Diagnostics (honoraria for lectures), outside the submitted work. MK reports non-financial support from Roche Diagnostics, during the conduct of the study. CN, PF and JKH have nothing to disclose. FL, CMR, and TL are employees of Roche Diagnostics GmbH.
Acknowledgements
The authors would like to acknowledge: Kathrin Schoenfeld (Roche Diagnostics) for her role in study conceptualization, study management, interpretation of analysis, and further critical input; Michael Laimighofer (Roche Diagnostics) for his role in database generation and data validation, statistical analysis plan, and formal analysis; and Sigrid Reichhuber and Janina Edion (Roche Diagnostics) for their role in investigational site management, data acquisition, and study monitoring. Medical writing support was provided by Katie Farrant, Elements Communications Ltd, Westerham, UK and was funded by Roche Diagnostics International Ltd, Rotkreuz, Switzerland. ELECSYS and COBAS E are trademarks of Roche Diagnostics. All other product names and trademarks are the property of their respective owners.