A robust, highly multiplexed mass spectrometry assay to identify SARS-CoV-2 variants
====================================================================================

* Matthew M. Hernandez
* Radhika Banu
* Paras Shrestha
* Ana S. Gonzalez-Reiche
* Adriana van de Guchte
* Keith Farrugia
* Robert Sebra
* Mount Sinai PSP Study Group
* Melissa R. Gitman
* Michael D. Nowak
* Carlos Cordon-Cardo
* Viviana Simon
* Harm van Bakel
* Emilia Mia Sordillo
* Nicolas Luna
* Angie Ramirez
* Sergio Andres Castañeda
* Luz Helena Patiño
* Nathalia Ballesteros
* Marina Muñoz
* Juan David Ramírez
* Alberto E. Paniz-Mondolfi

## Abstract

Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) variants are characterized by differences in transmissibility and response to therapeutics. Therefore, discriminating among them is vital for surveillance, infection prevention, and patient care. While whole viral genome sequencing (WGS) is the “gold standard” for variant identification, molecular variant panels have become increasingly available. Most, however, are based on limited targets and have not undergone comprehensive evaluation. We assessed the diagnostic performance of the highly multiplexed Agena MassARRAY® SARS-CoV-2 Variant Panel v3 to identify variants in a diverse set of 391 SARS-CoV-2 clinical RNA specimens collected across our health systems in New York City, USA as well as in Bogotá, Colombia (September 2, 2020 – March 2, 2022). We demonstrate almost perfect levels of interrater agreement between this assay and WGS for 9 of 11 variant calls (κ ≥ 0.856) and 25 of 30 targets (κ ≥ 0.820) tested on the panel. The assay had a high diagnostic sensitivity (≥93.67%) for contemporary variants (e.g., Iota, Alpha, Delta, Omicron [BA.1 sublineage]) and a high diagnostic specificity for all 11 variants (≥96.15%) and all 30 targets (≥94.34%) tested. Moreover, we highlight distinct target patterns that can be utilized to identify variants not yet defined on the panel including the Omicron BA.2 and other sublineages. These findings exemplify the power of highly multiplexed diagnostic panels to accurately call variants and the potential for target result signatures to elucidate new ones.

**Importance** The continued circulation of SARS-CoV-2 amidst limited surveillance efforts and inconsistent vaccination of populations has resulted in emergence of variants that uniquely impact public health systems. Thus, in conjunction with functional and clinical studies, continuous detection and identification are quintessential to inform diagnostic and public health measures. Furthermore, until WGS becomes more accessible in the clinical microbiology laboratory, the ideal assay for identifying variants must be robust, provide high resolution, and be adaptable to the evolving nature of viruses like SARS-CoV-2. Here, we highlight the diagnostic capabilities of a highly multiplexed commercial assay to identify diverse SARS-CoV-2 lineages that circulated at over September 2, 2020 – March 2, 2022 among patients seeking care at our health systems. This assay demonstrates variant-specific signatures of nucleotide/amino acid polymorphisms and underscores its utility for detection of contemporary and emerging SARS-CoV-2 variants of concern.

Keywords
*   RT-PCR
*   MALDI-TOF
*   SARS-CoV-2
*   variant panel
*   multiplex
*   Omicron

## Introduction

Since the onset of the coronavirus disease 2019 (COVID-19) pandemic, suboptimal surveillance and diagnostic efforts have not been able to prevent the rapid, unchecked spread of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) (1–4). In conjunction with various factors (e.g., variable healthcare access, limitations to effective infection prevention efforts), continued spread has led to the emergence of viral variants characterized by increased genomic diversity including the most recent Omicron (B.1.1.529) variant and its sublineages (5–8). This poses a unique challenge to healthcare systems and diagnostic laboratories, alike, as genomic variation has the potential to impact viral fitness (5, 9), disease pathogenesis (10–12), response to therapeutics (e.g., antibodies) (5, 13, 14), and molecular target detection (15–17).

Ideally, SARS-CoV-2 diagnostic assays should be scalable to test increased clinical specimens and should be robust enough to accommodate genomic variation in viruses over time. Although improved technologies have made high-throughput platforms more available, most are limited in the level of multiplexing and, thus, risk target dropout and failing to capture infected individuals. Indeed, current nucleic acid amplification tests (e.g., reverse-transcription polymerase chain reaction (RT-PCR)) largely utilize 1-3 targets to detect (e.g., presence/absence) SARS-CoV-2 nucleic acids. Moreover, as new variants have emerged, diagnostic panels are based on targets designed for detection of nucleotide changes that yield specific amino acid substitutions and call variants based on distinct target result combinations (18–20). However, most of these assays distinguish viral variants through result patterns of 3-9 molecular targets across multiple reaction wells (20–28), which are constrained to distinguishing current circulating variants but may not be sufficient to distinguish nascent, increasingly divergent variants.

Whole viral genome sequencing (WGS) has, therefore, largely served as the “gold standard” for pathogen genomic surveillance. Still, this methodology is not realistic for most diagnostic laboratories as it requires staff with bioinformatic expertise, bioinformatics infrastructure, is relatively expensive and restricted in lower income countries (LICs) and lower middle income countries (LMCs) (29, 30). Therefore, there is great potential for highly multiplexed assays that target an expansive repertoire of polymorphisms. Currently, these platforms are rare in number (31, 32) and most have not yet been evaluated for their diagnostic capabilities in the clinical setting.

Here, we recovered 391 SARS-CoV-2 viral RNA from clinical specimens collected from infected individuals who presented for testing at the Mount Sinai Health System (MSHS) in New York City (NYC) and at the Universidad del Rosario in Bogotá, Colombia from September 2, 2020 – March 2, 2022. These specimens had previously undergone WGS for epidemiologic surveillance, and we used this data as a benchmark to evaluate the diagnostic performance of the Agena MassARRAY® SARS-CoV-2 Variant Panel v3 (research use only, RUO). We tested this highly diverse set of viral variants to interrogate the level of agreement and diagnostic sensitivity and specificity across 12 distinct variants on the panel and 30 distinct polymorphic targets in the *Spike (S)* gene region. We demonstrate a high level of assay agreement and high levels of diagnostic sensitivity and specificity across most variant and individual targets tested. Furthermore, we highlight the utility of the variant panel to elucidate undefined or emergent variants based on unique target result signatures.

## Materials and Methods

### Ethics statement

For specimens obtained through routine testing at MSHS, the Mount Sinai Pathogen Surveillance Program was reviewed and approved by the Human Research Protection Program at the Icahn School of Medicine at Mount Sinai (ISMMS) (HS#13-00981). For specimens from Colombia, the study was reviewed and approved by the ethics Committee from Universidad del Rosario in Bogotá, Colombia (Act number DVO005 1550-CV1499). This study was performed following the Declaration of Helsinki and its later amendments, and all patient data was anonymized to minimize risk to participants.

### SARS-CoV-2 specimen collection and testing

Residual viral RNA from a total of 391 specimens that were previously collected from September 2, 2020 – March 2, 2022 for routine diagnostic testing were utilized for this study.

Specifically, 349 upper respiratory tract (e.g., nasopharyngeal, anterior nares) and saliva (September 2, 2020 – March 2, 2022) specimens were originally collected for SARS-CoV-2 diagnostic testing in the Molecular Microbiology Laboratory of the MSHS Clinical Laboratory, which is certified under Clinical Laboratory Improvement Amendments of 1988, 42 U.S.C. §263a and meets requirements to perform high-complexity tests were eligible for inclusion in this study. Viral RNA was extracted from 300μL of each specimen using the Viral DNA/RNA 300 Kit H96 (PerkinElmer, CMGL1033LS) on the automated chemagic(tm) 360 instrument (PerkinElmer, 2024L0020) per manufacturer’s protocol as previously described (33, 34). After routine testing and extraction, viral RNA was stored at -80°C prior to recovery for testing in this study.

Forty-two nasopharyngeal specimens were collected from patients from the Valle del Cauca department for SARS-CoV-2 testing at Universidad del Rosario from March 29, 2021 – July 28, 2021. Details of processing and SARS-CoV-2 testing of upper respiratory specimens have been described previously (35). After diagnostic testing, residual viral RNA was also stored at -80°C prior to recovery for testing in this study.

### SARS-CoV-2 sequencing, assembly, and phylogenetics

As part of the ongoing Mount Sinai Pathogen Surveillance Program, SARS-CoV-2 viral RNA from MSHS underwent RT-PCR and next-generation sequencing followed by genome assembly and lineage assignment using a phylogenetic-based nomenclature as described by Rambaut et al. (36) using the Pangolin v4.0.6 tool and PANGO-v1.2.81 nomenclature scheme ([https://github.com/cov-lineages/pangolin](https://github.com/cov-lineages/pangolin)) as previously described (4, 37).

Sequence libraries were prepared from RNA from Colombian specimens using the ARTIC Network protocol ([https://artic.network/ncov-2019](https://artic.network/ncov-2019) accessed on 1 February 2021) as previously described (38). Briefly, long-read Oxford Nanopore MinION sequencing was conducted by the MinKNOW application (v1.5.5). Raw Fast5 files were base called and demultiplexed using Guppy. Reads were filtered to remove possible chimeric reads, and genome assemblies were obtained following the MinION pipeline described in the ARTIC bioinformatics pipeline ([https://artic.network/ncov-2019/ncov2019-bioinformatics-sop.html](https://artic.network/ncov-2019/ncov2019-bioinformatics-sop.html) accessed on 1 February 2021).

Of 391 specimens, 381 single variant consensus genome sequences were identified, and the remaining 10 yielded mixed assemblies and, thus, a putative (inconclusive) consensus genome sequence was generated. All FASTA consensus genome sequences underwent mutation calling and phylogenetic lineage assignment by the Nextclade Web Interface ([https://clades.nextstrain.org/](https://clades.nextstrain.org/), last accessed 4/18/22) and the Pangolin COVID-19 Lineage Assigner ([https://pangolin.cog-uk.io/](https://pangolin.cog-uk.io/), last accessed 4/18/22).

### SARS-CoV-2 Variant Panel Testing

We recovered residual viral RNA from all 391 specimens from -80°C storage to undergo testing on the Agena MassARRAY® SARS-CoV-2 Variant Panel v3 ([https://www.agenabio.com/products/panel/coronavirus-sars-cov-2-variant-detection-research-panel/#:~:text=The%20MassARRAY%C2%AE%20SARS%2DCoV,SARS%2DCoV%2D2%20variants](https://www.agenabio.com/products/panel/coronavirus-sars-cov-2-variant-detection-research-panel/#:~:text=The%20MassARRAY%C2%AE%20SARS%2DCoV,SARS%2DCoV%2D2%20variants)., last accessed 4/25/22). The panel combines RT-PCR and matrix-assisted laser desorption/ionization time-of-flight (MALDI-TOF) to detect targeted viral polymorphisms in the Spike (*S*) gene (**Fig. 1A**). It consists of a two-well multiplex qualitative assay that utilizes primer mixes that target a total of 36 polymorphisms which – in various signature combinations – reflect 16 distinct SARS-CoV-2 variants (**Fig. 1B**).

![FIG 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2022/05/29/2022.05.28.22275691/F1.medium.gif)

[FIG 1.](http://medrxiv.org/content/early/2022/05/29/2022.05.28.22275691/F1)

FIG 1. Detection of viral variants by the Agena MassARRAY® SARS-CoV-2 Variant Panel.
(A) SARS-CoV-2 genome with nucleotide positions from 5’-to-3’ direction depicted above. *S* gene polymorphisms targeted by the variant panel (lollipops) and corresponding amino acids are depicted below. (B) A color map depicts algorithms of target combinations that define 16 distinct SARS-CoV-2 variants on the panel. Variant results are depicted (left) which include the WHO designation (e.g., Omicron, Delta, etc.) and corresponding PANGO lineage assignments. Note that the B.1.526.1 variant was re-designated as B.1.637 to distinguish it from the Iota variant lineage ([https://cov-lineages.org/lineage_list.html](https://cov-lineages.org/lineage_list.html), last accessed 4/26/22). The minimum number of targets required to support the corresponding variant result are indicated (right). Target results are depicted as colored cells indicating detectable native (e.g., unchanged from Wuhan-Hu-1 reference) amino acids which do not contribute to the variant target algorithm (grey), detectable native amino acids which do contribute to the algorithm (yellow), detectable amino acid polymorphisms (red), and dropout of the given target polymorphism. (C) Phylogenetic composition of 391 clinical specimen viral RNA recovered for diagnostic evaluation of the variant panel. Numbers of each lineage tested are depicted in brackets.

#### RT-PCR and generation of analytes

Per manufacturer’s protocol, for each specimen, viral RNA underwent RT-PCR by combining 0.355μL nuclease-free water, 1μL RT-PCR Mastermix, 0.125μL RNase Inhibitor, and 0.020μL of MMLV Enzyme in each of two wells in a 384-well format. To one well, 0.500μL SARS-CoV-2 Variant v3 PCR Primer P01 was added, and to the second, 0.500μL SARS-CoV-2 Variant v3 PCR Primer P02 was added. Three microliters of sample RNA were added to each of the two wells for a final RT-PCR reaction volume of 5μL. Four positive controls of synthetic SARS-CoV-2 RNA (Twist Synthetic SARS-CoV-2 RNA Controls 1 (MT007544.1, #102019), 14 (B.1.1.7\_710528, #103907), 16 (EPI_ISL_678597, #104043), and 17 (EPI_ISL_792683, #104044)) were diluted in a mixture of nuclease-free water (Ambion #AM9916) and human liver total RNA (Takara Bio #636531) and included in each RT-PCR run. This resulted in a total of 8 wells with 1,500 SARS-CoV-2 genome copies/well and 10ng human liver total RNA/well for all positive controls. A negative control of nuclease-free water was included in each RT-PCR run. RT-PCR thermocycler conditions are depicted in **Table S1**.

RT-PCR products underwent reaction with shrimp alkaline phosphatase (SAP). Directly to each RT-PCR well, a mastermix of 1.53μL nuclease-free water, 0.17μL SAP Buffer, and 0.30μL SAP was added for a total volume of 7μL including 2μL of SAP mastermix. SAP reaction thermocycler conditions are described in **Table S2**.

Extension products were generated with SARS-CoV-2 Variant v3 Extend Primers using the iPLEX® Pro Reagent Set. Mastermixes were created as follows: 1.06μL nuclease-free water, 0.20μL iPLEX Buffer Plus, GPR; 0.20μL iPLEX Termination Mix, 0.04μL iPLEX Pro Enzyme, and 0.50μL MassARRAY® SARS-CoV-2 Variant v3 Extend Primers (E01 or E02. Two microliters of E01 mastermix were added to each well amplified by P01 primers, and 2μL E02 mastermix was added to each well amplified by P02 primers for the total extension reaction volume of 9μL. Extension thermocycler conditions are detailed in **Table S3**.

#### Analyte dispensing, data acquisition, and data analyses

Twenty microliters of nuclease-free water were added to each well prior to desalting and dispensing in the MassARRAY® System for data acquisition. Analytes were desalted using suspended clean resin (Agena #08060) and dispensed onto SpectroCHIP® Arrays (CPM-384) for data acquisition with the MassARRAY® Analyzer with Chip Prep Module 384 as per manufacturer’s protocol. Instrument settings for iPLEX Pro genotyping panels were used with Genotype+Area selected as the Process Method. After data acquisition, MassARRAY® Typer Analyzer was used to analyze data and generate variant report output results for each specimen. All variant target results and individual target results for each specimen are depicted in **Table S4**.

### Diagnostic performance analyses

To compare performance of the panel to the WGS “gold standard”, we generated 2×2 contingency tables for detected and not detected results of each variant call or target call. To measure the level of agreement between WGS and the variant panel, we performed agreement analyses with kappa (κ) results and 95% confidence intervals (95% CI) using the publicly-available GraphPad Prism web calculator ([https://graphpad.com/quickcalcs/kappa2/](https://graphpad.com/quickcalcs/kappa2/), last accessed April 20, 2022). Level of agreement was interpreted from kappa values as previously described (39). Interpretations included no (κ < 0), slight (0 ≤ κ ≤ 0.20), fair (0.21 ≤ κ ≤ 0.40), moderate (0.41 ≤ κ ≤ 0.60), substantial (0.61 ≤ κ ≤ 0.80), and almost perfect agreement (0.80 ≤ κ ≤1.00). In addition, we measured diagnostic sensitivity and specificity and negative (NPV) and positive predictive values (PPV) for each variant and individual target polymorphism tested (GraphPad Prism v.9.3.1). Ninety-five percent confidence intervals were calculated by the hybrid Wilson/Brown method. Fisher’s exact tests were performed for each contingency table for each variant and/or target tested.

Statistical analyses were performed for variant call results of 12 of the possible 16 variants on the panel. We also performed these analyses for 30 of the 36 possible targets on the panel as clinical specimens that encoded 6 specific amino acid polymorphisms (D80G, Y453F, E484Q, Q493K, N501T, I692V) were not recovered for this study. In addition, we did not recover any specimens that harbored the native D614 amino acid (A23403 nucleotide), and, therefore, we were not able to compute level of agreement or diagnostic specificity for the D614G variant or D614G target calls. In addition, for performance analyses of targets H69_V70del, N439K, and E484K, we excluded specimens that resulted in target dropout as we could not infer nucleotide polymorphisms that caused dropout given that primer/probe sequences are proprietary and not known.

To assess prevalence of variant panel targets across Omicron sublineages, we interrogated publicly-available SARS-CoV-2 genomes on the GISAID database (last accessed May 6, 2022). Using the online graphical user interface, we counted the number of genomes that harbored each of the 36 possible substitutions for each of four Omicron sublineages: BA.2.12.1 (n = 12324 genomes), BA.3 (n = 184), BA.4 (n = 857), BA.5 (n = 437). Prevalence of each substitution was determined by dividing the number of genomes with the substitution by the total number of genomes analyzed for the sublineage in question.

### Display Items

All figures are original and were generated using the GraphPad Prism software, Microsoft Excel v16.60, and finished in Adobe Illustrator (v.26.1). **Fig. 1A** was created in [BioRender.com](http://BioRender.com) and finished in Adobe Illustrator.

### Data availability

All single variant consensus genome sequences were deposited in the publicly-available Global Initiative on Sharing Avian Influenza Data (GISAID) database ([www.gisaid.org](http://www.gisaid.org)) [accession identifiers indicated in **Table S4**]. The remaining 10 genomes with mixed patters of mutations were not deposited into GISAID as single variant consensus genomes could not be resolved (data available upon request).

## Results

We analyzed a diverse set of 391 SARS-CoV-2 viral RNA specimens that were collected from infected patients over 18 months of the COVID-19 pandemic in the NYC metropolitan area and Colombia. These RNA all underwent WGS that resulted in consensus genomes that comprise 56 distinct phylogenetic Pango lineages and corresponded to 12 of the 16 possible variant calls on the panel (**Fig. 1C**). These included 39 Iota (B.1.526), 40 Alpha (B.1.1.7), 110 Delta (B.1.617.2 (n = 3) + AY.x (n = 107)), and 79 Omicron (B.1.1.529 [BA.1 sublineage]) specimens. We also included 45 specimens that corresponded to 3 variants that are not defined by the panel (e.g., Lambda (C.37), Mu (B.1.621), Omicron (BA.2 sublineage)) to interrogate the assay’s ability to distinguish these based on target result patterns.

### Diagnostic performance of variant calling

To evaluate the diagnostic performance of the Agena MassARRAY® Variant Panel, phylogenetic results of consensus sequences based on WGS data served as the “gold standard” for comparison. Of 391 specimens tested on the variant panel, there were 62 with variant calls that were discordant from WGS data; however, 45 of these consisted of specimens whose sequenced variant was without an appropriately defined variant algorithm on the panel. Therefore, only 17 (4.91%) of clinical RNA tested yielded discordant results between WGS and the expected results on the variant panel.

We measured the level of agreement between the overall variant calls from WGS and the variant panel (**Table 1**). Of the 12 panel variants in our study set, we performed agreement analyses on 11. We could not measure level of agreement – or diagnostic sensitivity/specificity – for the isolated D614G result because specimens which concurrently encoded the native D614 amino acid and did not yield any other variant result were not recovered for this study.

View this table:
[TABLE 1.](http://medrxiv.org/content/early/2022/05/29/2022.05.28.22275691/T1)

TABLE 1. Diagnostic agreement between WGS and panel variant calls

Overall, we observed a high level of agreement (e.g., κ ≥ 0.856) for 9/11 variants including the contemporary Delta (B.1.617.2+AY.x) and Omicron (BA.1) variants. The Zeta (P.2) and Eta (B.1.525) variant calls demonstrated the lowest level of agreement. The single Zeta variant confirmed by WGS that was tested (PV26936) resulted as the Florida variant on the panel (**Table S4**). Interestingly, although the E484K and the four native amino acids – L18, K417, A701, Q677H – were correctly detected as part of the Zeta target algorithm, detection of K1191N and Q493K targets met the Florida variant target result criteria. The low level of agreement for the Zeta variant call is also impacted by the fact that all 15 Mu (B.1.621) specimens tested on the panel were incorrectly identified as Zeta; however, it is important to note that the Mu variant is not yet defined on this panel. Of the 7 Eta (B.1.525) variants tested on the panel, only 1 correctly identified as Eta while the remaining 6 resulted as detected D614G. These did not meet the minimum number of detectable targets to yield the Eta result and only resulted in 2-3 of the 4 minimum required targets. These results may be the consequences of RNA degradation over long-term storage. For example, the six discordant specimens encode the H69_V70del by WGS, but all yielded dropout of that target on the panel which further supports this scenario.

We also measured the diagnostic sensitivity and specificity of the panel (**Fig. 2A-B**) for the variants tested. Diagnostic sensitivity ranged from 0% (95% CI: 0-94.87%) [Zeta] to 100% (95% CI: 91.24-100%) [Alpha]. Unsurprisingly, the specimens for which we had limited (e.g., <10) specimens available for testing had the lowest measured sensitivities and broadest CIs including Zeta and Eta variants. Among variants for which we recovered >10 specimens for testing, diagnostic sensitivity was ≥93.67% [Omicron (BA.1)]. In addition, the variant panel demonstrated a high level of diagnostic specificity across all 11 variants tested that ranged from 96.15% (95% CI: 93.75-97.66%) for the Zeta variant to >99% for all other variants (**Fig. 2B**). Furthermore, excluding the Zeta variant, the panel results showed high PPVs (≥0.933) and high NPVs (≥0.984) for all variant calls (**Table S5**).

![FIG 2.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2022/05/29/2022.05.28.22275691/F2.medium.gif)

[FIG 2.](http://medrxiv.org/content/early/2022/05/29/2022.05.28.22275691/F2)

FIG 2. Diagnostic sensitivity and specificity of the Agena MassARRAY® SARS-CoV-2 Variant Panel.
(A) Diagnostic sensitivity and (B) diagnostic specificity of eleven variant calls on the panel are depicted. The number of specimens that correspond with each variant according to WGS are annotated in brackets. Depiction of (C) diagnostic sensitivity and (D) diagnostic specificity of each of thirty distinct panel targets. The number of specimens that correspond with each amino acid polymorphism according to WGS are annotated in brackets for each target. Asterisks (*) indicate targets for which dropout results were excluded from analyses (see Methods). For target N501Y, a separate diagnostic analysis was conducted excluding BA.1 specimens (“N501Y_Excl-BA.1”). Error bars reflect 95% CI in all four panels. ND, not determined.

### Diagnostic performance of distinct target calls

To evaluate the diagnostic capabilities of each of the 36 targeted polymorphisms that comprise the variant panel, we performed interrater agreement analyses and measured the diagnostic sensitivity and specificity of each assay target. Across all 391 viral RNA specimens, each of 30 of the possible 36 polymorphisms were present in at least one specimen.

When we performed agreement analyses on each of these 30 targets (**Table 2**), 25 demonstrated almost perfect levels of agreement (κ ≥ 0.820). The targets with suboptimal levels of agreement for our dataset included D215G (κ = 0; no agreement), L242_244del (κ = 0.568; moderate agreement), N501Y (κ = 0.528; moderate agreement), and K1191N (κ = 0.799; substantial agreement). This low level of agreement may be impacted by small sample sizes tested. Indeed, we only recovered 2-4 specimens that encoded each of the D215G, L242_244del, and K1191N targets, Therefore, small frequencies (e.g., 2-4) of inaccurate calls may explain this result. It is important to note that our study set did not include specimens with the native D614 amino acid (A24303 nucleotide), and level of agreement could not be calculated for the D614G target.

View this table:
[TABLE 2.](http://medrxiv.org/content/early/2022/05/29/2022.05.28.22275691/T2)

TABLE 2. Diagnostic agreement between WGS and panel target calls

Interestingly, for N501Y target, we found that of 158 specimens with the polymorphism by WGS, 79 yielded a false-negative result on the variant panel. All 79 belong to the Omicron (BA.1) variant lineage, and when reanalyzed excluding these BA.1 specimens, interrater agreement was almost perfect (κ = 0.975) (**Table 2**). This suggests genomic variation outside original assay design may impact primer/probe binding and yield distinct target results for novel variants.

Across the 30 targets tested, the average diagnostic sensitivity measured was 90.2% (**Fig. 2C**). The targets with the lowest sensitivities included D80A (75.00%, 95% CI: 30.06-98.72%), D215G (0%, 95% CI: 0.00-56.00%), L242_244del (50.00%, 95% CI: 9.00-91.00%), and N501Y (50.00%, 95% CI: 42.00-58.00%). Notably, when all BA.1 specimens were excluded from the analyses, the sensitivity of the N501Y target improved to 100.00% (95% CI: 95.00-100.00%).

The variant panel assay demonstrated a high diagnostic specificity across nearly all 30 targets tested in this study (**Fig. 2D**). On average, the diagnostic specificity was >99.00% across all of the tested diagnostic targets. Specificity was not calculated for the D614G target because no clinical specimens with the native D614 amino acid were recovered in this study. In addition, across the 30 targets, the PPVs and NPVs were 0.900 and 0.959, respectively (**Table S6**).

### Diagnostic target signatures of undefined variants

Given that the variant panel has a uniquely high level of multiplexing, we also interrogated the capabilities of the assay to reveal unique signatures of variants not defined by the panel software. To do this, we included 45 clinical specimens that included the older Lambda (C.37) (n = 21) and Mu (B.1.621) (n = 15) variants as well as the contemporary Omicron BA.2 variants (n = 9) recently captured in NYC (**Fig. 3A**). Each of the three were called as D614G, Zeta (P.2), and D614G, respectively on the panel.

![FIG 3.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2022/05/29/2022.05.28.22275691/F3.medium.gif)

[FIG 3.](http://medrxiv.org/content/early/2022/05/29/2022.05.28.22275691/F3)

FIG 3. Target result patterns of undefined variants on the Agena MassARRAY® SARS-CoV-2 Variant Panel.
**(A)** A color map depicts the observed target results for three undefined SARS-CoV-2 variants tested on the panel: Lambda (C.37), Mu (B.1.621), and Omicron (BA.2). Distinct target patterns observed among each of the variant types are depicted. Cells indicate the distinct target results including detectable native amino acid (grey), detection of target polymorphism (red), and target dropout (green). The number of specimens that yielded each of the distinct target result patterns are indicated on the right as well as the output variant ID result generated by the variant panel software. (B) A heatmap depicts the measured prevalence of each variant panel target substitution among publicly-available Omicron sublineage genomes as of May 6, 2022.

Based on the current design of the panel, most of the Lambda specimens tested (18/21) only have detectable D614G polymorphisms among the 36 targets. The remaining 3 additionally yield a T95I (C21846U) polymorphism; however, this substitution is not found in any of the 3 consensus sequences, and, therefore, may represent a nonspecific reaction or a minority intra-host variant. Notably, this polymorphism is rare and found in only 24/10186 (0.23%) Lambda genomes deposited in GISAID (last accessed May 6, 2022). The current target design does not target common Lambda substitutions including G75V, T76I, D253N, L452Q, T859N, or deletions (e.g., amino acids 246-252).

All 15 Mu specimens were appropriately called as Zeta (P.2) based on the presence of the native L18, K417, Q677, and A701 amino acids as well as the E484K which meets the threshold for the Zeta variant call. All Mu specimens display a signature of six detectable targets that is unique among all other variant patterns on this assay: T95I, Y144del, E484K, N501Y, D614G, and P681H. Interestingly, none of the specimens’ consensus genome sequences encode the Y144del which suggests other sequence variation may alter primer/probe binding to this target. In fact, 12 of the Mu sequences harbor substitutions at positions 144-145 (e.g., Y144S, Y145N) which may impact target detection. The five other amino acid substitutions are encoded in the consensus genomes of all 15 specimens. Of note, although specimen K42 features an adenosine insertion at genome position 21995, the downstream nucleotide sequence encodes these amino acid polymorphisms. In addition to these 5 substitutions, there are 3 Mu specimens which yielded a detectable Q677H target. However, these genomes harbor the G23593 nucleotide which encodes the native Q677 amino acid and suggests this is a nonspecific result or detection of a minor intra-host variant.

We also found that the 9 Omicron BA.2 specimens generated a distinct target result signature on the variant panel assay. All 9 resulted in detection of S477N, T478K, N501Y, D614G, and P681H targets as well as dropout of the N439K target. The five detected targets each were confirmed by the presence of the amino acid substitutions in WGS data. We cannot delineate the cause of the N439K target dropout because we do not know primer/probe sequences at the site of the targeted nucleotide substitution at position 22879. However, one can speculate that sequence variation around this region may interfere with primer/probe binding. Indeed, all 9 of the BA.2 specimens harbor the T22882G polymorphism which results in the N440K substitution. Furthermore, the K417N substitution is found in all BA.2 consensus genomes but is only detected in 7 specimens. This may be the result of different nucleic acid quantities across specimens and reflect a limit in analytic sensitivity for the target. Together, these are important findings to gauge the capabilities of this assay to highlight unique target signatures of variants that may be captured by this platform.

Finally, to assess the capabilities of the assay to detect other Omicron sublineages (e.g., BA.2.12.1, BA.3, BA.4, BA.5), we independently interrogated the prevalence of each variant panel target substitution among publicly-available genomes (GISAID) (**Fig. 3B**). We found that 94.9-99.7% of BA.2.12.1 genomes harbor each of the K417N, S477N, T478K, N501Y, D614G, and P681H substitutions. With the exception of the N439K target dropout in BA.2 genomes tested in this study, the BA.2.12.1 target signature harbors the same detectable polymorphisms. While 70.7-99.5% of BA.3 genomes also encode the S477N, T478, N501Y, D614G, and P681H, 63.0-66.3% harbor the H69_V70del, T95I, and Y144del substitution which help to distinguish this sublineage from BA.2 and BA.2.12.1. Furthermore, 88.1% of BA.4 and 99.3% of BA.5 genomes encode the L452R substitution which may help to differentiate these genomes from other Omicron sublineages.

## Discussion

Monoclonal antibody treatments are effective in limiting severe COVID-19 but emerging variants of concern often carry mutations that render the virus partially or completely resistant to antibody neutralization (13, 14, 40–44). Rapid SARS-CoV-2 variant calling is therefore essential for personalized COVID-19 treatment interventions. With the advent of commercial and lab-developed variant panels, however, accurate variant requires robust, high-resolution platforms which are limited in number and have not undergone evaluation prior to implementation. Indeed, a multi-laboratory external quality assessment in late 2021 revealed gaps in calling of contemporary variants that stemmed from inadequate selection of diagnostic targets to discern between variants (27). Given this, highly multiplexed, efficient platforms are invaluable but are limited in number and warrant comprehensive evaluation before implementation in the molecular microbiology laboratory.

Here, we report a comprehensive diagnostic evaluation of one of the highest multiplexed variant panel assays on the market. Based on a diverse cohort of clinical specimens across two continents and a wide timeline of the pandemic, we highlight almost perfect levels of interrater agreement between this assay and the “gold standard” WGS for 9 of 11 variants and 25 of 30 distinct targets tested. The assay has a high diagnostic specificity across all variants (≥96.15%) and all targets (≥94.34%) tested. Furthermore, the panel shows a high diagnostic specificity and sensitivity for contemporary variants in global circulation (e.g., Delta, Omicron (BA.1)).

Our study does present some limitations particularly with respect to limited sampling. While the panel has defined target signatures for 16 different variants, we were only able to recover clinical specimens that corresponded to 11 of these variants for testing. Indeed, variants with the lowest level of agreement and diagnostic performance metrics were those with some of the fewest specimens recovered and tested (e.g., Zeta (n = 1), Beta (n = 4), Eta (n = 7). We also did not include specimens from the early phase of the pandemic including D614 viruses (45, 46) which limited diagnostic analyses of the D614G variant and individual target. It is important to note, however, that the D614G polymorphism has undergone positive selection to eventuate emergent variants (47), and these older viruses have largely been replaced by the emergent Omicron lineage(s) (6, 48). We also recognize that we did not conduct this study at the extraction step of clinical specimens given limited availability of remnant upper respiratory or saliva specimens.

A unique benefit of a highly multiplexed molecular assay is its adaptability to the natural evolution of the pathogen at hand which confers the ability to identify changes in circulating viruses that manifest as distinct target result signatures. To assess this potential, we included undefined variants to determine if the discrete assay target result patterns could elucidate a variant’s identity without necessarily providing a defined result as the current software stands. Testing of Mu specimens resulted in a distinguishable combination of 5 detectable substitutions, but each result was interpreted as a Zeta (P.2) variant. This scenario highlights the utility of distinct target results to point to new viruses that rapidly arise the circulating milieu of variants. Moreover, this underscores the importance of adaptable target result interpretation software to address acute changes detected in patient populations. We also tested clinical specimens that corresponded with the most current variant in circulation – the Omicron sublineage BA.2 – which has largely replaced BA.1 globally over January through April 2022 ([https://covariants.org/](https://covariants.org/), last accessed 4/26/22). From our results, we report a BA.2-specific pattern of target results on this panel that can be used to readily discriminate the BA.2 from the BA.1 subtype. The following weeks/months will be key to monitoring to understand the utility of this platform for capturing other emerging Omicron sublineages (e.g., BA.2.12.1, BA.3, BA.4, BA.5).

Accurate identification of currently circulating and emerging SARS-CoV-2 variants is key to effective pathogen surveillance and providing optimal care to patients. Although WGS is the mainstay for surveillance, it is important to consider in the global context of a pandemic, this may not be a realistic technology for many LICs and LMCs (29). Therefore, there is a great need for rapid, cost-effective, conventional technologies (e.g., RT-PCR) in the clinical laboratory. However, these require increased diagnostic resolution to adequately capture viral evolution and meet the needs of pathogen surveillance. Thus, highly multiplexed molecular assays such as the one presented benefit from high discriminatory power and are a vital tool to shed light on changing viral dynamics.

## Supporting information

Supplemental Tables [[supplements/275691_file03.docx]](pending:yes)

## Data Availability

All single variant consensus genome sequences were deposited in the publicly-available Global Initiative on Sharing Avian Influenza Data (GISAID) database (www.gisaid.org) [accession identifiers indicated in Table S4]. The remaining 10 genomes with mixed patters of mutations were not deposited into GISAID as single variant consensus genomes could not be resolved (data available upon request).

[https://www.gisaid.org](https://www.gisaid.org) 

## Funding

This research was supported by the Center for Research on Influenza Pathogenesis, a National Institutes of Health (NIH) funded Center of Excellence for Influenza Research and Surveillance (CEIRS, contract number HHSN272201400008C; CEIRR contract number 75N93021C00014) [Icahn School of Medicine at Mount Sinai (ISMMS)], the NIH Office of Research Infrastructure under award numbers S10OD018522 and S10OD026880 [ISMMS Scientific Computing and Data, Patricia Kovatch], institutional and philanthropic funds (Open Philanthropy Project, #2020-215611 [ISMMS Department of Microbiology, Dr. Adolfo Garcia-Sastre, V.S. and H.v.B.], the Pershing Square Foundation [Mount Sinai Health System, Dr. David L. Reich and A.E.PM.], as well as a Robin Chemers Neustein Postdoctoral Fellowship Award [A.S.GR.]. We thank the Universidad del Rosario in the framework of its strategic plan RUTA2025. Thanks to President and the University Council for leading the strategic projects (JR).

## Author contributions

M.M.H., R.B., P.S., M.S.PSP.S.G., A.E.PM., M.R.G., M.D.N., M.M., N.L., A.R., S.C., N.B., J.D.R. and E.M.S. provided clinical samples for the study. M.M.H., R.B., P.S., M.S.PSP.S.G., and A.E.PM. accessioned clinical samples. A.S.GR., A.v.d.G, K.F., M.S.PSP.S.G., M.M., N.L., A.R., S.A.C., N.B., L.H.P., and H.v.B. performed viral genome sequencing experiments. R.S. provided NGS services. A.S.GR. and M.S.PSP.S.G. performed genome assembly and data curation. M.M.H., R.B., P.S., J.D.R., M.R.G., M.D.N., C.C.C., V.S., H.v.B., E.M.S., and A.E.PM analyzed, interpreted, or discussed data. M.M.H. wrote the manuscript. M.M.H., J.D.R., and A.E.PM. conceived the study. E.M.S. and A.E.PM. supervised the study. H.v.B., V.S., A.E.PM., and E.M.S. raised financial support.

M.M.H. and A.E.PM are the guarantors of this work and, as such, had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.

## Competing Interests

Robert Sebra is VP of Technology Development and a stockholder at Sema4, a Mount Sinai Venture. This work, however, was conducted solely at Icahn School of Medicine at Mount Sinai. Otherwise, the authors declare no competing interests.

## Acknowledgments

We thank the members of MSHS MML, Simon, and van Bakel laboratories. We are grateful for the continuous expert guidance provided by the ISMMS Program for the Protection of Human Subjects (PPHS).

We are thankful for the efforts of the Mount Sinai PSP Study Group members (in alphabetical order): Hala Alshammary, Angela A. Amoako, Mahmoud H. Awawda, Christian Cognigni, Aria Rooker, Jose Polanco, Levy A. Sominsky, Komal Srivastava, Paras Shrestha, Steve Shi, Jian Zhang, Zain Khalil.

## Footnotes

*   Mount Sinai PSP Study Group (in alphabetical order): Hala Alshammary, Angela A. Amoako, Mahmoud H. Awawda, Christian Cognigni, Aria Rooker, Jose Polanco, Levy A. Sominsky, Komal Srivastava, Huanzhi Shi, Liyong Cao, Feng Chen, Jian Zhang, Zain Khalil

*   Received May 28, 2022.
*   Revision received May 28, 2022.
*   Accepted May 29, 2022.


*   © 2022, Posted by Cold Spring Harbor Laboratory

This pre-print is available under a Creative Commons License (Attribution-NoDerivs 4.0 International), CC BY-ND 4.0, as described at [http://creativecommons.org/licenses/by-nd/4.0/](http://creativecommons.org/licenses/by-nd/4.0/)

## References

1.  1.Kalia K, Saberwal G, Sharma G. 2021. The lag in SARS-CoV-2 genome submissions to GISAID. Nat Biotechnol 39:1058–1060.
    
    

2.  2.Litwin T, Timmer J, Berger M, Wahl-Kordon A, Müller MJ, Kreutz C. 2022. Preventing COVID-19 outbreaks through surveillance testing in healthcare facilities: a modelling study. BMC Infect Dis 22:105.
    
    

3.  3.Deng X, Gu W, Federman S, du Plessis L, Pybus OG, Faria N, Wang C, Yu G, Bushnell B, Pan C-Y, Guevara H, Sotomayor-Gonzalez A, Zorn K, Gopez A, Servellita V, Hsu E, Miller S, Bedford T, Greninger AL, Roychoudhury P, Starita LM, Famulare M, Chu HY, Shendure J, Jerome KR, Anderson C, Gangavarapu K, Zeller M, Spencer E, Andersen KG, MacCannell D, Paden CR, Li Y, Zhang J, Tong S, Armstrong G, Morrow S, Willis M, Matyas BT, Mase S, Kasirye O, Park M, Masinde G, Chan C, Yu AT, Chai SJ, Villarino E, Bonin B, Wadford DA, Chiu CY. 2020. Genomic surveillance reveals multiple introductions of SARS-CoV-2 into Northern California. Science [https://doi.org/10.1126/science.abb9263](https://doi.org/10.1126/science.abb9263).
    
    

4.  4.Hernandez MM, Gonzalez-Reiche AS, Alshammary H, Fabre S, Khan Z, van De Guchte A, Obla A, Ellis E, Sullivan MJ, Tan J, Alburquerque B, Soto J, Wang C-Y, Sridhar SH, Wang Y-C, Smith M, Sebra R, Paniz-Mondolfi AE, Gitman MR, Nowak MD, Cordon-Cardo C, Luksza M, Krammer F, van Bakel H, Simon V, Sordillo EM. 2021. Molecular evidence of SARS-CoV-2 in New York before the first pandemic wave. Nat Commun 12:3463.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41467-021-23688-7&link_type=DOI) 

5.  5.Tao K, Tzou PL, Nouhin J, Gupta RK, de Oliveira T, Kosakovsky Pond SL, Fera D, Shafer RW. 2021. The biological and clinical significance of emerging SARS-CoV-2 variants. Nat Rev Genet 22:757–773.
    
    

6.  6.2021. Classification of Omicron (B.1.1.529): SARS-CoV-2 Variant of Concern. World Health Organization. [https://www.who.int/news/item/26-11-2021-classification-of-omicron-(b.1.1.529)-sars-cov-2-variant-of-concern](https://www.who.int/news/item/26-11-2021-classification-of-omicron-(b.1.1.529)-sars-cov-2-variant-of-concern). Retrieved 3 March 2022.
    
    

7.  7.Dhar MS, Marwal R, Vs R, Ponnusamy K, Jolly B, Bhoyar RC, Sardana V, Naushin S, Rophina M, Mellan TA, Mishra S, Whittaker C, Fatihi S, Datta M, Singh P, Sharma U, Ujjainiya R, Bhatheja N, Divakar MK, Singh MK, Imran M, Senthivel V, Maurya R, Jha N, Mehta P, a V, Sharma P, Vr A, Chaudhary U, Soni N, Thukral L, Flaxman S, Bhatt S, Pandey R, Dash D, Faruq M, Lall H, Gogia H, Madan P, Kulkarni S, Chauhan H, Sengupta S, Kabra S, Indian SARS-CoV-2 Genomics Consortium (INSACOG)‡, Gupta RK, Singh SK, Agrawal A, Rakshit P, Nandicoori V, Tallapaka KB, Sowpati DT, Thangaraj K, Bashyam MD, Dalal A, Sivasubbu S, Scaria V, Parida A, Raghav SK, Prasad P, Sarin A, Mayor S, Ramakrishnan U, Palakodeti D, Seshasayee ASN, Bhat M, Shouche Y, Pillai A, Dikid T, Das S, Maitra A, Chinnaswamy S, Biswas NK, Desai AS, Pattabiraman C, Manjunatha MV, Mani RS, Arunachal Udupi G, Abraham P, Atul PV, Cherian SS. 2021. Genomic characterization and epidemiology of an emerging SARS-CoV-2 variant in Delhi, India. Science 374:995–999.
    
    

8.  8.Arora P, Zhang L, Rocha C, Sidarovich A, Kempf A, Schulz S, Cossmann A, Manger B, Baier E, Tampe B, Moerer O, Dickel S, Dopfer-Jablonka A, Jäck H-M, Behrens GMN, Winkler MS, Pöhlmann S, Hoffmann M. 2022. Comparable neutralisation evasion of SARS-CoV-2 omicron subvariants BA.1, BA.2, and BA.3. Lancet Infect Dis [https://doi.org/10.1016/S1473-3099(22)00224-9](https://doi.org/10.1016/S1473-3099(22)00224-9).
    
    

9.  9.Plante JA, Liu Y, Liu J, Xia H, Johnson BA, Lokugamage KG, Zhang X, Muruato AE, Zou J, Fontes-Garfias CR, Mirchandani D, Scharton D, Bilello JP, Ku Z, An Z, Kalveram B, Freiberg AN, Menachery VD, Xie X, Plante KS, Weaver SC, Shi P-Y. 2021. Spike mutation D614G alters SARS-CoV-2 fitness. Nature 592:116–121.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/S41586-020-2895-3&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F05%2F29%2F2022.05.28.22275691.atom) 

10. 10.Tang P, Hasan MR, Chemaitelly H, Yassine HM, Benslimane FM, Al Khatib HA, AlMukdad S, Coyle P, Ayoub HH, Al Kanaani Z, Al Kuwari E, Jeremijenko A, Kaleeckal AH, Latif AN, Shaik RM, Abdul Rahim HF, Nasrallah GK, Al Kuwari MG, Al Romaihi HE, Butt AA, Al-Thani MH, Al Khal A, Bertollini R, Abu-Raddad LJ. 2021. BNT162b2 and mRNA-1273 COVID-19 vaccine effectiveness against the SARS-CoV-2 Delta variant in Qatar. Nat Med [https://doi.org/10.1038/s41591-021-01583-4](https://doi.org/10.1038/s41591-021-01583-4).
    
    

11. 11.Malden DE, Bruxvoort KJ, Tseng HF, Ackerson B, Choi SK, Florea A, Tubert J, Takhar H, Aragones M, Hong V, Talarico CA, McLaughlin JM, Qian L, Tartof SY. 2021. Distribution of SARS-CoV-2 Variants in a Large Integrated Health Care System - California, March-July 2021. MMWR Morb Mortal Wkly Rep 70:1415–1419.
    
    

12. 12.Nyberg T, Ferguson NM, Nash SG, Webster HH, Flaxman S, Andrews N, Hinsley W, Bernal JL, Kall M, Bhatt S, Blomquist P, Zaidi A, Volz E, Aziz NA, Harman K, Funk S, Abbott S, COVID-19 Genomics UK (COG-UK) consortium, Hope R, Charlett A, Chand M, Ghani AC, Seaman SR, Dabrera G, De Angelis D, Presanis AM, Thelwall S. 2022. Comparative analysis of the risks of hospitalisation and death associated with SARS-CoV-2 omicron (B.1.1.529) and delta (B.1.617.2) variants in England: a cohort study. Lancet 399:1303–1312.
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F05%2F29%2F2022.05.28.22275691.atom) 

13. 13.Bruel T, Hadjadj J, Maes P, Planas D, Seve A, Staropoli I, Guivel-Benhassine F, Porrot F, Bolland W-H, Nguyen Y, Casadevall M, Charre C, Péré H, Veyer D, Prot M, Baidaliuk A, Cuypers L, Planchais C, Mouquet H, Baele G, Mouthon L, Hocqueloux L, Simon-Loriere E, André E, Terrier B, Prazuck T, Schwartz O. 2022. Serum neutralization of SARS-CoV-2 Omicron sublineages BA.1 and BA.2 in patients receiving monoclonal antibodies. Nat Med [https://doi.org/10.1038/s41591-022-01792-5](https://doi.org/10.1038/s41591-022-01792-5).
    
    

14. 14.Tada T, Zhou H, Dcosta BM, Samanovic MI, Chivukula V, Herati RS, Hubbard SR, Mulligan MJ, Landau NR. 2022. Increased resistance of SARS-CoV-2 Omicron variant to neutralization by vaccine-elicited and therapeutic antibodies. eBioMedicine 78.
    
    

15. 15.Hernandez MM, Banu R, Gonzalez-Reiche AS, Gray B, Shrestha P, Cao L, Chen F, Shi H, Hanna A, Ramírez JD, van de Guchte A, Sebra R, Gitman MR, Nowak MD, Cordon-Cardo C, Schutzbank TE, Simon V, van Bakel H, Sordillo EM, Paniz-Mondolfi AE, Mount Sinai PSP Study Group. 2021. RT-PCR/MALDI-TOF diagnostic target performance reflects circulating SARS-CoV-2 variant diversity in New York City. bioRxiv.
    
    

16. 16.Bal A, Destras G, Gaymard A, Stefic K, Marlet J, Eymieux S, Regue H, Semanas Q, d’Aubarede C, Billaud G, Laurent F, Gonzalez C, Mekki Y, Valette M, Bouscambert M, Gaudy-Graffin C, Lina B, Morfin F, Josset L, COVID-Diagnosis HCL Study Group. 2021. Two-step strategy for the identification of SARS-CoV-2 variant of concern 202012/01 and other variants with spike deletion H69-V70, France, August to December 2020. Euro Surveill 26.
    
    

17. 17.Sánchez-Calvo JM, Alados Arboledas JC, Ros Vidal L, de Francisco JL, López Prieto MD. 2021. Diagnostic pre-screening method based on N-gene dropout or delay to increase feasibility of SARS-CoV-2 VOC B.1.1.7 detection. Diagn Microbiol Infect Dis 101:115491.
    
    

18. 18.Erster O, Mendelson E, Levy V, Kabat A, Mannasse B, Asraf H, Azar R, Ali Y, Shirazi R, Bucris E, Bar-Ilan D, Mor O, Mandelboim M, Sofer D, Fleishon S, Zuckerman NS. 2021. Rapid and High-Throughput Reverse Transcriptase Quantitative PCR (RT-qPCR) Assay for Identification and Differentiation between SARS-CoV-2 Variants B.1.1.7 and B.1.351. Microbiol Spectr 9:e0050621.
    
    

19. 19.Teng I-T, Nazzari AF, Choe M, Liu T, de Souza MO, Petrova Y, Tsybovsky Y, Wang S, Zhang B, Artamonov M, Madan B, Huang A, Lopez Acevedo SN, Pan X, Ruckwardt TJ, DeKosky BJ, Mascola JR, Misasi J, Sullivan NJ, Zhou T, Kwong PD. 2021. Molecular probes of spike ectodomain and its subdomains for SARS-CoV-2 variants, Alpha through Omicron. bioRxiv.
    
    

20. 20.Ashford F, Best A, Dunn SJ, Ahmed Z, Siddiqui H, Melville J, Wilkinson S, Mirza J, Cumley N, Stockton J, Ferguson J, Wheatley L, Ratcliffe E, Casey A, Plant T, COVID-19 Genomics UK (COG-UK) Consortium, Quick J, Richter A, Loman N, McNally A. 2022. SARS-CoV-2 Testing in the Community: Testing Positive Samples with the TaqMan SARS-CoV-2 Mutation Panel To Find Variants in Real Time. J Clin Microbiol 60:e0240821.
    
    

21. 21.Nörz D, Grunwald M, Tang HT, Weinschenk C, Günther T, Robitaille A, Giersch K, Fischer N, Grundhoff A, Aepfelbacher M, Pfefferle S, Lütgehetmann M. 2022. Clinical Evaluation of a Fully-Automated High-Throughput Multiplex Screening-Assay to Detect and Differentiate the SARS-CoV-2 B.1.1.529 (Omicron) and B.1.617.2 (Delta) Lineage Variants. Viruses 14.
    
    

22. 22.Yeung Priscilla S.-W.,  Wang Hannah,  Sibai Mamdouh,  Solis Daniel,  Yamamoto Fumiko,  Iwai Naomi,  Jiang Becky,  Hammond Nathan,  Truong Bernadette,  Bihon Selamawit,  Santos Suzette,  Mar Marilyn,  Mai Claire, Mfuh Kenji O., Miller Jacob A., Huang ChunHong, Sahoo Malaya K., Zehnder James L., Pinsky Benjamin A., Caliendo Angela M. 2022. Evaluation of a Rapid and Accessible Reverse Transcription-Quantitative PCR Approach for SARS-CoV-2 Variant of Concern Identification. J Clin Microbiol :e00178–22.
    
    

23. 23.Hale R, Crowley P, Dervisevic S, Coupland L, Cliff PR, Ebie S, Snell LB, Paul J, Williams C, Randell P, Pond M, Stanley K. 2021. Development of a Multiplex Tandem PCR (MT-PCR) Assay for the Detection of Emerging SARS-CoV-2 Variants. Viruses 13.
    
    

24. 24.De Pace V, Bruzzone B, Orsi A, Ricucci V, Domnich A, Guarona G, Randazzo N, Stefanelli F, Battolla E, Dusi PA, Lillo F, Icardi G. 2022. Comparative Analysis of Five Multiplex RT-PCR Assays in the Screening of SARS-CoV-2 Variants. Microorganisms 10.
    
    

25. 25.Nussbaum EZ, Thiriveedhi V, Uddin R, Cho HE, Carroll S, Rosenberg ES, Lemieux JE, Turbett SE. 2022. Implementation of a SARS-CoV-2 Genotyping Panel for Prompt Omicron Variant Identification: A Pragmatic Tool for Clinical Laboratories. Ann Intern Med [https://doi.org/10.7326/M22-0023](https://doi.org/10.7326/M22-0023).
    
    

26. 26.Vogels CBF, Breban MI, Ott IM, Alpert T, Petrone ME, Watkins AE, Kalinich CC, Earnest R, Rothman JE, Goes de Jesus J, Morales Claro I, Magalhães Ferreira G, Crispim MAE, Brazil-UK CADDE Genomic Network, Singh L, Tegally H, Anyaneji UJ, Network for Genomic Surveillance in South Africa, Hodcroft EB, Mason CE, Khullar G, Metti J, Dudley JT, MacKay MJ, Nash M, Wang J, Liu C, Hui P, Murphy S, Neal C, Laszlo E, Landry ML, Muyombwe A, Downing R, Razeq J, de Oliveira T, Faria NR, Sabino EC, Neher RA, Fauver JR, Grubaugh ND. 2021. Multiplex qPCR discriminates variants of concern to enhance global surveillance of SARS-CoV-2. PLoS Biol 19:e3001236.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pbio.3001236&link_type=DOI) 

27. 27.Buchta C, Camp JV, Jovanovic J, Radler U, Benka B, Puchhammer-Stöckl E, Müller MM, Griesmacher A, Aberle SW, Görzer I. 2021. Inadequate design of mutation detection panels prevents interpretation of variants of concern: results of an external quality assessment for SARS-CoV-2 variant detection. Clin Chem Lab Med [https://doi.org/10.1515/cclm-2021-0889](https://doi.org/10.1515/cclm-2021-0889).
    
    

28. 28.Dikdan RJ, Marras SAE, Field AP, Brownlee A, Cironi A, Hill DA, Tyagi S. 2022. Multiplex PCR Assays for Identifying all Major Severe Acute Respiratory Syndrome Coronavirus 2 Variants. J Mol Diagn 24:309–319.
    
    

29. 29.Brito AF, Semenova E, Dudas G, Hassler GW, Kalinich CC, Kraemer MUG, Ho J, Tegally H, Githinji G, Agoti CN, Matkin LE, Whittaker C, Danish Covid-19 Genome Consortium, COVID-19 Impact Project, Network for Genomic Surveillance in South Africa (NGS-SA), GISAID core curation team, Howden BP, Sintchenko V, Zuckerman NS, Mor O, Blankenship HM, de Oliveira T, Lin RTP, Siqueira MM, Resende PC, Vasconcelos ATR, Spilki FR, Aguiar RS, Alexiev I, Ivanov IN, Philipova I, Carrington CVF, Sahadeo NSD, Gurry C, Maurer-Stroh S, Naidoo D, von Eije KJ, Perkins MD, van Kerkhove M, Hill SC, Sabino EC, Pybus OG, Dye C, Bhatt S, Flaxman S, Suchard MA, Grubaugh ND, Baele G, Faria NR. 2021. Global disparities in SARS-CoV-2 genomic surveillance. medRxiv [https://doi.org/10.1101/2021.08.21.21262393](https://doi.org/10.1101/2021.08.21.21262393).
    
    

30. 30.Xuan J, Yu Y, Qing T, Guo L, Shi L. 2013. Next-generation sequencing in the clinic: promises and challenges. Cancer Lett 340:284–295.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.canlet.2012.11.025&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23174106&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F05%2F29%2F2022.05.28.22275691.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000327293400019&link_type=ISI) 

31. 31.Lai E, Becker D, Brzoska P, Cassens T, Davis-Turak J, Diamond E, Furtado M, Gandhi M, Gort D, Greninger AL, Hajian P, Hayashibara K, Kennedy EB, Laurent M, Lee W, Leonetti NA, Lozach J, Lu J, Nguyen JM, O’Donovan KMC, Peck T, Radcliffe GE, Ramirez JM, Roychoudhury P, Sandoval E, Walsh B, Weinell M, Wesselman C, Wesselman T, White S, Williams S, Wong D, Yu Y, Creager RS. 2022. A method for variant agnostic detection of SARS-CoV-2, rapid monitoring of circulating variants, detection of mutations of biological significance, and early detection of emergent variants such as Omicron. bioRxiv.
    
    

32. 32.Welch NL, Zhu M, Hua C, Weller J, Mirhashemi ME, Nguyen TG, Mantena S, Bauer MR, Shaw BM, Ackerman CM, Thakku SG, Tse MW, Kehe J, Uwera M-M, Eversley JS, Bielwaski DA, McGrath G, Braidt J, Johnson J, Cerrato F, Moreno GK, Krasilnikova LA, Petros BA, Gionet GL, King E, Huard RC, Jalbert SK, Cleary ML, Fitzgerald NA, Gabriel SB, Gallagher GR, Smole SC, Madoff LC, Brown CM, Keller MW, Wilson MM, Kirby MK, Barnes JR, Park DJ, Siddle KJ, Happi CT, Hung DT, Springer M, MacInnis BL, Lemieux JE, Rosenberg E, Branda JA, Blainey PC, Sabeti PC, Myhrvold C. 2022. Multiplexed CRISPR-based microfluidic platform for clinical testing of respiratory viruses and identification of SARS-CoV-2 variants. Nat Med [https://doi.org/10.1038/s41591-022-01734-1](https://doi.org/10.1038/s41591-022-01734-1).
    
    

33. 33.Hernandez MM, Banu R, Shrestha P, Patel A, Chen F, Cao L, Fabre S, Tan J, Lopez H, Chiu N, Shifrin B, Zapolskaya I, Flores V, Lee PY, Castañeda S, Ramírez JD, Jhang J, Osorio G, Gitman MR, Nowak MD, Reich DL, Cordon-Cardo C, Sordillo EM, Paniz-Mondolfi AE. 2021. RT-PCR/MALDI-TOF mass spectrometry-based detection of SARS-CoV-2 in saliva specimens. J Med Virol [https://doi.org/10.1002/jmv.27069](https://doi.org/10.1002/jmv.27069).
    
    

34. 34.Hernandez MM, Banu R, Gonzalez-Reiche AS, van de Guchte A, Khan Z, Shrestha P, Cao L, Chen F, Shi H, Hanna A, Alshammary H, Fabre S, Amoako A, Obla A, Alburquerque B, Patiño LH, Ramírez JD, Sebra R, Gitman MR, Nowak MD, Cordon-Cardo C, Schutzbank TE, Simon V, van Bakel H, Sordillo EM, Paniz-Mondolfi AE. 2022. Robust clinical detection of SARS-CoV-2 variants by RT-PCR/MALDI-TOF multitarget approach. J Med Virol 94:1606–1616.
    
    

35. 35.Patiño LH, Castañeda S, Muñoz M, Ballesteros N, Ramirez AL, Luna N, Guerrero-Araya E, Pérez J, Correa-Cárdenas CA, Duque MC, Méndez C, Oliveros C, Shaban MV, Paniz-Mondolfi AE, Ramírez JD. 2022. Epidemiological Dynamics of SARS-CoV-2 Variants During Social Protests in Cali, Colombia. Front Med 9:863911.
    
    

36. 36.Rambaut A, Holmes EC, O’Toole Á, Hill V, McCrone JT, Ruis C, du Plessis L, Pybus OG. 2020. A dynamic nomenclature proposal for SARS-CoV-2 lineages to assist genomic epidemiology. Nat Microbiol 5:1403–1407.
    
    

37. 37.Gonzalez-Reiche AS, Hernandez MM, Sullivan MJ, Ciferri B, Alshammary H, Obla A, Fabre S, Kleiner G, Polanco J, Khan Z, Alburquerque B, van de Guchte A, Dutta J, Francoeur N, Melo BS, Oussenko I, Deikus G, Soto J, Sridhar SH, Wang Y-C, Twyman K, Kasarskis A, Altman DR, Smith M, Sebra R, Aberg J, Krammer F, García-Sastre A, Luksza M, Patel G, Paniz-Mondolfi A, Gitman M, Sordillo EM, Simon V, van Bakel H. 2020. Introductions and early spread of SARS-CoV-2 in the New York City area. Science 369:297–301.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6Mzoic2NpIjtzOjU6InJlc2lkIjtzOjEyOiIzNjkvNjUwMS8yOTciO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMi8wNS8yOS8yMDIyLjA1LjI4LjIyMjc1NjkxLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

38. 38.Ramírez JD, Muñoz M, Ballesteros N, Patiño LH, Castañeda S, Rincón CA, Mendez C, Oliveros C, Perez J, Márquez EK,  Ortiz F de LS, Correa-Cárdenas CA, Duque MC, Paniz-Mondolfi A. 2021. Phylogenomic Evidence of Reinfection and Persistence of SARS-CoV-2: First Report from Colombia. Vaccines (Basel) 9.
    
    

39. 39.Landis JR, Koch GG. 1977. The measurement of observer agreement for categorical data. Biometrics 33:159–174.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.2307/2529310&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=843571&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F05%2F29%2F2022.05.28.22275691.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=A1977CY39700012&link_type=ISI) 

40. 40.Planas D, Veyer D, Baidaliuk A, Staropoli I, Guivel-Benhassine F, Rajah MM, Planchais C, Porrot F, Robillard N, Puech J, Prot M, Gallais F, Gantner P, Velay A, Le Guen J, Kassis-Chikhani N, Edriss D, Belec L, Seve A, Courtellemont L, Péré H, Hocqueloux L, Fafi-Kremer S, Prazuck T, Mouquet H, Bruel T, Simon-Lorière E, Rey FA, Schwartz O. 2021. Reduced sensitivity of SARS-CoV-2 variant Delta to antibody neutralization. Nature 596:276–280.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1101/2021.05.26.445838&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F05%2F29%2F2022.05.28.22275691.atom) 

41. 41.Liu C, Ginn HM, Dejnirattisai W, Supasa P, Wang B, Tuekprakhon A, Nutalai R, Zhou D, Mentzer AJ, Zhao Y, Duyvesteyn HME, López-Camacho C, Slon-Campos J, Walter TS, Skelly D, Johnson SA, Ritter TG, Mason C, Costa Clemens SA, Gomes Naveca F, Nascimento V, Nascimento F, Fernandes da Costa C, Resende PC, Pauvolid-Correa A, Siqueira MM, Dold C, Temperton N, Dong T, Pollard AJ, Knight JC, Crook D, Lambe T, Clutterbuck E, Bibi S, Flaxman A, Bittaye M, Belij-Rammerstorfer S, Gilbert SC, Malik T, Carroll MW, Klenerman P, Barnes E, Dunachie SJ, Baillie V, Serafin N, Ditse Z, Da Silva K, Paterson NG, Williams MA, Hall DR, Madhi S, Nunes MC, Goulder P, Fry EE, Mongkolsapaya J, Ren J, Stuart DI, Screaton GR. 2021. Reduced neutralization of SARS-CoV-2 B.1.617 by vaccine and convalescent serum. Cell 184:4220-4236.e13.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/J.CELL.2021.06.020/ATTACHMENT/10183911-F97E-4DA5-AE05-227854F207F4/MMC1.PDF&link_type=DOI) 

42. 42.Lusvarghi S, Pollett SD, Neerukonda SN, Wang W, Wang R, Vassell R, Epsi NJ, Fries AC, Agan BK, Lindholm DA, Colombo CJ, Mody R, Ewers EC, Lalani T, Ganesan A, Goguet E, Hollis-Perry M, Coggins SA, Simons MP, Katzelnick LC, Wang G, Tribble DR, Bentley L, Eakin AE, Broder CC, Erlandson KJ, Laing ED, Burgess TH, Mitre E, Weiss CD. 2022. SARS-CoV-2 BA.1 variant is neutralized by vaccine booster-elicited serum, but evades most convalescent serum and therapeutic antibodies. Sci Transl Med eabn8543.
    
    

43. 43.Yu J, Collier A-RY, Rowe M, Mardas F, Ventura JD, Wan H, Miller J, Powers O, Chung B, Siamatu M, Hachmann NP, Surve N, Nampanya F, Chandrashekar A, Barouch DH. 2022. Neutralization of the SARS-CoV-2 Omicron BA.1 and BA.2 Variants. N Engl J Med 386:1579– 1580.
    
    

44. 44.Guo D, Duan H, Cheng Y, Wang Y, Hu J, Shi H. 2022. Omicron-included mutation-induced changes in epitopes of SARS-CoV-2 spike protein and effectiveness assessments of current antibodies. Molecular Biomedicine 3:12.
    
    

45. 45.Korber B, Fischer WM, Gnanakaran S, Yoon H, Theiler J, Abfalterer W, Hengartner N, Giorgi EE, Bhattacharya T, Foley B, Hastie KM, Parker MD, Partridge DG, Evans CM, Freeman TM, de Silva TI, Sheffield COVID-19 Genomics Group, McDanal C, Perez LG, Tang H, Moon-Walker A, Whelan SP, LaBranche CC, Saphire EO, Montefiori DC. 2020. Tracking Changes in SARS-CoV-2 Spike: Evidence that D614G Increases Infectivity of the COVID-19 Virus. Cell 182:812-827.e19.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.cell.2020.06.043&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F05%2F29%2F2022.05.28.22275691.atom) 

46. 46.Isabel S, Graña-Miraglia L, Gutierrez JM, Bundalovic-Torma C, Groves HE, Isabel MR, Eshaghi A, Patel SN, Gubbay JB, Poutanen T, Guttman DS, Poutanen SM. 2020. Evolutionary and structural analyses of SARS-CoV-2 D614G spike protein mutation now documented worldwide. Sci Rep 10:14031.
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F05%2F29%2F2022.05.28.22275691.atom) 

47. 47.Chakraborty C, Saha A, Sharma AR, Bhattacharya M, Lee S-S, Agoramoorthy G. 2021. D614G mutation eventuates in all VOI and VOC in SARS-CoV-2: Is it part of the positive selection pioneered by Darwin? Mol Ther Nucleic Acids 26:237–241.
    
    

48. 48.Mallapaty S. 2022. Where did Omicron come from? Three key theories. Nature Publishing Group UK. [https://doi.org/10.1038/d41586-022-00215-2](https://doi.org/10.1038/d41586-022-00215-2). Retrieved 25 April 2022.