Development and potential usefulness of the COVID-19 Ag Respi-Strip® diagnostic assay in a pandemic context

INTRODUCTION

Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) represents a major health threat for humankind (1). In the absence of vaccine and specific antiviral treatment, the containment of the pandemic relies mainly on rapid identification and isolation of COVID-19 patients (2). In addition to chest computed tomography (CT), this strategy is based on the availability of real-time reverse transcription polymerase chain reaction (qRT-PCR) to be performed on any suspect patient presenting specific symptoms (3). These symptoms being similar to seasonal flu, it’s currently not possible to test all patients with flu-like symptoms due to the lack of resources and available diagnostic tests. As mentioned in the audio interview of the New England Journal of Medicine the 19^th of March 2020 (2), the importance of establishing the correct diagnosis is central to give the appropriate care to COVID-19 patients.

So far, several molecular-based tests have been developed and are being implemented in laboratories and reference centres with capabilities to perform such tests (see https://www.who.int/emergencies/diseases/novel-coronavirus-2019/technical-guidance/laboratory-guidance for details). However, the availability of molecular diagnostic tests is a concern, as we face worldwide shortage of the reagents. Although molecular diagnosis is the most sensitive and specific diagnostic method, the need for material, reagent and trained personnel limit the number of assays that can be performed and saturates the laboratories. Moreover, qRT-PCR still does not have a very rapid turnaround time (TAT).

The development of rapid diagnostic assays allows faster confirmation of a clinical suspicion of COVID-19, leading to earlier isolation and appropriate clinical care for the patients with positive results. Several serological tests have been developed but serological antibody-detection assays do not fulfil the requirement of the detection early after infection as the average incubation period of 3-5 days is too short for the development of an immune response (4).

In this perspective, Coris BioConcept (a Belgian manufacturer) has developed an immunochromatographic assay (ICT) for the rapid detection of SARS-CoV-2 antigen on nasopharyngeal specimens in about 15 minutes. Thanks to the results from previous research work on SARS-CoV, the nucleoprotein was identified as the best target for a sensitive diagnostic sandwich assay using monoclonal antibodies (5, 6,7). The SARS-CoV-2 shares high similarity with bat coronaviruses and the known SARS-CoV of the 2002-2003 epidemic (8) provided the opportunity to use previously developed reagents for developing a rapid diagnostic assay able to also detect the new SARS-CoV-2. The diagnostic technique, consisting of an anti-SARS-CoV capture antibody fixed onto nitrocellulose strip and a labelled anti-SARS-CoV antibody migrating with the buffer and the sample.

Regarding the COVID-19 pandemic and the urgency of sharing relevant data, in this original research article we describe the analytical performance of COVID-19 Ag Respi-Strip, according to the requirements of the actual European Directive 98/79/EC (9), the future European Regulation 2017/746 on in vitro diagnostic (IVD) medical devices (10), the Scandinavian SKUP-protocol (11) used for validation of qualitative tests and the clinical performance obtained with a multi-centric retrospective study. In addition, we reflect on the risk management and the conditions to be fulfilled before implementation as a point-of-care test (POCT) outside the hospital.

MATERIALS AND METHODS

Development of the COVID-19 Ag Respi-Strip

Antibodies and antigen

Eleven antibodies (designed A to K) (12) were coated at various concentrations on nitrocellulose (Advanced microdevices, India) with antibodies A to J coupled to colloidal gold beads (NanoQ, Belgium). Recombinant SARS-CoV nucleoprotein (recNP) preparation was obtained as described previously (12) and was coated on a nitrocellulose membrane or conjugated on colloidal gold nanoparticles. Recombinant his-tagged SARS-CoV-2 NP (recNP-2) has been produced in insect cell and purified (2-step purification); final purity > 90% (Genscript, Leiden, NL).

COVID-19 Ag Respi-Strip

the ICT strip consists of nitrocellulose laminated on a plastic backing, colloidal-gold conjugates being dried in a conjugate pad (Ahlstrom-Munksjö, France) overlapping the bottom of the nitrocellulose. For preliminary direct detection, SARS-CoV and SARS-CoV-2 NPs were coated at 100µg/ml and gold-labelled antibodies were deposited at 0.85µl/mm at 3 OD530nm. For the COVID-19 Ag Respi-Strip test, monoclonal antibodies directed against SARS-CoV and SARS-CoV-2 highly conserved nucleoprotein antigen are coated on the nitrocellulose. Another monoclonal antibody is conjugated to colloidal gold nanoparticles. The conjugate is immobilized on the conjugate pad. During the development, tests analysing the antibody reactivity and intensity were performed using serial dilutions of SARS-CoV-2 in a final volume of 300µl of buffer (data not shown here, cfr. Supplementary material). The results were determined after 15 min.

The standard operating procedure for COVID-19 Ag Respi-Strip is as follows (Figure 1): Transfer 100 µL of nasopharyngeal sample (nasopharyngeal aspirates, nasopharyngeal washes or nasal/nasopharyngeal swabs) in the collection tube. Add 100 µL of the LY-S dilution buffer to reach a dilution ratio of 1/2. Cap the tube with the stopper. Stir thoroughly to homogenize the solution. Open the tube. Immerse the strip in the direction indicated and close the tube with the stopper. Allow to react 15 minutes and read the result. For the interpretation of results, with a negative test result, a reddish-purple line appears at the Control line (C) position (upper line). No other band is present. For a positive test result, in addition to a reddish-purple band at the Control line (C), a visible reddish-purple band appears at the Test line position (T). Intensity of the test line may vary according to the quantity of antigens found in the sample. Any reddish purple line (T), even weak, should be considered as a positive result. An invalid test result is when the absence of a Control line indicates a failure in the test procedure. Repeat invalid tests with a new strip. Discard the closed tube according to Biohazard rules.

• Download figure
• Open in new tab

Figure 1:

Standard Operating Procedure SARS-CoV-2 Respi-Strip from Coris BioConcept.

ELISA

A 96-well microtiter plate was coated with 50 µL recNP and recombinant maltose binding protein (MBP, 1 µg/mL) and incubated overnight at 4 °C. The plate was washed with water and washing buffer (phosphate-buffered saline/0.5% Tween-20, PBS-T) and 200 µL blocking solution (PBS-T/5 % milk powder) was added for 20 minutes. Blocking solution was discarded and mAbs were added at 100 pg/ml in 50 µL blocking solution to recNP and MBP and incubated for 1 hour. The plate was washed again and 50 µL rabbit anti-mouse IgG/HRP (Dako) was added at 1:1000 dilution for another 1 hour incubation. The plate was washed and 50 microliter TMB substrate solution was added. All incubations took place at room temperature. The enzymatic reaction was stopped by addition of 50 µL 1 N H2SO4 and light absorption was measured with a photometer at 450 nm using 570 nm as reference wavelength. Measurements were done in duplicates. To obtain the final OD, the OD obtained with the control protein MBP was subtracted from the OD obtained with recNP.

Virus

SARS-CoV-2 passage 3 (SARS-CoV-2-Iso_01-Human-2020-02-07-Swe, accession no/genebank no MT093571) was cultured on Vero E6 cells. The titre was determined using plaque assay as describe before with fixation of cells 72hpi. All experiments involving isolated SARS-CoV-2 were performed in Biosafety Level 3 Laboratory at Public Health Agency of Sweden (Folkhälsomyndigheten, Stockholm, Sweden).

qRT-PCR

Sample was extracted using Direct-zol RNA MiniPrep kit (Zymo Research). qRT-PCR was run using E-gene SARS-CoV-2 primers/probe following World Health organization advises (13).

RESULTS

Clinical performance study

The overall clinical sensitivity is 57.6% and clinical specificity is 99.5%, with a PPV of 98.7%, NPV of 77.7% and an accuracy of 82.6% (Table 2). Even if the overall sensitivity of 57.6% will detect 6 out of 10 random people with COVID-like symptoms presenting at the hospital, in the subpopulation with the most contagious patients with the highest viral load (i.e. with Ct<25), this test will detect 7 out of 10 positive COVID-19 patients. In the COVID-19 population, the Cts ranged from 9.4 to 39.4 and the cut-off of the COVID-19 Ag Respi-Strip was found at Ct<22. Below the cut-off, the clinical sensitivity was 95.0%. A small number of samples has been studied from symptomatic healthcare workers (N=53), and the clinical performance showed a sensitivity of 68.0% and specificity of 100.0% in this subpopulation. Based on the results of the clinical performance study, a diagnostic decision algorithm is proposed in figure 2.

• Download figure
• Open in new tab

Figure 2:

Proposal for a diagnostic decision algorithm.

Risk Management

To visualize the risks and bottlenecks of the use of COVID-19 Ag Respi-Strip, an Ishikawa diagram has been created considering continuous risk management (Fig. 3). The facilities of a clinical biology laboratory are recommended in the Ishikawa diagram, to respond to the highest quality assurance and to permit lab technicians to handle the sample according to biosafety recommendations.

• Download figure
• Open in new tab

Figure 3:

Ishikawa diagram of rapid SARS-CoV-2 diagnostic tests for Clinical Labs’ Implementation.

DISCUSSION

The extraordinary spread of SARS-CoV-2 has resulted in the need for accelerated development of rapid and accurate laboratory diagnostic tests, allowing fast and accurate detection of infected patients (18). In this perspective, fast near-patient testing (POCT) could represent an effective diagnostic tool for prompt clinical and quarantine decisions. Besides the recent certification of molecular POCT such as Xpert^®Xpress SARS-CoV-2 on GeneXxpert (Cepheid), or ID NOW COVID-19 on Alere-i (Abbott), antigenic test could represent a valuable alternative, especially in the context of worldwide reagents’ and instruments’ shortage (which have already been reported for these molecular POCTs).

Next to a pre-peer reviewed article reporting a fluorescence immunochromatographic assay detecting nucleocapsid protein of SARS-CoV-2 in nasopharyngeal swab (19), this original research report is, according to our knowledge, the first one describing the analytical and clinical performance of a non-fluorescent ICT that can detect SARS-CoV-2 antigen in nasopharyngeal samples.

The analytical sensitivity of 74.2% found in a subpopulation with high SARS-CoV-2 viral load (Ct<25), the analytical specificity of 100.0% and robustness of 98.0% for COVID-19 Ag Respi-Strip show a promising new technique. In addition, our multi-centric retrospective study confirms the promising results, with a clinical sensitivity of 57.6% and a clinical specificity of 99.5%. The clinical sensitivity is 68.0% in a sub-population of healthcare workers and increases to 73.9% in a subpopulation of the most contagious patients with high viral load (Ct<25). It should be noted that for the clinical validation in this study, the samples were collected in transport media first for being processed by qRT-PCR, and leftovers were used with some delay with COVID-19 Ag Respi-Strip. Not only the sensitivity may have been impacted by the delay between sample collections and processing, also the dilution of sample in the transport media may affect the sensitivity of the assay. A clinical validation using the swab sample directly eluted in the assay buffer and test is required to assess the sensitivity of the assay as a POCT.

The overall sensitivity found in the analytical validation was probably lower than the overall clinical sensitivity because we used fresh samples in the clinical study while the samples for the analytical study were stored during 3 to 6 days at -20°C, and transported at room temperature after thawing in the fridge. As tested with four clinical samples (stored at 2-8°C), the intensity of the reaction slightly diminished after 24h. Further sample storage studies have to be conducted in the near future.

According to the manufacturer’s IFU, the nasopharyngeal samples must be tested as soon as possible after collection, which concords with the need for rapid diagnosis in this pandemic situation. In our population, we did not see any difference between nasopharyngeal swabs and nasopharyngeal aspirates. Because recent published data report high viral loads in nasopharyngeal, mid-turbinate, and nares specimen, we can infer that the ICT could also have a good sensitivity for such specimen. This has previously been described for other viruses and quantitative techniques (20). The evaluation on other swabs such as foam or polyester swabs should also be performed.

When we reflect on the cross-reactivity study, the number of samples analysed for S. aureus was not sufficient and sputum was not prescribed as sample type in the manufacturer’s IFU. Whether the false positive sputum was due to a matrix effect, its high-viscosity or to S. aureus, is not clear. Sputa from cystic fibrosis patients possess special characteristics, like higher viscosity and multi-pathogenic culture. To be prudent, at this stage, sputum should be avoided with the COVID-19 Ag Respi-Strip, because false-positive results cannot be excluded with this sample type. Whether cystic fibrosis patients should be excluded from analysis with the COVID-19 Ag Respi-Strip and directly receive a diagnosis with qRT-PCR, is not clear, but could be a judicious advice, as long as we lack further evidence.

In a subpopulation with high viral shedding (N=88 with Ct<25), probably the most infectious patients, the clinical sensitivity was 73.9% and we noticed during evaluation that the majority of the positive patients contained high viral loads. Indeed, 66.7% of all positive patients in the clinical performance study had a Ct below 25. Shi Y. et al. mention the severe respiratory symptomatic stage is associated with high viral load (4).

In regard to our results, the test is accurate enough (with an overall accuracy of 82.6%) for implementing in the frame of an integrative diagnostic strategy combining both rapid diagnostic test based on SARS-CoV-2 antigen detection with COVID-19 Ag Respi-Strip, molecular POCT and diagnostics on large automated platform, the latter often requiring a TAT of more than 4 hours.

Figure 2 shows the rapid antigen test can have a role to rapidly take measures at the entry of the emergency department in a pandemic context with high prevalence of COVID-19. Thanks to its specificity of 99.5%, antigen test-positive patients could receive immediate care while antigen test-negative patients will need to wait for CT-scan for triage and the result of qRT-PCR for confirmation of SARS-CoV-2. When the peak of the epidemic approaches and prioritization has to be done, to relieve the emergency department in a situation seeking implementation of fast hygienic measures and rapid patient care, it is defensible not to confirm the antigen test-positive patients with qRT-PCR.

In the proposal for a diagnostic decision algorithm, the TAT could be restrained to 15 minutes after sample collection for patients with a high viral load (Fig. 2). The decision algorithm in Figure 2 shows the potential clinical usefulness of the COVID-19 Ag Respi-Strip for patients suspected of SARS-COV-2 infection thanks to its high positive predictive value of 98.7%. However, suspected patients suffering from severe comorbidities could benefit from molecular POCT if available, because a higher negative predictive value is desired. But the format and the cost of molecular POCT limit them in large screening strategy especially when resources are limited and distribution is delayed.

Since the Hospital Urgency Plan has been declared in Belgium, the healthcare workers focus on severely and critically-ill COVID-19 patients needing hospitalisation. Nasopharyngeal samples for COVID-19 suspected patients are collected at presentation at the emergency department. These samples possess probably the highest viral load because they are the closest to the date of onset of symptoms referring to the kinetics of the viral load as shown in Cao et al. (21).

For this reason, we consider the COVID-19 Ag Respi-Strip could have a relevant place in the diagnostic algorithm at the entry of the emergency department, for the COVID-19 suspected patients at risk of developing severe disease who will require hospitalisation, according to the definition of a possible COVID-19 case as described by the Authorities (Fig. 2).

This decision algorithm would prepare all clinical laboratories for the significant increase in the number of specimen that will need to be tested for COVID-19, when large areas of the country face with community transmission. If a 24/7/365 work organization is proposed by the lab, the rapid result for positive cases in 30 minutes after reception of the specimen, would help to take immediate measures to prevent further spread of the most infectious cases. In a multi-site consolidated clinical microbiology laboratory model such as in the LHUB-ULB (22), a 24-h COVID-19 diagnostic service is provided by dedicated clinical microbiology technologists located in the central lab, while in satellite labs the COVID-19 Ag Respi-Strip is handled 24 hours a day by technologists from chemistry or haematology after cross-training to competently perform and interpret the results of the rapid test. Samples with a negative ICT result are transferred to the central laboratory for molecular diagnosis.

Post-implementation analysis of samples collected in the LHUB-ULB between the 31^st of March and the 7^th of April 2020 from patients in 4 hospitals from Brussels showed 33.3% (325/975) total positive COVID-19 test results of which 39.7% (129/325) was detected by COVID-19 Ag Respi-Strip. At epidemic peak days with screening of only COVID-19 suspected patients, the proposed algorithm allowed us to avoid 13.2% (129/975) screening qRT-PCR tests, reducing not only expensive qRT-PCR costs, but also the consumption of scarce reagents and consumables. Even if the cost of COVID-19 Ag Respi-Strip is far lower than the cost of our molecular diagnostic methods, budget impact should be studied within a larger health economic frame questioning whether a CT-scan would still be needed for triage and taking into account that the time gain for implementation of biosafety measures when the early positive result of the COVID-19 Ag Respi-Strip will help the clinician at the entry of the emergency to redirect his patient faster without the need for performing a CT-scan.

At this point, no outpatient population has been sampled due to the lack of material for diagnostic testing. Further studies are needed to test the COVID-19 Ag Respi-Strip in the outpatient population, with a special attention to healthcare workers at the frontline like general practitioners (GPs) and pharmacists, in regular contact with mild and pauci-symptomatic patients. One could consider that in conjunction with public health authorities, isolation measures could eventually be focused on those outpatient people with a positive COVID-19 Ag Respi-Strip result, in a subpopulation with a high pre-test prevalence, supposing it could become a tool for managing the lock-down. The implementation of this measure would depend on the precipitating pandemic situation and the possibility to start supplemental prospective outpatient studies or not, regarding the priority in which patient population the COVID-19 Ag Respi-Strip would be implemented first, considering the production capacities of this new method and the highest public health impact of reducing transmission using available resources. Furthermore, the COVID-19 Ag Respi-Strip could be used in residential care centers, supposing a high positivity ratio in closed communities.

Considering risk management and the bottlenecks mentioned in Fig. 3, the Ishikawa diagram shows that COVID-19 Ag Respi-Strip is readily implementable in all clinical laboratories, also the peripheral labs, procuring first-line diagnostic results inside and outside the hospital, to GPs and medical specialists all over the country. Although the standard operating procedure seems to be written for using the device as a POCT, caution has to be taken before widely application in GPs’ cabinets for three reasons. First, in Belgium the legal framework has not been published yet for designating responsibilities of healthcare workers using POCT outside the hospital environment. A proposal for a legal framework has been drafted, closely relating the GP to a clinical laboratory to guarantee traceability within a recognized quality management system and certification of competent users after training. Secondly, regarding the biosecurity rules for handling COVID-19 suspicious respiratory samples, and the absence of a Biological Safety Cabinet Class II at the GP’s office, the GP should possess all protection material like a biohazard bin, sterile gloves, a disposable lab coat, lab glasses and a FFP2 mask. Third, in this study, we did not record how many COVID-19 Ag Respi-Strips gave weak intensities for the control and test lines. But in our User friendly study, the observers mentioned a source of error when reading weakly positive COVID-19 Ag Respi-Strip due to the difficulty to visualize the colour line through the closed tube. To better visualize the strip when good light (such as with Crystal tubes) is not available, the lab technician had sometimes to open the test tube in the laminar air flow cabinet and pull out the strip with forceps. This type of operation would never be acceptable in a GP environment. At this point, the design of the device is a strip into a closed reaction tube, but R&D will continue to improve its maturity, with the perspective of a closed cassette including closed sample handler enhancing visualisation of the test line and reducing the risk of user error in interpretation of the results. Then, a pilot study should evaluate the applicability of the COVID-19 Ag Respi-Strip as a POCT device at the GP’s office, to report the performances obtained in a relevant environment with the intended users.

CONCLUSION

Our study is the first report evaluating the diagnostic efficacy of the disposable rapid antigen COVID-19 Ag Respi-Strip to detect SARS-COV-2 which expansively spreads worldwide. The satisfying performance and operational utility are promising for first-line diagnosis of COVID-19 in this pandemic situation, accelerating the care process and limiting qRT-PCR analysis to those patients found negative with the rapid antigen test. As mentioned in the proposed diagnostic algorithm, the COVID-19 Ag Respi-Strip may play a triage role during the peak of the pandemic because of the high prevalence, especially at the entry of the emergency department when patients present with high viral load. It is readily implementable in all clinical laboratories, procuring first-line diagnostic results inside and outside the hospital, to GPs and medical specialists. On the contrary, the applicability of the IVD medical device as POCT for GPs could be questioned regarding its maturity (not yet available as a closed cassette with closed sample handler), the legal responsibilities and the concordant distribution of biosafety material, especially when facing worldwide ruptures of FFP2 masks. In summary, the role of the COVID-19 Ag Respi-Strip is complementary to the currently-used molecular techniques.

Conflict of interest statement

Two parties have merged their expertise within this article with the intention of delivering a publication in the interest of the public health system: On the one hand, the IVD medical device has been developed by the investigator Pascal Mertens, Henri Magein, and Justine Bouzet working for Coris BioConcept and therefore considered a scientific investigators with potential conflict of interest even they don’t have any share in this company. Thierry Leclipteux was also involved in the development of this test and as CEO of Coris Bioconcept he has a potential conflict of interest. On the other hand, the validation as described in the analytical performance study, the clinical performance study and the risk management have been done completely independent from Coris BioConcept, without any conflict of financial interest. All scientific investigators that are external to Coris BioConcept declare having no conflict of interest. Coris BioConcept has offered the reagents for validation and after CE-certification, some kits for diagnosing the homeless people suspected with COVID-19 in Brussels.