Abstract
In response to the rapidly evolving COVID-19 pandemic, the U.S. Food and Drug Administration (FDA) has rapidly issued 49 emergency use authorizations (EUAs) for SARS-CoV-2 in vitro diagnostic test-kits. A critical metric in the performance evaluation for a diagnostic test kit is the analytical sensitivity, which is measured by the limit of detection (LOD). Commercial RNA stocks with known titers are used to determine LOD. We identified a problem with the titer reported for the commercial stocks when examining the analytical sensitivity of the reverse transcription quantitative PCR (RT-qPCR) protocol that is recommended by the Centers for Disease Control and Prevention (CDC) using plasmid DNA from Integrated DNA Technologies (IDT), synthetic RNA from BEI Resources (BEI), and extracted genomic RNA from BEI. We detected 3/3 positives for reactions containing synthetic RNA at a concentration of 0.1 copies/reaction (based on the supplier’s label concentration). The apparent better-than-single-molecule performance is a statistically highly unlikely event, indicating a potential inaccuracy in the supplier’s quantification of the stock material. Using an ultrasensitive and precise assay, reverse transcription digital PCR (RT-dPCR), we independently quantified concentrations of commercial SARS-CoV-2 plasmid DNA and SARS-CoV-2 RNA stocks. For plasmid DNA, the actual concentration measured by RT-dPCR was 11% of the nominal label concentration. For synthetic RNA, the actual concentration measured by RT-dPCR for one lot was 770% of the label concentration and for a different lot was 57% of the label concentration. For genomic RNA, the concentration measured by RT-dPCR for one lot was 240% of the label concentration and for a different lot it was 300% of the label concentration. This SARS-CoV-2 genomic RNA from BEI Resources has been used in at least 11 approved FDA Emergency Use Authorizations as of April 27, 2020. Such deviations of reported RNA or DNA stock concentrations from true concentrations can result in inaccurate quantification and calculation of LOD. Precise and accurate reporting of DNA and RNA stock concentrations by commercial suppliers will enable accurate quantification of assay performance, which is urgently needed to improve evaluation of different assays by diagnostic developers and regulatory bodies.
Competing Interest Statement
R.F.I. receives droplet digital PCR patent royalties from Bio-Rad and has a financial interest in Talis Biomedical Corp.
Funding Statement
This work was funded in part by an Innovation in Regulatory Science Award (IRSA) from the Burroughs Wellcome Fund, a grant from the Jacobs Institute for Molecular Engineering for Medicine (Caltech) and NSF Graduate Research Fellowship DGE-144469 (to E.J.).
Author Declarations
All relevant ethical guidelines have been followed; any necessary IRB and/or ethics committee approvals have been obtained and details of the IRB/oversight body are included in the manuscript.
Yes
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
California Institute of Technology 1200 E. California Blvd., Pasadena, CA, 91125 United States
Data Availability
All data will be made available at CaltechDATA upon publication.
