Abstract
Point-of-care lateral-flow assays (LFAs) are becomingly increasingly prevalent for diagnosing individual patient disease status and surveying population disease prevalence in a timely, scalable, and cost-effective manner, but a central challenge is to assure correct assay operation and results interpretation as the assays are manually performed in decentralized settings. A smartphone-based software can automate interpretation of an LFA kit, but such algorithms typically require a very large number of images of assays tested with validated specimens, which is challenging to collect for different assay kits, especially for those released during a pandemic. Here, we present an approach – AutoAdapt LFA – that uses few-shot learning, an approach used in other applications such as computer vision and robotics, for accurate and automated interpretation of LFA kits that requires a small number of validated images for training. The approach consists of three components: extraction of membrane and zone areas from an image of the LFA kit, a self-supervised encoder that employs a feature extractor trained with edge-filtered patterns, and few-shot adaptation that enables generalization to new kits using limited validated images. From a base model pre-trained on a commercial LFA kit, we demonstrated the ability of adapted models to interpret results from five new COVID-19 LFA kits (three detecting antigens for diagnosing active infection, and two detecting antibodies for diagnosing past infection). Specifically, using just 10 to 20 images of each new kit, we achieved accuracies of 99% to 100% for each kit. The server-hosted algorithm has an execution time of approximately 4 seconds, which can potentially enable quality assurance and linkage to care for users operating new LFAs in decentralized settings.
Competing Interest Statement
A version of this algorithm has been licensed by Columbia University to Safe Health Systems, Inc.
Funding Statement
Assay kits were kindly provided to Mayo Clinic for evaluations from Acon, Paramount (DeepBlue and Jinwofu), EcoTest (EcoTest Housing 2), and BTNX (EcoTest Housing 1). The work was supported by Herbert Irving Comprehensive Cancer Center in partnership with the Irving Institute for Clinical and Translational Research via a SARS-CoV-2 Research Pilot Grant, Columbia University School of Engineering and Applied Science via a Technology Innovations for Urban Living in the Face of COVID-19 Pilot Grant, and a gift from Bing Zhao.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
Serum samples for the antibody tests were collected under Mayo Clinic IRB 20-004544 or shared by the Department of Laboratory Medicine at the University of Washington School of Medicine (Seattle, WA). The use of excess clinical specimens was reviewed by the Mayo Clinic Biospecimens Committee and an appropriate Material Transfer Agreement was drawn up to allow access to de-identified specimens from the University of Washington School of Medicine. The University of Washington IRB approved this work with a consent waiver. Nasopharyngeal swabs from Mayo Clinic Hospital patients were heat fixed and run for the antigen tests under Mayo Clinic IRB 20-010688.
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Data Availability
The image library and code are available on request.