ABSTRACT
Background The app-based COVID Symptom Study was launched in Sweden to disseminate real-time estimates of disease spread and to collect prospective data for research. The aim of this study was to describe the project, develop models for estimation of COVID-19 prevalence and to evaluate it for prediction of hospital admissions for COVID-19.
Methods We enrolled 143 531 study participants (≥18 years) throughout Sweden, who contributed 10.6 million daily symptom reports between April 29, 2020 and February 10, 2021. Data from 19 161 self-reported PCR tests were used to create a symptom-based algorithm to estimate daily prevalence of symptomatic COVID-19. The prediction model was validated using external datasets and used to forecast subsequent new hospital admissions.
Results A prediction model for symptomatic COVID-19 based on 17 symptoms, age, and sex yielded an area under the ROC curve of 0.78 (95% CI 0.74-0.83) in an external validation dataset. App-based surveillance proved particularly useful for predicting hospital trends in times of insufficient testing capacity and registration delays. During the first wave, our prediction model estimates demonstrated a lower mean error (0.38 average new daily hospitalizations per 100 000 inhabitants per week (95% CI 0.32, 0.45)) for subsequent hospitalizations in the ten most populated counties, than a model based on confirmed case data (0.72 (0.64, 0.81)).
Conclusions The experience of the COVID Symptom Study highlights the important role citizens can play in real-time monitoring of infectious diseases, and how app-based data collection may be used for data-driven rapid responses to public health challenges.
Key messages
The app-based COVID Symptom Study, which was launched in Sweden in April 2020 collecting symptom and test data from voluntary adult study participants, could within weeks disseminate real-time estimates of disease spread contemporaneously collecting prospective data for COVID-19 research.
A prediction model for symptomatic COVID-19 based on symptoms, age, and sex was able to discrimate between test-positive and test-negative individuals with an area under the ROC curve of 0.78 (95% CI 0.74-0.83) in an external validation dataset.
App-based surveillance proved particularly useful for predicting hospital trends in times of insufficient testing capacity and registration delays.
The experience of the COVID Symptom Study highlights the importance of citizen science in real-time monitoring of infectious diseases, and how app-based data collection may be used for data-driven rapid responses to public health challenges.
Competing Interest Statement
COVID Symptom Study Sweden (CSSS) is a strictly non-commercial research project. PF consults for and has stock options in ZOE Limited relating to the PREDICT nutrition studies, which are entirely separate from the COVID Symptom Study app development and COVID-19 research. ATC previously served as an investigator on the PREDICT nutrition studies. TDS is a consultant to ZOE Limited. TS is the current CEO and a shareholder at Novus International Group AB, Sweden. RD, JW, JCP, SG, AM, SS and JLC work for ZOE Limited. All other authors declare that they have no competing interests.
Funding Statement
Swedish Heart-Lung Foundation (20190470, 20140776), Swedish Research Council (EXODIAB, 2009-1039; 2014-03529), European Commission (ERC-2015-CoG - 681742 NASCENT), and Swedish Foundation for Strategic Research (LUDC-IRC, 15-0067) to MG or PF. European Research Council Starting Grant (801965) to TF. NO was financially supported by the Knut and Alice Wallenberg Foundation as part of the National Bioinformatics Infrastructure Sweden at SciLifeLab. ATC was supported in this work through the Massachusetts Consortium on Pathogen Readiness (MassCPR). ZOE Limited provided in-kind support for all aspects of building, running and supporting the app and service to all users worldwide. Support for this study for KCL researchers was provided by the National Institute for Health Research (NIHR)-funded Biomedical Research Centre based at Guy's and St Thomas' (GSTT) NHS Foundation Trust. This work was supported by the UK Research and Innovation London Medical Imaging & Artificial Intelligence Centre for Value-Based Healthcare. Investigators also received support from the Wellcome Trust, Medical Research Council (MRC), British Heart Foundation (BHF), Alzheimer's Society, European Union, NIHR, COVID-19 Driver Relief Fund (CDRF) and the NIHR-funded BioResource, Clinical Research Facility and Biomedical Research Centre (BRC) based at GSTT NHS Foundation Trust in partnership with KCL. ZOE Limited developed the app for data collection as a not-for-profit endeavour. None of the funding entities had any role in study design, data analysis, data interpretation, or the writing of this manuscript.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
The Swedish Ethical Review Authority has approved CSSS (DNR 2020-01803 with addendums 2020-04006, 2020-04145, 2020-04451, and 2020-07080) and CRUSH Covid (DNR 2020-07080, and DNR 2020-04210 with addendum 2020-06315).
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
↵ꭞ Joint senior authorship
Author affiliations have been included in the manuscript, and Discussion has been updated for clarity.
Data Availability
Primary data in this study were collected by ZOE Limited and provided to CSSS under a data-sharing agreement. Additional data originated from the National Board of Health and Welfare, FoHM, Statistics Sweden, and NOVUS. Restrictions apply to the availability of data, which were used under license and ethical approval and are not publicly available. Data are, however, available from the authors upon reasonable request and with written permission from the Swedish Ethical Review Authority. Aggregate data is available for download at https://github.com/csss-resultat/covidsymptom.