ABSTRACT
The app-based COVID Symptom Study was launched in Sweden in April 2020 to contribute to real-time COVID-19 surveillance. We enrolled 143,531 study participants (≥18 years) who contributed 10.6 million daily symptom reports between April 29, 2020 and February 10, 2021. Data from 19,161 self-reported PCR tests were used to create a symptom-based model to estimate the individual probability of symptomatic COVID-19, with an AUC of 0.78 (95% CI 0.74–0.83) in an external dataset. These individual probabilities were used to estimate daily regional COVID-19 prevalence, which were in turn used together with current hospital data to predict next week COVID-19 hospital admissions. We found that this hospital prediction model demonstrated a lower median absolute percentage error (MdAPE: 25.9%) across the five most populated regions in Sweden during the first pandemic wave than a model based on case notifications (MdAPE: 30.3%). During the second wave, the error rates were similar. When applying the same model to an English dataset, not including local COVID-19 test data, we observed MdAPEs of 22.3% and 19.0%, respectively, highlighting the transferability of the prediction model.
Competing Interest Statement
CSSS is a strictly non-commercial research project. PF consults for and has stock options in ZOE Limited relating to the PREDICT nutrition studies, which are entirely separate from the COVID Symptom Study app development and COVID-19 research. ATC previously served as an investigator on the PREDICT nutrition studies. TDS is a consultant to ZOE Limited. TS is the current CEO and a shareholder at Novus International Group AB, Sweden. RD, JW, JCP, SG, AM, SS and JLC work for ZOE Limited. All other authors declare that they have no competing interests.
Funding Statement
Swedish Heart-Lung Foundation (20190470, 20140776), Swedish Research Council (EXODIAB, 2009-1039; 2014-03529), European Commission (ERC-2015-CoG - 681742 NASCENT), eSSENCE@LU 8:8 (eSSENCE - The e-Science Collaboration), Swedish Foundation for Strategic Research (LUDC-IRC, 15-0067), Crafoord Foundation (20211011), and EUGLOHRIA (101017752) to MG and/or PF, and European Research Council Starting Grant (801965) to TF. NO was financially supported by the Knut and Alice Wallenberg Foundation as part of the National Bioinformatics Infrastructure Sweden at SciLifeLab. ATC was supported in this work through the Massachusetts Consortium on Pathogen Readiness (MassCPR). JB was financially supported by Swedish Research Council (2019-00198 and 2021-04665) and by Sweden's Innovation Agency (Vinnova; 2021-02648). ZOE Limited provided in-kind support for all aspects of building, running and supporting the app and service to all users worldwide. Support for this study for KCL researchers was provided by the National Institute for Health Research (NIHR)-funded Biomedical Research Centre based at Guy's and St Thomas' (GSTT) NHS Foundation Trust. This work was also supported by the UK Research and Innovation London Medical Imaging & Artificial Intelligence Centre for Value-Based Healthcare. Investigators also received support from the Wellcome Trust, Medical Research Council (MRC), British Heart Foundation (BHF), Alzheimer's Society, European Union, NIHR, COVID-19 Driver Relief Fund (CDRF) and the NIHR-funded BioResource, Clinical Research Facility and Biomedical Research Centre (BRC) based at GSTT NHS Foundation Trust in partnership with KCL. ZOE Limited developed the app for data collection as a not-for-profit endeavour. None of the funding entities had any role in study design, data analysis, data interpretation, or the writing of this manuscript.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
The Swedish Ethical Review Authority has approved both the CSSS (DNR reference number 2020-01803 with addendums 2020-04006, 2020-04145, 2020-04451, 2020-07080, and 2021-02316) and CRUSH Covid (DNR reference number 2020-07080, and DNR 2020-04210 with addendum 2020-06315). In the United Kingdom, the CSS UK has been approved by King's College London (KCL) ethics committee REMAS ID 18210, review reference LRS-19/20-18210.
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
↵ꭞ Joint senior authorship
The title was updated to: "App-based COVID-19 syndromic surveillance and prediction of hospital admissions: The COVID Symptom Study Sweden". Author affiliations was updated for consistency, and Diem Nguyen was added as a co-author. New analyses were conducted and new results were generated. These updates resulted in revision of most parts of the manuscript, including figures and tables and supplementary material. Text was revised for clarity.
Data Availability
Primary data in this study were collected by ZOE Limited and provided to CSSS under a data-sharing agreement. Additional anonymized data originated from the National Board of Health and Welfare, the Public Health Agency of Sweden, Statistics Sweden, and NOVUS. Restrictions apply to the availability of these data, which were used under license and ethical approval and are not publicly available. Pseudonymized individual-level data are, however, available from the authors upon reasonable request and with written permission from the Swedish Ethical Review Authority. Group-level prevalence estimates calculated from individual-level data, hospitalization data, and cases of COVID positivity are available as the Source Data (Figures.zip), which were used to generate Figures 2-5. We provide mock CSSS individual level datasets, that can be used together with the code. These data do not represent real observations. The Source Data that support the findings of this study are available on GitHub at https://github.com/ulfha881/App-based-COVID-19-syndromic-surveillance-and-prediction-of-hospital-admissions-The-COVID-Symptom-S, or, in archived form, at https://doi.org/10.5281/zenodo.6069218.
