PT  - JOURNAL ARTICLE
AU  - Proverbio, Daniele
AU  - Kemp, Françoise
AU  - Magni, Stefano
AU  - Gonçalves, Jorge
TI  - Performance of early warning signals for disease re-emergence: a case study on COVID-19 data
AID  - 10.1101/2021.03.30.21254631
DP  - 2021 Jan 01
TA  - medRxiv
PG  - 2021.03.30.21254631
4099  - http://medrxiv.org/content/early/2021/08/30/2021.03.30.21254631.short
4100  - http://medrxiv.org/content/early/2021/08/30/2021.03.30.21254631.full
AB  - Developing tools for rapid and early detection of disease re-emergence is important to perform science-based risk assessment of epidemic threats. In the past few years, several early warning signals (EWS) from complex systems theory have been introduced to detect impending critical transitions and extend the set of indicators. However, it is still debated whether they are generically applicable or potentially sensitive to some dynamical characteristics such as system noise and rates of approach to critical parameter values. Moreover, testing on empirical data has, so far, been limited. Hence, verifying EWS performance remains a challenge. In this study, we tackle this question by analyzing the performance of common EWS, such as increasing variance and autocorrelation, in detecting the emergence of COVID-19 outbreaks in various countries. We illustrate that EWS are successful in detecting disease emergence if some basic assumptions are satisfied: a slow forcing through the transitions and not-fat-tailed noise. In uncertain cases, noise properties or commensurable time scales may obscure the expected early warning signals. Overall, our results suggest that EWS can be useful for active monitoring of epidemic dynamics, but that their performance is sensitive to certain features of the underlying dynamics. Our findings thus pave a connection between theoretical and empirical studies, constituting a further step towards the application of EWS indicators for informing public health policies.Author summary To extend the toolkit of alerting indicators against the emergence of infectious diseases, recent studies have suggested the use of generic early warning signals (EWS) from the theory of dynamical systems. Although extensively investigated theoretically, their empirical performance has still not been fully assessed. We contribute to it by considering the emergence of subsequent waves of COVID-19 in several countries. We show that, if some basic assumptions are met, EWS could be useful against new outbreaks, but they fail to detect rapid or noisy shifts in epidemic dynamics. Hence, we discuss the potentials and limitations of such indicators, depending on country-specific dynamical characteristics and on data collection strategies.Competing Interest StatementThe authors have declared no competing interest.Funding StatementDP's and SM's work is supported by the FNR PRIDE DTU CriTiCS, ref 10907093. FK's work is supported by the Luxembourg National Research Fund PRIDE17/12244779/PARK-QC. JG is partly supported by the 111 Project on Computational Intelligence and Intelligent Control, ref B18024.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:University of LuxembourgAll necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe analysis was performed in \textsc{Matlab} and Python. They require the \textit{Statistics Toolbox} and the \textit{scipy} library, respectively. Code and curated data are accessible on: \\ \url{https://github.com/daniele-proverbio/EWS_epidemic}. https://github.com/daniele-proverbio/EWS_epidemic