Abstract
As the Covid-19 pandemic soars around the world, there is urgent need to forecast the expected number of cases worldwide and the length of the pandemic before receding and implement public health interventions for significantly stopping the spread of Covid-19. Widely used statistical and computer methods for modeling and forecasting the trajectory of Covid-19 are epidemiological models. Although these epidemiological models are useful for estimating the dynamics of transmission of epidemics, their prediction accuracies are quite low. Alternative to the epidemiological models, the reinforcement learning (RL) and causal inference emerge as a powerful tool to select optimal interventions for worldwide containment of Covid-19. Therefore, we formulated real-time forecasting and evaluation of multiple public health intervention problems into off-policy evaluation (OPE) and counterfactual outcome forecasting problems and integrated RL and recurrent neural network (RNN) for exploring public health intervention strategies to slow down the spread of Covid-19 worldwide, given the historical data that may have been generated by different public health intervention policies. We applied the developed methods to real data collected from January 22, 2020 to July 30, 2020 for real-time forecasting the confirmed cases of Covid-19 across the world. We observed that the number of new cases of Covid-19 worldwide reached a peak (407,205) on July 24, 2020 and forecasted that the number of laboratory-confirmed cumulative cases of Covid-19 will pass 20 million as of August 22, 2020. The results showed that outbreak of Covid-19 worldwide has peaked and is on the decline
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
Dr. Li Jin was partially supported by National Natural Science Foundation of China (91846302). Dr. Wei Lin is supported by the National Key R&D Program of China (Grant no. 2018YFC0116600), the National Natural Science Foundation of China (Grant no. 11925103), and by the STCSM (Grant no. 18DZ1201000).
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
The data are public data. Exemption for IRB approval.
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
The title has been changed to Outbreak of Covid-19 worldwide is on the decline -----Recurrent Neural Reinforcement Learning and Health Interventions to Curb the Spread of Covid-19 in the world. Update the results. Data were updated from June 28, 2020 to July 30, 2020. New Results: We observed that the number of new cases of Covid-19 worldwide reached a peak (407,205) on July 24, 2020 and forecasted that the number of laboratory-confirmed cumulative cases of Covid-19 will pass 20 million as of August 22, 2020. The results showed that outbreak of Covid-19 worldwide has peaked and is on the decline
Data Availability
Data on the number of confirmed and new cases of Covid-19 from January 22, 2020 to June 28, 2020 were obtained from the John Hopkins Coronavirus Resource Center (https://coronavirus.jhu.edu/MAP.HTML).
