Predicting the Growth and Trend of COVID-19 Pandemic using Machine Learning and Cloud Computing

Motivation and Our Contributions

ML [11] can be utilized to handle large data and intelligently predict the spread of the disease. Cloud computing [12] can be used to rapidly enhance the prediction process using high-speed computations [7]. Novel energy-efficient edge systems can be used to procure data, in order to bring down power consumption. In this paper, we present a prediction model deployed using FogBus framework [13] for accurate prediction of the number of COVID-19 cases, the rise and the fall of the number of cases in near future and the date when various countries may expect the pandemic to end. We also provide a detailed comparison with a baseline model and show how catastrophic the effects can be if poorly fitting models are used. We present a prediction scheme based on the ML model, which can be used in remote cloud nodes for real-time prediction allowing governments and citizens to respond proactively. Finally, we summarize this work and present various research directions.

Article structure

The rest of the paper is organized as follows: Section 2 presents the prediction model and performance comparison. Section 3 concludes the work and describes the future research opportunities. Section 4 provides details of open repositories for the dataset, code and results.

Dataset

The dataset used in this case study is the Our World in Data by Hannah Ritchie.¹ The dataset is updated daily from the World Health Organization (WHO) situation reports.² More details about the dataset are available at: https://ourworldindata.org/coronavirus-source-data.

Cloud framework

The ML models are built to make a good advanced prediction of the number of new cases and the dates when the pandemic might end. To provide fail-safe computation and quick data analysis, we propose a framework to deploy these models on cloud datacenters, as shown in Figure 1.In a cloud based environment, the government hospitals and private health-centers continuously send their positive patient count. Population density, average and median age, weather conditions, health facilities etc. are also to be integrated for enhancing the accuracy of the predictions. For this case study, we used three instances of single core Azure B1s virtual machines with 1-GiB RAM, SSD Storage and 64-bit Microsoft Windows Server 2016¹. We used the HealthFog [11] framework leveraging the FogBus [13] for deploying multiple analysis tasks in an ensemble learning fashion to predict various metrics, like the number of anticipated facilities to manage patients and the hospitals. We analyzed that the cost of tracking patients on a daily basis, amortized CPU consumption and Cloud execution is 37% and only 1.2 USD per day. As the dataset size increases, computationally more powerful resources would be needed.

• Download figure
• Open in new tab

Figure 1:

Proposed Cloud based AI framework for COVID-19 related analytics.

ML model

Many recent works have suggested that the COVID-19 spread follows exponential distribution [17, 18, 19]. As per empirical evaluations and previous datasets on SARS-CoV-1 virus pandemic, many sources have shown that data corresponding to new cases with time has large number of outliers and may or may not follow a standard distribution like Gaussian or Exponential [20, 21, 22, 23]. In recent study by Data-Driven Innovation Laboratory, Singapore University of Technology and Design (SUTD), the regression curves were drawn using the Susceptible-Infected-Recovered model [24] and Gaussian distribution was deployed to estimate the number of cases with time. However, in the previously reported studies on the earlier version of the virus, namely SARA-CoV-1, the data was reported to follow Generalized Inverse Weibull (GIW) Distribution [25] better than Gaussian as shown in Figure 2 (details of Robust Weibull fitting follow in the next section). Detailed comparison for SARS-CoV-2 has been described in the next section. This fits the following function to the data:

• Download figure
• Open in new tab

Figure 2:

Fit curves for SARS-CoV-1 pandemic for Hong Kong (SAR), China. Data source: WHO epidemic curves (https://www.who.int/csr/sars/epicurve/epiindex/en/index4.html)

Here, f(x) denotes the number of cases with x, where x > 0 is the time in number of days from the first case, and α, β, γ > 0, are parameters of the model. Now, we can find the appropriate values of the parameters α, β and γ to minimize the error between the predicted cases (y = f(x)) and the actual cases (ŷ). This can be done using the popular Machine Learning technique of Levenberg-Marquardt (LM) for curve fitting [26]. However, as various sources have suggested, in initial stages of COVID-19 the data has many outliers and noise. This makes it hard to accurately predict the number of cases. Thus, we propose an iterative weighting strategy and call our fitting technique “Robust Fitting”. A diagrammatic representation of the iterative weighting process is shown in Figure 3.

• Download figure
• Open in new tab

Figure 3:

Iterative weighting technique for robust curve fitting.

The main idea is as follows. We maintain weights for all data points (i) in every iteration (n, starting from 0) as . First, we fit a curve using the LM technique with weights of all data points as 1, thus . Second, we find the weight corresponding to every point for the next iteration as:

Simply, in the above equation, we first take tanhshrink function defined as tanhshrink(x) = x − tanh(x) for the distances of all points along y axis from the curve (d_i). This is to have a higher value for points far from the curve and near 0 value for closer points. This, is then standardized by dividing with max value over all points and subtracted from 1 to get a weight corresponding to each point. This weight is then standardized using softmax function so that sum of all weights is 1. The curve is fit again using LM method, now with the new weights . The algorithm converges when the sum total deviation of all weights becomes lower than a threshold value.

Distribution Model Selection

To find the best fitting distribution model for the data corresponding to COVID-19, we studied the data on daily new confirmed COVID cases. Five sets of global data on daily new COVID-19 cases were used to fit parameters of different types of distributions. Finally, we identified the best performing 5 distributions. The results are shown in Table 1. We observe that using the iteratively weighted approach, the Inverse Weibull function fits the best to the COVID-19 dataset, as compared to the iterative versions of Gaussian, Beta (4-parameter), Fisher-Tippet (Extreme Value distribution), and Log Normal functions. When applied to the same dataset, Iterative Weibull showed an average MAPE of 12% lower than non-iteratively weighted Weibull. A step-by-step algorithm for iteratively weighted curve fitting using the GIW distribution (called “Robust Weibull”) is given in Algorithm 1.

Analysis and Interpretation

To compare the proposed “Robust Weibull fitting” model, we use the baseline proposed by Jianxi Luo from SUTD ³. The comparison metrics include Mean Squared Error (MSE), Mean Absolute Percentage Error (MAPE) and Coefficient of determination (R²). Table 2 shows the model predictions of the spread of the COVID-19 for every major country for which sufficient data was available and model fits had R² > 0.5 using the proposed model. As shown in the table, the proposed model performs significantly better than the baseline.

Algorithm 1

Robust Curve Fitting using Iterative weighting

• Download figure
• Open in new tab

As shown in Figure 4⁴, the predictions of the baseline Gaussian model deployed by SuTD are overoptimistic. Following such models could lead to premature uplifting of the lockdown, causing adverse effect on management of the epidemic. Having better fit models, as proposed here, could help plan a better strategy, based on more accurate predictions and future scenarios.

• Download figure
• Open in new tab

Figure 4:

Comparison of predicted dates to reach 97% of the total expected cases by baseline Gaussian and proposed Robust Weibull models. The predicted end date of the pandemic in the baseline model are over-optimistic.

Figure 5 shows the total predicted number of cases for all countries across the globe. Here we have neglected those countries where the data is insufficient for making predictions, or the number of days for data is less than 30. As shown in Figure 4 explained in model section, the fit curve can be used to predict the number of cases that will have to be dealt by the country, assuming the same trend continues. The figure illustrates that the maximum number of total cases will be in the North America region. The number of cases will also be high in the European continent, Russia and eastern Asia, including china, the original epicenter of the disease.

• Download figure
• Open in new tab

Figure 5:

Global heat-map for total predicted cases for different countries as on May 4, 2020 (countries with insufficient data for prediction are shown in white)