Markovian Random Walk Modeling and Visualization of the Epidemic Spread of COVID-19

1 Introduction

In late 2019, the infectious disease CoVID-19 began spreading globally, from its origin in Wuhan, China, to every populated continent on earth [2] resulting in a pandemic declared officially by the World Health Organization by March 2020 [3]. By April 7^th, 2020, the death toll stood at 81,865, with 1,426,096 cases confirmed globally [1]. Due to the long time delay between exposure and experience of characteristic symptoms, the apparently common occurrence of asymptomatic yet infectious individuals, and lack of any antiviral treatment during spreading [4], the disease spread rapidly before most regional governments had the time to implement appropriate containment policies.

Even though the viruses exhibit substantial genetic similarity across regions, the nature of its epidemic spread is unique to each region. Of particular economic importance, and its indirect effects on human welfare during the pandemic, is the surge of demand [5] for staple goods at the peak of active confirmed infected cases in a population. This work seeks to understand why different countries experience this peak at different magnitudes and different speeds. Given the contemporary nature of this pandemic, in addition to the aim of purely modeling the epidemic spread of CoVID-19, this work seeks to graphically visualize this spread for the benefit of all concurrent research continuing on this topic. The key information the visualization presented seeks to provide is the temporal and spatial quality of epidemic spreading, given a set of initial conditions and disease spread and containment specifics in the region under study.

The model presented is inspired by temporal visualizations of the spread of forest fires, where a single flaming tree among a lattice of trees can “infect” other “susceptible” green trees with the fire, until every tree has “recovered” by burning down [6]. Each of these actions occur with fixed probabilities that govern the Markovian system; by associating colors with each state, spreading of the disease or “forest fire” may be visualized. Our model adds a spatial component where agents make random walks to mimic how the disease spreads dynamically through human movement.

In order to simulate epidemic spreading, the possible states an agent can assume are based on the Susceptible – Infected – Removed (SIR) model, a set of nonlinear ordinary differential equations which can be used to track the magnitude of each population, assuming a closed system where S(t) + I(t) + R(t) = N is constant. In this system, the coefficient β represents the rate of transmission of the disease from the infected to the susceptible population, and γ represents the rate of removal, corresponding to recovery or death. It is justifiable to lump the latter two populations into one for the purpose of modeling, as long as both cease to be capable of further infecting others. The coupled ordinary differential equations describing the SIR model are

The SIR model has been applied to model the previous SARS coronavirus epidemic [7] [8]. Variations of the SIR model include the SEIR model where a new state E (exposed) is introduced, or SIS, where recovered agents are susceptible to reinfection. While these models have been shown to act as accurate approximations for the spread of notable infectious diseases [9], the pandemic nature of CoVID-19 has resulted in policy-driven responses from communities to actively curb spread of the disease, namely quarantining large numbers of individuals testing positive for the virus [10]. This work accounts for this population by extending the model to add a Quarantined state Q that captures the effect of isolating agents who test positive for the virus. By applying the SIR-Q states to a spatio-temporal random walk model, the spread of CoVID-19 can be visualized and the effect of critical demographic and policy variables upon epidemic spreading are evaluated.

2 Markov Random Walk Model

In order to estimate the spread of CoVID-19 in a human population, a Random Walk framework is used to model transmission of and recovery from the virus in the temporal and spatial domains and provide a visualization of this process. This stochastic process is Markovian in that each subsequent state of the system depends only on the previous state.

2.2 Parameter Selection and Initial Conditions

The lattice is defined as a 2-dimensional structure, of length 100 nodes in each direction. At initialization, S₀ initial number of susceptible agents and I₀ initial number of infected agents are randomly distributed throughout the lattice. For all the simulations shown in this work, I₀ is initialized as 10 agents. The population density D is linearly proportional to S₀, and for simplification purposes, a density index D of 1.0 indicates S₀ initialized as 10,000 agents in the following simulations. The testing rate T directly corresponds to the probability of an agent being tested P_t.

The most critical metric for measuring the spread of a disease is its reproduction number, which is a ratio of the transmission to recovery rate, and a strong indicator of rate of spreading, shown in equation 4.

There is no consensus currently on the exact reproduction number of CoVID-19 yet [11], but a study using the SEIR model to estimate R₀ using data from Wuhan, China concluded it fell within a 95% confidence interval of between 5.7 – 7.2, estimated to be 6.5 [12]. Neural-network based models have suggested how effective reproductive number can even be a dynamic variable [13]. For this work, R₀ was taken to be 7.0.

Each calendar day is approximated by one time-step, and a linear population scaling factor was used to fit the model to available data [14] through April 6th 2020 for the Hubei province of China where the city of Wuhan is located, South Korea, Iran, and Spain. The population density indexes D and testing rates T for each country or region were learned from the data.

3 Simulation Results

3.1 Effect of Susceptible Population Density and Testing

First, a theoretical environment is considered to measure the effect that changes in susceptible population density and testing rates have on the spread of CoVID-19 in a closed system. While holding the population density index D constant at 1.0, the testing rate T was altered, and the changes in population of susceptible, infected and quarantined, and removed agents over time were simulated, shown in figure 1. Frames from the visualization of simulation taken at timesteps of 5, 25, 45, and 65, for the system with no testing policy and the system with a testing rate T of 0.2 are displayed in figure 3.

• Download figure
• Open in new tab

Figure 1: Effect of Testing Rate T on S (left), I (middle), R (right) populations

• Download figure
• Open in new tab

Figure 3: Visualization of effect of instituting Testing Rate T of 0.2 (bottom row), compared to no testing (top row). S denoted as yellow, I as red, R as black, Q as white. Time progression from left to right, frames taken at timesteps of [5, 25, 45, 65]

The theoretical environment was also used to demonstrate the effect changes in population density had on the changes in makeup of population with respect to state of all agents in the system. The results of these simulations are shown in figure 2. In both figures 1 and 2, the vertical axes denotes the percentage of total agent population in each closed system.

• Download figure
• Open in new tab

Figure 2: Effect of Population Density on S (left), I (middle), R (right) populations

The effect of both differing testing rates T and population density indexes D on the system can be estimated by using the metric of peak infected percentage of the population as a measure of the disease’s maximum impact to the system. The results of these simulations are shown in figure 4.

• Download figure
• Open in new tab

Figure 4: Peak Infection Percentage as a function of D and T

3.2 Modeling CoVID-19 in Real Regions

The random walk model was used to simulate and visualize the epidemic spread of CoVID-19 in four different regions and countries. Hubei province (China) and South Korea both have experienced a decline in active confirmed cases, while the rate of new active confirmed cases in Spain appears to be decreasing. Cases in Iran continue to increase. Active confirmed cases are calculated by subtracting recovered and dead counts from the number of total confirmed cases. Active confirmed cases are analogous to the combined populations of Infected and Quarantined agents in the model. The simulations are scaled with a linear population scaling factor, and the population density index D and testing rate T are manually fitted from the rate of active confirmed and removed cases in the real data. The results of these simulations are shown in figures 5 and 6. The parameters used in the simulations are included in table 1.

• Download figure
• Open in new tab

Figure 5: Random Walk Simulation fitted to data [14] from Hubei Province China and South Korea

• Download figure
• Open in new tab

Figure 6: Random Walk Simulation fitted to data [14] from Spain and Iran

An interactive webpage with epidemic spreading visualizations powered by the model described in this paper can be found at the following address, below.

4 Discussion

The primary aim of this work was to understand why different regions of the world experience the pandemic spread of CoVID-19 in different ways. By recurrent testing of the population, infected individuals can be identified and quarantined, effectively preventing them from spreading the disease any further. It was observed that through increased rates of testing, an increasing percentage of the population could be saved from experiencing CoVID-19 altogether, to a point where if 40% of the population could be tested daily, any disease having a similar reproduction number would not be able to spread at all. This suggests an opportunity for preventing future viral outbreaks if testing can become a routine procedure that responsible members of the population carry out on themselves and self-report. It was also observed that through increased rates of testing, the peak of confirmed cases could be lowered, relieving the toll of an epidemic on the supply chain, and indirectly human wellbeing.

It was observed that by de-densification of the susceptible population, the peak count of active confirmed infected cases could be reduced and also delayed, to where the rate of infection of the population was decreased, potentially allowing for societal adjustment preceding the time of peak infection. This observation can be an opportunity for actionable advice for urban areas with flexible population densities, such as those with large student populations.

By analyzing how Hubei, China, South Korea, Spain, and Iran have experienced the pandemic spread of CoVID-19, it was observed that countries like South Korea, despite having highly dense susceptible populations, can curb the transmission of the disease in the population by high rates of testing. Along similar lines, it was observed that despite having a less dense population, if recurrent testing rates are low, the potential for an unmitigated outbreak is high as is the case in Iran.

Rather than seek to prescribe a confident policy recommendation or forecast future spreading of the pandemic based on the limited amount of data available currently, this work aims to offer a model for estimating the current spread of CoVID-19 based on demographic information and chosen policies, and present a tool for visualizing the effect that adjusting the variables of population density and testing rate has on a simulated population in a theoretical system.