Predictive Capacity of COVID-19 Test Positivity Rate ==================================================== * Livio Fenga * Mauro Gaspari ## Abstract COVID-19 infections can spread silently, due to the simultaneous presence of significant numbers of both critical and asymptomatic to mild cases. While for the former reliable data are available (in the form of number of hospitalization and/or beds in intensive care units), this is not the case of the latter. Hence, analytical tools designed to generate reliable forecast and future scenarios, should be implemented to help decision makers planning ahead (e.g. medical structures and equipment). Previous work of one of the authors shows that an alternative formulation of the Test Positivity Rate (TPR), i.e. the proportion of the number of persons tested positive in a given day, exhibits a strong correlation with the number of patients admitted in hospital and intensive care units. In this paper, we investigate the lagged correlation structure between the newly defined TPR and the hospitalized people time series, exploiting a rigorous statistical model, the Seasonal Auto Regressive Moving Average (*SARIMA*). The rigorous analytical framework chosen, i.e. the stochastic processes theory, allowed for a reliable forecasting about 12 days ahead, of those quantities. The proposed approach would also allow decision makers to forecast the number of beds in hospitals and intensive care units needed 12 days ahead. The obtained results show that a standardized TPR index is a valuable metric to monitor the growth of the COVID-19 epidemic. The index can be computed on daily basis and it is probably one of the best forecasting tools available today for predicting hospital and intensive care units overload, being an optimal compromise between simplicity of calculation and accuracy. Keywords * COVID-19 * test positivity rate * predictive capacity * health system management ## 1 Introduction One of the aspects that makes the COVID-19 pandemic difficult to control, is the simultaneous presence of significant numbers of both critical and asymptomatic to mild cases. While for the former reliable data are available (in the form of number of hospitalizations and/or beds in ICUs), this is not the case of the latter [35, 13, 18]. In many instances, in fact, those who contracted the virus are unaware of such a condition and thus enter the status of spreaders or, in the worse case, super-spreader. Such a phenomenon, commonly referred to as under-ascertainment, is the primary reason for a disease to spread uncontrolled. Should it be not carefully checked nor effectively counteracted, it can potentially grow indefinitely, posing severe health problems at a global level and severely impacting whole health systems. Action-wise, such a situation calls for at least two measures: on the one hand policy and decision makers should plan ahead the needs in terms of medical structures and equipment whereas, on the other hand, analytical tools designed to generate reliable forecast and future scenarios should be implemented. While a number of effective approaches have been studied and proposed for different epidemics over the years, this is not the case of the CoVID-19 pandemic. In fact, all the efforts so far done to model and predict such a disease might hardly support the idea that a uniformly “better” model is available to describe and predict the evolution of such a catastrophic pandemic. Therefore, even though many valid contributions have been proposed so far [24], it is not unreasonable to look at those efforts as the building block of one or more best practices. In particular, the forecasting problem has been addressed for two of the the most populated countries in the world, i.e. China [26] and India [37]. A survey including other approaches is presented here [38]. The complexity of such a task is discussed in [4], where the authors analyzed three different regional-scale models for forecasting and assessing the course of the pandemic. Along those lines, is worth mentioning the excellent article [23], where the main reasons leading to the failure of a forecasting models are presented. Finally, two different predictive approaches has been proposed for Italy, i.e. one exploiting the bootstrapped prediction generated by a model of the type ARMA [14] and one based on the simulated annealing algorithm [15]. The Test Positivity Rate (TPR) is one of the indexes often used worldwide for monitoring the progression of the COVID-19 pandemic, see for example the coronavirus testing dataset [20], which contains an updated picture of the international situation concerning testing strategies and the associated data for many countries. Until now, the TPR was mainly studied considering its relationship with confirmed cases [12], for example it was used to estimate COVID-19 prevalence in the different states of US [30]. However, a more intensive use of diagnosis tests associated with a standardization of the TPR, crucial in light of differences in the available tests, can solve their limited investigation abilities (see, e.g., [32]). In more details, a recent work of one of the authors [19] shows that a standardized COVID-19 Test Positivity Rate (TPR) can be used to predict hospital overload. In particular, by observing its trend, it is possible to forecast the course of patients admitted in hospital and in intensive care units. For example, when the TPR reaches a peak, a growth in COVID-19 hospitalisations lasting 12-15 days can be inferred. There is an intuitive motivation behind such a behavior: COVID-19 epidemiological data show that symptoms, on average, occur 11 days after the contraction of the infection and that critical patients are admitted in hospital about 4 days later. If we assume that the TPR is a measurement of the infections occurring in a given day, in an ideal situation, the infected people with a critical evolution will be presumably admitted in hospital 15 days later. More precisely, if the TPR increases in a given day, an increasing number of active cases (including the unknown ones) can be inferred for the same day, and presumably the number of infections is increasing too. Thus, after a while the number of hospitalized people will also increase. In other words, the insight is that the TPR index models the trend of the COVID-19 infections, and it is designed to embody the unknown cases. Clearly, for this measure to be valid, all the administered diagnostic tests should be considered in the TPR calculation, as pointed out in [19]. However, there are known biases involving diagnostic tests data that are difficult to deal with, e.g., those related to reporting delays [20]. As a result, the ideal predictive capacity cannot be assumed in practice, especially if different kind of tests are used, as in the case of the current Italian situation. Despite these limitations, the TPR can be effectively used to deduct important information on the course of the disease, as illustrated in Figure 1, where the epidemic course in Toscana region in autumn 2020 is depicted. This Figure also plots the time series of patients admitted in hospitals and in intensive care units. An interesting correlation between the curves can be observed: the TPR peak anticipates the peak of patients admitted in hospital and intensive care units. ![Figure 1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/03/10/2021.03.04.21252897/F1.medium.gif) [Figure 1:](http://medrxiv.org/content/early/2021/03/10/2021.03.04.21252897/F1) Figure 1: The TPR index predictive capacity. The aim of this research is to analyse in details this scenario to get to the heart of some hard-hitting questions, especially when the TPR is growing considerably. How many days will be needed to reach the peak of hospitalized people? How many beds in hospitals will be necessary to add? And, in general, which is the “theoretical” predictive capacity of the proposed TPR index? Starting from this motivation, we analysed the TPR index time series, as well as the hospitalized, and ICU patients time series, to investigate the predictive capacity of the TPR index, e.g, to individuate the time lags that can be effectively inferred from the available data. We first introduce the statistical methodology used and then we present a detailed analysis for four Italian region, for which data on antigen tests were available as reported in [19]. The lagged correlation between the TPR and hospitalized people time series will be modeled using a rigorous statistical model, i.e. of the type *SARIMA* (short for Seasonal Auto Regressive Moving Average). A detailed description of the underlying mathematics is presented in the Methods section. A generalization of the *ARIMA* (Auto Regressive Moving Average) class [7], *SARIMA* models have been introduced to model complex dynamics of the type stochastic seasonal in many fields of research, such as economics [16] and [11], engineering [28] or hydrology [29]. In epidemiology, *SARIMA* models have been applied in a variety of studies: in [31] the authors applied this model for estimating case occurrence of two diseases: malaria and hepatitis A from January 1980 to June 1995 for the United States whereas in [10] the epidemiological and aetiological characteristics of influenza have been identified by establishing suitable SARIMA models. In particular, such an approach proved to be accurate in the forecasting of the percentage of visits for influenza-like illness in urban and rural areas of Shenyang (China). More recently, [27] used the SARIMA method – in conjunction with models belonging to the class exponential smoothing – to predict the trend of acute hemorrhagic conjunctivitis disease and used the obtained outcomes to provide evidence for the government to formulate policies regarding its prevention in mainland China. The proposed mathematical model allowed us to estimate a predictive lag of about 12 days of the TPR for the prediction of hospitalized people time series in some Italian regions. Moreover, we defined a methodology to forecast the number of beds in hospitals and intensive care units needed 12 days ahead. The obtained results show that a standardized TPR index is a valuable metrics to monitor the growth of the COVID-19 epidemic. The index can be computed daily and it is probably one of the best forecasting tools available today for monitoring hospital and intensive care units overload, being an optimal compromise between simplicity of calculation and accuracy. ## 2 Results The data used in this paper are made available by the Italian Civil Protection Department and publicly accessible, free of charge, at the following web address: [https://github.com/pcm-dpc](https://github.com/pcm-dpc). In more details, these data – sampled at a daily frequency – are those necessary to compute the TPR (the number of new persons tested positive for COVID-19; the number of tests done considering both molecular (PCR) tests and antigen tests, and the number of healed persons), and those related to the number of hospitalizations and beds in intensive care units occupied by patients tested positive for COVID-19. The considered time frame ranges from Sept. 2 2020 to Feb. 10 2021 for a total of 353 data points. We have analysed 4 Italian regions for which the collection of the data on the antigen-based tests administered from Oct. 2020 to the 15th of Jan. 2021, has been possible, i.e. Toscana, Veneto, Piemonte and Alto Adige. The interested reader may refer to [19] for the details of the data collection procedure. Unfortunately, certain data concerning the use of diagnosis tests in the considered time frame are still not available for the other Italian regions. Figure 2 presents the TPR and hospitalised time series for Toscana, Veneto, Piemonte and Alto Adige. ![Figure 2:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/03/10/2021.03.04.21252897/F2.medium.gif) [Figure 2:](http://medrxiv.org/content/early/2021/03/10/2021.03.04.21252897/F2) Figure 2: The TPR index and hospitalized patients time series of Toscana, Veneto, Piemonte and Alto Adige. The presented empirical experiment considers two different scenarios, according to the way the available information is used. Their aim is to answer the hard-hitting questions that we have set in Figure 1. The first one – which can be defined of the type *real-life* – exploits the whole data set and it is designed to analyse the predictive capacity of TPR, to deliver a “theoretical” time lag between the two series, and prediction which, by design, cannot be verified being projected into the unknown future. On the contrary, the second experiment concerns forecasting the number of beds needed in hospitals and intensive care units after the determined time lag in specific situations in the past, that can be verified using the available data. ### 2.1 Analysis of the TPR predictive capacity In essence, this part of the experiment, being based on the whole data set, can support only qualitative considerations on the proposed method. In accordance with the intuition that TPR represents the evolution of infections, the TPR should impact the hospitalization time series 15 days in advance. Studying the lagged correlations between the TPR time series and those of patients admitted in hospitals and ICUs, using the SARIMA model, we have individuated a predictive time lag of about 12 days for all the analysed regions, which confirm our intuitive hypothesis. Indeed, a 12 days predictive capacity for the TPR, with respect to hospitalized patients instead of the hypothesised 15, can be reasonably expected considering the above mentioned retrospective revisions effect [20]. In Table 1, we will report the time lag estimated for each region, along with an approximated multiplier accounting for the positive (negative) variation in the number of beds needed for a unit increase (decrease) of the TPR index. View this table: [Table 1:](http://medrxiv.org/content/early/2021/03/10/2021.03.04.21252897/T1) Table 1: This table presents the results of the regression models with SARIMA errors concerning patients admitted in hospitals and intensive care units for Toscana, Veneto, Alto Adige and Piemonte regions. The columns *Days* and *Beds* indicate the TPR predictive capacity in days (with the associated t-value) and the estimated variation of beds in both hospitals and ICUs. As estimates of future values yet to realize, these predictions can be mainly exploited to make qualitative inferences. For example, in the Veneto region, if the TPR increases of one unit, the model estimates that 82 additional beds may be needed in the near future (after 12 days). As for the ICUs we can expect 12 additional beds. Vice versa, if the TPR decreases in Veneto a similar amount of beds should be subtracted. In the considered regions, the average variation of beds in hospital and ICUs are 63 and 16 respectively. ### 2.2 Forecasting hospital overload The second scenario envisioned, has been designed to carry out a precise evaluation of the performances delivered by the proposed method. To do so, we employed a test set with the same length but different starting point, as illustrated in Table 2. In practice, both structure and parameters of each SARIMA models has been estimated on the training set (this time with different sample sizes but same starting point) and, as already mentioned, evaluated on a “unknown” portion of data. Such a quantitative evaluation has been conducted considering different scenarios on all the studied regions: two in which the TPR was growing considerably in Toscana and Alto Adige; one associated to the beginning of the “red zone”1 Piemonte; one characterized by a slow growth of the TPR index in Veneto; and one associated to a fast lowering of the TPR indicator in Veneto. View this table: [Table 2:](http://medrxiv.org/content/early/2021/03/10/2021.03.04.21252897/T2) Table 2: Forecasting dates in different situations: training and test set As for the REG-SARIMA model, as described in the Methods section, the model order has been defined using the MAICE procedure and constraining the Box-Cox *λ* parameter to 0 (i.e. log – transforming the data). However, being an exhaustive search of the “best” REG-SARIMA model either unfeasible or or impractical for computational reasons, the competition set has been built following the Box-Jenkins procedure, as illustrated, e.g., in [7]. Almost all the parameters of the final models are statistically significant and generate a sequence of residuals which can be deemed acceptable in terms of whiteness. Most of the times, the Maximum Likelihood algorithm converged quickly, with the only exception of the Piemonte region. In this case, a “sparse” data generating process in the autoregressive part involved a lengthy estimation approach – of the type trial and error – for the definition of the “best” (in AIC sense) model’s non-seasonal structure. As already pointed out, the adopted MAICE procedure 13 is constrained to a specific value of the Box-Cox constant, which therefore has been set to *λ* = 0. As for the maximum order Γ, it has been arbitrarily chosen on a case by case basis (see the Methods section for details). The results of the forecasting experiments are summarized in Figure 3. The reader will certainly notice that the best forecasting results are obtained in the last experiment concerning the fast TPR lowering scenario in the Veneto region, where more data are available. However, all the other example provide reasonable results, and most importantly, when a fast growing of the TPR was present in the preceding of the cut, significant increases in hospitalizations are estimated. The determined increments are in general comparable to the generic estimations presented in Table 1. ![Figure 3:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/03/10/2021.03.04.21252897/F3.medium.gif) [Figure 3:](http://medrxiv.org/content/early/2021/03/10/2021.03.04.21252897/F3) Figure 3: Forecasting hospitalized patients growth in 5 different scenarios for regions: Toscana, Alto Adige, Piemonte and Veneto (also including a fast lowering example). ## 3 Discussion The proposed approach is general and can be exploited in any region/state under the condition that a set of requirements, below reported, are satisfied: 1. The data on the antigen tests administrated are provided; 2. The time series of new positive cases should include the daily number of new positives tested using only antigen tests; 3. The TPR should reach a peak before the hospitalized and ICU patients reach theirs. The third criterion captures the same effect dealt with in [35, 18]. In particular in [35] it is stated that “the peak of the cases curves shifts when they are adjusted for under-ascertainment”. The rationale behind this idea is that the peak of unknown infections necessarily precedes the one related to the hospital admissions. In general, when the first two requirements hold, then the 3rd one should hold as well. Vice-versa, if this is not the case, probably other anomalies or errors occur in the data. Moreover, issues concerning tests reliability cannot be excluded a priori – expecially when the ratio between hospitalized and positive cases growth considerably (e.g. due to tests specificity issues which might be related to new variants [3]). Should one or more of the above mentioned requirements be unfulfilled, the predictive properties of TPR might be affected. If this the case, an integration effort should be made to collect the missing data, and/or correct possible errors. For example, even though requirement 2 was not met for the Alto Adige region, we were able to analyse the TPR by manually adding the missing information to the time series of the new positives [19]. At this point, it is worth to compare the TPR index with other COVID-19 key indicators, commonly used for monitoring purposes [17], to the end of assessing their predictive properties. In particular, we have chosen the following indicators, designed to measure the dynamical behavior of the infections, i.e: * *Growth rate*: positives daily variation; * *Incidence*: fraction of COVID-19 positives per 100.000 individuals; * *The reproduction number R**t*: number of secondary infections generated from a case at time t. Table 3 shows the pure predictive capacity with respect to hospitalizations of these COVID-19 indicators, for comparison with the TPR. While the TPR can be considered as a measure of the number of infections that occur on a certain day, also accounting for unknown cases, indicators based on officially reported positive cases (e.g. incidence and growth rate), measure the variation of official cases in a given area. Assuming that critical cases are admitted into hospitals within 4 days after tested positive, such a delay can be taken as a approximate “upper bound” for their pure predictive capacity. View this table: [Table 3:](http://medrxiv.org/content/early/2021/03/10/2021.03.04.21252897/T3) Table 3: Pure predictive capacity in days of different COVID-19 indicators with respect to hospitalization. View this table: [Table 4:](http://medrxiv.org/content/early/2021/03/10/2021.03.04.21252897/T4) Table 4: This table presents the detailed results of the experiment presented in Section 2.1, for studying the SARIMA lagged correlation between the TPR time series and those of patients admitted in hospitals and ICUs. The last two columns *Days* and *Beds* indicate the TPR predictive capacity in days and the number of additional beds in hospital or ICU after 12 days for each TPR unit. As for the reproduction number it has to be said that, being based only on the known (detected) cases, is not designed to capture the hidden variations generated by the (unknown) asymptomatic. For example, Italy and UK experienced during the summer a strong reduction of the Rt values, which exhibited values below one. However, the data released at the beginning of the month of September, showed that, unfortunately, the virus did not stop spreading in summertime, and the Rt failed to properly react to the ongoing spreading situation. Thus, it is not unreasonable to assume the Rt predictive capacity to be approximately less or equal 4 days, consistently with other available indicators based on officially reported cases. Moreover, it might not be unlikely the reduction of such prediction horizon, considering the computation time actually needed for this indicator to be released. The impact of under-ascertainment (the ratio of confirmed cases to the true number of cases) on the reproduction number is also discussed in [35], where the correlation between testing and the amount of unknown cases is investigated. In essence, the Rt – Being based on the number of cases officially reported – should be expected to embody biasing components, to an extent directly proportional to the quota of unknown cases. On the contrary, the TPR, as we have demonstrated, adds an approximate extra time of 11 days (the average number of days between the infection and symptoms onset) leading to a pure predictive time lag of about 15 days, and a “theoretical” one of about 12 days. Last but not least, TPR precision clearly depends also on the data collection process adopted, which should be designed and implemented to guarantee the lowest possible error rates in the transmission of the test results. This also to minimize the negative impact arising from the above mentioned retrospective revisions. Indeed, it would be possible to define more precise TPR measures provided that the data were organized in a more structured form, as discussed in [19]. It is a fact that, by collecting and making available additional information – often readily available to the health care provider – the TPR would significantly improve its reliability. For example, it might be possible to gain precious insight by simply studying the effectiveness of different test typologies (diagnosis, screening, surveillance for health care operators and so forth) and associating specific accuracy information to the different types of tests administered. Clearly, the more (quality) information enter the TPR the more valuable its contribution in the description and prediction of the covid’s dynamics. For example, data collection could be improved developing point-of-care instant screening tests [39], incorporating TPR data transmission and calculation, as depicted in Figure 4. In this scenario, an improved TPR could be fruitfully exploited for monitoring, surveillance, and forecasting purposes, as well as to integrate electronic health records with information retrieved by sensors[39]. Nevertheless, results obtained in this study emphasize the effectiveness of the proposed approach. ![Figure 4:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/03/10/2021.03.04.21252897/F4.medium.gif) [Figure 4:](http://medrxiv.org/content/early/2021/03/10/2021.03.04.21252897/F4) Figure 4: Developing point-of-care (instant) screening tests for COVID-19: data collection, sensors technology, TPR calculation and information flows. In this paper, we have presented a forecasting method for the short term prediction of the impact of CoViD-19 disease on the public health system. To this end, we have provided enough evidence about the goodness of the TPR as a leading indicator for both the number of people hospitalized and, out of this group, for those who required a bed in intensive care units. The theoretical framework chosen – that is the time series analysis – has been particularly useful for the dynamic comparison and the exploitation of the information contained in the TPR time series. In our simulations, the model chosen, of the type REG-SARIMA, was able to generate reliable predictions from a minimum of 8 to 12 lags. However, especially in light of new developments of the disease – which take the form of many variants – the prediction performances of the REG-SARIMA model might might be affected, if not impaired altogether. Therefore, future directions include the study of a more appropriate model, e.g. of the type regime-switching. Furthermore, additional external information (e.g. the time varying percentage of critical cases) could be fruitfully exploited in a Bayesian theoretical framework (e.g. of the type Bayesian Hidden Markov Models [41]) or using heuristic based approaches (e.g. like the DempsterShafer techniques [5]). Finally, we will consider the remaining Italian regions as soon as time series of “enough” lenght become available. ## 4 Methods ### 4.1 The standardized TPR index The TPR is one of the metrics commonly used to infer the level of transmission of a disease in a population [8], and, as a such, has been also used in the case of the COVID-19 for different purposes, see for example [20, 30, 33]. However when different types of tests are used, as it happened during the second phase of the pandemic in Italy, where antigen tests have been extensively used, the definition of the TPR becomes more critical. In this study, we will use a standardized version of the TPR index defined by one of the authors [19], which allows to integrate antigen tests in the index calculation. Following the style of [19], where the Greek letters Θ, Φ and *µ* have been replaced respectively with the letters *τ, ρ* and *ω*, for consistency with the statistic notation later employed, the mean TPR index *τ* on *ω* days is defined as follows: ![Formula][1] where ![Graphic][2] and ![Graphic][3] are respectively the average values of new positive cases, molecular (PCR) tests and antigen tests done in the last *ω* days. To compute the TPR index, the average number of healed patients in the last *ω* days, ![Graphic][4] and an estimation for the number of repeated tests *Pr* are subtracted from the total number of tests. We assume that at least one test is done for each healed patient. The number of repeated tests *Pr* is computed using the formula 2, following the approach presented in [19]: ![Formula][5] This formula is obtained assumning that the positivity rates for antigen tests and molecular tests are the same, and thus *dayA/Pr* = *dayT/*(*dayP* −*Pr*). Using this approach the computed *Pr* can be considered an upper bound, because the molecular tests positivity rate is generally greater then the one related to antineg tests which are mainly used for screening purposes, see for example [40]. Finally, following the style of [19], a factor *ρ* is added to *τ* in order to model the impact of the number of tests on the remaining susceptible individuals, which are computed removing the total infected cases *I* from the population *N* of a given region. The number of tests are subtracted removing the repeated ones and those used for healed patients, obtaining the following formula: ![Formula][6] and the TPR index *τ**ω* is defined as follows: ![Formula][7] ### 4.2 The statistical method applied Throughout the paper, the time series of interest, say *x**t*, is always intended to be a real–valued, uniformly sampled, sequence of data points of length *T*, formally expressed as ![Formula][8] Furthermore, *x**t* is supposed to be a realization of an underlying stochastic process of the type *SARIMA* (short for Seasonal Auto Regressive Moving Average). Mathematically, *SARIMA* models take the form of a *t*-indexed difference equation – being *t* as defined in (5) – i.e.: ![Formula][9] Denoting with *B, d* and *D* the backward shift operator and the non-seasonal and seasonal difference operator respectively, defining *d* = 1 *B**d* and *D* = 1 − *B**D*, we have *φ**p*(*B*) = 1 − *φ*1*B φ*−2*B*2− …. − *φ**p**B**p*, *θ**q*(*B*) = 1 − *θ*1*B* − *θ*2*B*2 −…. − *θ**q**B**p*, Φ*P* (*B**S*) = 1 − Φ1*B**S* − Φ2*B*2*S*− …. − Φ*P* *B**P S* and Θ*Q*(*B**S*) = 1 − Θ1*B**S* − Θ2*B*2*S*− …. − Θ*q**B**QS*. Here, *φ, θ*, Φ, Θ, respectively denote the non-seasonal autoregressive and moving average parameters and the seasonal autoregressive and moving average parameters. Finally *α**t* is a 0–mean white noise with finite variance *σ*2. In the present paper, external information is exploited and embodied in (6) in the form of a matrix of regressors *D**j,t−k*, with *k* ∈ Z+, weighted by a vector of coefficients *β**j*, i.e. ![Formula][10] This particular extension is usually referred to as *REG-SARIMA*, to stress the role played by the possibly lagged (of an amount equals to *k* temporal lags) regressors, stored in the matrix *D**j,t*. This types of models are designed to capture the stochastic dynamics generated by the residuals obtained by regressing the matrix *D* (the independent variable(s)) on the time series of interest (the dependent variable). A better insight of the stochastic mechanism governing the *REG-SARIMA* equation can be gained by re-expressing equation 6 so as to emphasize the role played by the term *u**t* in (7), i.e. ![Formula][11] This formulation makes clear the flexibility of this approach which allows the extraction of the significant lags at which the different regressors impact the time series of interest as well as their magnitudes. If the integration constants *d* and *D* (introduced in Equation 8) are certainly useful to mitigate – if not solve altogether – many stationarity problems, on the other hand they might not be effective against non-normality and/or eteroschedasticity issues. Unfortunately, the data considered in this paper are affected by both these phenomena and therefore, as a coping mechanism, the well-known one–parameter Box–Cox data transformation has been adopted. Presented in the mid-sixties in [6], this method has been discussed and applied in a wide range of problems (see, among others, [36], [22] and [25]), given the widespread acceptance gained over the years. Its mathematical formulation is quite straightforward and takes the form of a power transformation, i.e. ![Formula][12] By embodying the *λ* parameter in Equation 7, the model employed in this paper is finally defined, i.e. ![Formula][13] The inference procedures carried out for the estimation of Equation 9 are of two types: maximum likelihood for the *SARIMA* parameters {*φ, θ*, Φ, Θ, *d, D*} and ordinary least squares for the vector *β*. Finally, the hyper-parameters {(*p, d, q, P, D, Q*)} as well as the Box-Cox constant *λ* are estimated within the framework of the Information Theory as explained in the following section. ### 4.3 Estimation of the model order and the *λ* parameter Akaike’s Information Criterion *AIC* ([1], [9], [21]) – one of the most popular model selector – will be employed to choose the *SARIMA* model order as well as the Box-Cox *λ* parameter. The selection of those constants is not a trivial task as it entails the solution of a conditional multi-objective problem induced by the 6–dimensional vector of unknown constants Γ ≡ {(*p, d, q, P, D, Q*)} conditional to the Box-Cox paramter *λ*. The estimation method employed to find the “best” conditioned vector of hyper-parameters – that is the one governing the selected order structure ![Graphic][14] – relies on the information theory and, in particular, on the Akaike Information Criterion (AIC). At its core, *AIC* is based on an estimate of the expected relative entropy (the Kullback–Leibler divergence) contained in an estimated model, that is the degree of divergence from the “true” theoretical model. Assuming *X**t* to be randomly drawn from an unknown distribution *H*(*x*), with density *h*(*x*), estimation of *h* is done by means of a parametric family of distributions with densities [*f* (*x*|*θ*; *θ* ∈ Θ)], *θ* the unknown parameters’ vector. Denoting by ![Graphic][15] the predictive density function, by *f* the true model and by *h* the approximating one, Kullback-Leiber divergence takes the form ![Formula][16] which, after some algebra, can be written as follows: ![Formula][17] This quantity can be estimated by replacing *H* with its empirical distribution *Ĥ*, so that ![Graphic][18]. This is an overestimated quantity of the expected log likelihood, given that *Ĥ* is closer to ![Graphic][19] than *H*. The related bias can be written as follows: ![Formula][20] Denoting, by the Greek letter *ξ* the number of estimated parameters, Akaike proved that ![Graphic][21], so that the information based criterion takes the form ![Graphic][22]. By multiplying this quantity by −2, finally *AIC* is defined as ![Formula][23] Elaborating on [34], the correct formulation of AIC for the model expressed in Equation 9 takes the form ![Formula][24] where ![Formula][25] and ![Formula][26] By sequentially applying Equation 11 for different combinations of the hyper-parameters {(*p, d, q, P, D, Q*))} and conditioning the observed data to *a given λ* parameter (which in Equation 12 has been denoted with *λ*) a sequence of AIC values is obtained. This is the first of the two-step selection strategy adopted in the present paper, which is usually referred to as *MAICE* (short for Minimum *AIC* Expectation) [2] procedure. In the second step, the order (Γ***) satisfying: ![Formula][27] i.e. the minimizer of the AICs generated by the candidate models, will be the winner model structure. However, Equations 12 and 13 are not designed to estimate the Box-Cox *λ* parameter. To this end, a grid search approach – over a set Λ of *B* competing parameters {*λ**j*; *j* = 1, 2, …, *B}* – has been applied. Each *λ* has been evaluated in terms of the contributions given in terms of both data normalization and statistical significance of the external regressor. Finally, *MAICE* procedure requires the definition of an upper bound for all the Γ parameters, as a maximum order a given process can reach. This choice, unfortunately, is *a priori* and arbitrary. ## Data Availability The TPR data for all Italian region compared with hospitalized time series is available in the following Web page. [http://www.cs.unibo.it/~gaspar/www/italy.html](http://www.cs.unibo.it/~gaspar/www/italy.html) ## Author Contributions * **Livio Fenga:** his contribution concerns the development of the statistical method used for the lagged correlation analysis and the construction of the prediction model. He also wrote the article and contributed to the discussion of the results. * **Mauro Gaspari:** his contribution concerns the definition of the TPR index and the design of the scenarios as well as of the associated figures. He also designed the forecasting experiments, prepared the time series. He finally wrote the article and contributed to the discussion of the results. ## Conflict of interest The author declares that he has no conflict of interest. ## Acknowledgements The author would like to thank the Italian Civil Protection Department, and all the staff involved for providing the data of the outbreak used in this study. ## Footnotes * The presentation has been improved, an improved discussion section was included with a new figure. * 1 In the three-tiered system issued in Italy to combat the spread of COVID-19, the “red zone” indicates an high-contagion-risk area where non-essential shops and markets are closed and residents are only allowed to leave their homes for work, health reasons or emergencies. * Received March 4, 2021. * Revision received March 10, 2021. * Accepted March 10, 2021. * © 2021, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution-NonCommercial 4.0 International), CC BY-NC 4.0, as described at [http://creativecommons.org/licenses/by-nc/4.0/](http://creativecommons.org/licenses/by-nc/4.0/) ## References 1. [1]. Hirotugu Akaike. A new look at the statistical model identification. IEEE transactions on automatic control, 19(6):716–723, 1974. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1109/TAC.1974.1100705&link_type=DOI) 2. [2]. Hirotugu Akaike. Modern development of statistical methods. In Trends and progress in system identification, pages 169–184. Elsevier, 1981. 3. [3]. Carl A Ascoli. Could mutations of sars-cov-2 suppress diagnostic detection? Nature Biotechnology, pages 1–2, 2021. 4. [4]. Andrea L Bertozzi, Elisa Franco, George Mohler, Martin B Short, and Daniel Sledge. The challenges of modeling and forecasting the spread of covid-19. Proceedings of the National Academy of Sciences, 117(29):16732– 16738, 2020. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoicG5hcyI7czo1OiJyZXNpZCI7czoxMjoiMTE3LzI5LzE2NzMyIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDMvMTAvMjAyMS4wMy4wNC4yMTI1Mjg5Ny5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 5. [5]. Malcolm Beynon, Bruce Curry, and Peter Morgan. The dempstershafer theory of evidence: an alternative approach to multicriteria decision mod-elling. Omega, 28(1):37–50, 2000. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S0305-0483(99)00033-X&link_type=DOI) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000084469300003&link_type=ISI) 6. [6]. George EP Box and David R Cox. An analysis of transformations. Journal of the Royal Statistical Society: Series B (Methodological), 26(2):211–243, 1964. [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=A1964XF37100004&link_type=ISI) 7. [7]. George EP Box, Gwilym M Jenkins, Gregory C Reinsel, and Greta M Ljung. Time series analysis: forecasting and control. John Wiley & Sons, 2015. 8. [8]. Ross M Boyce, Raquel Reyes, Michael Matte, Moses Ntaro, Edgar Mulogo, Feng-Chang Lin, and Mark J Siedner. Practical implications of the nonlinear relationship between the test positivity rate and malaria incidence. PLoS One, 11(3):e0152410, 2016. 9. [9]. Hamparsum Bozdogan. Model selection and akaike’s information criterion (aic): The general theory and its analytical extensions. Psychometrika, 52(3):345–370, 1987. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/BF02294361&link_type=DOI) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=A1987K344100004&link_type=ISI) 10. [10]. Ye Chen, Kunkun Leng, Ying Lu, Lihai Wen, Ying Qi, Wei Gao, Huijie Chen, Lina Bai, Xiangdong An, Baijun Sun, et al. Epidemiological features and time-series analysis of influenza incidence in urban and rural areas of shenyang, china, 2010–2018. Epidemiology & Infection, 148, 2020. 11. [11]. Chaido Dritsaki. Forecast of sarima models: An application to unemployment rates of greece. American Journal of Applied Mathematics and Statistics, 4(5):136–148, 2016. 12. [12]. Peter Ellis. Test positivity rates and actual incidence and growth of diseases, 2020. 13. [13]. Livio Fenga. Covid-19: an automatic, semiparametric estimation method for the population infected in italy. PeerJ, 9:e10819, 2021. 14. [14]. Livio Fenga. Forecasting the covid-19 diffusion in italy and the related occupancy of intensive care units. Journal of Probability and Statistics, 2021, 2021. 15. [15]. Livio Fenga and Carlo Del Castello. Covid19 meta heuristic optimization based forecast method on time dependent bootstrapped data. medRxiv, 2020. 16. [16]. Michael Funke. Time-series forecasting of the german unemployment rate. Journal of Forecasting, 11(2):111–125, 1992. 17. [17]. Alberto L García-Basteiro, Carlos Chaccour, Caterina Guinovart, Anna Llupiá, Joe Brew, Antoni Trilla, and Antoni Plasencia. Monitoring the covid-19 epidemic in the context of widespread local transmission. The Lancet Respiratory Medicine, 8(5):440–442, 2020. 18. [18]. Mauro Gaspari. A novel epidemiological model for covid-19. medRxiv. 19. [19]. Mauro Gaspari. Covid-19 test positivity rate as a marker for hospital overload. medRxiv, 2021. 20. [20]. Joe Hasell, Edouard Mathieu, Diana Beltekian, Bobbie Macdonald, Charlie Giattino, Esteban Ortiz-Ospina, Max Roser, and Hannah Ritchie. A crosscountry database of covid-19 testing. Scientific data, 7(1):1–7, 2020. 21. [21]. Shuhua Hu. Akaike information criterion. Center for Research in Scientific Computation, 93, 2007. 22. [22]. Charles R Hulten and Frank C Wykoff. The estimation of economic depreciation using vintage asset prices: An application of the box-cox power transformation. Journal of Econometrics, 15(3):367–396, 1981. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/0304-4076(81)90101-9&link_type=DOI) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=A1981LP95200004&link_type=ISI) 23. [23]. John PA Ioannidis, Sally Cripps, and Martin A Tanner. Forecasting for covid-19 has failed. International journal of forecasting, 2020. 24. [24]. Nicholas P Jewell, Joseph A Lewnard, and Britta L Jewell. Predictive mathematical models of the covid-19 pandemic: underlying principles and value of projections. Jama, 323(19):1893–1894, 2020. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jama.2020.6585&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32297897&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F10%2F2021.03.04.21252897.atom) 25. [25]. Sungduk Kim, Ming-Hui Chen, Joseph G Ibrahim, Arvind K Shah, and Jianxin Lin. Bayesian inference for multivariate meta-analysis box–cox transformation models for individual patient data with applications to evaluation of cholesterol-lowering drugs. Statistics in medicine, 32(23):3972– 3990, 2013. 26. [26]. Qiang Li, Wei Feng, and Ying-Hui Quan. Trend and forecasting of the covid-19 outbreak in china. Journal of Infection, 80(4):469–496, 2020. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32092392&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F10%2F2021.03.04.21252897.atom) 27. [27]. Huan Liu, Chenxi Li, Yingqi Shao, Xin Zhang, Zhao Zhai, Xing Wang, Xinye Qi, Jiahui Wang, Yanhua Hao, Qunhong Wu, et al. Forecast of the trend in incidence of acute hemorrhagic conjunctivitis in china from 2011–2019 using the seasonal autoregressive integrated moving average (sarima) and exponential smoothing (ets) models. Journal of infection and public health, 13(2):287–294, 2020. 28. [28]. Xianglong Luo, Liyao Niu, and Shengrui Zhang. An algorithm for traffic flow prediction based on improved sarima and ga. KSCE Journal of Civil Engineering, 22(10):4107–4115, 2018. 29. [29]. Habib Allah Mombeni, Sadegh Rezaei, Saralees Nadarajah, and Mahsa Emami. Estimation of water demand in iran based on sarima models. Environmental Modeling & Assessment, 18(5):559–565, 2013. 30. [30]. Martial L Ndeffo-Mbah et al. Using test positivity and reported case rates to estimate state-level covid-19 prevalence in the united states. medRxiv, 2020. 31. [31]. Flávio Fonseca Nobre, Ana Beatriz Soares Monteiro, Paulo Roberto Telles, and G David Williamson. Dynamic linear model and sarima: a comparison of their forecasting performance in epidemiology. Statistics in medicine, 20(20):3051–3069, 2001. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=11590632&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F10%2F2021.03.04.21252897.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000171563800005&link_type=ISI) 32. [32]. Ryosuke Omori, Kenji Mizumoto, and Gerardo Chowell. Changes in testing rates could mask the novel coronavirus disease (covid-19) growth rate. International Journal of Infectious Diseases, 94:116–118, 2020. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.ijid.2020.04.021&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32320809&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F10%2F2021.03.04.21252897.atom) 33. [33]. World Health Organization et al. Considerations for implementing and adjusting public health and social measures in the context of covid-19: interim guidance, 4 november 2020. Technical report, World Health Organization, 2020. 34. [34]. T Ozaki. On the order determination of arima models. Journal of the Royal Statistical Society: Series C (Applied Statistics), 26(3):290–301, 1977. 35. [35]. Timothy W Russell, Nick Golding, Joel Hellewell, Sam Abbott, Lawrence Wright, Carl AB Pearson, Kevin van Zandvoort, Christopher I Jarvis, Hamish Gibbs, Yang Liu, et al. Reconstructing the early global dynamics of under-ascertained covid-19 cases and infections. BMC medicine, 18(1):1–9, 2020. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/s12916-020-01597-8&link_type=DOI) 36. [36]. Remi M Sakia. The box-cox transformation technique: a review. Journal of the Royal Statistical Society: Series D (The Statistician), 41(2):169–178, 1992. 37. [37]. Kankan Sarkar, Subhas Khajanchi, and Juan J Nieto. Modeling and forecasting the covid-19 pandemic in india. Chaos, Solitons & Fractals, 139:110049, 2020. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.chaos.2020.110049&link_type=DOI) 38. [38]. Gitanjali R Shinde, Asmita B Kalamkar, Parikshit N Mahalle, Nilanjan Dey, Jyotismita Chaki, and Aboul Ella Hassanien. Forecasting models for coronavirus disease (covid-19): a survey of the state-of-the-art. SN Computer Science, 1(4):1–15, 2020. 39. [39]. Allison Tong, Tania C Sorrell, Andrew J Black, Corinne Caillaud, Wojciech Chrzanowski, Eugena Li, David Martinez-Martin, Alistair McEwan, Rex Wang, Alice Motion, et al. Research priorities for covid-19 sensor technology. Nature Biotechnology, pages 1–4, 2021. 40. [40]. Gianni Turcato, Arian Zaboli, Norbert Pfeifer, Laura Ciccariello, Serena Sibilio, Giovanna Tezza, and Dietmar Ausserhofer. Clinical application of a rapid antigen test for the detection of sars-cov-2 infection in symptomatic and asymptomatic patients evaluated in the emergency department: a preliminary report. Journal of Infection, 2020. 41. [41]. Olivier Cappe, Eric Moulines, and Tobias Ryden. Inference in hidden Markov models. Springer Science & Business Media, 2006. [1]: /embed/graphic-9.gif [2]: /embed/inline-graphic-1.gif [3]: /embed/inline-graphic-2.gif [4]: /embed/inline-graphic-3.gif [5]: /embed/graphic-10.gif [6]: /embed/graphic-11.gif [7]: /embed/graphic-12.gif [8]: /embed/graphic-13.gif [9]: /embed/graphic-14.gif [10]: /embed/graphic-15.gif [11]: /embed/graphic-16.gif [12]: /embed/graphic-17.gif [13]: /embed/graphic-18.gif [14]: /embed/inline-graphic-4.gif [15]: /embed/inline-graphic-5.gif [16]: /embed/graphic-19.gif [17]: /embed/graphic-20.gif [18]: /embed/inline-graphic-6.gif [19]: /embed/inline-graphic-7.gif [20]: /embed/graphic-21.gif [21]: /embed/inline-graphic-8.gif [22]: /embed/inline-graphic-9.gif [23]: /embed/graphic-22.gif [24]: /embed/graphic-23.gif [25]: /embed/graphic-24.gif [26]: /embed/graphic-25.gif [27]: /embed/graphic-26.gif