Use of penalized basis splines in estimation of characteristics of seasonal and sporadic infectious disease outbreaks ===================================================================================================================== * Ben Artin * Daniel M. Weinberger * Virginia E. Pitzer * Joshua L. Warren ## Abstract There is often a need to estimate the characteristics of epidemics or seasonality from infectious disease data. For instance, accurately estimating the start and end date of respiratory syncytial virus (RSV) epidemics can be used to optimize the initiation of prophylactic medication. These characteristics can sometimes be estimated directly from disease incidence data; more often, widely-used methods for describing these characteristics begin with a regression model fit to a time series of disease incidence. The fitted model is then used to calculate the quantities of interest. Calculation of these quantities typically involves combining multiple estimated parameters from the fitted model, and consequently only point estimates (rather than measures of uncertainty) can be made in a straightforward way. Motivated by attempts to estimate the optimal timing of prophylaxis for RSV, we developed a general method for obtaining confidence intervals for characteristics of seasonal and sporadic infectious disease outbreaks. To do this, we use multivariate sampling of a generalized additive model with penalized basis splines. Our approach provides robust confidence intervals regardless of the complexity of the calculations of the outcome measures, and it generalizes to other systems (including outbreaks of other infectious diseases). Here we present our general approach, its application to RSV, and an R package that provides a convenient interface for conducting and validating this type of analysis in other areas. **Author summary** Prevention and treatment of seasonal infections use numerous resources, such as pharmaceuticals, laboratory equipment, and clinical and non-clinical staff. Optimizing the use of these resources usually requires forecasting the timing of infectious disease seasons. In our research of respiratory syncytial virus (a seasonal respiratory infection that is a significant cause of infant hospitalizations and mortality world-wide) we used splines (a type of mathematical curves with convenient and well-understood statistical properties) to develop a new approach to obtain interval estimates of temporal characteristics of seasonal epidemics, such as the beginning and the end dates. We also developed an R package to facilitate use or our methods in other research. Here we present our general approach and outline its applications to RSV. ## Introduction Analyses of infectious disease dynamics often make inferences based on timing for various quantities of clinical and public health interest; for example, the start and the end of seasonal outbreaks, duration of outbreaks, and/or optimal timing of prophylaxis or treatment. Some aspects of timing can be estimated ad-hoc directly from disease incidence data; more typically, a regression model (for example, a generalized linear model (GLM) or a generalized additive model (GAM)) is fitted to a time series of observed disease counts, and the calculations of the quantities of interest are made based on combinations of parameters estimated from the fitted model. Calculating the uncertainty of estimates from these types of GAM/GLM-based methods presents a challenge under frequentist approaches. These challenges are exemplified by analyses of the dynamics of respiratory syncytial virus (RSV) — a respiratory infection that has annual or biennial seasonal pattern and is a major infectious cause of infant morbidity and mortality globally. [1, 2] In some countries, high-risk infants are administered antibody prophylaxis throughout the period of high RSV incidence. The therapy is expensive, and the duration of antibody protection is short-lived, [3, 4] so administration of prophylaxis needs to be timed with the RSV season to provide optimal protection. [5] Therefore, estimating the timing of initiation of the RSV season in different locations is important. Frequentist model fitting procedures provide measures of uncertainty for the individual model parameters. However, calculating the quantities of interest from those model parameters often requires differentiation or integration with respect to time (for example, to identify outbreak transition points or to determine overall disease burden), which can complicate the process of deriving large sample standard errors. As a result, these tools in RSV research, such as those evaluated in [6], typically ignore uncertainty and focus solely on estimation. When they do consider uncertainty estimation, these methods in infectious disease modeling are often either complex to use (for example, block bootstrapping), computationally intensive, or both. Parameter resampling is an approach that offers uncertainty estimation, balances ease of use with computational efficiency, and has been previously applied in infectious disease modeling. [7, 8] In this study, our goal was to generalize prior work on parameter resampling to develop a general framework of retrospective analysis of infectious diseases that allows estimation of uncertainty intervals for time-based outbreak characteristics (such as outbreak onset time) while being flexible as to the precise definition of the characteristics of interest. To that end, we will show how functional data analysis using GAMs with penalized splines can be used to fit smooth curves to infectious disease incidence data, and how the fitted model can then be used to calculate uncertainty intervals for characteristics of the epidemic, such as the start and end date of seasonal epidemics. ## Methods We developed this method in the context of our RSV research, in which the principal questions were: * Is the period during which RSV prophylaxis is administered well-matched to the timing of RSV seasons? * Could the prophylaxis period be adjusted so that more of the prophylaxis-eligible RSV cases fall within the prophylaxis period? To answer these questions, we defined the following outcome measures: * Season onset and offset, defined as the points in time when the cumulative incidence of RSV rises above 2.5% and 97.5% of the total incidence of RSV for the entire season. * Preventable fraction of a prophylaxis regimen, defined as the fraction of all prophylaxis-naive RSV cases occurring during the period when the prophylaxis regimen provides protection from RSV. Our approach is to fit a family of smooth curves through the observed disease incidence time series, and to infer time-domain features of the outbreak from these curves using parameter resampling. The fitting curves we use are penalized basis splines (P-splines), which have several desirable qualities, including computational compactness and efficiency and well-understood statistical behavior. Most notably for our application, P-spline parameters estimated by GAM are asymptotically normally distributed, provided that the underlying phenomenon is well-approximated by a piecewise-polynomial function. [9] Additionally, we developed a simulation study to validate this interval estimation method for our outcome measures. ### Outcome estimation By way of example, consider the (hypothetical) RSV season shown in Fig 1.  [Fig 1.](http://medrxiv.org/content/early/2020/07/17/2020.07.14.20138180/F1) Fig 1. Incidence of RSV-associated hospitalizations. To estimate the onset and offset for this RSV season, we begin by fitting a cyclic P-spline GAM (see Supplement) to the observations, using incidence at time *t, y*(*t*), as the model response variable, the log link function, and a 20-term cubic spline basis, *B**k* (*t*), as the only predictor such that ![Formula][1]</img> The best fit produced by this model (using a 2nd degree smoothing penalty) is shown in Fig 2a.  [Fig 2.](http://medrxiv.org/content/early/2020/07/17/2020.07.14.20138180/F2) Fig 2. The steps involved in outcome estimation using penalized splines, demonstrated by estimating onset and offset of seasonal outbreaks of RSV. (a) Best-fit P-spline model of RSV incidence; (b) Five different sampled P-spline models of RSV incidence; (c) Five different computed estimates of RSV season onset and offset; (d) Sampled distribution of RSV season onset and offset estimates. Using the asymptotic normality of the large-sample posterior distribution of *β**k*, we can use parameter estimates (and uncertainty estimates) from the P-spline GAM to obtain a large sample credible interval for *λ*(*t*) by sampling *β**k* from this distribution and calculating ![Graphic][2]</img> The resulting large sample credible interval has been shown to closely approximate the frequentist confidence interval across the entire function for non-linear data that follows a Poisson, binomial, or gamma distribution [10, 11]. Fig 2b demonstrates this in the form of *N* = 5 *λ*(*t*) curves produced by independently sampling each *β**k* *N* = 5 times; as *N* increases, the sampled curves yield large sample confidence intervals for *λ*(*t*) across all values of *t*. Having obtained a smooth model with confidence intervals of the expected incidence, we can turn to our first outcome measures of interest, time of outbreak onset (*t**on*) and offset (*t**off*), defined by: ![Formula][3]</img> Given any *λ*(*t*) sampled via *β**k* sampling, we numerically solve for the corresponding *t**on* and *t**off*, thereby indirectly sampling *t**on* and *t**off* from their sampling distributions. The same five *y*(*t*) with their corresponding *t**on* and *t**off* are shown in Fig 2c. Sampling a large number of *t**on* and *t**off* yields an approximation of the unknown distributions of *t**on* and *t**off*. In our example, sampling *N* = 2000 times yields the distributions of *t**on* and *t**off* shown in Fig 2d. From these distributions, we can calculate our desired point estimates (median) and interval estimates (quantiles): ![Graphic][4]</img> weeks (95% CI: 16.52 - 21.5 weeks), ![Graphic][5]</img> weeks (95% CI: 40.52 − 43.26 weeks). We defined our other outcome measure, the preventable fraction (*F**p*) of a prophylaxis regimen that offers protection between *t**start* and *t**end*, as: ![Formula][6]</img> We repeated the above method to estimate the preventable fraction of the prophylaxis regimen recommended by the American Academy of Pediatrics as well as several alternative prophylaxis regimens, which then enabled us to assess the potential benefit of adjusting the prophylaxis regimen to better align with the local RSV season. ### Simulation study We began by generating *N**season* = 60 RSV seasons. Each season was generated as follows: 1. Randomly choose epidemiologic week of season start *t**start* *∼* Uniform(5, 15), epidemiologic week of season end *t**end* *∼* Uniform(30, 45), and peak incidence *λ**max* *∼* Uniform(50, 500). 2. Calculate ![Formula][7]</img> to produce a curve roughly of the desired shape (rising from 0 to *λ**max*, then falling back to 0, between *t**start* and *t**end*). 3. Fit a log-linked cubic P-spline to *λ**∗*(*t*) to obtain true instantaneous incidence *λ*(*t*); this ensures that the true incidence is smooth in the second derivative. The number of seasons was chosen to balance power of the simulated outcome estimation with computational demand. The ranges of the parameters for the simulated seasons were chosen to include the observed characteristics in our actual dataset of RSV-related hospitalizations in Connecticut. For each season, we then generated *N**obs* = 60 sets of observations by sampling observed incidence ![Graphic][8]</img> at weekly intervals. We also calculated the true values of *t**on* and *t**off* directly from *λ* (*t*) for each season. Finally, we used the method described above to obtain ![Graphic][9]</img> and ![Graphic][10]</img> estimates for each of the *N**season* · *N**obs* = 3600 sets of observations, in order to verify that the true values of *t**on* and *t**off* calculated directly from *λ*(*t*)) were contained in the 95% CI *≈* 95% of the time. We repeated the same process to validate the preventable fraction estimates. ## Results To evaluate the results of our method, we considered three performance metrics: * Coverage: the fraction of estimated 95% confidence intervals that include the true value of the outcome measure. * Mean absolute error (MAE): the mean absolute value of the difference between point estimates and the true value. * Scaled MAE (for onset and offset only): mean absolute error divided by *t**off* *− t**on*. The process of performing a simulation study is straightforward, but the measures of robustness it yields must be interpreted in the context of the research at hand. In our particular case, the MAE of onset/offset estimates (*∼* 0.15 weeks, see Table 1) was small compared to time periods of interest in our analysis (which were 1 weeks or more). The MAE for preventable fraction was similarly non-consequential to our results. Overall, the simulation study showed that our estimation method for onset, offset, and preventable fraction met the needs of our RSV research. View this table: [Table 1.](http://medrxiv.org/content/early/2020/07/17/2020.07.14.20138180/T1) Table 1. Simulation study results. MAE: Mean absolute Error. SE: Standard error. ## Discussion In this study, we demonstrate how P-spline regression, combined with parameter resampling, can be used to generate uncertainty intervals for quantities derived from epidemic disease data. This is a general approach that can be applied to other to other systems, such as outbreaks of other infectious diseases, as well as other outcome measures. We focus on specific outcome measures (onset/offset time and preventable fraction) that are relevant for RSV. Validating our estimation of those quantities using a simulation study gives methodological grounding to this approach. Direct public health applications of this approach include investigation of the potential benefits of region-specific RSV prophylaxis guidelines. To facilitate application of P-spline estimation to other research, we wrote an R package, pspline.inference [12], that encapsulate our methods in an easy-to-use programming interface. It allows the user to obtain interval estimates of a user-defined outcome measure (as long as it’s computable from the model response variable), regardless of how complex its computation; it also provides an easy way to conduct a simulation study to validate estimation of the user-defined outcome measure on user-supplied data, thereby making it simple to develop and validate novel outcome measures. The package is available on GitHub and the Comprehensive R Archive Network (CRAN), and its documentation includes examples beyond those shown here. We considered including a head-to-head comparison between our approach and any number of alternative approaches to estimation of time-based outbreak characteristics. However, such comparison would have required defining what it means to compare a point-estimation method to an interval-estimation method and what it means to compare two methods of estimating onset and offset in the absence of a standardized meaning of onset and offset. We therefore decided head-to-head comparison was not within the scope of this initial report, and instead we focus here on an absolute evaluation of the correctness of our approach by means of the simulation study. The flexibility of our approach does come at a price. We validated it only for our input data and for our outcome measures; applications of this approach to other types of analysis will have to be validated independently. Our R package makes this validation simple to perform, but the validation is inherently time-consuming; whereas our analysis took minutes-to-hours to run, validation of our analysis took hours-to-days. Even with that computational cost, our approach is computationally less demanding than Bayesian Markov chain Monte Carlo (MCMC) approaches on datasets of comparable size, because the computationally expensive step in our approach is validation, not the analysis itself. The estimates produced by our method are likely to be biased (as shown in our RSV application); measuring that bias (using our validation tools) and assessing its impact on results is, necessarily, left up to the individual application. Our method is inherently retrospective; the strengths of our approach come from considering the incidence time series as a whole, and it therefore cannot, in its current form, be applied to real-time analysis. In summary, ours is a method of retrospective analysis of infectious disease outbreaks based on P-splines; it is computationally less demanding than Bayesian MCMC methods, yet, unlike the common frequentist approaches, it allows for more straightforward interval estimation of time-based outbreak characteristics. Although we only validated it for our analysis of RSV seasonality, it is applicable to other similar systems, and by publishing it on CRAN, we hope to facilitate its use in other analyses. ## Data Availability Data availability: not applicable Code available at [https://github.com/weinbergerlab/pspline.inference](https://github.com/weinbergerlab/pspline.inference) ## Supplement: P-spline GAMs in brief A *spline* of order *n* is a piecewise polynomial real function *S*(*x*) of degree *n −*1 on interval [*x**L*, *x**R*]; the points *p*1, *p*2,…, *p**m* *∈* [*x**L*, *x**R*] at which its polynomial segments join are known as its *knots*. Owing to its construction, a spline of order *n* has up to *n −* 1 continuous derivatives throughout [*x**L*, *x**R*]; for our analysis, we only consider splines with exactly *n −* 1 continuous derivatives. For any set of knots *P* = {*p*1,…, *p**m*}, we can construct a unique set of *m − n* splines of order *n* known as the *basis splines (B-splines) over P*, denoted with *B**k*(*x*; *n*; *P*), *k* = 1,…, *m − n*. Every spline *S*(*x*) of order *n* with knots *P* can be uniquely represented as a linear combination of the basis splines *B**k*(*x*; *n*; *P*) such that: ![Formula][11]</img> A *cyclic spline* of order *n* is a piecewise polynomial periodic real function *f* (*x*) = *f* (*x − T*). As with non-cyclic splines, a cyclic spline of order *n* is continuous in up to *n −* 1 derivatives, and we only consider those continuous in exactly *n −* 1 derivatives. Use of cyclic splines is often necessary in infectious disease modeling because non-cyclic splines do not guarantee smoothness at *x**L* *± kT* when extended to multiple periods. Basis splines of cyclic splines are themselves cyclic. A *generalized additive model* provides a framework for modeling a response variable *y*, using predictor variables *x**i*, *i* = 1,…, *p*, with corresponding potentially non-linear predictor functions *f**i*, *i* = 1,…, *p*, and a link function *g*, such that the expected value, *E*(*y*), is defined as ![Formula][12]</img> where *β* and *β**i,j* represent unknown model parameters. Splines can be used for each predictor function in a GAM by setting: ![Formula][13]</img> and treating the spline linear coefficients *c**i,k* as the model parameters *β**i,j*. Splines for different *f**i* in the model can have different orders *n**i* and different knot sets *P**i* of length *m**i*. After expanding each predictor spline, the GAM takes the form ![Formula][14]</img> with *β* and *β**i,j* = *c**i,k* as model parameters, and *n**i* and *P**i* chosen prior to analysis. This model can be fitted to data simply by minimizing ‖*y − E*(*y*) ‖ 2; however, this approach often leads to overfitting, especially with a larger number of knots. To mitigate this, the model can be modified to instead minimize ‖*y − E*(*y*) ‖ 2 + *P*, where *P* is a *penalty function* that measures non-smoothness of the model response variable. This approach balances closeness of fit with smoothness. B-splines used in a model with a penalty function are known as *penalized B-splines* (P-splines) [9]. A variety of penalty functions have been defined; the most common ones use *p*-th order differences between the model and the data, for some small integer *p* (often *p* = 2). As with general cyclic splines, *cyclic P-splines* are an extension of P-splines to periodic functions. ## Footnotes * * ben{at}artins.org * Received July 14, 2020. * Revision received July 14, 2020. * Accepted July 17, 2020. * © 2020, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution 4.0 International), CC BY 4.0, as described at [http://creativecommons.org/licenses/by/4.0/](http://creativecommons.org/licenses/by/4.0/) ## References 1. 1.Hall CB, Weinberg GA, Blumkin AK, Edwards KM, Staat MA, Schultz AF, et al. Respiratory syncytial virus-associated hospitalizations among children less than 24 months of age. Pediatrics. 2013;132(2):e341–8. doi:10.1542/peds.2013-0303. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTA6InBlZGlhdHJpY3MiO3M6NToicmVzaWQiO3M6MTA6IjEzMi8yL2UzNDEiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMC8wNy8xNy8yMDIwLjA3LjE0LjIwMTM4MTgwLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 2. 2.Hall CB, Weinberg GA, Iwane MK, Blumkin AK, Edwards KM, Staat MA, et al. The burden of respiratory syncytial virus infection in young children. The New England Journal of Medicine. 2009;360(6):588–598. doi:10.1056/NEJMoa0804877. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa0804877&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19196675&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F07%2F17%2F2020.07.14.20138180.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000263028800005&link_type=ISI) 3. 3.Andabaka T, Nickerson JW, Rojas-Reyes MX, Rueda JD, Bacic Vrca V, Barsic B. Monoclonal antibody for reducing the risk of respiratory syncytial virus infection in children. The Cochrane Database of Systematic Reviews. 2013;28(4):CD006602. doi:10.1002/14651858.CD006602.pub4. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/14651858.CD006602.pub4&link_type=DOI) 4. 4.Hampp C, Kauf TL, Saidi AS, Winterstein AG. Cost-effectiveness of respiratory syncytial virus prophylaxis in various indications. Archives of Pediatrics & Adolescent Medicine. 2011;165(6):498–505. doi:10.1001/archpediatrics.2010.298. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/archpediatrics.2010.298&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21300647&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F07%2F17%2F2020.07.14.20138180.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000291321000004&link_type=ISI) 5. 5.American Academy of Pediatrics Committee on Infectious Diseases, American Academy of Pediatrics Bronchiolitis Guidelines Committee. Updated guidance for palivizumab prophylaxis among infants and young children at increased risk of hospitalization for respiratory syncytial virus infection. Pediatrics. 2014;134(2):e620–38. doi:10.1542/peds.2014-1666. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTA6InBlZGlhdHJpY3MiO3M6NToicmVzaWQiO3M6MTA6IjEzNC8yL2U2MjAiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMC8wNy8xNy8yMDIwLjA3LjE0LjIwMTM4MTgwLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 6. 6.Midgley CM, Haynes AK, Baumgardner JL, Chommanard C, Demas SW, Prill MM, et al. Determining the Seasonality of Respiratory Syncytial Virus in the United States: The Impact of Increased Molecular Testing. The Journal of infectious diseases. 2017;216(3):345–355. doi:10.1093/infdis/jix275. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/infdis/jix275&link_type=DOI) 7. 7.Lauer SA, Sakrejda K, Ray EL, Keegan LT, Bi Q, Suangtho P, et al. Prospective forecasts of annual dengue hemorrhagic fever incidence in Thailand, 2010–2014. Proceedings of the National Academy of Sciences. 2018;115(10):E2175–E2182. doi:10.1073/pnas.1714457115. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoicG5hcyI7czo1OiJyZXNpZCI7czoxMjoiMTE1LzEwL0UyMTc1IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjAvMDcvMTcvMjAyMC4wNy4xNC4yMDEzODE4MC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 8. 8.Weinberger D, Cohen T, Crawford F, Mostashari F, Olson D, Pitzer VE, et al. Estimating the early death toll of COVID-19 in the United States. medRxiv. 2020;doi:10.1101/2020.04.15.20066431. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoibWVkcnhpdiI7czo1OiJyZXNpZCI7czoyMToiMjAyMC4wNC4xNS4yMDA2NjQzMXYyIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjAvMDcvMTcvMjAyMC4wNy4xNC4yMDEzODE4MC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 9. 9.Eilers PHC, Marx BD. Flexible smoothing with B-splines and penalties. Statistical Science. 1996;11(2):89–121. doi:10.1214/ss/1038425655. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1214/ss/1038425655&link_type=DOI) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=A1996WA79400001&link_type=ISI) 10. 10.Wood SN. On confidence intervals for generalized additive models based on penalized regresion splines. Australian & New Zealand Journal of Statistics. 2006;48(4):445–464. doi:10.1111/j.1467-842X.2006.00450.x. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/j.1467-842X.2006.00450.x&link_type=DOI) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000242861500003&link_type=ISI) 11. 11.Marra G, Wood SN. Coverage Properties of Confidence Intervals for Generalized Additive Model Components. Scandinavian Journal of Statistics. 2012;39(1):53–74. doi:10.1111/j.1467-9469.2011.00760.x. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/j.1467-9469.2011.00760.x&link_type=DOI) 12. 12.Artin B. pspline.inference: Estimation of Characteristics of Seasonal and Sporadic Infectious Disease Outbreaks Using Generalized Additive Modeling with Penalized Basis Splines; 2020. Available from: [http://github.com/weinbergerlab/pspline.inference](http://github.com/weinbergerlab/pspline.inference). [1]: /embed/graphic-2.gif [2]: /embed/inline-graphic-1.gif [3]: /embed/graphic-4.gif [4]: /embed/inline-graphic-2.gif [5]: /embed/inline-graphic-3.gif [6]: /embed/graphic-5.gif [7]: /embed/graphic-6.gif [8]: /embed/inline-graphic-4.gif [9]: /embed/inline-graphic-5.gif [10]: /embed/inline-graphic-6.gif [11]: /embed/graphic-8.gif [12]: /embed/graphic-9.gif [13]: /embed/graphic-10.gif [14]: /embed/graphic-11.gif