RT Journal Article
SR Electronic
T1 Evaluation of FluSight influenza forecasting in the 2021-22 and 2022-23 seasons with a new target laboratory-confirmed influenza hospitalizations
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2023.12.08.23299726
DO 10.1101/2023.12.08.23299726
A1 Mathis, Sarabeth M.
A1 Webber, Alexander E.
A1 León, Tomás M.
A1 Murray, Erin L.
A1 Sun, Monica
A1 White, Lauren A.
A1 Brooks, Logan C.
A1 Green, Alden
A1 Hu, Addison J.
A1 McDonald, Daniel J.
A1 Rosenfeld, Roni
A1 Shemetov, Dmitry
A1 Tibshirani, Ryan J.
A1 Kandula, Sasikiran
A1 Pei, Sen
A1 Shaman, Jeffrey
A1 Yaari, Rami
A1 Yamana, Teresa K.
A1 Agarwal, Pulak
A1 Balusu, Srikar
A1 Gururajan, Gautham
A1 Kamarthi, Harshavardhan
A1 Prakash, B. Aditya
A1 Raman, Rishi
A1 Rodríguez, Alexander
A1 Zhao, Zhiyuan
A1 Meiyappan, Akilan
A1 Omar, Shalina
A1 Baccam, Prasith
A1 Gurung, Heidi L.
A1 Stage, Steve A.
A1 Suchoski, Brad T.
A1 Ajelli, Marco
A1 Kummer, Allisandra G.
A1 Litvinova, Maria
A1 Ventura, Paulo C.
A1 Wadsworth, Spencer
A1 Niemi, Jarad
A1 Carcelen, Erica
A1 Hill, Alison L
A1 Jung, Sung-mok
A1 Lemaitre, Joseph C.
A1 Lessler, Justin
A1 Loo, Sara L
A1 McKee, Clifton D.
A1 Sato, Koji
A1 Smith, Claire
A1 Truelove, Shaun
A1 McAndrew, Thomas
A1 Ye, Wenxuan
A1 Bosse, Nikos
A1 Hlavacek, William S.
A1 Lin, Yen Ting
A1 Mallela, Abhishek
A1 Chen, Ye
A1 Lamm, Shelby M.
A1 Lee, Jaechoul
A1 Posner, Richard G.
A1 Perofsky, Amanda C.
A1 Viboud, Cécile
A1 Clemente, Leonardo
A1 Lu, Fred
A1 Meyer, Austin G
A1 Santillana, Mauricio
A1 Chinazzi, Matteo
A1 Davis, Jessica T.
A1 Mu, Kunpeng
A1 Pastore y Piontti, Ana
A1 Vespignani, Alessandro
A1 Xiong, Xinyue
A1 Ben-Nun, Michal
A1 Riley, Pete
A1 Turtle, James
A1 Hulme-Lowe, Chis
A1 Jessa, Shakeel
A1 Nagraj, V.P.
A1 Turner, Stephen D.
A1 Williams, Desiree
A1 Basu, Avranil
A1 Drake, John M.
A1 Fox, Spencer J.
A1 Gibson, Graham C.
A1 Suez, Ehsan
A1 Thommes, Edward W.
A1 Cojocaru, Monica G.
A1 Cramer, Estee Y.
A1 Gerding, Aaron
A1 Stark, Ariane
A1 Ray, Evan L.
A1 Reich, Nicholas G.
A1 Shandross, Li
A1 Wattanachit, Nutcha
A1 Wang, Yijin
A1 Zorn, Martha W.
A1 Aawar, Majd Al
A1 Srivastava, Ajitesh
A1 Meyers, Lauren A.
A1 Adiga, Aniruddha
A1 Hurt, Benjamin
A1 Kaur, Gursharn
A1 Lewis, Bryan L.
A1 Marathe, Madhav
A1 Venkatramanan, Srinivasan
A1 Butler, Patrick
A1 Farabow, Andrew
A1 Muralidhar, Nikhil
A1 Ramakrishnan, Naren
A1 Reed, Carrie
A1 Biggerstaff, Matthew
A1 Borchering, Rebecca K.
YR 2023
UL http://medrxiv.org/content/early/2023/12/11/2023.12.08.23299726.abstract
AB Accurate forecasts can enable more effective public health responses during seasonal influenza epidemics. Forecasting teams were asked to provide national and jurisdiction-specific probabilistic predictions of weekly confirmed influenza hospital admissions for one through four weeks ahead for the 2021-22 and 2022-23 influenza seasons.Across both seasons, 26 teams submitted forecasts, with the submitting teams varying between seasons. Forecast skill was evaluated using the Weighted Interval Score (WIS), relative WIS, and coverage.Six out of 23 models outperformed the baseline model across forecast weeks and locations in 2021-22 and 12 out of 18 models in 2022-23. Averaging across all forecast targets, the FluSight ensemble was the 2nd most accurate model measured by WIS in 2021-22 and the 5th most accurate in the 2022-23 season. Forecast skill and 95% coverage for the FluSight ensemble and most component models degraded over longer forecast horizons and during periods of rapid change.Current influenza forecasting efforts help inform situational awareness, but research is needed to address limitations, including decreased performance during periods of changing epidemic dynamics.Competing Interest StatementE.W.T. is an employee of Sanofi, which manufactures influenza vaccines. J.S. and Columbia University disclose partial ownership of SK Analytics. J.S. discloses consulting for BNI.Funding StatementM.B.N., P.R., J.T., S.V., A.A., G.K., B.H., B.L.L., M.V.M., M.A.A, A.S. disclose support for the research of this work from the Centers for Disease Control and Prevention (CDC) and Council of State and Territorial Epidemiologists (CSTE), [Cooperative Agreement number NU380T000297] M.C., J.D, K.M., X.X, APP, AV, P.C.V., A.G.K. M.L., M.A. disclose support for the research of this work from the HHS/CDC 6U01IP001137 and HHS/CDC 5U01IP0001137. B.A.P., A.R., H.P.K., Z.Z., G.G., P.A., S.S.B., R.V.V., disclose support for the research of this work from NSF (Expeditions CCF-1918770, CAREER IIS-2028586, RAPID IIS-2027862, Medium IIS-1955883, Medium IIS-2106961, PIPP CCF-2200269), CDC MInD program, faculty gifts from Facebook/Meta, and funds/computing resources from Georgia Tech and GTRI. M.S., L.C. F.L and A.G. M. disclose support for the research of this work from the Centers for Disease Control and Prevention (CDC) and Council of State and Territorial Epidemiologists (CSTE), [Cooperative Agreement number NU380T000297] M.S. discloses support for the research of this work from the National Institutes of Health (grant number R01GM130668) and (in part) by contract 200-2016-91779 with the Centers for Disease Control and Prevention. S.V., A.A., G.K., B.H., B.L.L., M.V.M., also disclose support for the research of this work from NSF Expeditions CCF-1918656, VDH Grant VDH-21-501-0135, University of Virginia Strategic Investment Fund Award SIF160. L.C.B., A.G., A.J.H., D.J.M., R.R., D.S., R.J.T. disclose support for the research of this work from the Centers for Disease Control and Prevention U011P001121 and Centers for Disease Control and Prevention 75D30123C15907. B.T.S., S.A.S., H.L.G., and P.B. disclose support for the research of this work from the Centers for Disease Control and Prevention (CDC) and Council of State and Territorial Epidemiologists (CSTE), [Cooperative Agreement number NU38OT000297] N.R. discloses support from National Science Foundation grants CCF-1918770, NRT DGE-1545362, and OAC-1835660. S.T., C.P.S., A.H. disclose support for the research of this work from the National Science Foundation [2127976]. S.T., C.P.S., A.H., J.L., J.C.L., S.L.L., C.D.M., K.S., S-m.J. disclose support from the Centers for Disease Control and Prevention [200-2016-91781].Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesI confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesAll data produced are available online at https://github.com/cdcepi/FluSight-manuscripts https://github.com/cdcepi/Flusight-forecast-data