Challenges of COVID-19 Case Forecasting in the US, 2020-2021
View ORCID ProfileVelma K Lopez, View ORCID ProfileEstee Y Cramer, Robert Pagano, View ORCID ProfileJohn M Drake, Eamon B O’Dea, Madeline Adee, Turgay Ayer, Jagpreet Chhatwal, Ozden O Dalgic, Mary A Ladd, Benjamin P Linas, Peter P Mueller, Jade Xiao, Johannes Bracher, Alvaro J Castro Rivadeneira, Aaron Gerding, Tilmann Gneiting, Yuxin Huang, Dasuni Jayawardena, Abdul H Kanji, Khoa Le, Anja Mühlemann, Jarad Niemi, Evan L Ray, Ariane Stark, View ORCID ProfileYijin Wang, Nutcha Wattanachit, Martha W Zorn, Sen Pei, Jeffrey Shaman, View ORCID ProfileTeresa K Yamana, Samuel R Tarasewicz, Daniel J Wilson, Sid Baccam, Heidi Gurung, Steve Stage, Brad Suchoski, View ORCID ProfileLei Gao, Zhiling Gu, Myungjin Kim, View ORCID ProfileXinyi Li, Guannan Wang, Lily Wang, Yueying Wang, Shan Yu, Lauren Gardner, Sonia Jindal, Maximilian Marshall, Kristen Nixon, Juan Dent, Alison L Hill, Joshua Kaminsky, Elizabeth C Lee, Joseph C Lemaitre, Justin Lessler, Claire P Smith, View ORCID ProfileShaun Truelove, Matt Kinsey, Luke C. Mullany, View ORCID ProfileKaitlin Rainwater-Lovett, Lauren Shin, Katharine Tallaksen, Shelby Wilson, Dean Karlen, View ORCID ProfileLauren Castro, Geoffrey Fairchild, Isaac Michaud, Dave Osthus, Jiang Bian, Wei Cao, Zhifeng Gao, Juan Lavista Ferres, Chaozhuo Li, Tie-Yan Liu, Xing Xie, Shun Zhang, Shun Zheng, Matteo Chinazzi, Jessica T Davis, Kunpeng Mu, Ana Pastore y Piontti, View ORCID ProfileAlessandro Vespignani, Xinyue Xiong, Robert Walraven, Jinghui Chen, Quanquan Gu, Lingxiao Wang, View ORCID ProfilePan Xu, Weitong Zhang, Difan Zou, Graham Casey Gibson, Daniel Sheldon, Ajitesh Srivastava, Aniruddha Adiga, Benjamin Hurt, Gursharn Kaur, Bryan Lewis, Madhav Marathe, Akhil Sai Peddireddy, Przemyslaw Porebski, Srinivasan Venkatramanan, Lijing Wang, Pragati V Prasad, Jo W Walker, Alexander E Webber, Rachel B Slayton, Matthew Biggerstaff, View ORCID ProfileNicholas G Reich, Michael Johansson
doi: https://doi.org/10.1101/2023.05.30.23290732
Velma K Lopez
1COVID-19 Response, Centers for Disease Control and Prevention, Atlanta, GA, United States of America
Estee Y Cramer
2University of Massachusetts, Amherst, Amherst, MA, United States of America
Robert Pagano
3Unaffiliated, Tucson, AZ, United States of America
John M Drake
4University of Georgia, Athens, GA, United States of America
Eamon B O’Dea
4University of Georgia, Athens, GA, United States of America
Madeline Adee
5Massachusetts General Hospital, Boston, MA, United States of America
Turgay Ayer
6Georgia Institute of Technology, Atlanta, GA, United States of America
Jagpreet Chhatwal
7Massachusetts General Hospital, Harvard Medical School, Boston, MA, United States of America
Ozden O Dalgic
8Value Analytics Labs, Boston, MA, United States of America
Mary A Ladd
5Massachusetts General Hospital, Boston, MA, United States of America
Benjamin P Linas
9Boston University School of Medicine, Boston, MA, United States of America
Peter P Mueller
7Massachusetts General Hospital, Harvard Medical School, Boston, MA, United States of America
Jade Xiao
6Georgia Institute of Technology, Atlanta, GA, United States of America
Johannes Bracher
10Chair of Econometrics and Statistics, Karlsruhe Institute of Technology, Karlsruhe, Germany
Alvaro J Castro Rivadeneira
2University of Massachusetts, Amherst, Amherst, MA, United States of America
Aaron Gerding
2University of Massachusetts, Amherst, Amherst, MA, United States of America
Tilmann Gneiting
11Heidelberg Institute for Theoretical Studies, Heidelberg, Germany
Yuxin Huang
2University of Massachusetts, Amherst, Amherst, MA, United States of America
Dasuni Jayawardena
2University of Massachusetts, Amherst, Amherst, MA, United States of America
Abdul H Kanji
2University of Massachusetts, Amherst, Amherst, MA, United States of America
Khoa Le
2University of Massachusetts, Amherst, Amherst, MA, United States of America
Anja Mühlemann
12Institute of Mathematical Statistics and Actuarial Science, University of Bern, Bern, Switzerland
Jarad Niemi
13Iowa State University, Ames, IA, United States of America
Evan L Ray
2University of Massachusetts, Amherst, Amherst, MA, United States of America
Ariane Stark
2University of Massachusetts, Amherst, Amherst, MA, United States of America
Yijin Wang
2University of Massachusetts, Amherst, Amherst, MA, United States of America
Nutcha Wattanachit
2University of Massachusetts, Amherst, Amherst, MA, United States of America
Martha W Zorn
2University of Massachusetts, Amherst, Amherst, MA, United States of America
Sen Pei
14Mailman School of Public Health, Columbia University, New York, New York, United States of America
Jeffrey Shaman
14Mailman School of Public Health, Columbia University, New York, New York, United States of America
Teresa K Yamana
14Mailman School of Public Health, Columbia University, New York, New York, United States of America
Samuel R Tarasewicz
15Federal Reserve Bank of San Francisco, San Francisco, CA, United States of America
Daniel J Wilson
15Federal Reserve Bank of San Francisco, San Francisco, CA, United States of America
Sid Baccam
16IEM, Bel Air, MD, United States of America
Heidi Gurung
16IEM, Bel Air, MD, United States of America
Steve Stage
16IEM, Bel Air, MD, United States of America
Brad Suchoski
16IEM, Bel Air, MD, United States of America
Lei Gao
17George Mason University, Fairfax, VA, United States of America
Zhiling Gu
13Iowa State University, Ames, IA, United States of America
Myungjin Kim
18Kyungpook National University, Bukgu, Daegu, Republic of Korea
Xinyi Li
19Clemson University, Clemson, SC, United States of America
Guannan Wang
20College of William & Mary, Williamsburg, VA, United States of America
Lily Wang
17George Mason University, Fairfax, VA, United States of America
Yueying Wang
21Amazon, Seattle, WA, United States of America
Shan Yu
22University of Virginia, Charlottesville, VA, United States of America
Lauren Gardner
23Johns Hopkins University, Baltimore, MD, United States of America
Sonia Jindal
23Johns Hopkins University, Baltimore, MD, United States of America
Maximilian Marshall
23Johns Hopkins University, Baltimore, MD, United States of America
Kristen Nixon
23Johns Hopkins University, Baltimore, MD, United States of America
Juan Dent
24Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States of America
Alison L Hill
23Johns Hopkins University, Baltimore, MD, United States of America
Joshua Kaminsky
24Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States of America
Elizabeth C Lee
24Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States of America
Joseph C Lemaitre
25École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
Justin Lessler
26UNC Gillings School of Global Public Health, Chapel Hill, NC, United States of America
Claire P Smith
24Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States of America
Shaun Truelove
24Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States of America
Matt Kinsey
27Johns Hopkins University Applied Physics Lab, Baltimore, MD, United States of America
Luke C. Mullany
27Johns Hopkins University Applied Physics Lab, Baltimore, MD, United States of America
Kaitlin Rainwater-Lovett
27Johns Hopkins University Applied Physics Lab, Baltimore, MD, United States of America
Lauren Shin
27Johns Hopkins University Applied Physics Lab, Baltimore, MD, United States of America
Katharine Tallaksen
27Johns Hopkins University Applied Physics Lab, Baltimore, MD, United States of America
Shelby Wilson
27Johns Hopkins University Applied Physics Lab, Baltimore, MD, United States of America
Dean Karlen
28University of Victoria, Victoria, BC, Canada
Lauren Castro
29Los Alamos National Laboratory, Los Alamos, NM, United States of America
Geoffrey Fairchild
29Los Alamos National Laboratory, Los Alamos, NM, United States of America
Isaac Michaud
29Los Alamos National Laboratory, Los Alamos, NM, United States of America
Dave Osthus
29Los Alamos National Laboratory, Los Alamos, NM, United States of America
Jiang Bian
30Microsoft, Redmond, WA, United States of America
Wei Cao
30Microsoft, Redmond, WA, United States of America
Zhifeng Gao
30Microsoft, Redmond, WA, United States of America
Juan Lavista Ferres
30Microsoft, Redmond, WA, United States of America
Chaozhuo Li
30Microsoft, Redmond, WA, United States of America
Tie-Yan Liu
30Microsoft, Redmond, WA, United States of America
Xing Xie
30Microsoft, Redmond, WA, United States of America
Shun Zhang
30Microsoft, Redmond, WA, United States of America
Shun Zheng
30Microsoft, Redmond, WA, United States of America
Matteo Chinazzi
31Laboratory for the Modeling of Biological and Socio-technical Systems, Northeastern University, Boston, MA, United States of America
Jessica T Davis
31Laboratory for the Modeling of Biological and Socio-technical Systems, Northeastern University, Boston, MA, United States of America
Kunpeng Mu
31Laboratory for the Modeling of Biological and Socio-technical Systems, Northeastern University, Boston, MA, United States of America
Ana Pastore y Piontti
31Laboratory for the Modeling of Biological and Socio-technical Systems, Northeastern University, Boston, MA, United States of America
Alessandro Vespignani
31Laboratory for the Modeling of Biological and Socio-technical Systems, Northeastern University, Boston, MA, United States of America
Xinyue Xiong
31Laboratory for the Modeling of Biological and Socio-technical Systems, Northeastern University, Boston, MA, United States of America
Robert Walraven
32Unaffiliated, Davis, CA, United States of America
Jinghui Chen
33University of California, Los Angeles, Los Angeles, CA, United States of America
Quanquan Gu
33University of California, Los Angeles, Los Angeles, CA, United States of America
Lingxiao Wang
33University of California, Los Angeles, Los Angeles, CA, United States of America
Pan Xu
33University of California, Los Angeles, Los Angeles, CA, United States of America
Weitong Zhang
33University of California, Los Angeles, Los Angeles, CA, United States of America
Difan Zou
33University of California, Los Angeles, Los Angeles, CA, United States of America
Graham Casey Gibson
34Los Alamos National Lab, Los Alamos, NM, United States of America
Daniel Sheldon
2University of Massachusetts, Amherst, Amherst, MA, United States of America
Ajitesh Srivastava
35University of Southern California, Los Angeles, CA, United States of America
Aniruddha Adiga
22University of Virginia, Charlottesville, VA, United States of America
Benjamin Hurt
22University of Virginia, Charlottesville, VA, United States of America
Gursharn Kaur
22University of Virginia, Charlottesville, VA, United States of America
Bryan Lewis
22University of Virginia, Charlottesville, VA, United States of America
Madhav Marathe
22University of Virginia, Charlottesville, VA, United States of America
Akhil Sai Peddireddy
36Discreet Labs, Raleigh, NC, United States of America
Przemyslaw Porebski
22University of Virginia, Charlottesville, VA, United States of America
Srinivasan Venkatramanan
22University of Virginia, Charlottesville, VA, United States of America
Lijing Wang
37New Jersey Institute of Technology, Newark, NJ, United States of America
Pragati V Prasad
1COVID-19 Response, Centers for Disease Control and Prevention, Atlanta, GA, United States of America
Jo W Walker
1COVID-19 Response, Centers for Disease Control and Prevention, Atlanta, GA, United States of America
Alexander E Webber
1COVID-19 Response, Centers for Disease Control and Prevention, Atlanta, GA, United States of America
Rachel B Slayton
1COVID-19 Response, Centers for Disease Control and Prevention, Atlanta, GA, United States of America
Matthew Biggerstaff
1COVID-19 Response, Centers for Disease Control and Prevention, Atlanta, GA, United States of America
Nicholas G Reich
2University of Massachusetts, Amherst, Amherst, MA, United States of America
Michael Johansson
1COVID-19 Response, Centers for Disease Control and Prevention, Atlanta, GA, United States of America
Data Availability
The forecasts from models used in this paper are available from the COVID-19 Forecast Hub GitHub repository (https://github.com/reichlab/covid19-forecast-hub) and the Zoltar forecast archive (https://zoltardata.com/project/44). The code used to generate all figures and tables in the manuscript is available in a public repository (https://github.com/cdcepi/Evaluation-of-case-forecasts-submitted-to-COVID19-Forecast-Hub).
Posted June 04, 2023.
Challenges of COVID-19 Case Forecasting in the US, 2020-2021
Velma K Lopez, Estee Y Cramer, Robert Pagano, John M Drake, Eamon B O’Dea, Madeline Adee, Turgay Ayer, Jagpreet Chhatwal, Ozden O Dalgic, Mary A Ladd, Benjamin P Linas, Peter P Mueller, Jade Xiao, Johannes Bracher, Alvaro J Castro Rivadeneira, Aaron Gerding, Tilmann Gneiting, Yuxin Huang, Dasuni Jayawardena, Abdul H Kanji, Khoa Le, Anja Mühlemann, Jarad Niemi, Evan L Ray, Ariane Stark, Yijin Wang, Nutcha Wattanachit, Martha W Zorn, Sen Pei, Jeffrey Shaman, Teresa K Yamana, Samuel R Tarasewicz, Daniel J Wilson, Sid Baccam, Heidi Gurung, Steve Stage, Brad Suchoski, Lei Gao, Zhiling Gu, Myungjin Kim, Xinyi Li, Guannan Wang, Lily Wang, Yueying Wang, Shan Yu, Lauren Gardner, Sonia Jindal, Maximilian Marshall, Kristen Nixon, Juan Dent, Alison L Hill, Joshua Kaminsky, Elizabeth C Lee, Joseph C Lemaitre, Justin Lessler, Claire P Smith, Shaun Truelove, Matt Kinsey, Luke C. Mullany, Kaitlin Rainwater-Lovett, Lauren Shin, Katharine Tallaksen, Shelby Wilson, Dean Karlen, Lauren Castro, Geoffrey Fairchild, Isaac Michaud, Dave Osthus, Jiang Bian, Wei Cao, Zhifeng Gao, Juan Lavista Ferres, Chaozhuo Li, Tie-Yan Liu, Xing Xie, Shun Zhang, Shun Zheng, Matteo Chinazzi, Jessica T Davis, Kunpeng Mu, Ana Pastore y Piontti, Alessandro Vespignani, Xinyue Xiong, Robert Walraven, Jinghui Chen, Quanquan Gu, Lingxiao Wang, Pan Xu, Weitong Zhang, Difan Zou, Graham Casey Gibson, Daniel Sheldon, Ajitesh Srivastava, Aniruddha Adiga, Benjamin Hurt, Gursharn Kaur, Bryan Lewis, Madhav Marathe, Akhil Sai Peddireddy, Przemyslaw Porebski, Srinivasan Venkatramanan, Lijing Wang, Pragati V Prasad, Jo W Walker, Alexander E Webber, Rachel B Slayton, Matthew Biggerstaff, Nicholas G Reich, Michael Johansson
medRxiv 2023.05.30.23290732; doi: https://doi.org/10.1101/2023.05.30.23290732
Challenges of COVID-19 Case Forecasting in the US, 2020-2021
Velma K Lopez, Estee Y Cramer, Robert Pagano, John M Drake, Eamon B O’Dea, Madeline Adee, Turgay Ayer, Jagpreet Chhatwal, Ozden O Dalgic, Mary A Ladd, Benjamin P Linas, Peter P Mueller, Jade Xiao, Johannes Bracher, Alvaro J Castro Rivadeneira, Aaron Gerding, Tilmann Gneiting, Yuxin Huang, Dasuni Jayawardena, Abdul H Kanji, Khoa Le, Anja Mühlemann, Jarad Niemi, Evan L Ray, Ariane Stark, Yijin Wang, Nutcha Wattanachit, Martha W Zorn, Sen Pei, Jeffrey Shaman, Teresa K Yamana, Samuel R Tarasewicz, Daniel J Wilson, Sid Baccam, Heidi Gurung, Steve Stage, Brad Suchoski, Lei Gao, Zhiling Gu, Myungjin Kim, Xinyi Li, Guannan Wang, Lily Wang, Yueying Wang, Shan Yu, Lauren Gardner, Sonia Jindal, Maximilian Marshall, Kristen Nixon, Juan Dent, Alison L Hill, Joshua Kaminsky, Elizabeth C Lee, Joseph C Lemaitre, Justin Lessler, Claire P Smith, Shaun Truelove, Matt Kinsey, Luke C. Mullany, Kaitlin Rainwater-Lovett, Lauren Shin, Katharine Tallaksen, Shelby Wilson, Dean Karlen, Lauren Castro, Geoffrey Fairchild, Isaac Michaud, Dave Osthus, Jiang Bian, Wei Cao, Zhifeng Gao, Juan Lavista Ferres, Chaozhuo Li, Tie-Yan Liu, Xing Xie, Shun Zhang, Shun Zheng, Matteo Chinazzi, Jessica T Davis, Kunpeng Mu, Ana Pastore y Piontti, Alessandro Vespignani, Xinyue Xiong, Robert Walraven, Jinghui Chen, Quanquan Gu, Lingxiao Wang, Pan Xu, Weitong Zhang, Difan Zou, Graham Casey Gibson, Daniel Sheldon, Ajitesh Srivastava, Aniruddha Adiga, Benjamin Hurt, Gursharn Kaur, Bryan Lewis, Madhav Marathe, Akhil Sai Peddireddy, Przemyslaw Porebski, Srinivasan Venkatramanan, Lijing Wang, Pragati V Prasad, Jo W Walker, Alexander E Webber, Rachel B Slayton, Matthew Biggerstaff, Nicholas G Reich, Michael Johansson
medRxiv 2023.05.30.23290732; doi: https://doi.org/10.1101/2023.05.30.23290732
Subject Area
Subject Areas
- Addiction Medicine (386)
- Allergy and Immunology (701)
- Anesthesia (193)
- Cardiovascular Medicine (2859)
- Dermatology (244)
- Emergency Medicine (431)
- Epidemiology (12569)
- Forensic Medicine (10)
- Gastroenterology (807)
- Genetic and Genomic Medicine (4447)
- Geriatric Medicine (402)
- Health Economics (716)
- Health Informatics (2856)
- Health Policy (1050)
- Hematology (376)
- HIV/AIDS (893)
- Medical Education (415)
- Medical Ethics (114)
- Nephrology (464)
- Neurology (4201)
- Nursing (223)
- Nutrition (617)
- Oncology (2205)
- Ophthalmology (626)
- Orthopedics (254)
- Otolaryngology (319)
- Pain Medicine (269)
- Palliative Medicine (83)
- Pathology (488)
- Pediatrics (1172)
- Primary Care Research (483)
- Public and Global Health (6787)
- Radiology and Imaging (1494)
- Respiratory Medicine (902)
- Rheumatology (430)
- Sports Medicine (369)
- Surgery (473)
- Toxicology (57)
- Transplantation (202)
- Urology (174)