Timeliness of U.S. mortality data releases during the COVID-19 pandemic: delays are associated with electronic death registration system and elevated weekly mortality ====================================================================================================================================================================== * Janet Rosenbaum * Marco Stillo * Nathaniel Graves * Roberto Rivera ## Abstract All-cause mortality counts allow public health authorities to identify populations experiencing excess deaths from pandemics, natural disasters, and other emergencies. Further, delays in mortality reporting may contribute to misinformation because death counts take weeks to become accurate. We estimate the timeliness of all-cause mortality releases during the Covid-19 pandemic, and identify potential reasons for reporting delays, using 35 weeks of provisional mortality counts between April 3 and December 4, 2020 for 52 states/jurisdictions. On average, states’ mortality counts are delayed by 5.6 weeks (standard deviation 1.74), with a range of 8.8 weeks between the fastest state and the slowest state. States that hadn’t adopted the electronic death registration system were about 4 weeks slower, and 100 additional weekly deaths per million were associated with 0.4 weeks delays, but the residual standard deviation was 0.9 weeks, suggesting other sources of delay. Disaster planning should include improving the timeliness of mortality data. Keywords * vital statistics * mortality * timeliness * disaster planning * United States ## Introduction During natural disasters, pandemics, and other emergencies, policymakers can use estimates of excess mortality to assess the number of deaths that resulted from the emergency and identify populations at continuing risk. During the Covid-19 pandemic, the U.S. Centers for Disease Control and Prevention has found that excess mortality exceeds the official Covid-19 mortality count (1), which may be due to underdiagnosed Covid-19 due to low test access, atypical Covid-19 presentation, reduced healthcare seeking for acute non-Covid-19 conditions (2), or etiologically nonspecific death reporting (3). Despite excess deaths, the infodemic accompanying Covid-19 included misinformation that Covid-19 mortality was exaggerated (4) (5), and belief in misinformation is cross-sectionally associated with adherence to Covid-19 prevention measures such as mask-wearing (6). Accurate and timely estimation of excess mortality allows policymakers and clinicians to formulate appropriate responses to mitigate excess mortality, such as providing appropriate guidance about seeking health care for acute conditions and encouraging the population to adhere to non-pharmaceutical interventions such as social distancing and wearing masks (2). Public health statisticians often estimate excess mortality from weekly provisional all-cause mortality data from the Mortality Surveillance System, which exclude deaths not yet reported and are updated in successive weekly releases (7). States vary in the timeliness of death reporting varies in part because states vary in the extent of adoption of the Electronic Death Registration System (8). States have improved the timeliness of death reporting in recent years: within 13 weeks, all-cause deaths were 84% complete in 2015 (7) and 95% complete in 2017 (9). This study estimates delays in all-count mortality counts for each state and estimates improvements in timeliness associated with the extent of electronic death registration adoption. ## Methods ### Data Using the Mortality Surveillance System, we archived 35 weeks of provisional mortality counts by state between April 3 and December 4, 2020. The National Center for Health Statistics stratified the provisional counts into 52 jurisdictions: all 50 states, with New York City (NYC) and non-NYC New York State separated, and the District of Columbia included. ### Measures We used adoption of the electronic death registration prior to the starting point of this data as the primary predictor variable. Four states did not use electronic death registration (CT, NC, RI, WV), 9 states and New York City (NYC) had fewer than 75% death certificates filed with electronic death registration (AR, CO, MD, MI, MS, NY, PA, TN, VA), and the 38 remaining jurisdictions (37 states and DC) filed more than 75% of death certificates with electronic death registration (8). We don’t have data about the percentage of death certificates filed electronically, but it is reasonable to believe that the closer jurisdictions get to 100% of death certificates filed electronically, the smaller the delay. We confirmed electronic death registration implementation with each state’s public health vital statistics website. We hypothesized that weeks with more all-cause deaths would have greater delays, due to the resources needed for processing additional deaths, so we tested whether total deaths or deaths per million were associated with delay. We hypothesized that states with more economic resources would have faster death certificate processing. We used the Bureau of Economic Analysis’s 2018 per capita GDP for the 50 states and the District of Columbia from 2018 as a measure of economic resources; although New York State’s delay excludes NYC death certificates, the tax base of New York State includes NYC. To assess whether this delay measure (weeks of delay) is associated with a prior measure of data completeness, we used a 2017 measure of the percent of death certificates available within 13 weeks as a covariate (9). ### Statistical Analysis We estimated the mortality reporting delay for each of the 23 weeks from April 3-September 5, 2020, based on the weekly provisional mortality releases April 3-December 4, 2020. We chose the ending date 12 weeks before the most recent data release. We estimated the mortality reporting delay as the number of provisional releases until the increases in provisional mortality count were less than 1% for all subsequent weekly releases. All 52 jurisdictions in the data achieved this standard, yielding 1196 mortality delay observations from 52 jurisdictions. We assessed the face validity of these mortality reporting delay estimates by comparison with a spaghetti plot for each jurisdiction, where each line represents a weekly release (Supplementary Appendix). We used linear regression with weeks of delay as the outcome variable, with varying intercept by states; we plotted these varying intercepts for the null model (Figure 1). We used the linear model because it provided more interpretable results than Poisson models because intercepts represented weeks of delay. We judged that the residuals appeared homoskedastic and a quantile-quantile plot of the residuals appeared to fit the normal distribution with few outliers. ![Figure 1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/01/08/2021.01.07.21249401/F1.medium.gif) [Figure 1:](http://medrxiv.org/content/early/2021/01/08/2021.01.07.21249401/F1) Figure 1: Weeks of delay for reporting all-cause mortality within 1% for April 3-September 5, 2020, centered at the mean. Positive values represent slower than average and negative values represent faster. We estimated the delay due to paper-based systems using fixed slope and varying intercept regression models: the first model used only a binary indicator for no electronic death registration adoption and the second used a categorical variable for no adoption, less than 75% adoption, and more than 75% adoption. Both models’ results yielded similar answers. We also fitted models controlling for state gross domestic product (GDP) per capita, population, and the 2017 completeness measure, but these variables did not improve the fit of the model according to a log-likelihood test. We included mortality per million population per year as a covariate. This study is an analysis of publicly available data from United States federal sources in broad categories such that individuals cannot be identified, so it is not human subjects research and is exempt from requiring human subjects board review. We have made the raw data and code publicly available. All analyses were performed in R 4.0.3 between April and December 2020. ## Results On average, we found that all-cause mortality counts take 5.6 weeks to become accurate with less than 1% increases subsequently. We display the average number of weeks of delay for all 52 jurisdictions in Figure 1. In this figure, the slowest states were North Carolina, Connecticut, and Alaska, which are respectively 5.4, 4.8, and 4.7 weeks slower than average, and the fastest states are Maine, New Hampshire, and Vermont, which are 3.4, 3.1, and 3.1 weeks faster than average, a gap of almost 9 weeks between the slowest and fastest states. The jurisdictions with quicker than average response time are Arizona, Arkansas, California, Colorado, Florida, Hawaii, Idaho, Illinois, Kansas, Maine, Maryland, Massachusetts, Michigan, Montana, Nebraska, New Hampshire, New Jersey, New York State (excluding New York City), New York City, Pennsylvania, South Carolina, Tennessee, Utah, Vermont, Washington state, and Wisconsin (Figure 1). The states with average response time are Texas, Iowa, Wyoming, Minnesota, Mississippi, North Dakota, and Virginia (Figure 1). Figure 2 shows a plot of delay in reporting all-cause mortality from all 52 jurisdictions, the outcome variable for the regression. Table 1 shows the regression results predicting delay in mortality reporting with varying intercept by state. Compared with full electronic death registration adoption (greater than 75% of death certificates reported electronically), states without electronic death registration adoption had a 4.1 week delay in reporting all-cause mortality counts on average (4.13, 95% confidence interval (CI) (2.23, 6.03)). States with partial electronic death registration did not differ from states with full electronic death registration adoption in mortality reporting delay (−0.90, 95% CI (−2.18, 0.39)). States with greater mortality had greater delay in reporting mortality; each week’s delay in mortality reporting was associated with that week’s mortality; each additional 100 weekly deaths per million population per year was associated with 0.69 more weeks of delay (95% CI (0.58, 0.80)). We found that electronic death registration modified the effect of deaths: greater deaths are associated with more delays for states that didn’t adopt electronic death registration. States with greater per capita GDP, all-cause mortality completeness within 13 weeks in 2017, or population did not have greater delay, based on likelihood ratio tests of nested models that include these variables. View this table: [Table 1:](http://medrxiv.org/content/early/2021/01/08/2021.01.07.21249401/T1) Table 1: Linear regression to predict delay in mortality reporting (centered at the mean) with varying intercept by state (n=1196 observations of 52 jurisdictions) ![Figure 2:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/01/08/2021.01.07.21249401/F2.medium.gif) [Figure 2:](http://medrxiv.org/content/early/2021/01/08/2021.01.07.21249401/F2) Figure 2: Delay in mortality reporting by date and adoption of electronic death registration system, compared with average (dotted line) ## Discussion We found that mortality reporting delay is associated with greater mortality, suggesting that states take longer to report accurate mortality counts during times of excess death, when these mortality counts are most needed. Policy makers use all-cause mortality for estimating deaths due to natural disasters and health emergencies when deaths may not be coded accurately. Delays in reporting mortality result in provisional counts lower than actual mortality. In the case of the Covid-19 pandemic, pandemic misinformation about mortality could use low provisional mortality counts (4, 5), and other studies found that pandemic misinformation reduced public adherence to non-pharmaceutical interventions (6). These mortality reporting delays are not attributable to state resources: high-resource states are no faster than low-resource states. The three slowest states, North Carolina, Connecticut, and Alaska, are the 33rd, 4th, and 8th richest states, and the three fastest states, Maine, Vermont, and New Hampshire, are the 43rd, 36th, and 18th richest states. This measure of completeness captures delays not captured by previous measures of completeness. Alaska is considered to be a full adopter of electronic death registration (8) with 95% completeness within 13 weeks in 2017 (9), but Alaska was among the slowest states by our measure of number of weeks of delay. Connecticut and North Carolina began to pilot electronic systems respectively in July 2020 (10) and October 2020 (11). However, our results suggest that substantial delays in all-cause death counts occur even in states that fully implemented electronic death registration. Further, Connecticut’s delays decreased in mid-May when mortality decreased, rather than in July when the electronic system began implementation; among Connecticut’s 5 weeks with the largest delays (12+ weeks), 4 weeks were also the highest mortality weeks. ### Public health implications As suggested after earlier pandemics (12), policy makers need to increase resources to improve the timeliness of mortality data as part of pandemic planning. Improving mortality data timeliness will also benefit natural disaster planning, when excess deaths can be used for mortality estimation. The vital statistics infrastructure is under-funded (13). State and federal pandemic planners should seek resolution for delays in mortality reporting so that all-cause deaths can be used to estimate excess deaths to identify areas and populations in need of additional intervention. Funeral directors, who enter demographic information, adopted electronic death registration quickly, but medical examiners have lagged (8). California and Arizona allowed electronic death registration submissions by fax machine (8), and our analysis found that these states were both faster than average. States that consider unconventional approaches for electronic death registration submission that meet the needs of all stakeholders may have similar success. The CDC includes percent completeness metrics in the Mortality Surveillance System, defined as the number of deaths divided by the average number of deaths from the most recent 4 years. This completeness measure cannot measure completeness accurately during a period of excess deaths, which is when these measures are most crucial and subject to the most public scrutiny. Data completeness measures that can remain accurate during periods of high mortality may reduce misinformation, such as claims that mortality counts are exaggerated. ## Data Availability We have made the raw data and code publicly available. [https://github.com/GreenGrape80/allcausemortality/](https://github.com/GreenGrape80/allcausemortality/) ![Supplementary Figure 1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/01/08/2021.01.07.21249401/F3.medium.gif) [Supplementary Figure 1:](http://medrxiv.org/content/early/2021/01/08/2021.01.07.21249401/F3) Supplementary Figure 1: Spaghetti plot of weekly releases of all-cause mortality for four states in the same region: Connecticut reports deaths 4.8 weeks slower than average, and New York State (minus New York City), New Jersey, and Pennsylvania report deaths 2.5, 1.6, and 1.3 weeks faster than average. ![](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/01/08/2021.01.07.21249401/F4/graphic-6.medium.gif) [](http://medrxiv.org/content/early/2021/01/08/2021.01.07.21249401/F4/graphic-6) ![](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/01/08/2021.01.07.21249401/F4/graphic-7.medium.gif) [](http://medrxiv.org/content/early/2021/01/08/2021.01.07.21249401/F4/graphic-7) ![](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/01/08/2021.01.07.21249401/F4/graphic-8.medium.gif) [](http://medrxiv.org/content/early/2021/01/08/2021.01.07.21249401/F4/graphic-8) ![](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/01/08/2021.01.07.21249401/F4/graphic-9.medium.gif) [](http://medrxiv.org/content/early/2021/01/08/2021.01.07.21249401/F4/graphic-9) ![](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/01/08/2021.01.07.21249401/F4/graphic-10.medium.gif) [](http://medrxiv.org/content/early/2021/01/08/2021.01.07.21249401/F4/graphic-10) ![](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/01/08/2021.01.07.21249401/F4/graphic-11.medium.gif) [](http://medrxiv.org/content/early/2021/01/08/2021.01.07.21249401/F4/graphic-11) ![](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/01/08/2021.01.07.21249401/F4/graphic-12.medium.gif) [](http://medrxiv.org/content/early/2021/01/08/2021.01.07.21249401/F4/graphic-12) ![](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/01/08/2021.01.07.21249401/F4/graphic-13.medium.gif) [](http://medrxiv.org/content/early/2021/01/08/2021.01.07.21249401/F4/graphic-13) ![](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/01/08/2021.01.07.21249401/F4/graphic-14.medium.gif) [](http://medrxiv.org/content/early/2021/01/08/2021.01.07.21249401/F4/graphic-14) ![](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/01/08/2021.01.07.21249401/F4/graphic-15.medium.gif) [](http://medrxiv.org/content/early/2021/01/08/2021.01.07.21249401/F4/graphic-15) ![](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/01/08/2021.01.07.21249401/F4/graphic-16.medium.gif) [](http://medrxiv.org/content/early/2021/01/08/2021.01.07.21249401/F4/graphic-16) ![](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/01/08/2021.01.07.21249401/F4/graphic-17.medium.gif) [](http://medrxiv.org/content/early/2021/01/08/2021.01.07.21249401/F4/graphic-17) ![](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/01/08/2021.01.07.21249401/F4/graphic-18.medium.gif) [](http://medrxiv.org/content/early/2021/01/08/2021.01.07.21249401/F4/graphic-18) ![](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/01/08/2021.01.07.21249401/F4/graphic-19.medium.gif) [](http://medrxiv.org/content/early/2021/01/08/2021.01.07.21249401/F4/graphic-19) ![](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/01/08/2021.01.07.21249401/F4/graphic-20.medium.gif) [](http://medrxiv.org/content/early/2021/01/08/2021.01.07.21249401/F4/graphic-20) ![](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/01/08/2021.01.07.21249401/F4/graphic-21.medium.gif) [](http://medrxiv.org/content/early/2021/01/08/2021.01.07.21249401/F4/graphic-21) Supplementary Figure 2: Spaghetti plot of weekly releases of all-cause mortality for the three fastest states and three slowest states. Each line represents weekly mortality counts for a single data release. ## Footnotes * **Conflict of interest statement:** On behalf of all authors, the corresponding author states that there is no conflict of interest. * Received January 7, 2021. * Revision received January 7, 2021. * Accepted January 8, 2021. * © 2021, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/) ## References 1. 1.Centers for Disease Control and Prevention. Excess Deaths Associated with COVID-19 [Internet]. Excess Deaths Associated with COVID-19 Provisional Death Counts for Coronavirus Disease (COVID-19). 2020 [cited 2020 Nov 18]. Available from: [https://www-cdc-gov.newproxy.downstate.edu/nchs/nvss/vsrr/covid19/excess_deaths.htm](https://www-cdc-gov.newproxy.downstate.edu/nchs/nvss/vsrr/covid19/excess_deaths.htm) 2. 2.Rivera R, Rosenbaum, Janet E, Quispe W. Excess mortality in the United States during the first three months of the COVID-19 pandemic. Epidemiol Infect. 2020;148(e264):1–9. 3. 3.Gill JR, DeJoseph ME. The Importance of Proper Death Certification During the COVID-19 Pandemic. JAMA. 2020 Jul 7;324(1):27–8. 4. 4.Islam MS, Sarkar T, Khan SH, Mostofa Kamal A-H, Hasan SMM, Kabir A, et al. COVID- 19-Related Infodemic and Its Impact on Public Health: A Global Social Media Analysis. Am J Trop Med Hyg. 2020 Oct;103(4):1621–9. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.4269/ajtmh.20-0812&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32783794&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F01%2F08%2F2021.01.07.21249401.atom) 5. 5.Bunker D. Who do you trust? The digital destruction of shared situational awareness and the COVID-19 infodemic. Int J Inf Manag. 2020 Dec;55:102201. 6. 6.Hornik R, Kikut A, Jesch E, Woko C, Siegel L, Kim K. Association of COVID-19 Misinformation with Face Mask Wearing and Social Distancing in a Nationally Representative US Sample. Health Commun. 2021 Jan;36(1):6–14. 7. 7.Spencer MR, Ahmad F. Timeliness of Death Certificate Data for Mortality Surveillance and Provisional Estimates. Washington DC: National Center for Health Statistics, CDC; 2016 Dec p. 8. (National Vital Statistics System: Vital Statistics Rapid Release). Report No.: 1. 8. 8.Ventura SJ. The U.S. National Vital Statistics System: transitioning into the 21st century, 1990-2017. Hyattsville, Maryland: U.S. Department of Health and Human Services, Centers for Disease Control and Prevention, National Center for Health Statistics; 2018. 74 p. (Vital and health statistics, series 1, program and collection procedures; vol. 1). 9. 9.Ahmad FB, Dokpesi P, Escobedo L, Rossen L. Timeliness of Death Certificate Data by Sex, Age, and Geography. National Center for Health Statistics, CDC; 2020 Jun. (Vital Statistics Rapid Release). Report No.: 009. 10. 10.Connecticut State Department of Public Health. CT-Vitals [Internet]. Hartford, CT; [cited 2020 Dec 2]. Available from: [https://portal.ct.gov/DPH/Vital-Records/CT-Vitals](https://portal.ct.gov/DPH/Vital-Records/CT-Vitals) 11. 11.North Carolina Department of Health and Human Services. North Carolina Department of Health and Human Services Implements Electronic Death Registration System to Streamline Death Reporting in NC [Internet]. Raleigh, NC: North Carolina Department of Health and Human Services; 2020 Oct [cited 2020 Dec 2]. Available from: [https://www.ncdhhs.gov/news/press-releases/ncdhhs-implements-electronic-death-registration-system-streamline-death](https://www.ncdhhs.gov/news/press-releases/ncdhhs-implements-electronic-death-registration-system-streamline-death) 12. 12.Prieto DM, Das TK, Savachkin AA, Uribe A, Izurieta R, Malavade S. A systematic review to identify areas of enhancements of pandemic simulation models for operational use at provincial and local levels. BMC Public Health. 2012 Mar 30;12:251. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/1471-2458-12-251&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22463370&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F01%2F08%2F2021.01.07.21249401.atom) 13. 13.Gerberding JL. Measuring Pandemic Impact: Vital Signs From Vital Statistics. Ann Intern Med. 2020 Sep 11;1–2.