ABSTRACT
Excess death estimates have great value in public health, but they can be sensitive to analytical choices. Here we propose a multiverse analysis approach that considers all possible different time periods for defining the reference baseline and a range of 1 to 4 years for the projected time period for which excess deaths are calculated. We used data from the Human Mortality Database on 33 countries with detailed age-stratified death information on an annual basis during the period 2009-2021. The use of different time periods for reference baseline led to large variability in the absolute magnitude of the exact excess death estimates. However, the relative ranking of different countries compared to others for specific years remained largely unaltered. The relative ranking of different years for the specific country was also largely independent of baseline. Averaging across all possible analyses, distinct time patterns were discerned across different countries. Countries had declines between 2009 and 2019, but the steepness of the decline varied markedly. There were also large differences across countries on whether the COVID-19 pandemic years 2020-2021 resulted in an increase of excess deaths and by how much. Consideration of longer projected time windows resulted in substantial shrinking of the excess deaths in many, but not all countries. Multiverse analysis of excess deaths over long periods of interest can offer a more unbiased approach to understand comparative mortality trends across different countries, the range of uncertainty around estimates, and the nature of observed mortality peaks.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
This study was funded by NIH R35 GM122543
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
Human mortality database: https://www.mortality.org/
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
Author Contributions: M.L. and J.P.A.I. had the original idea. M.L. analyzed the data with contributions from F.Z. and J.P.A.I. J.P.A.I. and M.L. wrote the paper, and all three authors interpreted the data, edited the paper, and approved the final version.
Competing Interest Statement: No conflicts of interest.
Funding: NIH R35 GM122543
Data statement: All data are in the manuscript and in publicly available datasets
Several changes in the text, especially in the discussions and methods have been done, according to the requests of the reviewers. Table 1 has been updated with new results. Estimates of excess deaths during the pandemic years that are averaged against all possible reference periods may be misleading in absolute magnitude, since very early years such as 2009 may not be as relevant as more recent years like 2019. Therefore, we also rerun the analyses for all 66 possible combinations of reference years with various weights as now detailed in the methods. We have then added the estimates of excess deaths for 2020+2021 in the revised Table 1 as three new columns, according to these 3 calculations and we comment on these results in the text.
Data Availability
All data produced in the present study are available upon reasonable request to the authors
