ABSTRACT
Excess death estimates have great value in public health, but they can be sensitive to analytical choices. Here we propose a multiverse analysis approach that considers all possible different time periods for defining the reference baseline and a range of 1 to 4 years for the projected time period for which excess deaths are calculated. We used data from the Human Mortality Database on 33 countries with detailed age-stratified death information on an annual basis during the period 2009-2021. The use of different time periods for reference baseline led to large variability in the absolute magnitude of the exact excess death estimates. However, the relative ranking of different countries compared to others for specific years remained largely unaltered. Averaging across all possible analyses, distinct time patterns were discerned across different countries. Countries had declines between 2009 and 2019, but the steepness of the decline varied markedly. There were also large differences across countries on whether the COVID-19 pandemic years 2020-2021 resulted in an increase of excess deaths and by how much. Consideration of longer projected time windows resulted in substantial shrinking of the excess deaths in many, but not all countries. Multiverse analysis of excess deaths over long periods of interest can offer a more unbiased approach to understand comparative mortality trends across different countries, the range of uncertainty around estimates, and the nature of observed mortality peaks.
SIGNIFICANCE STATEMENT Excess death estimates are the ultimate assessment of the impact of multiple diseases and forces on the mortality of a population. However, their calculation can be notoriously unstable because it depends on a multitude of analytical choices. Other scientific fields have started using multiverse analysis approaches where all possible analytical choices are considered. We developed a multiverse analysis approach for excess death estimation. The approach is demonstrated with data from 33 countries for the period 2009-2021. Multiverse analysis offers a standardized way to demonstrate the sensitivity of estimates to analytic assumptions, to understand the presence of time patterns (rather than arbitrarily prespecify them), and to reveal consistent patterns that characterize excess deaths in a comparative fashion between different countries.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
This study was funded by NIH R35 GM122543
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
Human mortality database: https://www.mortality.org/
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
Competing Interest Statement: No conflicts of interest.
Funding: NIH R35 GM122543.
Data statement: All data are in the manuscript and in publicly available datasets
Data Availability
All data produced in the present study are available upon reasonable request to the authors
