RT Journal Article SR Electronic T1 Causal Estimands for Analyses of Averted and Avertible Outcomes due to Infectious Disease Interventions JF medRxiv FD Cold Spring Harbor Laboratory Press SP 2024.07.24.24310946 DO 10.1101/2024.07.24.24310946 A1 Jia, Katherine M A1 Boyer, Christopher B A1 Wallinga, Jacco A1 Lipsitch, Marc YR 2024 UL http://medrxiv.org/content/early/2024/11/30/2024.07.24.24310946.abstract AB During the coronavirus disease (COVID-19) pandemic, researchers attempted to estimate the number of averted and avertible outcomes due to non-pharmaceutical interventions or vaccination campaigns to quantify public health impact. However, the estimands used in these analyses have not been previously formalized. It is also unclear how these analyses relate to the broader framework of direct, indirect, total, and overall causal effects of an intervention under interference. In this study, using potential outcome notation, we adjust the direct and overall effects to accommodate analyses of averted and avertible outcomes. We use this framework to interrogate the commonly-held assumption in empirical studies that vaccine-averted outcomes via direct impact among vaccinated individuals (or vaccine-avertible outcomes via direct impact among unvaccinated individuals) is a lower bound on vaccine-averted (or -avertible) outcomes overall. To do so, we describe a susceptible-infected-recovered-death model stratified by vaccination status. When vaccine efficacies wane, the lower bound fails for vaccine-avertible outcomes. When transmission or fatality parameters increase over time, the lower bound fails for both vaccine-averted and -avertible outcomes. Only in the simplest scenario where vaccine efficacies, transmission, and fatality parameters are constant over time, outcomes averted via direct impact among vaccinated individuals (or outcomes avertible via direct impact among unvaccinated individuals) is shown to be a lower bound on overall impact on vaccine-averted (or -avertible) outcomes. In conclusion, the lower bound can fail under common violations to assumptions on constant vaccine efficacy, pathogen properties, or behavioral parameters over time. In real data analyses, estimating what seems like a lower bound on overall impact through estimating direct impact may be inadvisable without examining the directions of indirect effects. By classifying estimands for averted and avertible outcomes and examining their relations, this study improves conduct and interpretation of research evaluating impact of infectious disease interventions.Competing Interest StatementC.B. reports consulting income from Janssen Pharmaceuticals. M.L. serves as Senior Advisor to the US CDC's Center for Forecasting and Outbreak Analytics. This paper is written in his academic capacity and may not represent the views of the CDC or any government agency.Funding StatementJ.W. was supported by the European Union's Horizon research and innovation program—project ESCAPE (Grant number: 101095619). C.B. and M.L. were supported by the SeroNet program of the National Cancer Institute (Grant number: 1U01CA261277).Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesI confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesThis is a simulation study with code available at https://github.com/katjia/impact_estimands. https://github.com/katjia/impact_estimands