Abstract
Social policies have great potential to improve population health and reduce health disparities. Thus, increasing empirical research seeks to quantify the health effects of social policies by exploiting variation in the timing of policy changes across places. Multiple social policies are often adopted simultaneously or in close succession in the same locations, creating co-occurrence which must be handled analytically for valid inferences. Although this is a substantial methodological challenge for studies aiming to isolate social policy effects, limited prior work has systematically considered analytic solutions within a causal framework or assessed whether these solutions are being adopted. We designated seven analytic solutions to policy co-occurrence, including efforts to disentangle individual policy effects and efforts to estimate the combined effects of co-occurring policies. We leveraged an existing systematic review of social policies and health to evaluate how often policy co-occurrence is identified as a threat to validity and how often each analytic solution is applied in practice. Of the 55 studies, only 17 (31%) reported checking for any co-occurring policies, although 36 (67%) used at least one approach that helps address policy co-occurrence. The most common approaches were: adjusting for measures of co-occurring policies; defining the outcome on subpopulations likely to be affected by the policy of interest (but not other co-occurring policies); and selecting a less-correlated measure of policy exposure. As health research increasingly focuses on policy changes, we must systematically assess policy co-occurrence and apply analytic solutions to strengthen future studies on the health effects of social policies.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
This work was supported by the Evidence for Action program of the Robert Wood Johnson Foundation and the National Institute on Alcohol Abuse and Alcoholism (grant number K99 AA028256).
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
This study uses only secondary data from published studies and therefore does not constitute human subjects research.
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
Funding: This work was supported by the Evidence for Action program of the Robert Wood Johnson Foundation and the National Institute on Alcohol Abuse and Alcoholism (grant number K99 AA028256)
Conflicts of interest None: declared.
Revised terminology from "clustering" to "co-occurrence"; Revised typology of analytic strategies; additional detail on methods; clarification of study goals; added appendix.
Data Availability
All data used in this study arise from published studies that are publicly available.