PT - JOURNAL ARTICLE AU - Panagiotoglou, Dimitra AU - Lim, Jihoon TI - Using synthetic controls to estimate the population-level effects of Ontario’s recently implemented overdose prevention sites and consumption and treatment services AID - 10.1101/2021.12.13.21267739 DP - 2022 Jan 01 TA - medRxiv PG - 2021.12.13.21267739 4099 - http://medrxiv.org/content/early/2022/10/12/2021.12.13.21267739.short 4100 - http://medrxiv.org/content/early/2022/10/12/2021.12.13.21267739.full AB - Background Between 2017 and 2020, Ontario implemented overdose prevention sites (OPS) and consumption and treatment services (CTS) in nine of its 34 public health units (PHU). We tested for the effect of booth-hours (spaces within OPS/CTSs for supervised consumption) on opioid-related health service use and mortality rates at the provincial-(aggregate) and PHU-level.Methods We used monthly rates of all opioid-related emergency department (ED) visits, hospitalizations, and deaths between January 2015 and March 2021 as our three outcomes. For each PHU that implemented OPS/CTSs, we created a synthetic control as a weighted combination of unexposed PHUs. Our exposure was the time-varying rate of booth-hours provided. We estimated the population-level effects of the intervention on each outcome per treated/synthetic-control pair using controlled interrupted time series with segmented regression; and tested for the aggregate effect using a multiple baseline approach. We adjusted for time-varying provision of prescription opioids for pain management, opioid agonist treatment (OAT), and naloxone kits; and corrected for seasonality and autocorrelation. All rates were per 100,000 population. For sensitivity analysis, we restricted the post-implementation period to before COVID-19 public health measures were implemented (March 2020).Results Our aggregate analyses found no effect per booth-hour on ED visit (0.00, 95% CI: -0.01, 0.01; p-value=0.6684), hospitalization (0.00, 95% CI: 0.00, 0.00; p-value=0.9710) or deaths (0.00, 95% CI: 0.00, 0.00; p-value=0.2466). However, OAT reduced ED visits (−0.20, 95% CI: -0.35, -0.05; p-value=0.0103) and deaths (−0.04, 95% CI: -0.05, -0.03; p-value=<0.0001). Conversely, prescription opioids for pain management modestly increased deaths (0.0008, 95% CI: 0.0002, 0.0015; p-value=0.0157) per 100,000 population, respectively. Except for a few treated PHU/synthetic control pairs, disaggregate results were congruent with overall findings.Conclusion Booth-hours had no population-level effect on opioid-related overdose ED visit, hospitalization, or death rates.Competing Interest StatementThe authors have declared no competing interest.Funding StatementDr. Panagiotoglou is supported by a Junior 1 Scholar Award (#309818) from the Fonds de recherche du Quebec-santeAuthor DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:We used monthly counts of all opioid-related ED visits, acute care hospitalizations, and deaths that occurred between January 2014 and December 2020 per PHU, as reported in Ontario's publicly accessible Interactive Opioid Tool. The tool includes all opioid-related ED visits and acute care hospitalizations as captured in the province-wide National Ambulatory Care Reporting System and Discharge Abstract Database, and all fatal events where opioid poisoning from codeine, fentanyl (including carfentanil and other fentanyl analogues), heroin, hydrocodone, hydromorphone, methadone, morphine, or oxycodone was considered a contributing cause of death according to the Office of the Chief Coroner.(22) We converted event counts to incidence rates using the province's IntelliHealth population level estimates (2003-2016, extracted October 2017) and population projections (2017-2020, extracted August 2019) also available in the tool.(22) We supplemented the PHU-level overdose event data with PHU-level population demographic estimates (percent of the population designated low income, without a high school diploma, immigrant, and visible minority; median household income); age- and sex-standardized rates of alcohol-related emergency department visits and hospitalizations; and monthly counts of concomitant interventions: persons receiving opioid prescriptions (overall, for pain, OAT) and naloxone kits distributed. To capture OPS/CTS intervention 'intensity' we included the total number of booth-hours (booths/seats/spaces) available for supervised consumption of illicit substances, per month. I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesAll data produced in the present study are available upon reasonable request to the authors. Data used are also available across multiple public sources including Ontario Public Health's Opioid Tool, the Ontario Drug Policy and Research Network and public health units' annual reports or dashboards.