Abstract
Background Cardiovascular disease (CVD) is a leading cause of death globally. Angiotensin-converting enzyme inhibitors (ACEi) and angiotensin receptor blockers (ARB), compared in the ONTARGET trial, each prevent CVD. However, trial populations may not be representative of the general population.
Methods Using trial replication methods within routine-care data, we explored replicability of the ONTARGET trial. For people prescribed an ACEi and/or an ARB in the UK Clinical Practice Research Datalink CPRD GOLD from 1/1/2001-31/7/2019, we applied trial criteria and propensity-score methods to create an ONTARGET trial-eligible cohort. Comparing ARB to ACEi, using Cox-proportional hazards models, we estimated hazard ratios for the primary composite trial outcome (cardiovascular death, myocardial infarction, stroke, or hospitalisation for heart failure), as well as secondary outcomes. As the pre-specified criteria were met confirming trial replicability, we then explored treatment effect heterogeneity of ACEi and ARB among three trial-underrepresented subgroups: females, those aged ≥75 years and those with chronic kidney disease.
Findings In the trial-eligible population (n=137,155), results for the primary outcome met pre-specified criteria for similarity to the ONTARGET trial and demonstrated similar effects of ARB and ACEi, (HR 0.97 [95% CI: 0.93, 1.01]). When extending to trial-underrepresented groups, similar treatment effects of ARB and ACEi were observed by sex (P=0.09), age (P=0.70) and chronic kidney disease status (P=0.10).
Interpretation We were able to replicate the results of the ONTARGET trial using routinely-collected healthcare data. Results suggest that trial findings were generalisable to population subgroups underrepresented in the trial.
Funding GlaxoSmithKline
Evidence before this study Trial replication is an important methodology increasingly used to validate findings from observational studies against target trials. Unlike many naïve observational comparisons, a previous study demonstrated replicability of the ONTARGET trial using United States insurance claims data. However, it is unknown whether trial replicability can be extended to UK routinely-collected healthcare data. In addition, little work has been done to extend findings of comparative effectiveness among trial-underrepresented subgroups such as women, the elderly and those with chronic kidney disease despite high rates of prescribing of ACE Inhibitors and angiotensin receptor blockers among these groups in routine-care.
Added value of this study With access to the individual patient data from the ONTARGET study and using propensity-score methods to address confounding, we demonstrated trial replicability using routinely-collected primary care data, representative of a large proportion of the UK population. We were then able to leverage the large sample size of the trial-eligible cohort to extend findings to trial-underrepresented groups and demonstrated similar comparative effectiveness for subgroups of patients treated with ARB and ACEi among women, those aged ≥75 years and those with chronic kidney disease.
Implications of all the available evidence Our findings support similar effectiveness for cardiovascular and renal outcomes for patients receiving an ARB compared to an ACEi in a trial-eligible cohort and subgroups for which there is currently a lack of evidence of treatment effectiveness. Trial-replication methodology can be used to provide evidence for populations underrepresented in clinical trials.
INTRODUCTION
Cardiovascular disease (CVD) is a leading cause of death globally, with older people and those with chronic kidney disease (CKD) at particularly high-risk.[1] Medications used to prevent cardiovascular events are prescribed based on evidence from randomised controlled trials. However, there is uncertainty whether trial evidence is generalisable to all patient groups because trials often restrict inclusion to younger patients with fewer comorbidities,[2, 3] and because trial patients are likely to have better adherence and monitoring. Observational studies using routinely-collected healthcare data can use trial-replication methods to validate findings against those from randomised trials, sometimes referred to as “benchmarking”.[9-12] When similar findings are observed, we have more confidence that sources of bias and confounding are minimised, and aided by a large sample size and more diverse population, can then examine treatment effectiveness in trial underrepresented or excluded groups.
ONTARGET was a large global trial with 25620 participants and a follow-up of 3.5-5.5 years that compared the cardiovascular effects of angiotensin receptor II blocker (ARB) (telmisartan) to angiotensin-converting enzyme inhibitor (ACEi) (ramipril) among patients who had vascular disease or high-risk diabetes.[13, 14] Ramipril had previously been shown compared with placebo, to reduce the composite outcome of myocardial infarction, stroke or cardiovascular death by 22% (95% CI: 14-30%).[15] The findings of the ONTARGET trial of non-inferiority for telmisartan vs ramipril led to telmisartan’s licensing for cardiovascular event reduction in 2009[16] and were a major contribution to perception of equivalent treatment effectiveness for ARB and ACEI. However, the relative effectiveness of ARB and ACEI for patients not included or underrepresented in ONTARGET remains uncertain. The aims of this study were to demonstrate whether the primary and secondary outcome results of the ONTARGET trial could be replicated in UK routinely-collected data and, if so, to examine treatment effects in females, those aged ≥75 years and those with CKD, all groups that were underrepresented in ONTARGET.
METHODS
Data sources and study cohort
We aimed to replicate the ONTARGET trial by developing a propensity-score—weighted trial-eligible cohort in the UK Clinical Practice Research Datalink (CPRD) GOLD primary care dataset, linked to hospitalisation data from Hospital Episode Statistics (HES) and death registrations from the Office for National Statistics (ONS). We selected patients who were ever prescribed any dose of an ACEi and/or an ARB from 1/1/2001-31/7/2019 and had been registered at an up-to-standard practice (meeting minimum data quality criteria[17]) for at least 12 months at the time of their first prescription (Figure 1). We defined ‘exposed periods’ as all continuous courses of therapy, with a calculated prescription gap of >90 days referred to as an ‘unexposed period’. We did not restrict the study cohort to new users; therefore, we started their follow-up at the start of any of the exposed periods for which they met trial criteria and were included in the cohort, thus emulating recruitment into the ONTARGET trial. Patients were not required to have a minimum length of exposure to be considered. Using Read diagnostic and ICD-10 codes, we selected exposed periods that met the ONTARGET trial criteria. This resulted in a pool of trial-eligible exposed periods within individuals in CPRD. Specific diagnostic codes used for cohort identification are available for download: https://doi.org/10.17037/DATA.00002112. Our study protocol has been published;[18] Supplementary Table 1 details post-hoc changes to the published protocol.
Trial replication
The original trial coordinator, Population Health Research Institute, anonymised and provided access to the ONTARGET trial data. The trial data were combined with the CPRD cohort of trial-eligible ACEi exposed periods. We then 1:1 matched each ONTARGET trial participant to one trial-eligible ACEi exposed period, without replacement, on closest propensity-score, using a propensity-score model for the probability of being included in the trial (Model 1). We used a caliper of 0.25 of the standard deviation of the logit of the propensity-score, with the restriction that only one ACEi trial-eligible exposed period per patient could be matched. This resulted in a trial-matched ACEi cohort. We used standardised differences (<0.1) and kernel density plots to assess the quality of matches.[19]
To ensure balance among CPRD groups used in analysis, we appended the trial-matched ACEi cohort with the trial-eligible ARB cohort to develop a second propensity-score model for the probability of receiving an ACEi (Model 2). To generate the propensity-score— weighted trial-eligible cohort for our main analysis, we applied Model 2 to a cohort containing one randomly selected ARB and ACEi trial-eligible period per patient, respectively, generated propensity-scores and obtained inverse probability weights.[20] Ensuring balance using propensity-score weights instead of matching, enabled us to maximise the number of participants included in the analysis. Patients could contribute to both ARB and ACEi exposed cohorts, but patients could not be matched to themselves, and trial-eligible periods that had prescription start dates on the same day were excluded from both groups.
Variables included in propensity-score Model 2 were chosen based on a-priori knowledge of predictors of treatment with an ACEi, and are displayed in Supplementary Table 2. To maximise comparability between the ACEi and ARB trial-eligible cohorts generated from routine data, additional variables not available in ONTARGET, such as socio-economic status, were included in Model 2. Because our cohort included prevalent users, we also included variables associated with switching treatments, such as time since first trial-eligible period, and number of previous ARB/ACEi trial-eligible periods.[21]
Procedures
Exposures and outcomes
To maximise study power and generalisability, we compared outcomes between users of ARB and ACEi, rather than telmisartan and ramipril specifically. Outcomes were selected to replicate those in the ONTARGET trial.
Primary outcome: composite of cardiovascular death, myocardial infarction (MI), stroke, or hospital admission for congestive heart failure
Secondary outcomes:
Main secondary outcome: composite of cardiovascular death, MI or stroke
Individual components of primary outcome
Death from non-cardiovascular causes
All-cause mortality
Further secondary and other outcomes: (separately) newly-diagnosed congestive heart failure; revascularisation procedures; loss of glomerular filtration rate (GFR) or development of end-stage kidney disease (ESKD) (defined as: 50% reduction in estimated GFR (eGFR), start of kidney replacement therapy (KRT) or development of eGFR < 15ml/min/1.73m2); development of ESKD (defined as: start of KRT or development of eGFR < 15ml/min/1.73m2); microvascular complications of diabetes mellitus. GFR was calculated using the CKD-Epi equation 2009 without reference to ethnicity.[22]
Safety outcomes: cough; angioedema; hyperkalaemia (potassium >5.5 mmol/L); ≥30% increase in serum creatinine.
Statistical analysis
Trial replication
Using an intention-to-treat approach for the main analysis, we compared cohorts using a Cox proportional hazards model weighted by propensity-scores generated from Model 2, with robust standard errors. The Cox model was additionally adjusted for any variables that demonstrated imbalance after propensity-score—weighting.[23] To replicate the trial per-protocol analysis, we also carried out an on-treatment analysis of ARB vs ACEi, additionally censoring at discontinuation of trial-eligible period. Further details on censoring are specified in Supplementary Figure 1.
Because ONTARGET reported relative risks for safety outcomes, we used a logistic regression model with robust standard errors. Treatment cessation was defined as the end of an included trial-eligible exposed period (i.e., a prescription gap of >90 days after the calculated prescription end date). The last safety event which occurred before treatment cessation was considered as the reason for treatment cessation and these results were compared with ONTARGET.
We replicated the subgroup analyses carried out in ONTARGET using a propensity-score— weighted Cox proportional hazards model fitted with an interaction term for subgroup and treatment and used a Wald test to identify any effect modification. The subgroups studied were as in ONTARGET: sex, age (<65 years, 65-74 years, ≥75 years), systolic blood pressure (SBP) (≤134 mmHg, 135-150 mmHg, >150 mmHg), diabetes, and cardiovascular disease at study entry. In addition, we included CKD status at baseline as a subgroup (CKD: eGFR <60 mL/min/1.73m2).
Validation criteria
A priori, we defined replicability of the primary outcome of ONTARGET (HR 1.01 [95% CI: 0.94, 1.09]) if the HR estimates from the propensity-score—weighted analysis for ARB vs ACEi were between 0.9-1.12 and the 95% CI for the HR contained 1.0.[18]
Underrepresented groups
Conditional on the validation criteria being met, we examined whether there was treatment heterogeneity among the underrepresented group using interaction terms for sex, age and CKD status. For CKD status, we repeated methods to create the propensity-score—weighted cohort after removing the trial exclusion criteria of baseline serum creatinine >265 μmol/L.
Sensitivity analyses
To explore any benefits to using a propensity-score—matched trial-eligible cohort, which ensured patient characteristics were comparable to trial participants, as opposed to a propensity-score—weighted trial-eligible cohort where patients were more diverse, we 1:1 matched the trial-matched ACEi patients to closest trial-eligible ARB period using propensity-scores from Model 2 and repeated the analyses.[18]
To examine the impact of including patients who may have only received one prescription for an ARB/ACEi, we started follow-up from 28 days after the start of the trial-eligible period, excluding patients if there were no prescriptions after 28 days.
We assessed the impact on the kidney outcomes of specifying sustained deterioration of kidney function. This required eGFR <15ml/min/1.73m2 or 50% reduction in eGFR on two occasions at least 3 months apart for loss of eGFR or ESKD and development of ESKD outcomes.
As a post-hoc sensitivity analysis, we assessed the impact of changing between medications in CPRD for safety outcomes by restricting the cohort to patients’ first trial-eligible exposed period, and by excluding those with previous exposure to the alternative drug at any time before.
Role of the funding source
This project is funded by a GlaxoSmithKline PhD studentship as part of a collaboration between GlaxoSmithKline and the London School of Hygiene and Tropical Medicine. The funders had no role in the study design, data collection, data analysis, data interpretation, or writing of the report.
Results
Baseline characteristics
After propensity-score—weighting, 96,602 ACEi and 40,553 ARB prescribed patients were included in the comparison of ARB vs ACEi users (Supplementary Figure 1).
Mean age was similar across exposure groups (71 years), slightly older than in ONTARGET (66 years). There was a higher proportion of females across each exposure group (∼51%) than in ONTARGET (27%) (Table 1). Balance before and after weighting is shown in Supplementary Table 3. Imbalance remained for several time-related variables: time since first trial-eligible period, calendar year of trial-eligible period and number of prior ARB trial-eligible periods, so analysis was adjusted for these variables.
Follow-up and adherence
Among the propensity-score—weighted trial-eligible cohort, a total of 82,121 patients were followed until an event or 5.5 years of follow-up (maximum follow-up in the ONTARGET trial). After one year, among patients in the ARB group 2.6% had switched to an ACEi and among patients in the ACEi group, 11% switched to an ARB. Adherence was lower in CPRD, with 70% ACEi patients still on ACEi treatment after one year and 78% ARB patients still on ARB treatment after one year, compared to ONTARGET, where 92% ramipril patients were taking an ACEi and 94% telmisartan patients taking an ARB after one year[13] (Supplementary Table 4).
Trial replication
Primary outcomes and validation
Among the propensity-score—weighted trial-eligible cohort, the primary composite outcome occurred in 6287 (16%) in the ARB group and in 16935 (18%) in the ACEi group (median follow-up 4.7 years), for event rates of 4.2 and 4.4 per 100 person-years, respectively. In ONTARGET, the number of events was 1423 (17%) and 1412 (17%) in the telmisartan and ramipril treatment groups, respectively, over median follow-up of 4.7 years. Comparing ARB users with ACEi users in the trial-eligible cohorts, the risk of the primary outcome was similar, HR 0.98 (95% CI: 0.94, 1.02) in the propensity-score–weighted, adjusted analysis. This was comparable to the ONTARGET primary outcome (HR 1.01 [95% CI: 0.94, 1.09]) and met the pre-specified validation criteria of trial replicability (Table 2 and Figure 2). Results of the on-treatment analysis were similar HR 1.02 (95% CI: 0.93, 1.12) for ARB vs ACEi, comparable to both the ONTARGET per-protocol analysis (HR 1.00 [95% CI: 0.92, 1.09]) and to our main intention-to-treat analysis.
Secondary and other outcomes
Results were consistent with ONTARGET for the main secondary composite outcome of cardiovascular death, MI or stroke (Figure 2) and all other secondary outcomes, including development of ESKD (HR 1.06 [95% CI: 0.95, 1.19]) (Supplementary Table 5). However, within the CPRD trial-eligible cohort the risk of the composite of loss of GFR or ESKD was higher for ARB users than for ACEi users (HR 1.11 [95% CI: 1.04, 1.19]), where ONTARGET observed similar treatment effects (Table 2 and Supplementary Table 5).
Safety outcomes
In analyses of safety outcomes as reason for treatment cessation, cough was more common in ARB than in ACEi users (RR 1.29 [95% CI: 1.16, 1.43]) and angioedema was similar between groups, both in contrast with ONTARGET findings of reduced risk of cough and angioedema with ARB vs ACEi, however the number of events in our analysis was low, and our assessment was based on timing, whereas the ONTARGET reason for discontinuation was prospectively documented. Hyperkalaemia and ≥30% increase in serum creatinine were also more common in ARB users than in ACEi users RR 1.12 (95% CI: 1.06, 1.18) and RR 1.38 (95% CI: 1.34, 1.43), respectively (Supplementary Table 6).
Subgroup analysis
Results of the primary outcome for ARB vs ACEi, stratified within the same subgroups as ONTARGET are shown in Figure 3. We observed evidence of effect modification by baseline SBP (P<0.01) with a lower risk among ARB users compared to ACEi in those with baseline SBP ≤134mmHg. All other subgroups studied showed no strong evidence of treatment heterogeneity between groups, which was consistent with the findings in ONTARGET.
Underrepresented groups
For ARB vs ACEi for the primary composite outcome, there was no evidence to suggest treatment heterogeneity between males and females (P=0.21), by age group (P=0.62) and by CKD status (P=0.17). Among the trial-underrepresented groups of females, those aged ≥75 years and those with CKD, treatment effects were consistent with ONTARGET (Figure 3). For most secondary outcomes treatment effects were similar among males and females. However, there was some evidence of treatment heterogeneity for the outcomes of cardiovascular-related death (P=0.03), all-cause mortality (P=0.04) and revascularisation procedures (P=0.03). Treatment effects were similar among ARB and ACEi users for men but among females ARB were associated with a lower risk of cardiovascular-related death and all-cause mortality compared to ACEi (Supplementary Figure 2).
Similarly, by age group there was no evidence of treatment heterogeneity for most secondary outcomes. However, treatment effects differed for the outcomes of revascularisation procedures (P=0.02) and loss of GFR or ESKD (P<0.01). ARB and ACEi had similar treatment effects among users aged ≥65 years but among users aged <65 years, ARB were associated with a lower risk of revascularisation procedures and a higher risk of loss of GFR or ESKD, but event numbers were low (Supplementary Figure 3).
For CKD, evidence of treatment heterogeneity was observed for MI (P=0.02) and newly diagnosed heart failure (P=0.03) and revascularisation procedures (P=0.01). For these outcomes, treatment effectiveness was similar among ARB and ACEi users with CKD at baseline but ARB were associated with a lower risk among those without CKD at baseline (Supplementary Figure 4).
Sensitivity analyses
Analysis of the propensity-score—matched trial-eligible cohort for ARB vs ACEi gave similar results to the propensity-score—weighted trial-eligible cohort for the primary outcome (HR 0.97 [95% CI: 0.92, 1.02], number of events: ARB=2453 (16%), ACEi=2539 (16%)) (Table 2 and Supplementary Table 7). For all other outcomes, results had HRs close to 1.0 and 95% CI containing 1.0 (Supplementary Table 7).
The risk of the primary outcome was lower among ARB users when follow-up was started from 28 days after the start of the trial-eligible period (HR 0.93 [95% CI: 0.90, 0.96], number of events: ARB=5966 (15%), ACEi=16051 (16.8%)).
Specifying sustained deterioration of kidney function for loss of GFR or ESKD had no effect on results. However, among ARB users the risk of development of ESKD was increased (HR 1.16 [95% CI: 1.02, 1.32], number of events: ARB=626 (1.7%), ACEi=1016 (1.2%)). Restricting to new users with no previous exposure to the opposite drug for safety outcomes, showed a lower risk of cough and angioedema as reason for treatment cessation for ARB vs ACEi, which was consistent with the trial findings (Supplementary Table 8).
Discussion
We emulated the ONTARGET randomised trial, using a large routinely-collected healthcare dataset. By applying the trial criteria and creating a propensity-score—weighted trial-eligible cohort with balanced characteristics in each treatment arm, we showed similar risks among ARB and ACEi users for the composite of cardiovascular death, MI, stroke or hospital admission for congestive heart failure, as well as further secondary outcomes. The ONTARGET per-protocol analysis was also replicated using an on-treatment approach where we obtained consistent results. Furthermore, marked similarity between ONTARGET and our observational study was also found in subgroup analysis, with ARB users with the lowest baseline SBP at lower risk of the primary composite outcome compared to ACEi users. We subsequently extended analysis to females, those aged ≥75 years and patients with CKD (all underrepresented in ONTARGET), where we demonstrated consistency of treatment effects for most outcomes.
Comparison to other studies
Our findings of similar effectiveness of ARB vs ACEi by sex and age were consistent with previous comparative effectiveness studies.[24, 25] In line with the findings from a large Taiwanese cohort study,[26] we demonstrated no difference between ARB vs ACEi in risk of kidney outcomes among those with and without CKD.
One recent ONTARGET replication study using United States insurance claims data performed a propensity-score—matched analysis of telmisartan vs ramipril and found HR 0.99 (95% CI: 0.85, 1.14) for the primary outcome. [11] The sample was small (9930 patients) and, unlike the trial, included new users only.
In contrast to other naïve observational studies that have shown a decreased risk among ARB users,[27-29] we observed equal treatment effectiveness of ARB and ACEi. This implies that using trial emulation techniques and propensity-score—weighting to obtain balance among exposure groups can adequately address confounding and bias and lead to results comparable to the target trial.
Strengths and Limitations
We were able to demonstrate that both a propensity-score—weighting approach and a propensity-score—matching approach yielded equivalent results to ONTARGET, providing evidence to support the use of a weighted approach in future trial replication studies (preferred, because weighting minimises the loss of participants involved in matching and enables greater power for examining rare outcomes such as ESKD). Having replicated the ONTARGET results, the increased sample size and diverse population in the propensity-score—weighted trial-eligible cohort allowed us to extend our analyses to trial-underrepresented groups. This included people with CKD where evidence from observational studies is limited. Among this group, we observed similar treatment effectiveness among ARB and ACEi users for the primary outcome and all other outcomes, including the outcomes of loss of GFR or ESKD and development of ESKD.
Despite overall similarity between ARB and ACEi users for most outcomes, we noted some discrepancies with ONTARGET. In the ONTARGET trial, ARB and ACEi users had comparable risk of kidney-related outcomes. In contrast, we found ARBs to be associated with a moderately greater risk of loss of GFR or ESKD compared with users of ACEi. This may reflect testing multiple outcomes, low numbers of outcomes in some strata or residual confounding by indication.
When dealing with comparisons between a new drug and a historic drug, careful considerations need to be given to handle treatment switchers and appropriately account for time trends in prescribing. We sought to account for such variables, including them as terms in our propensity-score model but it is not possible to exclude this as a source of residual confounding or bias.
Discrepancy of safety outcomes is likely due to the close monitoring of adverse events in a trial setting compared with routine clinical care. Events such as cough are likely to be underreported in routine data. In addition to this, some confounding by indication may be present, particularly for patients with a history of cough or angioedema who may have been switched from an ACEi to an ARB. This was demonstrated in our sensitivity analysis, restricting the cohort to non-switchers, where we obtained results much closer to the ONTARGET trial. However, since ARB users who have not previously been exposed to an ACEi are likely to be healthier and less likely to experience cough, due to the known risk of cough among ACEi users, we cannot be sure that restricting to non-switchers does not introduce further bias.
Conclusion
In this emulation of the ONTARGET randomised trial using routinely-collected healthcare data, we closely replicated the primary and secondary outcomes and were able to demonstrate the generalisability of trial results to a cohort representative of patients receiving prescriptions for ACEi or ARB in UK primary care. Subsequently we were able to provide evidence that trial results extend to trial-underrepresented subgroups where evidence is limited including females, those aged ≥75 years and patients with CKD. Benchmarking findings from observational studies against target trial results can add confidence to findings when using routinely-collected data to investigate the generalisability of trial findings to wider populations.
Data Availability
Data was provided by CPRD under terms of the LSHTM license and can be requested from CPRD. ONTARGET trial data was obtained via a data sharing agreement with the sponsor, Hamilton Health Sciences Corporation.
Author contributions
All authors contributed to the conceptualisation, study question and design. PB, LT, KW, EW, AW, AS, CL, CC and EP contributed to the statistical analysis decisions of this study. PB completed formal analysis of this study and wrote the original draft of this manuscript under the supervision of LT, KW and MC. LD facilitated the transfer of trial data used in this project. PB, LT, KW, EW, AW, AS, CL, EP had access to the data and data reported in this manuscript was verified by LT and KW. All authors contributed to the writing, review and editing of the submitted manuscript.
Conflicts of interest
PB is funded by a GSK PhD studentship. AS is employed by LSHTM on a fellowship sponsored by GSK. CC has received consultation, advisory board membership or research funding from the Ontario Ministry of Health, Sanofi, Pfizer, Leo Pharma, Astellas, Janssen, Amgen, Boehringer-Ingelheim and Baxter. In 2018 CC co-chaired a KDIGO potassium controversies conference sponsored at arm’s length by Fresenius Medical Care, AstraZeneca, Vifor Fresenius Medical Care, Relypsa, Bayer HealthCare and Boehringer Ingelheim. CC co-chairs the cloth mask knowledge exchange, a stakeholder group that includes cloth mask manufacturers and fabric distributors. MC was an employee of GSK at the time of the study. All other authors have no conflicts.
Acknowledgments
We are grateful to the Population Health Research Institute for providing access to the individual patient level data. This work was supported by the funding from a GSK studentship held by PB as part of an ongoing collaboration between GSK and the London School of Hygiene and Tropical Medicine.