Abstract
Background Therapeutic options for type 2 diabetes mellitus (T2DM) have expanded over the last decade with the emergence of sodium-glucose co-transporter-2 (SGLT2) inhibitors and glucagon-like peptide-1 (GLP1) receptor agonists, which reduced the risk of major cardiovascular events in randomized controlled trials (RCTs). Cardiovascular evidence for older second-line agents, such as sulfonylureas, and direct head-to-head comparisons, including with dipeptidyl peptidase 4 (DPP4) inhibitors, are lacking, leaving a critical gap in our understanding of the relative effects of T2DM agents on cardiovascular risk and on patient-centered safety outcomes.
Methods and Analysis The Large-Scale Evidence Generations Across a Network of Databases for T2DM (LEGEND-T2DM) initiative is a series of systematic, large-scale, multinational, real-world comparative cardiovascular effectiveness and safety studies of all 4 major second-line anti-hyperglycemic agents including SGLT2 inhibitor, GLP1 receptor agonist, DPP4 inhibitor and sulfonylureas. LEGEND-T2DM will leverage the Observational Health Data Science and Informatics (OHDSI) community that provides access to a global network of administrative claims and electronic health record (EHR) data sources. Committed data partners represent 190 million patients in the US and about 50 million internationally. LEGEND-T2DM will identify all adult, T2DM patients who newly initiate a traditionally second-line T2DM agent, including individuals with and without established cardiovascular disease. Using an active comparator, new-user cohort design, LEGEND-T2DM will execute all pairwise class-vs-class and drug-vs-drug comparisons in each data source that meet a minimum patient count of 1,000 per arm and extensive study diagnostics that assess reliability and generalizability through cohort balance and equipoise to examine the relative risk of cardiovascular and safety outcomes. The primary cardiovascular outcomes include a 3-point and a 4-point composite of major adverse cardiovascular events, and series of safety outcomes. The study will pursue data-driven, large-scale propensity adjustment for measured confounding, a large set of negative control outcome experiments to address unmeasured and systematic bias.
Ethics and Dissemination The study ensures data safety through a federated analytic approach and follows research best practices, including prespecification and full disclosure of hypotheses tested and their results. LEGEND-T2DM is dedicated to open science and transparency and will publicly share all our analytic code from reproducible cohort definitions through turn-key software, enabling other research groups to leverage our methods, data, and results in order to verify and extend our findings.
1 Rationale and Background
The landscape of therapeutic options for type 2 diabetes mellitus (T2DM) has been dramatically transformed over the last decade [1]. The emergence of drugs targeting the sodium-glucose co-transporter-2 (SGLT2) and the glucagon-like peptide-1 (GLP1) receptor has expanded the role of T2DM agents from lowering blood glucose to directly reducing cardiovascular risk [2]. A series of large randomized clinical trials designed to evaluate the cardiovascular safety of SGLT2 inhibitors and GLP1 receptor agonists found that use of many of these agents led to a reduction in major adverse cardiovascular events, including myocardial infarction, hospitalization for heart failure, and cardiovascular mortality [3–6]. However, other T2DM drugs widely used before the introduction of these novel agents, such as sulfonylureas, did not undergo similarly comprehensive trials to evaluate their cardiovascular efficacy or safety. Moreover, direct comparisons of newer agents with dipeptidyl peptidase-4 (DPP4) inhibitors, with neutral effects on major cardiovascular outcomes [7–10], have not been conducted. Nevertheless, DPP4 inhibitors and sulfonylureas continue to be used in clinical practice and are recommended as second-line T2DM agents in national clinical practice guidelines.
Several challenges remain in formulating T2DM treatment recommendations based on existing evidence [11]. First, trials of novel agents did not pursue head-to-head comparisons to older agents and were instead designed as additive treatments on the background of commonly used T2DM agents. Therefore, the relative cardiovascular efficacy and safety of novel compared with older agents is not known, and indirect estimates have relied on summary-level data restricted to common comparators [12–14] and are less reliable [15, 16]. Second, trials of novel agents have tested individual drugs against placebo, but have not directly compared SGLT2 inhibitors with GLP1 receptor agonists in reducing adverse cardiovascular event risk. Moreover, there is no evidence to guide the use of individual drugs within each class and across different drug classes, particularly among patients at lower cardiovascular risk than recruited in clinical trials. Third, randomized trials focused on cardiovascular efficacy and safety, but were not powered to adequately assess the safety of these agents across a spectrum of non-cardiovascular outcomes. Finally, restricted enrollment across regions, and subgroups of age, sex, and race further limits the efficacy and safety assessment that may guide individual patients’ treatment.
Evidence gaps from these trials also pose a challenge in designing treatment algorithms, which rely on comparative effectiveness and safety of drugs. Perhaps, as a result, there is large variation in clinical practice guidelines and in clinical practice with regard to these medications, with many patients initiated on the newer therapies and many others treated with older regimens [17–21]. Among the second-line options, there is much variation with respect to the order of drugs used. This lack of consensus about the best approach provides an opportunity for systematic, large-scale observational studies.
2 Study Objectives
To inform critical decisions facing patients with diabetes, their caregivers, clinicians, policymakers and healthcare system leaders, we have launched the Large-Scale Evidence Generation and Evaluation across a Network of Databases for Diabetes (LEGEND-T2DM) initiative to execute a series of comprehensive observational studies to compare cardiovascular outcome rates and safety of second-line T2DM glucose-lowering agents. Specifically, these studies aim
To determine, through systematic evaluation, the comparative effectiveness of traditionally second-line T2DM agents, SGLT2 inhibitors and GLP1 receptor agonists, with each other and with DPP4 inhibitors and sulfonylureas, for cardiovascular outcomes.
To determine, through systematic evaluation, the comparative safety of traditionally second-line T2DM agents among patients with T2DM.
To assess heterogeneity in effectiveness and safety of traditionally second-line T2DM agents among key patient subgroups: Using stratified patient cohorts, we will quantify differential effectiveness and safety across subgroups of patients based on age, sex, race, renal impairment, and baseline cardiovascular risk.
3 Research Methods
LEGEND-T2DM will execute three systematic, large-scale observational studies of second-line T2DM agents to estimate the relative risks of cardiovascular effectiveness and safety outcomes.
The Class-vs-Class Study will provide all pairwise comparisons between the four major T2DM agent classes to evaluate their comparative effects on cardiovascular risk (Objective 1) and patient-centered safety outcomes (Objective 2);
The Drug-vs-Drug Study will furnish head-to-head pairwise comparisons between individual agents within and across classes (both Objectives 1 and 2); and The Heterogeneity Study will refine these comparisons for T2DM patients for important subgroups (Objective 3). In contrast to a single comparison approach, LEGEND-T2DM will provide a comprehensive view of the findings and their consistency across populations, drugs, and outcomes. We will model each study on our successful collaborative research evaluating the comparative effectiveness of antihypertensives recently published in The Lancet [22].
Table 1 list the four major T2DM agent classes and the individual agents licensed in the U5.S+.6+w4it+h7in each class. We will examine all 
class-wise comparisons and all 
ingredient-wise comparisons.
T2DM drug classes and individual agents within each class
Committed LEGEND-T2DM data sources and the populations they cover.
For each comparison, we are interested in the relative risk of each of the cardiovascular and safety outcomes listed in Table 3.
LEGEND-T2DM study outcomes
3.1 Study Design
For each study, we will employ an active comparator, new-user cohort design [23–25]. New-user cohort design is advocated as the primary design to be considered for comparative effectiveness and drug safety [26–28]. By identifying patients who start a new treatment course and using therapy initiation as the start of follow-up, the new-user design models an randomized controlled trial (RCT) where treatment commences at the index study visit. Exploiting such an index date allows a clear separation of baseline patient characteristics that occur prior to index date and are usable as covariates in the analysis without concern of inadvertently introducing mediator variables that arise between exposure and outcome [29]. Excluding prevalent users as those without a sufficient washout period prior to first exposure occurrence further reduces bias due to balancing mediators on the causal pathway, time-varying hazards, and depletion of susceptibles [28, 30]. Our systematic framework across studies further will address residual confounding, publication bias, and p-hacking using data-driven, large-scale propensity adjustment for measured confounding [31], a large set of negative control outcome experiments to address unmeasured and systematic bias [32–34], and full disclosure of hypotheses tested [35]. Figure 1 illustrates our design for all studies that the following sections describe in more detail.
Schematic of LEGEND-T2DM new-user cohort design for the Class-vs-Class, Drug-vs-Drug and Heterogeneity studies.
3.2 Data Sources
We will execute LEGEND-T2DM as a series of OHDSI network studies. All data partners within OHDSI are encouraged to participate voluntarily and can do so conveniently, because of the community’s shared Observational Medical Outcomes Partnership (OMOP) common data model (CDM) and OHDSI tool-stack. Many OHDSI community data partners have already committed to participate and we will recruit further data partners through OHDSI’s standard recruitment process, which includes protocol publication on OHDSI’s GitHub, an announcement in OHDSI’s research forum, presentation at the weekly OHDSI all-hands-on meeting and direct requests to data holders.
Table 2 lists the 13 already committed data sources for LEGEND-T2DM; these sources encompass a large variety of practice types and populations. For each data source, we report a brief description and size of the population it represents and its patient capture process and start date. While the earliest patient capture begins in 1989 (CUIMC), the vast majority come from the mid-2000s to today, providing almost two decades of T2DM treatment coverage. US populations include those commercially and publicly insured, enriched for older individuals (MDCR, VA), lower socioeconomic status (MDCD), and racially diverse (VA >20% Black or African American, CUIMC 8%). The US data sources may capture the same patients across multiple sources. Different views of the same patients are an advantage in capturing the diversity of real-world health events that patients experience. Across CCAE (commercially insured), MCDR (Medicare) and MCDC (Medicaid), we expect little overlap in terms of the same observations recorded at the same time for a patient; patients can flow between sources (e.g., a CCAE patient who retires can opt-in to become an MDCR patient), but the enrollment time periods stand distinct. On the other hand, Op-tum, PanTher, OpenClaims, CUIMC and YNHHS may overlap in time with the other US data sources. While it remains against licensing agreements to attempt to link patients between most data sources, Optum reports <20% overlap between their claims and EHR data sources that is reassuringly small. All data sources will receive institutional review board approval or exemption for their participation before executing LEGEND-T2DM.
3.3 Study Population
We will include all subjects in a data source who meet inclusion criteria for one or more traditionally second-line T2DM agent exposure cohorts. Broadly, these cohorts will consist of T2DM patients either with or without prior metformin monotherapy who initiate treatment with one of the 22 drug ingredients that comprise the DPP4 inhibitor, GLP1 receptor agonist, SGT2 inhibitor and sulfonylurea drug classes (Table 1). We do not consider thiazolidinediones given their known association with a risk of heart failure and bladder cancer [36, 37]. We describe specific definitions for exposure cohorts for each study in the following sections.
3.4 Exposure Comparators
3.4.1 Class-vs-Class Study comparisons
The Class-vs-Class Study will construct four exposure cohorts for new-users of any drug ingredient within the four traditionally second-line drug classes in Table 1. Cohort entry (index date) for each patient is their first observed exposure to any drug ingredient for the four second-line drug classes. Consistent with an idealized target trial for T2DM therapy and cardiovascular risk [38, 39], inclusion criteria for patients based on the index date will include:
T2DM diagnosis and no Type 1 or secondary diabetes mellitus diagnosis before the index date;
At least 1 year of observation time before the index date (to improve new-user sensitivity); and
No prior drug exposure to a comparator second-line or other antihyperglycemic agent (i.e. thiazolidinediones, acarbose, acetohexamide, bromocriptine, glibornuride, miglitol and nateglinide) or 30 days insulin exposure before index date.
We will construct and compare separately cohorts patients either with
At least 3 months of metformin use before the index date,
No prior metformin use before the index date.
In the first case, three months of metformin is consistent with ADA guidelines [40]. In the second case, we are interested in relative effectiveness and safety of these traditionally second-line agents in patients who initiate their treatments without first using metformin. We purposefully do not automatically exclude or restrict to patients with a history of myocardial infarction, stroke or other major cardiovascular events, which will allow us to report relative effectiveness and safety for individuals with both low or moderate and high cardiovascular risk. Likewise, we do not automatically exclude or restrict to individuals with severe renal impairment [41]. We will use cohort diagnostics, such as achieving covariate balance and clinical empirical equipoise between exposure cohorts (Section 4) and stakeholder input to guide the possible need to exclude other prior diagnoses, such as congestive heart failure, pancreatitis or cancer [41].
Appendix A.1 reports the complete OHDSI ATLAS cohort description for new-users of DDP4 inhibitors with prior metformin use. This description lists complete specification of cohort entry events, additional inclusion criteria, cohort exit events, and all associated standard OMOP CDM concept code sets used in the definition. We generate programmatically equivalent cohort definitions for new-others of each drug class with and without prior metformin use. ATLAS then automatically translates these definitions into network-deployable SQL source code. Appendix A.2 lists the inclusion criteria modifier for no prior metformin use.
Of note, the inclusion criteria do not directly incorporate quantitative measures of poor glycemic control, such as one or more elevated serum HbA1c measurements; such laboratory values are irregularly captured in large claims and even EHR data sources. Older ADA guidelines (but not since 2020 for patients with cardiovascular disease [42]) advise escalating to a second-line agent only when glycemic control is not met with metformin monotherapy, nicely mirroring our cohort design for our historical data. We will conduct sensitivity analyses involving available HbA1c measurements to demonstrate their bal-surements ≥ within 6 months before the index [39]. We will also conduct sensitivity
For each data source, we will then execute all 
class comparisons forof patients strongly suggest data source-specific differences in prescribing practices that may introduce residual bias and sufficient samples sizes are required to construct effective propensity score models [43].
3.4.2 Drug-vs-Drug Study comparisons
The Drug-vs-Drug Study will construct exposure cohorts for new-users of each drug ingredient in Table 1. We will apply the same cohort definition, inclusion criteria and patient count minimum as described in Section 3.4.1.
For each data source, we will then execute all 
pairwise drug comparisons. While we will publicly report studies results for all pairwise comparisons, we will focus primary clinical interpretation and scientific publishing to the 
comparisons that pit drugs within the same class against each other, as well as acrossclass comparisons that stakeholders deem pertinent given their experiences.
Appendix A.5 reports the complete OHDSI ATLAS cohort description for new-users of aloglipitin with prior metformin use. Again, we programmatically construct all new-user drug-level cohort and automatically translate into SQL.
3.4.3 Heterogeneity Study comparisons
The Heterogeneity Study will further stratify all 237 classand drug-level exposure cohorts in Sections 3.4.1 and 3.4.2 by clinically important patient characteristics that modify cardiovascular risk or relative treatment heterogeneity to provide patient-focused treatment recommendations. These factors will include:
Age (18 - 44 / 45 - 64 / 65 at the index date)
Gender (women / men)
Race (African American or black)
Cardiovascular risk (low or moderate/high, defined by established cardiovascular disease at the index date)
Renal impairment (at the index date)
We will define patients at high cardiovascular risk as those who fulfill at index date an established cardiovascular disease (CVD) definition that has been previously developed and validated for risk stratification among new-users of second-line T2DM agents [44]. Under this definition, established CVD means having at least 1 diagnosis code for a condition indicating cardiovascular disease, such as atherosclerotic vascular disease, cerebrovascular disease, ischemic heart disease or peripheral vascular disease, or having undergone at least 1 procedure indicating cardiovascular disease, such as percutaneous coronary intervention, coronary artery bypass graft or revascularization, any time on or prior to the exposure start. Likewise, we will define renal impairment through diagnosis codes for chronic kidney disease and end-stage renal disease, dialysis procedures, and laboratory measurements of estimated glomerular filtration rate, serum creatinine and urine albumin.
Appendix A.4 presents complete OHDSI ATLAS specifications for these subgroups, including all standard OMOP CDM concept codes defining cardiovascular risk and renal disease.
3.4.4 Validation
We will validate exposure cohorts and aggregate drug utilization using comprehensive cohort characterization tools against both claims and EHR data sources. Chief among these tools stands OHDSI’s CohortDiagnostic package (github). For any cohort and data source mapped to OMOP CDM, this package systematically generates incidence new-user rates (stratified by age, gender, and calendar year), cohort characteristics (all comorbidities, drug use, procedures, health utilization) and the actual codes found in the data triggering the various rules in the cohort definitions. This can allow researchers and stakeholders to understand the heterogeneity of source coding for exposures and health outcomes as well as the impact of various inclusion criteria on overall cohort counts (details described in Section 4).
3.5 Outcomes
Across all data sources and pairwise exposure cohorts, we will assess relative risks of 32 cardiovascular and patient-centered outcomes (Table 3). Primary outcomes of interest are:
3-point major adverse cardiovascular events (MACE), including acute myocardial infarction, stroke, and sudden cardiac death, and
4-point MACE that additionally includes heart failure hospitalization.
outcomes include:
individual MACE components,
acute renal failure,
revascularization
In data sources with laboratory measurements, secondary outcomes further include:
glycemic control, and
measured renal dysfunction
will also study second-line T2DM drug side-effects and safety concerns highlighted in the 2018 ADA guidelines [40] and from RCTs, including:
abnormal weight change,
genitourinary (GU) infection,
various cancers, and
hypoglycemia.
We will employ the same level of systematic rigor in studying outcomes regardless of their primary or secondary label.
A majority of outcome definitions have been previously implemented and validated in our own work [22,44–48] based heavily on prior development by others (see references in Table 3 [44–101]). To assess across-source consistency and general clinical validity, we will characterize outcome incidence, stratified by age, sex and index year for each data source.
3.6 Analysis
3.6.1 Contemporary utilization of drug classes and individual agents
For all cohorts in the three studies, we will describe overall utilization as well as temporal trends in the use of each drug class and agents within the class. Further, we will eavaluate these trends in patient groups by age (18-44 / 45-64 / ≥ years), gender, race and For all cohorts in the three studies, we will describe overall utilization as well as temporal trends in the use of each drug class and agents within the class. Further, we will evaluate 65 geographic regions. Since the emergence of novel medications in the management of type 2 DM in 2014, there has been a rapid expansion in both the number of drug classes and individual agents. These data will provide insight into the current patterns of use and possible disparities. These data are critical to guide the real-world application of treatment decision pathways for the treatment of T2DM patients.
Specifically, we will calculate and validate aggregate drug utilization using the OHDSI’s CohortDiagnostic package against both claims and EHR data sources. The CohortDiagnostics package works in two steps: 1) Generate the utilization results and diagnostics against a data source and 2) Explore the generated utilization and diagnostics in a userfriendly graphical interface R-Shiny app. Through the interface, one can explore patient profiles of a random sample of subjects in a cohort. These diagnostics provide a consistent methodology to evaluate cohort definitions/phenotype algorithms across a variety of observational databases. This will enable researchers and stakeholders to become informed on the appropriateness of including specific data sources within analyses, exposing potential risks related to heterogeneity and variability in patient care delivery that, when not addressed in the design, could result in errors such as highly correlated covariates in propensity score matching of a target and a comparator cohort. Thus, the added value of this approach is two-fold in terms of exposing data quality for a study question and ensuring face validity checks are performed on proposed covariates to be used for balancing propensity scores.
3.6.2 Relative risk of cardiovascular and patient-centered outcomes
For all three studies, we will execute a systematic process to estimate the relative risk of cardiovascular and patient-centered outcomes between new-users of second-line T2DM agents. The process will adjust for measured confounding, control from further residual (unmeasured) bias and accommodate important design choices to best emulate the nearly impossible to execute, idealized RCT that our stakeholders envision across data source populations, comparators, outcomes and subgroups.
To adjust for potential measured confounding and improve the balance between cohorts, we will build large-scale propensity score (PS) models [102] for each pairwise comparison and data source using a consistent data-driven process through regularized regression [31]. This process engineers a large set of predefined baseline patient characteristics, including age, gender, race, index month/year and other demographics and prior conditions, drug exposures, procedures, laboratory measurements and health service utilization behaviors, to provide the most accurate prediction of treatment and balance patient cohorts across many characteristics. Construction of condition, drug, procedures and observations include occurrences within 365, 180 and 30 days prior to index date and are aggregated at several SNOMED (conditions) and ingredient/ATC class (drugs) levels. Other demographic measures include comorbidity risk scores (Charlson, DCSI, CHADS2, CHAD2VASc). From prior work, feature counts have ranged in the 1,000s - 10,000s, and these large-scale PS models have outperformed hdPS [103] in simulation and real-world examples [31].
We will:
Exclude patients who have experienced the outcome prior to their index date,
Stratify and variable-ratio match patients by PS, and
Use Cox proportional hazards models
to estimate hazard ratios (HRs) between alternative target and comparator treatments for the risk of each outcome in each data source. The regression will condition on the PS strata/matching-unit with treatment allocation as the sole explanatory variable and censor patients at the end of their time-at-risk (TAR) or data source observation period. We will prefer stratification over matching if both sufficiently balance patients (see Section 4), as the former optimizes patient inclusions and thus generalizability.
We will execute each comparison using three different TAR definitions, reflecting different and important causal contrasts:
Intent-to-treat (TAR: index + 1 → end of observation) captures both direct treatment effects and (long-term) behavioral/treatment changes that initial assignment triggers [104];
On-treatment-1 (TAR: index + 1 → treatment discontinuation) is more patient-centered [105] and captures direct treatment effect while allowing for escalation with additional T2DM agents; and
On-treatment-2 (TAR: index + 1 → discontinuation or escalation with T2DM agents) carries the least possible confounding with other concurrent T2DM agents.
Our “on-treatment” is often called “per-protocol” [106]. Systematically executing with multiple causal contrasts enables us to identify potential biases that missing prescription data, treatment escalation and behavioral changes introduce, while preserving the ease of intent-to-treat interpretation and power if the data demonstrate them as unbiased. Appendix A.3 reports the modified cohort exit rule for the on-treatment-2 TAR.
We will aggregate HR estimates across non-overlapping data sources to produce metaanalytic estimates using a random-effects meta-analysis [107]. This classic meta-analysis assumes that per-data source likelihoods are approximately normally distributed [108]. This assumption fails when outcomes are rare as we expect for some safety events. Here, our recent research shows that as the number of data sources increases, the non-normality effect increases to where coverage of 95% confidence intervals (CIs) can be as low as 5%. To counter this, we will also apply a Bayesian meta-analysis model [109, 110] that neither assumes normality nor requires patient-level data sharing by building on composite likelihood methods [111] and enables us to introduce appropriate overlap weights between data sources.
Residual study bias from unmeasured and systematic sources often remains in observational studies even after controlling for measured confounding through PS-adjustment [32, 33]. For each comparison-outcome effect, we will conduct negative control (falsification) outcome experiments, where the null hypothesis of no effect is believed to be true, using approximately 100 controls. We identified these controls through a data-rich algorithm [112] that identifies prevalent OMOP condition concept occurrences that lack evidence of association with exposures in published literature, drug-product labeling and spontaneous reports, and were then adjudicated by clinical review. We previously validated 60 of the controls in LEGEND-HTN [22]. Appendix C lists these negative controls and their OMOP condition concept IDs.
Using the empirical null distributions from these experiments, we will calibrate each study effect HR estimate, its 95% CI and the p-value to reject the null hypothesis of no differential effect [34]. We will declare an HR as significantly different from no effect when its calibrated p < 0.05 without correcting for multiple testing. Finally, blinded to all trial results, study investigators will evaluate study diagnostics for all comparisons to assess if they were likely to yield unbiased estimates (Section 4).
3.6.3 Sensitivity analyses and missingness
Because of the potential confounding effect of glycemic control at baseline between treatment choice and outcomes and to better understand the impact of limited glucose level measurements on effectiveness and safety estimation that arises in administrative claims and some EHR data, we will perform pre-specified sensitivity analyses for all studies within data sources that contain reliable glucose or hemoglobin A1c measurements. Within a study, for each exposure pair, we will first rebuild PS models where we additionally include baseline glucose or hemoglobin A1c measurements as patient characteristics, stratify or match patients under the new PS models that directly adjust for potential confounding by glycemic control and then estimate effectiveness and safety HRs.
A limitation of the Cox model is that no doubly robust procedure is believed to exist for estimating HRs, due to their non-collapsibility [113]. Doubly robust procedures combine baseline patient characteristic-adjusted outcome and PS models to control for confounding and, in theory, remain unbiased when either (but not necessarily both) model is correctly specified [114]. Doubly robust procedures do exist for hazard differences [113] and we will validate the appropriateness of our univariable Cox modeling by comparing estimate differences under an additive hazards model [116] with and without doubly robust-adjustment [117]. In practice, however, neither the outcome nor PS model is correctly specified, leading to systematic error in the observational setting.
Missing data of potential concern are patient demographics (gender, age, race) for our inclusion criteria. We will include only individuals whose baseline eligibility can be characterized that will most notably influence race subgroup assessments in the Heterogeneity Study. No further missing data can arise in our large-scale PS models because all features, with the exception of demographics, simply indicate the presence or absence of health records in a given time-period. Finally, we limit the impact of missing data, such as prescription information, relating to exposure time-at-risk by entertaining multiple definitions [29]. In all reports, we will clearly tabulate numbers of missing observations and patient attrition.
4 Sample Size and Study Power
Within each data source, we will execute all comparisons with 1,000 eligible patients per arm. Blinded to effect estimates, investigators and stakeholders will evaluate extensive study diagnostics for each comparison to assess reliability and generalizability, and only report risk estimates that pass [25, 35]. These diagnostics will include
Minimum detectable risk ratio (MDRR) as a typical proxy for power,
Preference score distributions to evaluate empirical equipoise10 and population generalizability,
Extensive patient characteristics to evaluate cohort balance before and after PSadjustment,
Negative control calibration plots to assess residual bias, and
Kaplan-Meier plots to examine hazard ratio proportionality assumptions.
We will define cohorts to stand in empirical equipoise if the majority of patients carry preference scores between 0.3 and 0.7 and to achieve balance if all after-adjustment characteristics return absolute standardized mean differences 0.1 [118].
5 Strengths and Limitations
5.1 Strengths
LEGEND-T2DM is, to our knowledge, the largest and most comprehensive study to provide evidence about the comparative effectiveness and safety of second-line T2DM agents. The LEGEND-T2DM studies will encompass over 1 million patients initiating second-line T2DM agents across at least 13 databases from 5 countries and will examine all pairwise comparisons between the four second-line drug classes against a panel of TODO health outcomes. Through an international network, LEGEND-T2DM seeks to take advantage of disparate health databases drawn from different sources and across a range of countries and practice settings. These large-scale and unfiltered populations better represent real-world practice than the restricted study populations in prescribed treatment and follow-up settings from RCTs. Our use of the OMOP CDM allows extension of the LEGEND-T2DM experiment to future databases and allows replication of these results on licensable databases that were used in this experiment, while still maintaining patient privacy on patient-level data.
LEGEND-T2DM further advances the statistically rigorous and empirically validated methods we have developed in OHDSI that specifically address bias inherent in observational studies and allow for reliable causal inference. Patient characteristics and their treatment choices are likely to confound comparative effectiveness and safety estimates. Our approach combines active comparator new-user designs that emulate randomized clinical trials with large-scale propensity adjustment for measured confounding, a large set of negative control outcome experiments to address unmeasured and systematic bias, and full disclosure of hypotheses tested.
Each LEGEND-T2DM aim will represent evidence synthesis from a large number of bespoke studies across multiple data sources. Addressing questions one bespoke study at a time is prone to errors arising from multiple testing, random variation in effect estimates and publication bias. LEGEND-T2DM is designed to avoid these concerns through methodologic best practices [119] with full study diagnostics and external replication.
Through open science, LEGEND-T2DM will allow any interested investigators to engage as partners in our work at many levels. We will publicly develop all protocols and analytic code. This invites additional data custodians to participate in LEGEND-T2DM and enables others to modify and reuse our approach for other investigations. We will also host realtime access to all study result artifacts for outside analysis and interpretation. Such an open science framework ensures a feed-forward effect on other scientific contributions in the community. Collectively, LEGEND-T2DM will generate patient-centered, high quality, generalizable evidence that will transform the clinical management of T2DM through our active collaboration with patients, clinicians, and national medical societies. LEGENDT2DM will spur scientific innovation through the generation of open-source resources in data science.
5.2 Limitations
Even though many potential confounders will be included in these studies, there may be residual bias due to unmeasured or misspecified confounders, such as confounding by indication, differences in physician characteristics that may be associated with drug choice, concomitant use of other drugs started after the index date, and informative censoring at the end of the on-treatment periods. To minimize this risk, we will use methods to detect residual bias through a large number of negative and positive controls.
Ideal negative controls carry identical confounding between exposures and the outcome of interest [120]. The true confounding structure, however, is unknowable. Instead of attempting to find the elusive perfect negative control, we will rely on a large sample of controls that represent a wide range of confounding structures. If a study comparison proves to be unbiased for all negative controls, we can feel confident that it will also be unbiased for the outcome of interest. In our previous studies [22,25,121], using the active comparator, new-user cohort design we will employ here, we have observed minimal residual bias using negative controls. This stands in stark contrast to other designs such as the (nested) case-control that tends to show large residual bias because of incomparable exposure cohorts implied by the design [122].
Observed follow-up times are limited and variable, potentially reducing power to detect differences in effectiveness and safety and, further, misclassification of study variables is unavoidable in secondary use of health data, so it is possible to misclassify treatments, covariates, and outcomes. Based on our previous successful studies on antihypertensives, we do not expect differential misclassification, and therefore bias will most likely be towards the null. Finally, the electronic health record databases may be missing care episodes for patients due to care outside the respective health systems. Such bias, however, will also most likely be towards the null.
6 Protection of Human Subjects
LEGEND-T2DM does not involve human subjects research. The project does, however, use human data collected during routine healthcare provision. Most often the data are de-identified within data source. All data partners executing the LEGEND-T2DM studies within their data sources will have received institutional review board (IRB) approval or waiver for participation in accordance to their institutional governance prior to execution (see Table 4). LEGEND-T2DM executes across a federated and distributed data network, where analysis code is sent to participating data partners and only aggregate summary statistics are returned, with no sharing of patient-level data between organizations.
IRB approval or waiver statement from partners.
7 Management and Reporting of Adverse Events and Adverse Reactions
LEGEND-T2DM uses coded data that already exist in electronic databases. In these types of databases, it is not usually possible to link (i.e., identify a potential causal association between) a particular product and medical event for any specific individual. Thus, the minimum criteria for reporting an adverse event (i.e., identifiable patient, identifiable reporter, a suspect product and event) are not available and adverse events are not reportable as individual adverse event reports. The study results will be assessed for medically important findings.
8 Plans for Disseminating and Communicating Study Results
Open science aims to make scientific research, including its data process and software, and its dissemination, through publication and presentation, accessible to all levels of an inquiring society, amateur or professional [123] and is a governing principle of LEGENDT2DM. Open science delivers reproducible, transparent and reliable evidence. All aspects of LEGEND-T2DM (except private patient data) will be open and we will actively encourage other interested researchers, clinicians and patients to participate. This differs fundamentally from traditional studies that rarely open their analytic tools or share all result artifacts, and inform the community about hard-to-verify conclusions at completion.
8.1 Transparent and re-usable research tools
We will publicly register this protocol and announce its availability for feedback from stakeholders, the OHDSI community and within clinical professional societies. This protocol will link to open source code for all steps to generating diagnostics, effect estimates, figures and tables. Such transparency is possible because we will construct our studies on top of the OHDSI toolstack of open source software tools that are community developed and rigorously tested [25]. We will publicly host LEGEND-T2DM source code at (https://github.com/ohdsi-studies/LegendT2dm), allowing public contribution and review, and free re-use for anyone’s future research.
8.2 Continous sharing of results
LEGEND-T2DM embodies a new approach to generating evidence from healthcare data that overcome weaknesses in the current process of answering and publishing (or not) one question at a time. Generating evidence for thousands of research and control questions using a systematic process enables us to not only evaluate that process and the coherence and consistency of the evidence, but also to avoid p-hacking and publication bias [35]. We will store and openly communicate all of these results as they become available using a user-friendly web-based app that serves up all descriptive statistics, study diagnostics and effect estimates for each cohort comparison and outcome. Open access to this app will be through a general public facing LEGEND-T2DM webpage.
8.3 Scientific meetings and publications
We will deliver multiple presentations annually at scientific venues including the annual meetings of the American Diabetes Association, American College of Cardiology, American Heart Association and American Medical Informatics Association. We will also prepare multiple scientific publications for clinical, informatics and statistical journals.
8.4 General public
We believe in sharing our findings that will guide clinical care with the general public. LEGEND-T2DM will use social-media (Twitter) to facilitate this. With dedicated support from the OHDSI communications specialist, we will deliver regular press releases at key project stages, distributed via the extensive media networks of UCLA, Columbia and Yale.
Data Availability
The study relies on a federated analytic model where the data reside with the source. The code for the study will be publicly available but the data can only be obtained in partnership with individuals and organizations included as data sources.
Disclosures
This study is undertaken within Observational Health Data Sciences and Informatics (OHDSI), an open collaboration. RK is a founder of Evidence2Health, and receives grant funding from the US National Institutes of Health. MJS and PBR are employees of Janssen Research and Development and shareholders in John & Johnson. GH receives grant funding from the US National Institutes of Health and the US Food & Drug Administration and contracts from Janssen Research and Development. HMK receives grants from the US Food & Drug Administration, Medtronics and Janssen Research and Development, is co-founder of HugoHealth and chairs the Cardiac Scientific Advisory Board for UnitedHealth. MAS receives grant funding from the US National Institutes of Health, the US Department of Veterans Affairs and the US Food & Drug Administration and contracts from Janssen Research and Development and IQVIA.
Appendix
A Exposure Cohort Definitions
A.1 Class-vs-Class Exposure (DPP4 New-User) Cohort / OT1
A.1.1 Cohort Entry Events
People with continuous observation of 365 days before event may enter the cohort when observing any of the following:
drug exposure of ‘DPP4 inhibitors’ for the first time in the person’s history.
Limit cohort entry events to the earliest event per person. Restrict entry events to with all of the following criteria:
with the following event criteria: who are >= 18 years old.
having at least 1 condition occurrence of ‘Type 2 diabetes mellitus’, starting anytime on or before cohort entry start date; allow events outside observation period.
having no condition occurrences of ‘Type 1 diabetes mellitus’, starting anytime on or before cohort entry start date; allow events outside observation period.
having no condition occurrences of ‘Secondary diabetes mellitus’, starting anytime on or before cohort entry start date; allow events outside observation period.
A.1.2 Additional Inclusion Criteria
No prior GLP-1 receptor agonist exposure
Entry events having no drug exposures of ‘GLP-1 receptor agonists’, starting anytime on or before cohort entry start date; allow events outside observation period.
No prior SGLT-2 inhibitor exposure
Entry events having no drug exposures of ‘SGLT2 inhibitors’, starting anytime on or before cohort entry start date; allow events outside observation period.
No prior SU exposure
Entry events having no drug exposures of ‘Sulfonylureas’, starting anytime on or before cohort entry start date; allow events outside observation period.
No prior other anti-diabetic exposure
Entry events having no drug exposures of ‘Other anti-diabetics’, starting anytime on or before cohort entry start date; allow events outside observation period.
Prior metformin use
Entry events with any of the following criteria:
having at least 1 drug era of ‘Metformin’, starting anytime up to 90 days before cohort entry start date; allow events outside observation period; with era length >= 90 days.
having at least 3 drug exposures of ‘Metformin’, starting anytime on or before cohort entry start date; allow events outside observation period.
No prior insulin use or combo initiation: Proxy for < 30 days drug era anytime before index and no combination use on index
Entry events with all of the following criteria:
having no drug eras of ‘Insulin’, starting anytime up to 30 days before cohort entry start date; allow events outside observation period; with era length > 30 days.
having no drug eras of ‘Insulin’, starting between 30 days before and 0 days after cohort entry start date; allow events outside observation period.
A.1.3 Cohort Exit
The cohort end date will be based on a continuous exposure to ‘DPP4 inhibitors’: allowing 30 days between exposures, adding 0 days after exposure ends, and using days supply and exposure end date for exposure duration.
A.1.4 Cohort Eras
Entry events will be combined into cohort eras if they are within 0 days of each other.
A.1.5 Concept: DPP4 inhibitors
A.1.6 Concept: GLP-1 receptor agonists
A.1.7 Concept: SGLT2 inhibitors
A.1.8 Concept: Sulfonylureas
A.1.9 Concept: Other anti-diabetics
A.1.10 Concept: Insulin
A.1.11 Concept: Metformin
A.1.12 Concept: Secondary diabetes mellitus
A.1.13 Concept: Type 1 diabetes mellitus
A.1.14 Concept: Type 2 diabetes mellitus
A.2 Metformin Use Modifier
A.2.1 No prior metformin use
Entry events having no drug eras of ‘Metformin’, starting anytime on or before cohort entry start date; allow events outside observation period.
A.3 Escalation Exit Criteria
The cohort end date will be based on a continuous exposure to ‘DPP4 inhibitors’: allowing 30 days between exposures, adding 0 days after exposure ends, and using days supply and exposure end date for exposure duration.
The person also exists the cohort when encountering any of the following events:
drug exposures of ‘All alternative target exposures’.
drug exposures of ‘Other anti-diabetics’.
drug eras of ‘Insulin’, with era length > 30 days.
A.3.1 Concept: All alternative target exposures
A.4 Heterogenity Study Inclusion Criteria
A.4.1 Lower age group
Entry events with the following event criteria: who are < 45 years old.
A.4.2 Middle age group
Entry events with all of the following criteria:
with the following event criteria: who are >= 45 years old.
with the following event criteria: who are < 65 years old.
A.4.3 Older age group
Entry events with the following event criteria: who are >= 65 years old.
A.4.4 Female stratum
Entry events with the following event criteria: who are female.
A.4.5 Male stratum
Entry events with the following event criteria: who are male.
A.4.6 Race stratum
Entry events with the following event criteria: race is: “black or african american”, “black”, “african american”, “african”, “bahamian”, “barbadian”, “dominican”, “dominica islander”, “haitian”, “jamaican”, “tobagoan”, “trinidadian” or “west indian”.
A.4.7 Low cardiovascular risk
Entry events with all of the following criteria:
having no condition occurrences of ‘Conditions indicating established cardiovascular disease’, starting anytime on or before cohort entry start date; allow events outside observation period.
having no procedure occurrences of ‘Procedures indicating established cardiovascular disease’, starting anytime on or before cohort entry start date; allow events outside observation period.
A.4.8 Higher cardiovascular risk
Entry events with any of the following criteria:
having at least 1 condition occurrence of ‘Conditions indicating established cardiovascular disease’, starting anytime on or before cohort entry start date; allow events outside observation period.
having at least 1 procedure occurrence of ‘Procedures indicating established cardiovascular disease’, starting anytime on or before cohort entry start date; allow events outside observation period.
A.4.9 Concept: Conditions indicating established cardiovascular disease
A.4.10 Concept: Procedures indicating established cardiovascular disease
A.4.11 Without renal impairment
Entry events having no condition occurrences of ‘Renal impairment’, starting anytime on or before cohort entry start date; allow events outside observation period.
A.4.12 Renal impairment
Entry events having at least 1 condition occurrence of ‘Renal impairment’, starting anytime on or before cohort entry start date; allow events outside observation period.
A.4.13 Concept: Renal impairment
A.5 Drug-vs-Drug Exposure (Alogliptin New-User) Cohort / OT1
A.5.1 Cohort Entry Events
People with continuous observation of 365 days before event may enter the cohort when observing any of the following:
drug exposure of ‘alogliptin’ for the first time in the person’s history.
Limit cohort entry events to the earliest event per person. Restrict entry events to with all of the following criteria:
with the following event criteria: who are >= 18 years old.
having at least 1 condition occurrence of ‘Type 2 diabetes mellitus’, starting anytime on or before cohort entry start date; allow events outside observation period.
having no condition occurrences of ‘Type 1 diabetes mellitus’, starting anytime on or before cohort entry start date; allow events outside observation period.
having no condition occurrences of ‘Secondary diabetes mellitus’, starting anytime on or before cohort entry start date; allow events outside observation period.
A.5.2 Additional Inclusion Criteria
No prior with-in class exposure
Entry events having no drug exposures of ‘DPP4 inhibitors excluding alogliptin’, starting anytime on or before cohort entry start date; allow events outside observation period.
No prior GLP-1 receptor agonist exposure
Entry events having no drug exposures of ‘GLP-1 receptor agonists’, starting anytime on or before cohort entry start date; allow events outside observation period.
No prior SGLT-2 inhibitor exposure
Entry events having no drug exposures of ‘SGLT2 inhibitors’, starting anytime on or before cohort entry start date; allow events outside observation period.
No prior SU exposure
Entry events having no drug exposures of ‘Sulfonylureas’, starting anytime on or before cohort entry start date; allow events outside observation period.
No prior other anti-diabetic exposure
Entry events having no drug exposures of ‘Other anti-diabetics’, starting anytime on or before cohort entry start date; allow events outside observation period.
Prior metformin use
Entry events with any of the following criteria:
having at least 1 drug era of ‘Metformin’, starting anytime up to 90 days before cohort entry start date; allow events outside observation period; with era length >= 90 days.
having at least 3 drug exposures of ‘Metformin’, starting anytime on or before cohort entry start date; allow events outside observation period.
No prior insulin use or combo initiation: Proxy for < 30 days drug era anytime before index and no combination use on index
Entry events having no drug eras of ‘Insulin’, starting anytime on or before cohort entry start date; allow events outside observation period; with era length > 30 days.
A.5.3 Cohort Exit
The cohort end date will be based on a continuous exposure to ‘alogliptin’: allowing 30 days between exposures, adding 0 days after exposure ends, and using days supply and exposure end date for exposure duration.
A.5.4 Cohort Eras
Entry events will be combined into cohort eras if they are within 0 days of each other.
A.5.5 Concept: alogliptin
A.5.6 Concept: DPP4 inhibitors excluding alogliptin
B Outcome Cohort Definitions
B.1 3-point MACE
B.1.1 Cohort Entry Events
People may enter the cohort when observing any of the following:
condition occurrences of ‘Acute myocardial Infarction’.
condition occurrences of ‘Sudden cardiac death’.
condition occurrences of ‘Ischemic stroke’.
condition occurrences of ‘Intracranial bleed Hemorrhagic stroke’.
Restrict entry events to having at least 1 visit occurrence of ‘Inpatient or ER visit’, starting anytime on or before cohort entry start date and ending between 0 days before and all days after cohort entry start date.
B.1.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 7 days.
B.1.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 180 days of each other.
B.1.4 Concept: Inpatient or ER visit
B.1.5 Concept: Acute myocardial Infarction
B.1.6 Concept: Sudden cardiac death
B.1.7 Concept: Ischemic stroke
B.1.8 Concept: Intracranial bleed Hemorrhagic stroke
B.1.9 Concept: Heart Failure
B.2 4-point MACE
B.2.1 Cohort Entry Events
People may enter the cohort when observing any of the following:
condition occurrences of ‘Acute myocardial Infarction’.
condition occurrences of ‘Sudden cardiac death’.
condition occurrences of ‘Ischemic stroke’.
condition occurrences of ‘Iintracranial bleed Hemorrhagic stroke’.
condition occurrences of ‘Heart Failure’.
Restrict entry events to having at least 1 visit occurrence of ‘Inpatient or ER visit’, starting anytime on or before cohort entry start date and ending between 0 days before and all days after cohort entry start date.
B.2.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 7 days.
B.2.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 180 days of each other.
B.2.4 Concept: Inpatient or ER visit
B.2.5 Concept: Acute myocardial Infarction
B.2.6 Concept: Sudden cardiac death
B.2.7 Concept: Ischemic stroke
B.2.8 Concept: Iintracranial bleed Hemorrhagic stroke
B.2.9 Concept: Heart Failure
B.3 Acute myocardial infarction
B.3.1 Cohort Entry Events
People may enter the cohort when observing any of the following:
condition occurrences of ‘[LEGEND-T2DM] Acute myocardial Infarction’.
Restrict entry events to having at least 1 visit occurrence of ‘Inpatient or ER visit’, starting anytime on or before cohort entry start date and ending between 0 days before and all days after cohort entry start date.
B.3.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 7 days.
B.3.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 180 days of each other.
B.3.4 Concept: Inpatient or ER visit
B.3.5 Concept: [LEGEND-T2DM] Acute myocardial Infarction
B.4 Acute renal failure
B.4.1 Cohort Entry Events
People may enter the cohort when observing any of the following:
condition occurrences of ‘Acute Renal Failure’.
Restrict entry events to having at least 1 visit occurrence of ‘Inpatient or ER visit’, starting anytime on or before cohort entry start date and ending between 0 days before and all days after cohort entry start date.
B.4.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 30 days.
B.4.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 30 days of each other.
B.4.4 Concept: Inpatient or ER visit
B.4.5 Concept: Acute Renal Failure
B.5 Glycemic control
B.5.1 Cohort Entry Events
People enter the cohort when observing any of the following:
measurements of ‘HbA1c_v2’, numeric value <= 7; unit: “percent”.
measurements of ‘HbA1c_v2’, numeric value <= 53; unit: “millimole per mole”.
Limit qualifying entry events to the earliest event per person.
B.5.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 1 day.
B.5.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 90 days of each other.
B.5.4 Concept: HbA1c_v2
B.6 Hospitalization with heart failure
B.6.1 Cohort Entry Events
People enter the cohort when observing any of the following:
visit occurrences of ‘Inpatient or ER visit’; having at least 1 condition occurrence of ‘[LEGEND-T2DM] Heart Failure’, starting between 0 days before and all days after ‘Inpatient or ER visit’ start date and starting anytime on or before ‘Inpatient or ER visit’ end date.
B.6.2 Cohort Exit
The cohort end date will be offset from index event’s end date plus 0 days.
B.6.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 7 days of each other.
B.6.4 Concept: Inpatient or ER visit
B.6.5 Concept: [LEGEND-T2DM] Heart Failure
B.7 Measured renal dysfunction
B.7.1 Cohort Entry Events
People enter the cohort when observing any of the following:
measurements of ‘Creatinine measurement’, numeric value > 3; unit: “milligram per deciliter”.
measurements of ‘Creatinine measurement’, numeric value > 265; unit: “micromole/liter”.
measurements of ‘Creatinine measurement’, numeric value > 0.265; unit: “millimole per liter”.
measurements of ‘Creatinine measurement’, numeric value > 3; unit: “milligram”.
Limit cohort entry events to the earliest event per person.
B.7.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 1 day.
B.7.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 0 days of each other.
B.7.4 Concept: Creatinine measurement
B.8 Revascularization
B.8.1 Cohort Entry Events
People may enter the cohort when observing any of the following:
procedure occurrences of ‘PCI’.
procedure occurrences of ‘CABG’.
B.8.2 Additional Inclusion Criteria
Hospitalization
Entry events having at least 1 visit occurrence of ‘Hospitalization’, starting between 0 days before and 0 days after cohort entry start date.
B.8.3 Cohort Exit
The cohort end date will be offset from index event’s start date plus 1 day.
B.8.4 Cohort Eras
Entry events will be combined into cohort eras if they are within 0 days of each other.
B.8.5 Concept: PCI
B.8.6 Concept: Hospitalization
B.8.7 Concept: CABG
B.9 Stroke
B.9.1 Cohort Entry Events
People may enter the cohort when observing any of the following:
condition occurrences of ‘[LEGEND-T2DM] Stroke (ischemic or hemorrhagic)’.
Restrict entry events to having at least 1 visit occurrence of ‘Inpatient or ER visit’, starting between all days before and 1 days after cohort entry start date and ending between 0 days before and all days after cohort entry start date.
B.9.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 7 days.
B.9.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 180 days of each other.
B.9.4 Concept: Inpatient or ER visit
B.9.5 Concept: [LEGEND-T2DM] Stroke (ischemic or hemorrhagic)
B.10 Sudden cardiac death
B.10.1 Cohort Entry Events
People may enter the cohort when observing any of the following:
condition occurrences of ‘[LEGEND HTN] Sudden cardiac death’.
Restrict entry events to having at least 1 visit occurrence of ‘Inpatient or ER visit’, starting anytime on or before cohort entry start date and ending between 0 days before and all days after cohort entry start date.
B.10.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 7 days.
B.10.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 180 days of each other.
B.10.4 Concept: Inpatient or ER visit
B.10.5 Concept: [LEGEND HTN] Sudden cardiac death
B.11 Abnormal weight gain
B.11.1 Cohort Entry Events
People enter the cohort when observing any of the following:
observations of ‘[LEGEND HTN] Abnormal weight gain’.
B.11.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 1 day.
B.11.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 90 days of each other.
B.11.4 Concept: [LEGEND HTN] Abnormal weight gain
B.12 Abnormal weight loss
B.12.1 Cohort Entry Events
People enter the cohort when observing any of the following:
observations of ‘[LEGEND HTN] Abnormal weight loss’.
B.12.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 1 day.
B.12.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 90 days of each other.
B.12.4 Concept: [LEGEND HTN] Abnormal weight loss
B.13 Acute pancreatitis
B.13.1 Cohort Entry Events
People may enter the cohort when observing any of the following:
condition occurrences of ‘[LEGEND HTN] Acute pancreatitis’.
Restrict entry events to having at least 1 visit occurrence of ‘Inpatient or ER visit’, starting anytime on or before cohort entry start date and ending between 0 days before and all days after cohort entry start date.
B.13.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 7 days.
B.13.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 30 days of each other.
B.13.4 Concept: Inpatient or ER visit
B.13.5 Concept: [LEGEND HTN] Acute pancreatitis
B.14 All-cause mortality
B.14.1 Cohort Entry Events
People enter the cohort when observing any of the following:
death of any form.
Limit cohort entry events to the earliest event per person.
The person also exists the cohort at the end of continuous observation.
B.14.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 0 days of each other.
B.15 Bladder cancer
B.15.1 Cohort Entry Events
People with continuous observation of 365 days before event enter the cohort when observing any of the following:
condition occurrence of ‘Bladder cancer’ for the first time in the person’s history.
Limit cohort entry events to the earliest event per person.
B.15.2 Cohort Exit
The person also exists the cohort at the end of continuous observation.
B.15.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 0 days of each other.
B.15.4 Concept: Bladder cancer
B.16 Bone fracture
B.16.1 Cohort Entry Events
People enter the cohort when observing any of the following:
condition occurrences of ‘Bone fracture’.
B.16.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 1 day.
B.16.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 90 days of each other.
B.16.4 Concept: Bone fracture
B.17 Breast cancer
B.17.1 Cohort Entry Events
People with continuous observation of 365 days before event enter the cohort when observing any of the following:
condition occurrence of ‘Malignant tumor of breast’ for the first time in the person’s history.
Limit cohort entry events to the earliest event per person.
B.17.2 Cohort Exit
The person also exists the cohort at the end of continuous observation.
B.17.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 0 days of each other.
B.17.4 Concept: Malignant tumor of breast
B.18 Diabetic ketoacidosis
B.18.1 Cohort Entry Events
People may enter the cohort when observing any of the following:
condition occurrences of ‘Diabetic ketoacidosis’.
Restrict entry events to having at least 1 visit occurrence of ‘Inpatient or ER visit’, starting between all days before and 1 days after cohort entry start date and ending between 0 days before and all days after cohort entry start date.
B.18.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 7 days.
B.18.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 180 days of each other.
B.18.4 Concept: Inpatient or ER visit
B.18.5 Concept: Diabetic ketoacidosis
B.19 Diarrhea
B.19.1 Cohort Entry Events
People enter the cohort when observing any of the following:
condition occurrences of ‘[LEGEND HTN} Diarrhea’.
B.19.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 1 day.
B.19.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 30 days of each other.
B.19.4 Concept: [LEGEND HTN} Diarrhea
B.20 Genitourinary infection
B.20.1 Cohort Entry Events
People enter the cohort when observing any of the following:
condition occurrences of ‘UTI’.
Limit qualifying entry events to the earliest event per person.
B.20.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 1 day.
B.20.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 30 days of each other.
B.20.4 Concept: UTI
B.21 Hyperkalemia
B.21.1 Cohort Entry Events
People enter the cohort when observing any of the following:
condition occurrences of ‘[LEGEND HTN] Hyperkalemia’.
measurements of ‘[LEGEND HTN] Potassium measurement’, numeric value > 5.6; unit: “millimole per liter”.
B.21.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 1 day.
B.21.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 90 days of each other.
B.21.4 Concept: [LEGEND HTN] Hyperkalemia
B.21.5 Concept: [LEGEND HTN] Potassium measurement
B.22 Hypoglycemia
B.22.1 Cohort Entry Events
People enter the cohort when observing any of the following:
condition occurrences of ‘Hypoglycemia’.
B.22.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 1 day.
B.22.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 30 days of each other.
B.22.4 Concept: Hypoglycemia
B.23 Hypotension
B.23.1 Cohort Entry Events
People enter the cohort when observing any of the following:
condition occurrences of ‘[LEGEND HTN] Hypotension’.
B.23.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 1 day.
B.23.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 90 days of each other.
B.23.4 Concept: [LEGEND HTN] Hypotension
B.24 Joint pain
B.24.1 Cohort Entry Events
People enter the cohort when observing any of the following:
condition occurrences of ‘Joint pain’.
B.24.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 1 day.
B.24.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 90 days of each other.
B.24.4 Concept: Joint pain
B.25 Lower extremity amputation
B.25.1 Cohort Entry Events
People may enter the cohort when observing any of the following:
procedure occurrences of ‘below-knee amputations’.
Restrict entry events to having no procedure occurrences of ‘below-knee amputations’, starting in the 30 days prior to cohort entry start date.
B.25.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 0 days.
B.25.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 0 days of each other.
B.25.4 Concept: below-knee amputations
B.26 Nausea
B.26.1 Cohort Entry Events
People enter the cohort when observing any of the following:
condition occurrences of ‘[LEGEND HTN] Nausea’.
B.26.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 1 day.
B.26.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 30 days of each other.
B.26.4 Concept: [LEGEND HTN] Nausea
B.27 Peripheral edema
B.27.1 Cohort Entry Events
People enter the cohort when observing any of the following:
condition occurrences of ‘Edema’.
B.27.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 1 day.
B.27.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 180 days of each other.
B.27.4 Concept: Edema
B.28 Photosensitivity
B.28.1 Cohort Entry Events
People enter the cohort when observing any of the following:
condition occurrences of ‘Photosensitivity’.
B.28.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 1 day.
B.28.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 90 days of each other.
B.28.4 Concept: Photosensitivity
B.29 Renal cancer
B.29.1 Cohort Entry Events
People with continuous observation of 365 days before event enter the cohort when observing any of the following:
condition occurrence of ‘Primary malignant neoplasm of kidney’ for the first time in the person’s history.
Limit cohort entry events to the earliest event per person.
B.29.2 Cohort Exit
The person also exists the cohort at the end of continuous observation.
B.29.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 0 days of each other.
B.29.4 Concept: Primary malignant neoplasm of kidney
B.30 Thyroid tumor
B.30.1 Cohort Entry Events
People with continuous observation of 365 days before event enter the cohort when observing any of the following:
condition occurrence of ‘Neoplasm of thyroid gland’ for the first time in the person’s history.
Limit cohort entry events to the earliest event per person.
B.30.2 Cohort Exit
The person also exists the cohort at the end of continuous observation.
B.30.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 0 days of each other.
B.30.4 Concept: Neoplasm of thyroid gland
B.31 Venous thromboembolism
B.31.1 Cohort Entry Events
People enter the cohort when observing any of the following:
condition occurrences of ‘[LEGEND HTN] Venous thromboembolism (pulmonary embolism and deep vein thrombosis)’.
B.31.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 1 day.
B.31.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 180 days of each other.
B.31.4 Concept: [LEGEND HTN] Venous thromboembolism (pulmonary embolism and deep vein thrombosis)
B.32 Vomiting
B.32.1 Cohort Entry Events
People enter the cohort when observing any of the following:
condition occurrences of ‘[LEGEND HTN] Vomiting’.
B.32.2 Cohort Exit
The cohort end date will be offset from index event’s start date plus 1 day.
B.32.3 Cohort Eras
Entry events will be combined into cohort eras if they are within 30 days of each other.
B.32.4 Concept: [LEGEND HTN] Vomiting
C Negative Control Concepts
Table 72: Negative outcome controls specified through condition occurrences that map to (a descendent of) the indicated concept ID
List of Abbreviations
- CDM
- Common data model
- DPP4
- Dipeptidyl peptidase-4
- GLP1
- Glucagon-like peptide-1
- IRB
- Institutional review board
- LEGEND
- Large-scale Evidence Generation and Evaluation across a Network of Databases
- MACE
- Major adverse cardiovascular event
- MDRR
- Minimum detectable risk ratio
- OHDSI
- Observational Health Data Science and Informatics
- OMOP
- Observational Medical Outcomes Partnership
- PS
- Propensity score
- RCT
- Randomized controlled trial
- SGLT2
- Sodium-glucose co-transporter-2
- T2DM
- Type 2 diabetes mellitus
References
- 1.↵
- 2.↵
- 3.↵
- 4.
- 5.
- 6.↵
- 7.↵
- 8.
- 9.
- 10.↵
- 11.↵
- 12.↵
- 13.
- 14.↵
- 15.↵
- 16.↵
- 17.↵
- 18.
- 19.
- 20.
- 21.↵
- 22.↵
- 23.↵
- 24.
- 25.↵
- 26.↵
- 27.
- 28.↵
- 29.↵
- 30.↵
- 31.↵
- 32.↵
- 33.↵
- 34.↵
- 35.↵
- 36.↵
- 37.↵
- 38.↵
- 39.↵
- 40.↵
- 41.↵
- 42.↵
- 43.↵
- 44.↵
- 45.
- 46.
- 47.
- 48.↵
- 49.
- 50.
- 51.
- 52.
- 53.
- 54.
- 55.
- 56.
- 57.
- 58.
- 59.
- 60.
- 61.
- 62.
- 63.
- 64.
- 65.
- 66.
- 67.
- 68.
- 69.
- 70.
- 71.
- 72.
- 73.
- 74.
- 75.
- 76.
- 77.
- 78.
- 79.
- 80.
- 81.
- 82.
- 83.
- 84.
- 85.
- 86.
- 87.
- 88.
- 89.
- 90.
- 91.
- 92.
- 93.
- 94.
- 95.
- 96.
- 97.
- 98.
- 99.
- 100.
- 101.↵
- 102.↵
- 103.↵
- 104.↵
- 105.↵
- 106.↵
- 107.↵
- 108.↵
- 109.↵
- 110.↵
- 111.↵
- 112.↵
- 113.↵
- 114.↵
- 115.
- 116.↵
- 117.↵
- 118.↵
- 119.↵
- 120.↵
- 121.↵
- 122.↵
- 123.↵
