Generation of Risk Score for Serious Non-Steroidal Anti-Inflammatory Drug (NSAID) Induced Cardiovascular Events (NAÏVE) among Active-Duty Service Members and Veterans

Study Design and Data Source

A retrospective nested case-control of the DAVINCI (Data Analysis and Visualization Initiative) data was leveraged to develop the risk scores for cardiovascular events.

DAVINCI is a collaborative effort between the Department of Defense (DoD) and the Veterans Health Administration (VHA) within the Department of Veterans Affairs (VA) in the US.³⁴ The DAVINCI database integrates and analyzes various types of health data, including electronic health records (EHRs), administrative data, and clinical data from both the DoD and the VA using Observational Medical Outcomes Partnership (OMOP) common data models. The clinical records include information regarding healthcare visits, conditions, dispensed drugs, and procedures in both the inpatient and outpatient settings.

Study Cohort

The study utilized the same derived cohort from the DAVINCI database as a previous study that identified factors associated with the cardiovascular events.³³ More specifically, the study cohort consisted of individuals with at least one NSAID pharmacy claim with a days’ supply greater than 7 days between October 1, 2016 and September 30, 2020 and excluded individuals under the age of 18, with missing sex, or missing race variables. The authors determined that a 7 days’ supply requirement balances competing priorities to remove short-term prescriptions while recognizing that previous studies indicated that CV risk may be significant within the first 30 days. A total of 4,408,315 individuals were identified in the dataset with at least one NSAID pharmacy claim. Of these, 231,967 individuals were identified as cases. Cases were defined as individuals who experienced a cardiovascular event. A cardiovascular event included a non-fatal myocardial infarction, non-fatal stroke, and new onset of heart failure and was defined using International Classification of Disease, 10^th Revision, Clinical Modification (ICD10-CM) codes. Ten control patients were randomly assigned to each case and assigned the index date of the assigned case.^35,36 To ensure that included individuals were regular users of TRICARE or VHA health services, individuals were required to have a recorded encounter in the 180 to 365 days prior to their identified or assigned index date. The study cohort consisted of 231,967 cases and 2,319,670 controls.

Covariates and Outcomes

The first occurrence of a cardiovascular event, as defined by ICD-10 codes was the primary outcome of interest. Independent variables considered for the risk score were demographic, clinical, and prescription-related variables. Demographic variables were age, sex, and race. Comorbidity measures included diabetes², hypertension², dyslipidemia², history of myocardial infarctions¹, arthritis or spondylitis³⁷, peripheral artery disease², chronic kidney disease¹, atherothrombotic disease¹, history of tobacco use², cerebrovascular disease², coronary artery disease², cardiomyopathy¹, obstructive sleep apnea (OSA)¹, liver dysfunction¹, and chronic obstructive pulmonary disease (COPD).¹ Prescription use measures included the use of aspirin and other anticoagulants. NSAID-specific drug information included NSAID selectivity (Cox 1, Cox 2, and non-selective),^5,10,14,38 dosage (low/medium and high dose),^10,13,14,39 and time since initial exposure (≤30, 31-90, 91+ and no exposure).^6,13,14,39 Independent variables were collected in the 180 days prior to the index date.

Statistical Analyses

The sample was characterized using descriptive statistics. Continuous variables were summarized using means and interquartile ranges and compared between cases and controls using t-tests. Categorical variables were summarized using frequencies and proportions. Categorical variables between cases and controls were compared using Chi-square tests.

Similar to other risk development protocols, multivariable logistic regression was performed to identify potential predictors of cardiovascular events.^40,41 All independent variables were included in the model. Variables with a p-value greater than 0.10 were removed from the model unless they were statistically identified as confounders.

Confounders were determined as variables whose removal from the model led to a 20% or greater change in parameter estimates for one or more of the other variables, compared to the original model. The final model included confounders and all variables with a p-value of 0.10 or less.

Risk Index Construction

The items to be included in the final index were chosen based on the statistical significance of their association with cardiovascular events in the logistic regression model, to strengthen the usability of the risk score and the practical need for a concise instrument that can be easily administered by healthcare professionals. To balance the scientific and statistical considerations of each variable, the following were considered during the risk score item selection process including the strength of association, confirmation of the variable as a risk factor in published literature, generalizability to the population, and the feasibility of obtaining valid and reliable information for each item in the risk score.

Point values for each of the risk questionnaire items were calculated by multiplying the β coefficients generated from regression analysis by 10 and rounding to the nearest integer. The calculated risk index scores were used in a multiple logistic regression model to predict probabilities of experiencing the outcome of a cardiovascular event.

Receiver operating curves (ROC) and corresponding C-statistics were utilized to determine the model’s discrimination ability between individuals with and without the outcome of interest.⁴²

To validate the risk index, the generated predicted probabilities were separated into deciles. Ten risk classes were created based on the observed occurrence of cardiovascular events. The number of patients, the average predicted probability of the outcome, and observed incidence of events were calculated for each risk class. All statistical analyses were performed using R. This study followed the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) reporting guideline.⁴³ This study was determined to be exempt by the Defense Health Agency Institutional Review Board.

Descriptive Statistics

Baseline characteristics, including demographics (age, race, and sex), predefined risk factors (comorbidities), prescription drug information (including NSAID-related factors), and time since NSAID exposure are shown in Table 1. As described in Forbes et al, unadjusted analyses showed that cases of nonsteroidal anti-inflammatory drug-induced cardiovascular events (NAÏVE) were more likely to be older, non-white or black, male sex, and have a greater burden of illness as indicated by the number of comorbidities.³³ Additionally, cases had higher numbers of previous cardiovascular events (history of myocardial infarction and cerebrovascular accidents). Cases were more frequently prescribed other potentially relevant medications including aspirin and anticoagulants than controls. Lastly, low/medium dose NSAIDs were prescribed more in both cases and controls compared to high-dose NSAIDs.

Multivariable Modeling

The logistic regression model for the primary outcome of NSAID-related composite cardiovascular event of myocardial infarction, nonfatal cerebrovascular accident, and new heart failure resulted in multiple, independent, statistically significant associations.³³ Of note, “History of heart failure” was removed from the predefined risk factors as there were only 10 cases of prior heart failure despite the large sample size.

High-dose NSAID use was the only independent variable excluded from multivariable regression modeling due to P>0.10 on bivariate analysis. Demographic variables associated with higher odds of nonsteroidal anti-inflammatory drug-induced cardiovascular events (NAÏVE) included age 45-54 (OR 5.69, 95% CI 5.49, 5.89), 55-64 (OR 9.72, 95% CI 9.39, 10.05), 65-74 (OR 12.35, 95% CI 11.94, 12.79), and 75 and older (OR 20.04, 95% CI 19.35, 20.77). Multiple predefined risk factors were associated with an event including: cerebrovascular disease (OR 5.04, CI 95% 4.95, 5.13), cardiomyopathy (OR 2.70, 95% CI 2.63, 2.78), history of myocardial infarction (OR 2.07, 95% CI 2.01, 2.13), coronary artery disease (OR 1.77, 95% CI 1.75, 1.80), COPD (OR 1.61, 95% CI 1.59, 1.63), and hypertension (OR 1.57, 95% CI 1.55, 1.59).

NSAID exposure was the NSAID-specific risk factor with the strongest association to NAÏVE and the highest likelihood peaking after 31-90 days of exposure (OR 9.54, 95% CI 9.15, 9.96), followed by less than 30 days (OR 8.97, 95% CI 8.58, 9.37), and 91-180 days (OR 8.69, 95% CI 8.33, 9.07) with a continued trend of slowly declining risk with longer term exposure. Medication-related risk factors associated with higher odds of the outcome were aspirin (OR 1.71, 95% CI 1.69, 1.73) and other anticoagulants (OR 2.58, 95% CI 2.53, 2.62).³³ The odds ratios of secondary outcomes are summarized in Appendix Table 1.

NAÏVE Risk Index Score

Table 3 shows the risk index items retained from the statistically significant predictors in the final model, and their corresponding assigned point values. Several statistically significant items in the final model were excluded in the final risk score due to lack of clinical significance, and overall impact on model simplicity and accuracy.

Demographics excluded from the final risk score were sex and race. Predefined risk factors (comorbidities) excluded were history of heart failure, obstructive sleep apnea (OSA), dyslipidemia, peripheral arterial disease, and arthritis/spondylosis. Excluded NSAID specific factors were COX selectivity and dose.

Table 4 presents risk classes by deciles of predicted probability of NAÏVE and the corresponding observed incidence. Based on risk factors present/absent during the past 12 months before the index date of the NAÏVE event, the predicted probability of a cardiovascular event ranged from 3% in the lowest risk class to 93% in the highest, and the observed incidence of NAIVE increased commensurately. The risk class model’s C-statistic was 0.88 and Hosmer-Lemeshow goodness-of-fit statistic 1723 (P<0.001), indicating very good calibration and discrimination between patients with and without an event (Table 4).

Intended Use and Interpretation of Results

The NAÏVE risk scoring tool requires responding to 13 items divided into 4 sections that include factors well documented in the literature as predictors of cardiovascular events. They comprise the risk factors most strongly associated with NAÏVE including age, NSAID exposure, predefined comorbidities, concomitant prescribed medications, and previous cardiovascular events. The NAÏVE risk scoring tool supports but does not replace the health care provider’s judgement in clinical decision-making and provides the basis for transparent conversations and shared decision-making regarding CV risk associated with NSAID use.

The intent of developing the NAÏVE screening tool is to assist health care professionals who are considering prescribing NSAIDs, to assess a patient’s baseline risk or re-evaluate current risk of non-steroidal anti-inflammatory drug-induced cardiovascular events (NAÏVE). Due to its reliance on readily available demographic, medical diagnosis codes, and prescription information in the electronic health record, the NAÏVE screening tool can be easily incorporated into automated clinical decision support tools, dashboards, and artificial intelligence driven health care initiatives for easier adoption and implementation to improve quality of care and efficiency for busy providers. It also can be employed periodically during ongoing treatment to reevaluate risk based on changes in a patient’s clinical condition or medication regimen. Explaining a NAÏVE score to a patient creates an opportunity to discuss the benefits and risks associated with the use of NSAIDs. For example, the provider may begin a discussion with, “Patients with risk scores similar to yours (e.g., 61 points) “were predicted to have X% chance (e.g., 26%) “of experiencing a cardiovascular event such as heart attack, stroke, or develop heart failure.” “This can occur quickly with the highest risk within the first 90 days of treatment. While NSAIDs are first-line treatment and may be effective for your condition, we should consider these potential risks and discuss alternatives.”

Strengths and Limitations

NAÏVE was developed using extensive administrative health care data in the U.S. VHA/DoD population. Limitations inherent to observational studies using administrative data include: 1) medical coding errors/misclassification of comorbidities and previous cardiovascular events; 2) lack of data on patient adherence to prescribed medications or utilization of over-the-counter (OTC) medications including NSAIDs; 3) potentially relevant family history or demographics. In addition, while our VHA/DoD cohort had a significant number of younger patients, women were less represented than the general population and the study sample might not accurately reflect the broader U.S. population of users of prescription NSAIDs. As such, the predictive ability of NAÏVE, like other tools derived from observational data, is subject to residual confounding by currently unknown or excluded contributory factors.

The final risk index score does not include all known risk factors, such as family history of cardiovascular events. In addition, some variables associated with an event in the VHA/DoD sample were excluded because they were either not clinically significant or did not contribute in a meaningful way to the predicted probability of cardiovascular events and the priority to simplify the model.

Implications for Future Research

While NAÏVE performed well in the VHA and DoD patient populations, it should be assessed and further validated in a separate population that is more representative of U.S. users of prescription NSAIDs. NAÏVE will also benefit from prospective reliability and validity testing across a broad spectrum of patients. NAÏVE can be formatted for electronic administration via Web or mobile platform to improve its real-world deployment by enabling automated risk scoring, and calculation of risk class.