RT Journal Article SR Electronic T1 Development and validation of multivariable prediction models for adverse COVID-19 outcomes in IBD patients JF medRxiv FD Cold Spring Harbor Laboratory Press SP 2021.01.15.21249889 DO 10.1101/2021.01.15.21249889 A1 John Sperger A1 Kushal S. Shah A1 Minxin Lu A1 Xian Zhang A1 Ryan C. Ungaro A1 Erica J. Brenner A1 Manasi Agrawal A1 Jean-Frederic Colombel A1 Michael D. Kappelman A1 Michael R. Kosorok YR 2021 UL http://medrxiv.org/content/early/2021/01/20/2021.01.15.21249889.abstract AB Importance Risk calculators can facilitate shared medical decision-making1. Demographics, comorbidities, medication use, geographic region, and other factors may increase the risk for COVID-19-related complications among patients with IBD2,3.Objectives Develop an individualized prognostic risk prediction tool for predicting the probability of adverse COVID-19 outcomes in patients with IBD.Design, Setting, and Participants This study developed and validated prognostic penalized logistic regression models4 using reports to Surveillance Epidemiology of Coronavirus Under Research Exclusion for Inflammatory Bowel Disease (SECURE-IBD) from March–October 2020. Model development was done using a training data set (85% of cases reported March 13 – September 15, 2020), and model validation was conducted using a test data set (the remaining 15% of cases plus all cases reported September 16–October 20, 2020).Main Outcomes and Measures COVID-19 related:Hospitalization+: composite outcome of hospitalization, ICU admission, mechanical ventilation, or deathICU+: composite outcome of ICU admission, mechanical ventilation, or deathDeathWe assessed the resulting models’ discrimination using the area under the curve (AUC) of the receiver-operator characteristic (ROC) curves and reported the corresponding 95% confidence intervals (CIs).Results We included 2709 cases from 59 countries (mean age 41.2 years [s.d. 18], 50.2% male). A total of 633 (24%) were hospitalized, 137 (5%) were admitted to the ICU or intubated, and 69 (3%) died. 2009 patients comprised the training set and 700 the test set.The models demonstrated excellent discrimination, with a test set AUC (95% CI) of 0.79 (0.75, 0.83) for Hospitalization+, 0.88 (0.82, 0.95) for ICU+, and 0.94 (0.89, 0.99) for Death. Age, comorbidities, corticosteroid use, and male gender were associated with higher risk of death, while use of biologic therapies was associated with a lower risk.Conclusions and Relevance Prognostic models can effectively predict who is at higher risk for COVID-19-related adverse outcomes in a population of IBD patients. A free online risk calculator (https://covidibd.org/covid-19-risk-calculator/) is available for healthcare providers to facilitate discussion of risks due to COVID-19 with IBD patients. The tool numerically and visually summarizes the patient’s probabilities of adverse outcomes and associated CIs. Helping physicians identify their highest-risk patients will be important in the coming months as cases rise in the US and worldwide. This tool can also serve as a model for risk stratification in other chronic diseases.Question How well can a multivariable risk model predict the risk of hospitalization, intensive care unit (ICU) stay, or death due to COVID-19 in patients with inflammatory bowel disease (IBD)?Findings Multivariable prediction models developed using data from an international voluntary registry of IBD patients and available for use online (https://covidibd.org/) have very good discrimination for predicting hospitalization (Test set AUC 0.79) and excellent discrimination for ICU admission (Test set AUC 0.88) and death (Test set AUC 0.94). The models were developed with a training sample of 2009 cases and validated in an independent test sample of 700 cases comprised of a random sub-sample of cases and all cases entered in the registry during a one-month period after model development.Meaning This risk prediction model may serve as an effective tool for healthcare providers to facilitate conversations about COVID-19-related risks with IBD patients.Competing Interest StatementJohn Sperger, Kushal S. Shah, Minxin Lu, Xian Zhang, Erica J. Brenner, Manasi Agrawal, and Michael R. Kosorok report no conflicts of interest. RCU has served as a consultant and/or advisory board member for Bristol Myers Squibb, Eli Lilly, Janssen, Pfizer, and Takeda. He has received research support from AbbVie, Boehringer Ingelheim, and Pfizer. He is supported by a Career Development Award from the National Institutes of Health (K23KD111995興01A1). JFC reports receiving research grants from AbbVie, Janssen Pharmaceuticals and Takeda; receiving payment for lectures from AbbVie, Amgen, Allergan, Inc. Ferring Pharmaceuticals, Shire, and Takeda; receiving consulting fees from AbbVie, Amgen, Arena Pharmaceuticals, Boehringer Ingelheim, Celgene Corporation, Celltrion, Eli Lilly, Enterome, Ferring Pharmaceuticals, Genentech, Janssen Pharmaceuticals, Landos, Ipsen, Medimmune, Merck, Novartis, Pfizer, Shire, Takeda, Tigenix, Viela bio; and hold stock options in Intestinal Biotech Development and Genfit. MDK has consulted for Abbvie, Janssen, Pfizer, and Takeda, is a shareholder in Johnson & Johnson, and has received research support from Pfizer, Takeda, Janssen, Abbvie, Lilly, Genentech, Boehringer Ingelheim, Bristol Myers Squibb, Celtrion, and Arenapharm.Funding StatementThis work was funded by the Helmsley Charitable Trust (2003-04445), National Center for Advancing Translational Sciences (UL1TR002489), a T32DK007634 (EJB), and a K23KD111995-01A1 (RCU). Additional funding was provided by Pfizer, Takeda, Janssen, Abbvie, Eli Lilly, Genentech, Boehringer Ingelheim, Bristol Myers Squibb, Celltrion, and Arenapharm.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The UNC-Chapel Hill Office for Ethics has determined that the storage and analysis of de-identified data do not constitute human subject research (SOP 4201 https://unc.policystat.com/policy/5160241/latest/) as defined under [45 CFR 46.102 and 21 CFR 56.102] and do not require IRB approval.All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesWe are committed to sharing our data with the international research community. Data requests are reviewed by our SECURE-IBD team including the International Advisory Committee to ensure data will be used in a scientifically and ethically sound way. The data request form and additional information can be found online at https://covidibd.org/sharing-secure-ibd-data/