Abstract
Background Ciprofloxacin is a widely used antibiotic that has lost efficiency due to extensive resistance. We developed machine learning (ML) models that predict the probability of ciprofloxacin resistance in hospitalized patients.
Methods Data were collected from electronic records of hospitalized patients with positive bacterial cultures, during 2016-2019. Susceptibility results to ciprofloxacin (n=10,053 cultures) were obtained for E. coli, K. pneumoniae, M. morganii, P.aeruginosa, P. mirabilis and S. aureus. An ensemble model, combining several base models, was developed to predict ciprofloxacin resistant cultures, either with (gnostic) or without (agnostic) information on the infecting bacterial species.
Results The ensemble models’ predictions were well-calibrated, and yielded ROC-AUCs (area under the receiver operating characteristic curve) of 0.763 (95%CI 0.634-0.785) and 0.849 (95%CI 0.799-0.921) on independent test-sets for the agnostic and gnostic datasets, respectively. Shapley additive explanations analysis identified that influential variables were related to resistance of previous infections, where patients arrived from (hospital, nursing home, etc.), sex, and recent resistance frequencies in the hospital. A decision curve analysis revealed that implementing our models can be beneficial in a wide range of cost-benefits considerations of ciprofloxacin administration.
Conclusions This study develops ML models to predict ciprofloxacin resistance in hospitalized patients. The models achieved high predictive ability, were well calibrated, had substantial net-benefit across a wide range of conditions, and relied on predictors consistent with the literature. This is a further step on the way to inclusion of ML decision support systems into clinical practice.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
This study was supported by the Israel Science Foundation (ISF 1286/21).
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
The study was approved by the Institutional Review Board (Helsinki) Committee of Meir Medical Center.
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Data Availability
Data are proprietary but can be made available upon reasonable request from the authors.
