Abstract
Background Primary immunodeficiency diseases represent an expanding set of heterogeneous conditions which are difficult to recognize clinically. Diagnostic rates outside of the newborn period have not changed appreciably. This concern underscores a need for novel methods of disease detection.
Objective We built an artificial intelligence model to provide real-time risk assessment about primary immunodeficiency and to facilitate prescriptive analytics for initiating the most appropriate diagnostic work up. Our goal is to improve diagnostic rates for primary immunodeficiency and shorten time to diagnosis.
Methods We extracted data from the Texas Children’s Hospital electronic health record on a large population of primary immunodeficiency patients (n = 1762) and age-matched set of controls (n = 1698). From the cohorts, clinically relevant prior probabilities were calculated enabling construction of a Bayesian network probabilistic model. Our model was constructed with clinical-immunology domain expertise, trained on a balanced cohort of 100 cases-controls and validated on an unseen balanced cohort of 150 cases-controls. Performance was measured by area under the receiver operator characteristic curve (AUROC).
Results Our Bayesian network was accurate in classifying immunodeficiency patients from controls (AUROC = 0.945; p<0.0001) at a risk threshold of ≥6%. Additionally, the model was 89% accurate for categorizing validation cohort members into appropriate International Union of Immunological Societies diagnostic categories.
Conclusion Artificial intelligence methods can classify risk for primary immunodeficiency and guide management. Our Bayesian network enables highly accurate, objective decision making about risk and guides the user towards the appropriate diagnostic evaluation for patients with recurrent infections.
Competing Interest Statement
NLR received consulting fees for scientific advisory activities with Takeda Pharmaceuticals Horizon Therapeutics and CSL Behring. He also receives royalties from Wolters Kluwer for topic contribution to UpToDate. All other authors have nothing to disclose.
Funding Statement
This work was funded through a Translational Research Grant (Award No - 58293-I) by the Jeffrey Modell Foundation
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
This study was approved by the Baylor College of Medicine Institutional Review Board (H-38501). All patient data remained confidential and was retained in the Texas Childrens Hospital system.
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
↵† Dr. Motazedi was a resident at Baylor College of Medicine during the majority of her contribution to this work. Presently she is a fellow in training at The Massachusetts General Hospital.
Data Availability
Patient protected health information (PHI) is not available; however, all clinical data used to generate inference by the Bayesian network is available. Most relevant data from our study are included in the supplementary materials. Additional data availability may be made available from the corresponding author on reasonable request.
