Abstract
Importance The Agatston score is a measure of cardiovascular disease traditionally calculated on cardiac gated computed tomography (CT) of the chest. Cardiac gated CT is resource-intensive, can be hard to access, and involves extra radiation exposure. Artificial intelligence (AI) can be used to opportunistically calculate Agatston score on non-gated CTs performed for other indications.
Objective This study compared the accuracy of an AI model (Riverain Technologies ClearRead CT CAC) at calculating Agatston scores on non-gated CTs to both consensus radiologist interpretations on the same CTs and Agatston scores from paired cardiac gated CTs.
Design A retrospective standalone performance assessment was conducted on a dataset of non-contrast CT chest cases acquired between January 2022 and December 2023.
Setting The study was conducted at five hospitals in the United States.
Participants The cohort included non-gated CTs from 491 patients. It was enriched to ensure a representation of disease severity by selecting approximately two-thirds of patients using the originally reported Agatston score on a paired cardiac gated CT within the study timeframe.
Main Outcome(s) and Measure(s) The study compared the agreement of Agatston categories (0, 1-99, 100-399 and ≥400) between the AI model and ground truth radiologists or original radiology reports using the quadratic weighted Kappa coefficient.
Exposure(s) Each non-gated CT case was interpreted independently by three radiologists to establish consensus interpretations. Each CT was then interpreted by the AI model. The Agatston scores for paired cardiac gated CTs were obtained from original radiology reports.
Results The agreement between the AI model and ground truth radiologists was 0.959 (95% CI: 0.943-0.975). This result was broadly consistent across sex, age group, race, ethnicity and CT scanner manufacturer subgroups. The agreement between the AI model and paired cardiac gated CT was 0.906 (95% CI: 0.882-0.927).
Conclusions and Relevance The assessed AI model accurately calculated Agatston scores on non-gated CTs and produced similar scores to paired cardiac gated CTs. Its use could broaden screening for atherosclerotic cardiovascular disease, enabling opportunistic screening on CTs captured for other indications.
Competing Interest Statement
Source of Funding This study was funded by Riverain Technologies. Riverain Technologies was involved in the design and conduct of the study; preparation, review, and approval of the manuscript; and decision to submit the manuscript for publication. Riverain Technologies was not involved in the collection, management, analysis, and interpretation of the data. Disclosures Authors are employees of Mass General Brigham and/or Massachusetts General Hospital, which had received institutional funding from Riverain Technologies for the study.
Funding Statement
This study was funded by Riverain Technologies. Riverain Technologies was involved in the design and conduct of the study; preparation, review, and approval of the manuscript; and decision to submit the manuscript for publication. Riverain Technologies was not involved in the collection, management, analysis, and interpretation of the data.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
This study was approved by the Mass General Brigham Institutional Review Board with a waiver of informed consent and ethical approval.
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
Data Availability
Data is not publicly available as it contains Protected Health Information (PHI). We do not have IRB approval for public data-sharing.
