Development and validation of artificial intelligence-based algorithms for predicting the segments debulked by rotational atherectomy using intravascular ultrasound

Study population

IVUS data from patients with de novo severely calcified coronary lesions who underwent IVUS-guided RA at five centers were consecutively collected from July 2016 to October 2021. IVUS imaging data were acquired using a VISICUBE IVUS imaging system with a 60-MHz mechanically rotating IVUS catheter (AltaView^TM, Terumo, Tokyo, Japan). The criteria for lesion selection were as follows: (i) lesions located in the left anterior descending coronary artery (LAD), (ii) lesions with severe calcifications that were defined as radiopacities when observed without cardiac motion before contrast injection(12), (iii) IVUS examination performed before any intervention and immediately after RA, and (iv) the RA burr size was selected as 1.5 or 1.75 mm. The exclusion criteria were a diagnosis of acute coronary syndrome, in-stent restenosis, a branch lesion, left main narrowing >50%, and any balloon dilation before post-RA IVUS. The protocol for the retrospective data analysis was approved by our Institutional Review Board (2021252). The need for informed consent was waived because IVUS images were acquired during daily clinical practice from patients who consented to the comprehensive research use of their data. All the patients were guaranteed the opportunity to opt out of the study.

RA and IVUS procedures

RA was performed under local anesthesia via the radial or femoral approach using a 6 or 7-Fr guiding catheter. After crossing the lesion with a 0.014-inch conventional guidewire, an IVUS image was obtained before any coronary intervention. The IVUS catheter was inserted into each coronary artery as distally as possible, and an imaging run was performed back to the aorto-ostial junction using an automated transducer pullback system. The decision to perform RA at each center was based on a clinical expert consensus document(8). Following the IVUS examination, the 0.014-inch conventional guidewire was exchanged with a 0.009-inch RotaWire floppy or RotaWire extra support guidewire (Boston Scientific, Marlborough, MA, USA) using a microcatheter. Each operator chose the guidewire and burr size for RA based on same document above(8). After the burr passed the lesion, it was removed using the Dynaglide mode. IVUS examinations were repeated immediately after RA in a manner similar to the pre-RA IVUS in all cases.

IVUS segmentation

Preprocedural IVUS images were reviewed carefully to identify the cross-section with the minimum lumen area (MLA). IVUS analyses were conducted at the MLA at 0.5-mm intervals from sites 10 mm proximal to 10 mm distal to the MLA site. Cross-sections with poor-quality IVUS images were excluded from the study. The lumen contour was manually traced in every image frame, following a previously reported standard protocol(16,17) (Figure 1).

• Download figure
• Open in new tab

Figure 1. Analysis of IVUS images and creating ground truth labelling

(A) A pre-RA IVUS image. (B) Lumen contour on image A drawn by dedicated software. (C) A post-RA IVUS image matched with image A. (D) Lumen contour on image C. (E) A merged image of pre-RA IVUS image B and post-RA IVUS image D by the software. A debulked segment is identified by calculating the post-RA lumen area minus the pre-RA lumen area (green area). (F) The orientation of the debulked segments on the merged images. (G) The ground truth image shows the debulked segments’ orientation on the IVUS image’s outer circle.

IVUS: intravascular ultrasound; RA: rotational atherectomy

Serial IVUS images taken before and immediately after RA were reviewed in parallel on the screen. The analyzed cross-sections were co-registered frame-by-frame based on the distance from landmarks, such as side branches or the site of calcification, following the same method of previous IVUS studies(12,18). The spatial axes of the two matched IVUS cross-sectional images were aligned and merged using dedicated software (ImageJ, NIH, Bethesda, MD, USA). The cross-section was considered to have a debulked region when the lumen area increased by >5% after RA, and the region with an enlarged lumen contained sharp traces of burr debulking on the post-RA IVUS image(12).

Ground truth labelling

The orientations of the debulked segments identified in the merged images are marked on the outer circle of each IVUS image. Ground truth images were created by merging the same marks into the pre-IVUS images (Figure 1). Image creation was performed by a cardiologist using the software mentioned above.

Model development

In our quest to further the capabilities of coronary artery imaging, we aimed to develop a deep-learning model capable of using IVUS images of coronary arteries to predict regions of excavation by the RA. The unique circular structure of the coronary arteries was utilized in our design. To achieve this, we partitioned the structure into 36 orientations, segmented every 10°. For each orientation, our model predicted whether a specific site would be debulked.

Another key feature of our model design is the continuity of the coronary arteries. Toward this end, the prediction for any slice n was obtained by incorporating images from slice n, one slice before (slice n−1), and one slice after (slice n+1), spaced 5 mm apart. We used three images to predict the excavation site for slice n more accurately. From an implementation perspective, our architecture connects 36 fully connected layers, each corresponding to one of the 36 orientations segmented every 10°, to a single feature extractor.

The model was trained such that the sum of the 36 individual loss values minimized the total loss. For our feature extractor, two architectures, ResNet [Deep Residual Learning for Image Recognition] and ConVNeXt [A ConvNet for the 2020s], were explored. Both employed pre-trained models from ImageNet and underwent fine-tuning. The Adam loss function was chosen for its optimization properties; data augmentation was implemented using RandAugment [Randaugment: Practical automated data augmentation with a reduced search space]. The model that achieved the smallest loss function value on the validation dataset (within 100 epochs) was selected as the best-performing model. The entire model was trained using the PyTorch framework [PyTorch: An Imperative Style, High-Performance Deep Learning Library]. Although our model was built from the ground up, it was inspired by and modified from the original source code available online (https://github.com/Medical-AI-Lab/Nervus) [Nervus: A Comprehensive DL Classification, Regression, and Prognostication Tool for both Medical Image and Clinical Data Analysis]. Specifically, the classifier from this codebase was adapted to accommodate the 36 orientations, which formed the foundation for our current model. A detailed model is shown in Figure 2; the source code is available online.

• Download figure
• Open in new tab

Figure 2. Overview of model development

In our model, the image of slice n and the images before (slice n−1) and after (slice n+1) are incorporated at 5-mm intervals. Using three input images, image information in the long-axis direction of the blood vessel is obtained, expecting to improve the prediction accuracy. ResNet is the base architecture for the proposed model because of its successful performance. Our architecture connects one feature extractor to 36 fully connected parallel layers (each layer corresponding to one of the 36 directions divided by 10°), which serve as classifiers. The 36 results and images of slice n are combined, and the deep-learning algorithm is coded so that they can be outputted.

Model test

The performance of the best-performing model was assessed on the validation and test datasets. Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and accuracy were used as primary metrics for evaluation. These metrics were presented as averages for each degree and image.

Statistical analysis

All statistical analyses of the model tests were performed using R version 4.0.0. For statistical inferences, we adopted a two-sided significance level of 5% and relied on the Clopper–Pearson method.

Data

The study analyzed 2460 cross-sections from 60 LAD lesions in 60 patients. Because the cross-sectional images were of low quality or cross-sectional images from slice n+1 (5 mm distal from the MLA site) and/or slice n-1 (5 mm proximal from the MLA site) were missing, 354 images were excluded. Consequently, 2106 cross-sections were segmented and labeled as the ground truth. Among these cross-sections, 1416 (67%) contained debulked regions; the remaining 690 (33%) did not. The images were divided into training (1649), validation (226), and test (231) datasets.

Model development

Upon evaluating the performances of various architectures, we found that ResNet had superior accuracy and efficiency. Its sophisticated design and deep layers demonstrate a distinct advantage, making it the leading choice for our artificial intelligence model for predicting debulked regions from pre-RA IVUS images of the coronary arteries. During this period, the model with the lowest loss in the validation data was considered the best-performing model. The model was developed using the training and validation datasets.

Diagnostic performance of our artificial intelligence model

The best-performing model was evaluated using test datasets. In each cross-sectional analysis, our artificial intelligence model achieved an average sensitivity, specificity, PPV, NPV, and accuracy of 81%, 72%, 46%, 90%, and 75%, respectively. Table 1 shows the 10°-wise performances for predicting the region debulked by RA. In the 10°-wise analysis, no significant difference was found in diagnostic accuracy among the individual 10° regions. A representative image of the proposed model is shown in Figure 3.

• Download figure
• Open in new tab

Figure 3. Representative image of model test

The diagnostic performance of our model is evaluated based on the agreement rate between the debulking angle predicted by the model and the debulking angle of the ground truth. It is evaluated using 457 datasets allocated as validation and testing datasets. Here, we present a representative case with acceptable test results.

Limitation

This study had some limitations. First, our artificial intelligence model was developed and validated only for the LAD and did not support the right coronary and left circumflex arteries. Second, observing lesions using IVUS before RA is essential for applying our results in routine clinical practice. However, the IVUS imaging catheter may not be advanced beyond severely calcified lesions that require RA. Third, the model was developed from IVUS images of cases using RA-burr sizes of 1.5 and 1.75 mm; the diagnostic accuracy when using other burr sizes is unknown. Fourth, the wire used during IVUS differed from that used during RA.

Clinical Competencies

Although rotational atherectomy is a useful technique for severely calcified lesions, patients undergoing RA show a greater incidence of catastrophic complications, such as coronary perforation. Therefore, we have empirically predicted the segment where the atherectomy burr debulked from intravascular ultrasound images, but the diagnostic accuracy of human experience-based prediction is low.

Translational Outlook

Although the diagnostic accuracy was high, the positive predictive value was insufficient. This model needs to be tested prospectively in real clinical cases to investigate its impact on clinical practice in the field of coronary intervention.