Deep Learning in the prediction of Angiography-proven Severe Coronary Stenosis in Patients with Apparently Normal Electrocardiograms ==================================================================================================================================== * Zhengkai Xue * Shijia Geng * Shaohua Guo * Guanyu Mu * Bo Yu * Peng Wang * Sutao Hu * Weilun Xu * Yanhong Liu * Lei Yang * Huayue Tao * Kangyin Chen * Shenda Hong ## Abstract Patients with severe coronary artery stenosis may have apparently normal electrocardiograms (ECGs), making it difficult to detect the adverse health conditions during screening or physical examinations, resulting in them missing the optimal window of treatment. The goal of this study was to develop an artificial intelligence-based ECG model which can distinguish severe coronary stenosis (≥ 90%) from no or mild coronary stenosis (< 50%) in patients with apparently normal ECGs. Deep learning (DL) models trained from scratch with pre-trained parameters (transfer learning) were tested on ECG alone as well as on ECG along with clinical information (age, sex, hypertension, diabetes, dyslipidemia and smoking status). We also compared the performance of logistic regression for clinical information only and found that DL models trained from scratch with ECG alone can achieve a specificity of 0.746; however, they have low sensitivity, which is comparable to the performance of logistic regression with clinical data. Although adding clinical information to the ECG DL model trained from scratch can improve the sensitivity, it can reduce the specificity. Combining clinical information with the ECG transfer learning model provides the best performance, with a 0.847 AUC, 0.848 sensitivity, and 0.704 specificity. Keywords * electrocardiogram * coronary artery disease * artificial intelligence * deep learning * transfer learning ## 1 Introduction Coronary artery disease (CAD) is one of the most common cardiovascular diseases in the world and can cause severe life-threatening cardiovascular events such as acute myocardial infarction (MI), malignant arrhythmia, and heart failure [1, 2]. The timely treatment of CAD can improve the prognosis and reduce the incidence of adverse events and mortality. Given this, the early screening and diagnosis of CAD are of great significance. Coronary angiography (CAG) is the “gold standard” for the diagnosis of CAD; however, it cannot be used for screening since it is invasive, expensive and requires specialized equipment and personnel. Electrocardiogram (ECG), on the other hand, is a simple and easy test to perform and is widely used for the screening and diagnosis of heart diseases. However, ECG has low sensitivity and specificity in predicting coronary artery stenosis [3], especially in CAD patients without myocardial ischemia, which may appear normal or apparently normal (when neither the ECG machine’s automatic interpretation nor the doctor’s manual interpretation report significant abnormalities). Figure 1 shows two patients with apparently normal resting ECGs. Patient A’s CAG images show no obvious coronary lesions; however, Patient B’s CAG images reveal severe coronary stenosis, with about 95% stenosis in the distal part of the circumflex branch and about 80% stenosis in the middle part of the left anterior descending branch. In clinical practice, it is common for CAD patients with severe coronary stenosis to have only mild angina and apparently normal ECGs. This situation is extremely harmful because the patients’ conditions are not easily detected during routine physical examinations or screenings, and the best time for treatment may have been missed by the time severe symptoms appear. ![Figure 1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2022/11/29/2022.11.26.22282701/F1.medium.gif) [Figure 1:](http://medrxiv.org/content/early/2022/11/29/2022.11.26.22282701/F1) Figure 1: ECGs and CAG Images of Two Patients. Both patients have an apparently normal ECG. Patient A’s CAG images show no obvious coronary lesions; however, Patient B’s CAG images show severe coronary stenosis in both the circumflex branch and the left anterior descending branch (see red arrows). In recent years, methods using artificial intelligence (AI) have been developed for use in the field of cardiovascular studies [4], in which an ECG model based on deep learning (DL) is used in the diagnosis of arrhythmia [5, 6], cardiac systolic or diastolic dysfunction [7, 8], valvular heart disease [9], cardiomyopathy [10], predicting the risk of death [11], and so on [12]. For CAD, Leasure’s group developed a DL model to correlate ECGs with the results of CAG, to classify the severity and location of coronary artery stenosis [13]. Also, Huang and colleagues tested six well-known computer vision DL models to predict the location of obstructed coronary artery from ECG images [14]. The models developed by both groups obtained high sensitivity and high specificity. However, these studies do not emphasize ECG status and might include ECGs that show obvious abnormalities. The abnormalities could ease the model training and make the AI-model less powerful since doctors can find the problems by themselves without AI assistant. We carefully select apparently normal ECGs for our study with the aim of exploring the performances of DL models in identifying patients with severe (≥ 90%) stenosis versus no/mild (< 50%) stenosis. Our findings are as follows 1. DL models have the potential to predict patients with severe coronary stenosis with apparently normal ECGs. 2. DL model trained from scratch with ECG alone can achieve a specificity of 0.746; however, the sensitivity is low. The performance is similar to that of logistic regression of clinical information including age, gender, hypertension, diabetes, dyslipidemia, and smoking status. 3. Adding clinical information to the ECG DL model trained from scratch can improve the sensitivity; however, it drastically reduces the specificity. 4. Combining clinical information with the outputs of an existing ECG classification model (transfer learning) can achieve an accuracy of 0.750 with a sensitivity of 0.848 and specificity of 0.704 for identifying severe coronary artery stenosis. ## 2 Materials and Methods ### 2.1 Data sources Patients admitted to the Department of Cardiology at the Second Hospital of Tianjin Medical University from January 2019 to February 2021, who received at least one standard 12-lead ECG within 3 days before CAG were included in the study. The selection criteria were as follows: over 18 years of age; apparently normal ECG; no acute or old MI; no previous percutaneous coronary intervention (PCI) or coronary artery bypass grafting (CABG). We also collect data on age, gender, past medical history, smoking status, and results from laboratory testing. All clinical data were obtained with the informed consent of patients and approved by the hospital ethics committee. The summary of the clinical baseline characteristics for the whole dataset is shown in Table 1. View this table: [Table 1:](http://medrxiv.org/content/early/2022/11/29/2022.11.26.22282701/T1) Table 1: Baseline Characteristics for All Data A total of 392 patients were selected for the study, and each patient had a 10-second standard 12-lead ECG that was acquired using a Fukuda Denshi CardiMax FX-7402 ECG Machine. A professional cardiologist qualified for ECG diagnosis manually interpreted the ECG graphs printed out with 25mm/s paper speed and 10mm/mV voltage calibration. We decrypted and extracted raw ECG data that had a 500Hz sampling frequency using the EFS-200C software provided by the manufacturer. The summary of the ECG measurements is listed in Table 2. View this table: [Table 2:](http://medrxiv.org/content/early/2022/11/29/2022.11.26.22282701/T2) Table 2: ECG Measurements for All Data (*±* is for verified normally distributed data, (*−*) is the interquartile range for non-normally distributed data) Based on the CAG results, we classified coronary artery stenosis as severe (case group) and no/mild (control group) stenosis by visual inspection of lumen diameter. Severe stenosis was defined as ≥ 90% stenosis in at least one of the major coronary arteries or their major branches, and no/mild stenosis as < 50% stenosis in all major coronary arteries and their major branches. The CAG results were independently assessed and reported by two professional interventional cardiologists during the process with reference to computer-assisted quantitative coronary angiography (QCA) results, and the final degree of stenosis was determined with the agreement of the two physicians. The lesion information from CAG is shown in Table 3. Under the guidance of cardiologists, technicians labelled the ECGs with corresponding labels (0 for no/mild stenosis, and 1 for severe stenosis). View this table: [Table 3:](http://medrxiv.org/content/early/2022/11/29/2022.11.26.22282701/T3) Table 3: Lesion Information from CAG for All Data We randomly assigned the data into training and test sets in a ratio of approximately 3:1, and obtained 288 training examples and 104 test examples. The flow diagram for the overall data selection process is shown in Figure 2, and Table 4 lists the baseline characteristics for the training and test set, respectively. View this table: [Table 4:](http://medrxiv.org/content/early/2022/11/29/2022.11.26.22282701/T4) Table 4: Baseline Characteristics for Training and Test Set ![Figure 2:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2022/11/29/2022.11.26.22282701/F2.medium.gif) [Figure 2:](http://medrxiv.org/content/early/2022/11/29/2022.11.26.22282701/F2) Figure 2: Flow Diagram of the Criteria ### 2.2 Models In the study, we conducted experiments to differentiate the severity of coronary stenosis using ECGs based on a deep convolutional neuron network (CNN) structure verified to perform well on ECG-related tasks [15, 16, 17]. The input layer of the model structure contained 12 channels representing the 12 leads of the ECG, and each channel had 5000 data points that matched a 10-second recording with a sampling frequency of 500 Hz. The original output layer had 47 units corresponding to 47 ECG classes in the original classification task. To perform our task, we added a fully connected layer at the end with one output unit that produces the probability of severe coronary stenosis (1 - probability of no/mild coronary stenosis). With different inputs and training methods, we obtained four models: a model trained from scratch with ECG alone; a model trained from scratch with ECG and baseline features; a transfer learning model with ECG alone; and a transfer learning model with ECG and baseline features. Models training from scratch had random weights at the beginning and used the training data to optimize the cost function, which is the binary cross-entropy between the predicted stenosis probabilities and the actual labels. Transfer learning models borrowed the weights pre-trained from the ECG classification task, which presumably contained information on how to process and analyze ECG data, and further optimized the cost function using the training data based on these weights. We call the 47 features extracted from the original deep CNN model as “deep features”, and the details of the features are discussed in Section 4. For the models with additional baseline features, we added the six baseline characteristics of patients (age (normalized), gender (0 female; 1 male), hypertension (0 no; 1 yes), diabetes (0 no; 1 yes), dyslipidemia (0 no; 1 yes), smoking status (0 no; 1 yes)) on the second last layer to combine them with the 47 deep features, and fed the total of 53 features into the last fully-connected layer to obtain the final decision. We also conducted logistic regression on the baseline features alone to study the effects of baseline characteristics on severe coronary stenosis differentiation and verified the outcomes from the combination of deep and baseline features. All of the five experimental models are illustrated in Figure 3. ![Figure 3:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2022/11/29/2022.11.26.22282701/F3.medium.gif) [Figure 3:](http://medrxiv.org/content/early/2022/11/29/2022.11.26.22282701/F3) Figure 3: Diagram of Experimental Models ### 2.3 Evaluation Metrics After training, we calculated and reported the results metrics on the test data set, which included area under the curve (AUC), accuracy, precision, sensitivity, specificity, and F1-score. The AUC refers specifically to the area under the receiver operating characteristics (ROC) curve. A ROC curve plots the performance of a binary classification model at different threshold settings, and AUC represents the overall classification ability of the model. The x-axis of the ROC curve is the false positive rate (FPR), and the y-axis is the true positive rate (TPR). In our study, the false positive (FP) is the actual no/mild stenosis that is predicted as severe stenosis by the model, and the true positive (TP) is the number of actual severe stenosis that is predicted as severe stenosis. FPR is the ratio of FP to the total actual no/mild stenosis, which is the sum of FP and the true negative (TN), while TPR is the ratio of TP to the total actual severe stenosis, which is the sum of TP and the false negative (FN). We preferred a higher TPR as well as a lower FPR and selected a threshold that maximized the Youden’s Index (TPR - FPR). Based on this selected threshold, we calculated and reported the accuracy, precision, sensitivity, specificity, and F1-score. The equations used for the calculations are as follows: ![Formula][1] ![Formula][2] ![Formula][3] ![Formula][4] ![Formula][5] ## 3 Results With the testing data, we obtained the probabilities of severe coronary stenosis for each model. Figure 4 shows the ROC curves of all the models. The ECG and baseline features model with transfer learning gave the highest AUC (0.847), while other DL models had similar AUC (0.649 - 0.665). The logistic regression model for baseline features had an AUC of 0.717, which was the second highest value. ![Figure 4:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2022/11/29/2022.11.26.22282701/F4.medium.gif) [Figure 4:](http://medrxiv.org/content/early/2022/11/29/2022.11.26.22282701/F4) Figure 4: ROC Curves of All Models Table 5 shows the metrics of the test results for each model with the optimal threshold selected based on Youden Index. The ECG and baseline features model with transfer learning gave the best accuracy (0.750), precision (0.571) and F1-score (0.683) among the experimental models. The ECG and baseline features model trained from scratch had the highest sensitivity (0.909), while the ECG-only model trained from scratch had the highest specificity (0.746). The AUC, sensitivity, and specificity for each model are shown in Figure 3, and the normalized confusion matrices of the models based on the selected thresholds are shown in Figure 5. View this table: [Table 5:](http://medrxiv.org/content/early/2022/11/29/2022.11.26.22282701/T5) Table 5: Metrics of All Models (*±*95% CI) ![Figure 5:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2022/11/29/2022.11.26.22282701/F5.medium.gif) [Figure 5:](http://medrxiv.org/content/early/2022/11/29/2022.11.26.22282701/F5) Figure 5: Normalized Confusion Matrices of All Models We also conducted regression analysis on the baseline features and have presented theses results in Table 6. Age, hypertension and dyslipdemia have significant coefficients among all the baseline features. View this table: [Table 6:](http://medrxiv.org/content/early/2022/11/29/2022.11.26.22282701/T6) Table 6: Regression Analysis Results for Baseline Features ## 4 Discussion In the study, we investigated the feasibility of using DL techniques to distinguish between severe (≥90%) and no/mild (< 50%) coronary stenosis from apparently normal ECG. We discovered that with ECG alone, the DL model trained from random parameters can achieve a specificity of 0.746, the highest among all tested models. This suggests that the DL model trained from scratch can accurately identity no/mild stenosis conditions in the control group using ECG alone. However, its sensitivity was only 0.545, indicating that it might not perform well in predicting severe stenosis in the case group. We hypothesize that adding more features can improve the ability to identify severe cases, and by adding patients’ baseline characteristics (age, gender, hypertension, diabetes, dyslipidemia and smoking status), we greatly increased the sensitivity to 0.909. However, the specificity dropped to 0.423, which is the lowest among the experimental models. This might be due to the lack of training data, which causes a high bias for the prediction model. Therefore, we applied the transfer learning technology and fine-tuned the model based on parameters from an ECG classification task. With ECG-alone transfer learning model, we obtained an acceptable sensitivity of 0.667; however, the specificity was still relatively low (0.577). Finally, we tried the ECG and baseline features transfer learning model and obtained a relatively high specificity (0.704) as well as a a high sensitivity (0.848). By comparison, we also applied logistic regression on the baseline features alone and obtained an accuracy of 0.663 with a sensitivity of 0.545 and sensitivity of 0.718. The baseline characteristics selected (age, gender, hypertension, diabetes, dyslipdemia, smoking status) are generally accepted cardiovascular risk factors [18]. In Table 6, we have presented the analysis results for the risk factors from the logistic regression. Age, hypertension, and dyslipidemia had significant coefficients, which indicates that these three factors influence the discrimination of coronary stenosis severity. The logistic regression with baseline features had similar performances as that of the ECG-alone model trained from scratch, which was better than the ECG-alone transfer learning model. The reason may be that the ECG classification task and the coronary stenosis discrimination task are essentially different, and the model pre-trained for the ECC classification task may not capture the ECG characteristics that determine the severity of the stenosis. However, by adding the baseline features to the transfer learning model, we can correct the skewed information and achieve the highest performance among the experimental models. Similar to the results of logistic regression analysis for baseline features, we also report the results of deep features regression analysis in Table 7. We observed that among the deep features, PVC (Premature Ventricular Contraction), VT (Ventricular Tachycardia), AFL (Atrial Flutter), VE (Ventricular Escape), LVH (Left Ventricular Hypertrophy), RAH (Right Atrial Hypertrophy), PACED (Paced Rhythm), and PAUSE (Sinus Pause) have significant coefficients. It can be interpreted that these deep features are effective in identifying severe coronary stenosis. However, although corresponding to ECG classes, the deep features are intermediate features that cannot represent the diagnosis decisions on certain classes. Further research is required to explore the relationship between the pre-trained classification task and the stenosis discrimination task. For the time being, the ECG classes should only be treated as tags for the deep features and should not be overanalyzed. View this table: [Table 7:](http://medrxiv.org/content/early/2022/11/29/2022.11.26.22282701/T7) Table 7: Regression Analysis Results for Deep and Baseline Features In the previous AI-based CAD studies using CAG results as labels, the usual criterion for severe stenosis was *>* 70% lumen diameter stenosis [13, 14]. We selected 90% as the criterion for severe stenosis cases because the current guidelines specify that stenoses less than 90% are not necessarily functionally significant (i.e. they do not always induce myocardial ischaemia) [19]. The guidelines also suggest revascularization on lesions fractional flow reserve (FFR) *leq*0.8 which matches coronary stenosis ≥ 90% [20]. Therefore, predicting stenosis ≥90% can be used for identifying definite myocardial ischaemia and deciding whether to perform revascularization. Although some patients still have apparently normal ECGs when having ≥90% coronary stenosis, it is very likely that some specific changes related to ischemia have occurred that can be captured by DL models. Compared with other screening tests in medicine, such as the CHA2DS2-VASc score to assess stroke risk in patients with atrial fibrillation (0.57 0.72 AUC) [21], and brain natriuretic peptide (BNP) and N-terminal fragment of proBNP (NT-proBNP) for left ventricular dysfunction detection (AUC of 0.60 and 0.70, respectively) [22], our transfer learning DL model with ECG and baseline features achieved a higher performance with an AUC of 0.85 for distinguishing ≥ 90% coronary artery stenosis. There are some limitations of this study. First, as discussed, the amount of data collected in this study was relatively small, which would have affected the model performance. Larger amounts of data should be used in prospective studies to externally validate model performance and verify the effects of baseline features and transfer learning. Second, the CAG results involved in this study do not have sufficient details of coronary lesions, therefore, we could only determine the severity of the stenosis and not the location of the lesion and other relevant information. Finally, although visualization tools such as Gradient-weighted Class Activation Mapping (Grad-CAM) [23] provide intuitive ways to display the feature importance for CNNs, AI ECG models are still considered to be “black-boxes” that lack interpretability, especially professional medical explanations. In Figure 6, we show the Grad-CAM mapped ECG examples that are related to the second to last layer of the transfer learning model: A is a TN example; B is an FP example; C is an FN example; D is a TP example. For the control groups A and B, the model paid more attention around the T-P segment, while for the case groups C and D, redder areas appeared around the QRS complex. However, we need to explore more nuanced approaches relevant to medical interpretations. ![Figure 6:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2022/11/29/2022.11.26.22282701/F6.medium.gif) [Figure 6:](http://medrxiv.org/content/early/2022/11/29/2022.11.26.22282701/F6) Figure 6: Examples of Gradcam results ## 5 Conclusion Using apparently normal ECGs, we investigated the possibility of using DL technologies to distinguish severe coronary stenosis(≥ 90%) from no or mild coronary stenosis (< 50%). The manual readings of the selected ECGs do not show much evidence of the coronary stenosis status. Using a deep CNN trained completely with our labeled data, we could reach an accuracy of 0.683, which is higher than that achieved by cardiologists; however, the sensitivity was low. By combining the pre-trained ECG classification model parameters with patients’ baseline characteristics, we could achieve an accuracy of 0.750 with a sensitivity of 0.848 and specificity of 0.704. The findings are profound since they not only demonstrate the effectiveness of using AI ECG models to identify severe coronary stenosis, but also validate an effective approach using existing ECG models. With the existing ECG models, we can easily extract “deep features” that summarize the ECG’s inherent information and combine these features with traditional clinical data to obtain valuable auxiliary diagnostic conclusions with inexpensive calculations. Our goal is to further optimize the model to achieve early accurate identification and early intervention in high-risk patients with severe stenosis to reduce mortality and morbidity. At the same time, we hope to improve the interpretability of the model so that medical professionals have more trust in it and promote its application. ## Data Availability Data used for this study are not publicly available due to privacy concerns. Part of the data is available upon request to the corresponding author. ## Data availability Data used for this study are not publicly available due to privacy concerns. Part of the data is available upon request to the corresponding author. ## Code availability The model code is available at [https://github.com/hsd1503/resnet1d](https://github.com/hsd1503/resnet1d). ## Consent All data involved in this study are obtained with the informed consent of patients and approved by the ethics committee of the Second Hospital of Tianjin Medical University (Tianjin, China). ## Funding This work was supported by the National Natural Science Foundation of China (No. 62102008), the Research Foundation of Major Science and Technology Projects of Tianjin Municipal Science and Technology Bureau (No. 18ZXRHSY00180), the Tianjin Municipal Natural Science Foundation (No. 21JCZDJC01080), and Tianjin Key Medical Discipline (Specialty) Construction Project (No. TJYXZDXK-029A). * Received November 26, 2022. * Revision received November 26, 2022. * Accepted November 29, 2022. * © 2022, Posted by Cold Spring Harbor Laboratory The copyright holder for this pre-print is the author. All rights reserved. The material may not be redistributed, re-used or adapted without the author's permission. ## References 1. [1].Malakar AK, Choudhury D, Halder B, Paul P, Uddin A, Chakraborty S. A review on coronary artery disease, its risk factors, and therapeutics. Journal of cellular physiology. 2019;234(10):16812–23. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F11%2F29%2F2022.11.26.22282701.atom) 2. [2].Zhou M, Wang H, Zeng X, Yin P, Zhu J, Chen W, et al. Mortality, morbidity, and risk factors in China and its provinces, 1990–2017: a systematic analysis for the Global Burden of Disease Study 2017. The Lancet. 2019;394(10204):1145–58. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F11%2F29%2F2022.11.26.22282701.atom) 3. [3].Mahmoodzadeh S, Moazenzadeh M, Rashidinejad H, Sheikhvatan M. Diagnostic performance of electrocardiography in the assessment of significant coronary artery disease and its anatomical size in comparison with coronary angiography. Journal of research in medical sciences: the official journal of Isfahan University of Medical Sciences. 2011;16(6):750. 4. [4].Yan Y, Zhang JW, Zang GY, Pu J. The primary use of artificial intelligence in cardiovascular diseases: what kind of potential role does artificial intelligence play in future medicine? Journal of geriatric cardiology: JGC. 2019;16(8):585. 5. [5].Clifford GD, Liu C, Moody B, Li-wei HL, Silva I, Li Q, et al. AF classification from a short single lead ECG recording: The PhysioNet/computing in cardiology challenge 2017. In: 2017 Computing in Cardiology (CinC). IEEE; 2017. p. 1–4. 6. [6].Hong S, Wu M, Zhou Y, Wang Q, Shang J, Li H, et al. ENCASE: An ENsemble ClASsifiEr for ECG classification using expert features and deep neural networks. In: 2017 Computing in cardiology (cinc). IEEE; 2017. p. 1–4. 7. [7].Attia ZI, Kapa S, Lopez-Jimenez F, McKie PM, Ladewig DJ, Satam G, et al. Screening for cardiac contractile dysfunction using an artificial intelligence–enabled electrocardiogram. Nature medicine. 2019;25(1):70–4. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41591-018-0240-2&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F11%2F29%2F2022.11.26.22282701.atom) 8. [8].Sengupta PP, Kulkarni H, Narula J. Prediction of abnormal myocardial relaxation from signal processed surface ECG. Journal of the American College of Cardiology. 2018;71(15):1650–60. [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6MzoiUERGIjtzOjExOiJqb3VybmFsQ29kZSI7czo0OiJhY2NqIjtzOjU6InJlc2lkIjtzOjEwOiI3MS8xNS8xNjUwIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjIvMTEvMjkvMjAyMi4xMS4yNi4yMjI4MjcwMS5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 9. [9].Cohen-Shelly M, Attia ZI, Friedman PA, Ito S, Essayagh BA, Ko WY, et al. Electrocardiogram screening for aortic valve stenosis using artificial intelligence. European heart journal. 2021;42(30):2885–96. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F11%2F29%2F2022.11.26.22282701.atom) 10. [10].Goto S, Mahara K, Beussink-Nelson L, Ikura H, Katsumata Y, Endo J, et al. Artificial intelligence-enabled fully automated detection of cardiac amyloidosis using electrocardiograms and echocardiograms. Nature communications. 2021;12(1):1–12. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41467-021-25050-3&link_type=DOI) 11. [11].Raghunath S, Ulloa Cerna AE, Jing L, VanMaanen DP, Stough J, Hartzel DN, et al. Prediction of mortality from 12-lead electrocardiogram voltage data using a deep neural network. Nature medicine. 2020;26(6):886–91. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F11%2F29%2F2022.11.26.22282701.atom) 12. [12].Hong S, Zhou Y, Shang J, Xiao C, Sun J. Opportunities and challenges of deep learning methods for electrocardiogram data: A systematic review. Computers in Biology and Medicine. 2020;122:103801. 13. [13].Leasure M, Jain U, Butchy A, Otten J, Covalesky VA, McCormick D, et al. Deep learning algorithm predicts angiographic coronary artery disease in stable patients using only a standard 12-lead electrocardiogram. Canadian Journal of Cardiology. 2021;37(11):1715–24. 14. [14].Huang PS, Tseng YH, Tsai CF, Chen JJ, Yang SC, Chiu FC, et al. An Artificial Intelligence-Enabled ECG Algorithm for the Prediction and Localization of Angiography-Proven Coronary Artery Disease. Biomedicines. 2022;10(2):394. 15. [15].Hong S, Fu Z, Zhou R, Yu J, Li Y, Wang K, et al. Cardiolearn: a cloud deep learning service for cardiac disease detection from electrocardiogram. In: Companion Proceedings of the Web Conference 2020; 2020. p. 148–52. 16. [16].Hong S, Xu Y, Khare A, Priambada S, Maher K, Aljiffry A, et al. HOLMES: Health OnLine Model Ensemble Serving for Deep Learning Models in Intensive Care Units. In: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining; 2020. p. 1614–24. 17. [17].Fu Z, Hong S, Zhang R, Du S. Artificial-intelligence-enhanced mobile system for cardiovascular health management. Sensors. 2021;21(3):773. 18. [18].Kannel WB, McGee DL. Diabetes and cardiovascular risk factors: the Framingham study. Circulation. 1979;59(1):8–13. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTQ6ImNpcmN1bGF0aW9uYWhhIjtzOjU6InJlc2lkIjtzOjY6IjU5LzEvOCI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIyLzExLzI5LzIwMjIuMTEuMjYuMjIyODI3MDEuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 19. [19].Knuuti J, Wijns W, Saraste A, Capodanno D, Barbato E, Funck-Brentano C, et al. 2019 ESC Guidelines for the diagnosis and management of chronic coronary syndromes: the Task Force for the diagnosis and management of chronic coronary syndromes of the European Society of Cardiology (ESC). European heart journal. 2020;41(3):407–77. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/eurheartj/ehz425&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F11%2F29%2F2022.11.26.22282701.atom) 20. [20].Toth G, Hamilos M, Pyxaras S, Mangiacapra F, Nelis O, De Vroey F, et al. Evolving concepts of angiogram: fractional flow reserve discordances in 4000 coronary stenoses. European heart journal. 2014;35(40):2831–8. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/eurheartj/ehu094&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24644308&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F11%2F29%2F2022.11.26.22282701.atom) 21. [21].Wu JT, Wang SL, Chu YJ, Long DY, Dong JZ, Fan XW, et al. CHADS2 and CHA2DS2-VASc scores predict the risk of ischemic stroke outcome in patients with interatrial block without atrial fibrillation. Journal of Atherosclerosis and Thrombosis. 2016:34900. 22. [22].Bhalla V, Isakson S, Bhalla MA, Lin JP, Clopton P, Gardetto N, et al. Diagnostic ability of B-type natriuretic peptide and impedance cardiography: testing to identify left ventricular dysfunction in hypertensive patients. American journal of hypertension. 2005;18(S2):73S–81S. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=15752936&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F11%2F29%2F2022.11.26.22282701.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000227612400007&link_type=ISI) 23. [23].Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D. Grad-cam: Visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE international conference on computer vision; 2017. p. 618–26. [1]: /embed/graphic-8.gif [2]: /embed/graphic-9.gif [3]: /embed/graphic-10.gif [4]: /embed/graphic-11.gif [5]: /embed/graphic-12.gif