PT - JOURNAL ARTICLE AU - Han, Dong AU - Moon, Jihye AU - Mercado Díaz, Luís Roberto AU - Chen, Darren AU - Williams, Devan AU - Mohagheghian, Fahimeh AU - Ghetia, Om AU - Peitzsch, Andrew G. AU - Kong, Youngsun AU - Nishita, Nishat AU - Ghutadaria, Ohm AU - Orwig, Taylor A. AU - Mensah Otabil, Edith AU - Noorishirazi, Kamran AU - Hamel, Alexander AU - Dickson, Emily L. AU - DiMezza, Danielle AU - Lessard, Darleen AU - Wang, Ziyue AU - Mehawej, Jordy AU - Filippaios, Andreas AU - Naeem, Syed AU - Gottbrecht, Matthew F. AU - Fitzgibbons, Timothy P. AU - Saczynski, Jane S. AU - Barton, Bruce AU - Ding, Eric Y. AU - Tran, Khanh-Van AU - McManus, David D. AU - Chon, Ki H. TI - Multiclass arrhythmia classification using multimodal smartwatch photoplethysmography signals collected in real-life settings AID - 10.1101/2024.12.03.24318445 DP - 2024 Jan 01 TA - medRxiv PG - 2024.12.03.24318445 4099 - http://medrxiv.org/content/early/2024/12/05/2024.12.03.24318445.short 4100 - http://medrxiv.org/content/early/2024/12/05/2024.12.03.24318445.full AB - In the early stages of atrial fibrillation (AF), most cases are paroxysmal (pAF), making identification only possible with continuous and prolonged monitoring. With the advent of wearables, smartwatches equipped with photoplethysmographic (PPG) sensors are an ideal approach for continuous monitoring of pAF. There have been numerous studies demonstrating successful capture of pAF events, especially using deep learning. However, deep learning requires a large amount of data and independent testing on diverse datasets, to ensure the generalizability of the model, and most prior studies did not meet these requirements. Moreover, most prior studies using wearable-based PPG sensor data collection were limited either to controlled environments, to minimize motion artifacts, or to short duration data collection. Most importantly, frequent premature atrial and ventricular contractions (PAC/PVC) can confound most AF detection algorithms. This has not been well studied, largely due to limited datasets containing these rhythms. Note that the recent deep learning models show 97% AF detection accuracy, and the sensitivity of the current state-of-the-art technique for PAC/PVC detection is only 75% on minimally motion artifact corrupted PPG data. Our study aims to address the above limitations using a recently completed NIH-funded Pulsewatch clinical trial which collected smartwatch PPG data over two weeks from 106 subjects. For our approach, we used multi-modal data which included 1D PPG, accelerometer, and heart rate data. We used a computationally efficient 1D bi-directional Gated Recurrent Unit (1D-Bi-GRU) deep learning model to detect three classes: normal sinus rhythm, AF, and PAC/PVC. Our proposed 1D-Bi-GRU model’s performance was compared with two other deep learning models that have reported some of the highest performance metrics, in prior work. For three-arrhythmia-classification, testing data for all deep learning models consisted of using independent data and subjects from the training data, and further evaluations were performed using two independent datasets that were not part of the training dataset. Our multimodal model achieved an unprecedented 83% sensitivity for PAC/PVC detection while maintaining a high accuracy of 97.31% for AF detection. Our model was computationally more efficient (14 times more efficient and 2.7 times faster) and outperformed the best state-of-the-art model by 20.81% for PAC/PVC sensitivity and 2.55% for AF accuracy. We also tested our models on two independent PPG datasets collected with a different smartwatch and a fingertip PPG sensor. Our three-arrhythmia-classification results show high macro-averaged area under the receiver operating characteristic curve values of 96.22%, and 94.17% for two independent datasets, demonstrating better generalizability of the proposed model.Competing Interest StatementThe authors have declared no competing interest.Clinical TrialNCT03761394Clinical Protocols https://doi.org/10.1016/j.cvdhj.2021.07.002 Funding StatementThis work was supported by NIH under Grant R01 HL137734.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Formal ethical approval for this study was obtained from the University of Massachusetts Medical School Institutional Review Board (approval number H00016067 for the clinical trial and H00009953 for the AF trial). Written informed consent was collected from all patient participants.I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesThe Pulsewatch data (our segment-level adjudication and continuous recording of reference ECG, PPG, and ACC) used in this paper will be publicly available for downloading on https://www.synapse.org/Synapse:syn23565056/. The external testing datasets?UMMC Simband dataset and the MIMIC-III dataset?are already publicly available. https://github.com/Cassey2016 https://www.synapse.org/Synapse:syn23565056/