PT  - JOURNAL ARTICLE
AU  - Webster, Dan E.
AU  - Haberman, Rebecca H.
AU  - Perez Chada, Lourdes Maria
AU  - Tummalacherla, Meghasyam
AU  - Tediarjo, Aryton
AU  - Yadav, Vijay
AU  - Neto, Elias Chaibub
AU  - MacDuffie, Woody
AU  - DePhillips, Michael
AU  - Sieg, Eric
AU  - Catron, Sydney
AU  - Grant, Carly
AU  - Francis, Wynona
AU  - Nguyen, Marina
AU  - Yussuff, Muibat
AU  - Castillo, Rochelle L.
AU  - Yan, Di
AU  - Neimann, Andrea L.
AU  - Reddy, Soumya M.
AU  - Ogdie, Alexis
AU  - Kolivras, Athanassios
AU  - Kellen, Michael R.
AU  - Mangravite, Lara M.
AU  - Sieberts, Solveig K.
AU  - Omberg, Larsson
AU  - Merola, Joseph F.
AU  - Scher, Jose U.
TI  - Clinical validation of digital biomarkers and machine learning models for remote measurement of psoriasis and psoriatic arthritis
AID  - 10.1101/2022.04.13.22273676
DP  - 2022 Jan 01
TA  - medRxiv
PG  - 2022.04.13.22273676
4099  - http://medrxiv.org/content/early/2022/04/16/2022.04.13.22273676.short
4100  - http://medrxiv.org/content/early/2022/04/16/2022.04.13.22273676.full
AB  - Background Psoriasis and psoriatic arthritis are common immune-mediated inflammatory conditions that primarily affect the skin, joints and entheses and can lead to significant disability and worsening quality of life. Although early recognition and treatment can prevent the development of permanent damage, psoriatic disease remains underdiagnosed and undertreated due in part to the disparity between disease prevalence and relative lack of access to clinical specialists in dermatology and rheumatology. Remote patient self-assessment aided by smartphone sensor technology may be able to address these gaps in care, however, these innovative disease measurements require robust clinical validation.Methods We developed smartphone-based assessments, collectively named the Psorcast suite, that can be self-administered to measure cutaneous and musculoskeletal signs and symptoms of psoriatic disease. The image and motion sensor data collected by these assessments was processed to generate digital biomarkers or machine learning models to detect psoriatic disease phenotypes. To evaluate these digital endpoints, a cross-sectional, in-clinic validation study was performed with 92 participants across two specialized academic sites consisting of healthy controls and participants diagnosed with psoriasis and/or psoriatic arthritis.Findings In the domain of skin disease, digital patient assessment of percent body surface area (BSA) affected with psoriasis demonstrated very strong concordance (CCC = 0·94, [95%CI = 0·91–0·96]) with physician-assessed BSA. Patient-captured psoriatic plaque photos were remotely assessed by physicians and compared to in-clinic Physician Global Assessment parameters for the same plaque with fair to moderate concordance (CCCerythema=0·72 [0·59–0·85]; CCCinduration=0·72 [0·62–0·82]; CCCscaling=0·60 [0·48–0·72]). Arm range of motion was measured by the Digital Jar Open assessment to classify physician-assessed upper extremity involvement with joint tenderness or enthesitis, demonstrating an AUROC = 0·68 (0·47–0·85). Patient-captured hand photos were processed with object detection and deep learning models to classify clinically-diagnosed nail psoriasis with an accuracy of 0·76, which is on par with remote physician rating of nail images (avg. accuracy = 0·63) with model performance maintaining accuracy when raters were too unsure or image quality was too poor for a remote assessment.Interpretation The Psorcast digital assessments, performed by patient self-measurement, achieve significant clinical validity when compared to in-person physical exams. These assessments should be considered appropriately validated for self-monitoring and exploratory research applications, particularly those that require frequent, remote disease measurements. However, further validation in larger cohorts will be necessary to demonstrate robustness and generalizability across populations for use in evidence-based medicine or clinical trial settings. The smartphone software and analysis pipelines from the Psorcast suite are open source and available to the scientific community.Funding This work is funded by the Psorcast Digital Biomarker Consortium consisting of Sage Bionetworks, Psoriasis and Psoriatic Arthritis Centers for Multicenter Advancement Network (PPACMAN), Novartis, UCB, Pfizer, and Janssen Pharmaceuticals. J.U.S work was supported by the Snyder Family Foundation and the Riley Family Foundation.Evidence before this study No systematic literature review was performed. Patient self-measurement with smartphone sensors has been shown to be clinically valid for assessing signs and symptoms such as tremor, gait, physical activity, or range of motion across multiple disease indications. While smartphone-based applications have been developed for digitally tracking psoriatic disease, they have largely focused on questionnaire-based patient reported outcomes.Added value of this study To our knowledge, Psorcast is the first application using ubiquitous smartphone sensor technology for patients to remotely measure their psoriatic disease phenotypes, including detection of nail psoriasis and a continuous variable outcome measure of joint tenderness and enthesitis based on range of motion. This study not only developed a suite of novel, smartphone sensor-based assessment that can be self-administered to measure cutaneous and musculoskeletal signs and symptoms, but provides clinical validation of these measures.Implications of all the available evidence The developed Psorcast suite of measurements can serve as groundwork for patient-driven, remote measurement of psoriatic disease. The use and continued development of this technology opens up new possibilities for both clinical care and research endeavors on a large scale. Psorcast measurements are currently being validated for their ability to assess disease changes longitudinally, allowing for more frequent symptom monitoring in clinical trials, more granular insight into the time course of medication action, and possible identification of responders from non-responders to specific therapies.Competing Interest StatementAt time of manuscript submission, DEW is employed by AbbVie. RHH declares consulting fees from Janssen. AO declares consulting fees from Abbvie, Amgen, BMS, Celgene, CorEvitas, Gilead, Happify Health, Janssen, Lilly, Novartis, Pfizer, UCB and grants from Abbvie, Amgen, Novartis and Pfizer. SR declares consulting fees from Abbvie, Janssen, Novartis, Pfizer, and UCB. ALN declares that she has served as a consultant for Janssen, UCB, AbbVie, BMS and her immediate family member owns shares of stock in J&J, Eli Lilly, AbbVie, and Pfizer. JFM is a consultant and/or investigator for Amgen, Bristol-Myers Squibb, Abbvie, Dermavant, Eli Lilly, Novartis, Janssen, UCB, Sanofi, Regeneron, Sun Pharma, Biogen, Pfizer and Leo Pharma. JUS declares consulting fees from Abbvie, Amgen, BMS, Janssen, Lilly, Novartis, Pfizer, Sanofi, UCB and grants from Janssen and Pfizer.Funding StatementThis work is funded by the Psorcast Digital Biomarker Consortium consisting of Sage Bionetworks, Psoriasis and Psoriatic Arthritis Centers for Multicenter Advancement Network (PPACMAN), Novartis, UCB, Pfizer, and Janssen Pharmaceuticals. J.U.S work was supported by the Snyder Family Foundation and the Riley Family Foundation.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:IRB of New York University and Brigham and Women's Hospital gave ethical approval for this workI confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesDe-identified validation study datasets that can be shared publicly are available on the Synapse platform at the url: https://www.synapse.org/#!Synapse:syn26840742/wiki/ Guidelines to reproduce the analysis results and figures is shared in this Github Repository: https://github.com/Sage-Bionetworks/psorcast-validation-manuscript. App software can be found at https://github.com/Sage-Bionetworks/Psorcast-iOS. https://www.synapse.org/#!Synapse:syn26840742/wiki/ https://github.com/Sage-Bionetworks/psorcast-validation-manuscript https://github.com/Sage-Bionetworks/Psorcast-iOS