PT  - JOURNAL ARTICLE
AU  - Phatak, Sanat
AU  - Chakraborty, Somashree
AU  - Goel, Pranay
TI  - Computer vision detects inflammatory arthritis in standardized smartphone photographs in an Indian patient cohort
AID  - 10.1101/2023.08.20.23294349
DP  - 2023 Jan 01
TA  - medRxiv
PG  - 2023.08.20.23294349
4099  - http://medrxiv.org/content/early/2023/08/22/2023.08.20.23294349.short
4100  - http://medrxiv.org/content/early/2023/08/22/2023.08.20.23294349.full
AB  - Introduction Computer vision extracts meaning from pixelated images and holds promise in automating clinical tasks. Convolutional neural networks (CNN), deep learning networks used therein, have shown promise in X-ray images as well as joint photographs. We studied the performance of a CNN on standardized smartphone photographs in detecting inflammation in three hand joints.Methods We enrolled consecutive patients with inflammatory arthritis of less than two years duration and excluded those with deformities. Each patient was examined by a rheumatologist and the presence of synovitis in each joint was recorded. Hand photographs were taken in a standardized manner and anonymized. Images were cropped to include joints of interest. A reNrt-101 backbone modified for two class outputs (inflamed or not) was used for training. We also tested a hue augmented dataset. We report accuracy, sensitivity and specificity for three joints: wrist, index finger proximal interphalangeal (IFPIP), middle finger interphalangeal (MFPIP).Results The cohort had a mean age of 49.7 years; most had rheumatoid arthritis(n=68). The wrist (62.5%), MFPIP (47%) and IFPIP (41.5%) were the three most commonly inflamed joints. The CNN achieved the highest accuracy in being able to detect synovitis in the MFPIP (83%) followed by the IFPIP (74%) and the wrist (65%).Discussion We show that computer vision was able to detect inflammation in three joints of the hand with reasonable accuracy on standardized photographs despite a small dataset. Feature engineering was not required, and the CNN worked despite a diversity in clinical diagnosis. Larger datasets are likely to improve accuracy and help explain the basis of classification. These data suggest a potential use of computer vision in screening and follow-up of inflammatory arthritis.Competing Interest StatementSP and PG are co-inventors on a provisional patent application at the Indian Patent Office that includes some material used in this paperFunding StatementThis study did not receive any fundingAuthor DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Ethics committee of KEM Hospital Research Centre gave ethical approval for this work.(KEMHRCEC/2018) Ethics committee of Indian Institute of Science Education and Research waived ethical approval for this work.I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.Yes