PT - JOURNAL ARTICLE AU - Mineur, L. AU - Heide, M. AU - Eickhoff, S. AU - Avram, M. AU - Franzen, L. AU - Buschmann, F. AU - Schröpfer, F. AU - Rogg, H.V. AU - Andreou, C. AU - Brügge, N.S. AU - Handels, H. AU - Borgwardt, S. AU - Korda, A. TI - Analysis of facial expressions recorded from patients during psychiatric interviews AID - 10.1101/2024.09.19.24313994 DP - 2024 Jan 01 TA - medRxiv PG - 2024.09.19.24313994 4099 - http://medrxiv.org/content/early/2024/09/22/2024.09.19.24313994.short 4100 - http://medrxiv.org/content/early/2024/09/22/2024.09.19.24313994.full AB - Mental health research increasingly focuses on the relationship between psychiatric symptoms and observable manifestations of the face and body1. In recent studies2,3, psychiatric patients have shown distinct patterns in movement, posture and facial expressions, suggesting these elements could enhance clinical diagnostics.The analysis of the facial expressions is grounded on the Facial Action Coding System (FACS)4. FACS provides a systematic method for categorizing facial expressions based on specific muscle movements, enabling detailed analysis of emotional and communicative behaviors. This method combined with recent advancements in Artificial Intelligence (AI) has shown promising results for the detection of the patient mental state.We analyze video data from patients with various psychiatric symptoms, using open-source Python toolboxes for facial expression and body movement analysis. These toolboxes facilitate face detection, facial landmark detection, emotion detection and motion recognition. Specifically, we aim to explore the connection between these physical expressions and established diagnostic tools, like symptom severity scores, and finally enhance psychiatric diagnostics by integrating AI-driven analysis of video data.By providing a more objective and detailed understanding of psychiatric symptoms, this study could lead to earlier detection and more personalized treatment approaches, ultimately improving patient outcomes. The findings will contribute to the development of innovative diagnostic tools that are both efficient and accurate, addressing a critical need in mental health care.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThe equipment used for the recordings was funded by the UKSH Research Foundation in 2022 (https://www.uksh.de/gutestun/foerderstiftung.html). Prof. Giorgos Giannakakis and Prof. Anastasios Roussos from the FORTH institute in Greece supported on the set up of the lab used for the clinical interviews.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Ethics committee of the University of Luebeck gave ethical approval for this work on the 19th July 2024 (file number 2024-355_1)I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesAll data produced in the present study are available upon reasonable request to the authors