Improvement in quality of life and cognitive function in Post Covid Syndrome after online occupational therapy: results from a randomized controlled pilot study ================================================================================================================================================================ * Dominik Schröder * Andrea Stölting * Christina Müllenmeister * Georg M.N. Behrens * Sandra Klawitter * Frank Klawonn * Aisha Cook * Nadja Wegner * Martin Wetzke * Tim Schmachtenberg * Alexandra Dopfer-Jablonka * Frank Müller * Christine Happle ## Abstract **Background** Post-COVID-Syndrome (PCS) poses enormous clinical challenges. Occupational therapy (OT) is recommended in PCS, but structural validation of this concept is pending. **Methods** In an unblinded randomized pilot study (clinical trial # DRKS0026007), feasibility and effects of online OT in PCS were tested. Probands received structured online OT over 12 weeks either via interactive online treatment sessions (interactive group) or prerecorded videos (video group). 50% of probands received no online OT (control group). At week 0, 12, and 24, we analyzed study experience, health-related quality of life, and impairment in performance, participation, and cognitive functions. **Results** N=158 probands (mean age 38 yrs., 86% female) were included into the analyses. 83.3% of probands in the interactive versus 48.1% of probands in the video group described their study experience as positive or very positive (p=0.001). After 12 weeks, all groups displayed significant improvement in concentration, memory, and performance of daily tasks. After 24 weeks, significant improvement in concentration and memory were observed in control- and video-probands, and social participation had improved after video-OT. However, only probands that had received interactive online OT showed improvement of all measured endpoints including concentration, memory, quality of life, and social participation. **Conclusion** We show that online OT is feasible and that interactive online OT is a promising treatment strategy for affected patients. We present exploratory data on its efficacy and describe variables that can be employed for further investigations in confirmatory trials. Key words * occupational therapy * digital * Post Covid Syndrome * Long Covid * pilot study * randomized controlled trial ## Introduction Approximately 3-10% of people with an acute SARS-COV-2 infection develop Post COVID-syndrome (PCS) with ongoing symptoms [1-3]. PCS affected people often experience severe fatigue, trouble concentrating, and reduced quality of life and social participation [4-6]. Current therapy guidelines for PCS mention occupational therapy (OT) as a treatment option [6], and case reports describe success of OT in treating this novel condition [7]. However, clinical studies confirming efficacy of OT in PCS are pending. We sought to combine the concept of OT for PCS with the strategy of remote (digital) treatment delivery. Remote treatment strategies via digital communication have become more accepted since the COVID-19 pandemic [8]. As many PCS patients suffer from impaired mobility, digital treatment appears to be particularly appealing for this patient group [9]. Given the high prevalence of PCS, the scalability of digital therapy formats could enable efficient treatment for a high number of affected people. Here, we tested the feasibility and efficacy of structured online OT for PCS in a randomized controlled, unpowered pilot study (German clinical trial registry #DRKS00026007 [10]). OT was based on a detailed manual tailored to the needs of PCS patients and delivered online, either by interactive sessions or as prerecorded videos. The aim of the intervention was to support affected people in developing coping strategies against major PCS symptoms such as fatigue and cognitive impairments and thus improve their quality of life and social participation. ## Methods ### Trial Design This is a randomized controlled pilot study with two interventional groups receiving OT either via (I) interactive digital sessions (interactive group) or (II) prerecorded videos (video group). A control group (III) received no intervention (controls). Planned allocation ratio was 1:1:2 (I:II:III). Patients were evaluated upon study start (T1), after the 12-week treatment phase (T2) and 24 weeks after study start (T3). More study details are outlined in a study protocol [10]. No changes were made after trial commencement. ### Participants and Recruitment Following inclusion criteria were applied: [1] age ≥ 16 years, [2] persistent or new PCS symptoms ≥ 4 weeks after SARS-CoV-2 infection (confirmed by PCR or rapid antigen testing), [3] feeling of strong cognitive impairment and/or fatigue (concentration deficits and/or fatigue) ≥ 5/10 on a Likert scale, [4] access to a digital device, [5] consent to participate in the study. Recruitment was performed through an online study platform for persons affected by PCS (DEFEAT Corona, German study registry number DRKS00026007 [11]). Interested patients were asked to complete an online screening survey. PCS people meeting the inclusion criteria were invited to participate by email. Prior to enrollment, individual consent talks were conducted which each interested eligible person and further study information was provided. Participants declared written consent before enrollment. ### Interventions Participants in the interactive group received online OT by an experienced occupational therapist twice weekly through interactive digital sessions. Probands in the video group were provided with links for prerecorded OT videos for two weekly sessions. Outline and structure of OT were based on a detailed manual tailored to the needs of PCS patients which was identical in both interventional groups [10]. OT sessions consisted of guided exercises to control typical PCS symptoms as well as customizable units to improve performance in everyday occupations, social participation, and wellbeing. Participants in both groups also received OT workbooks and were asked to apply contents into their everyday life complementing the OT content of each therapy session regularly. Control participants received no treatment. ### Outcomes Feasibility and acceptance of the treatment concept (primary endpoints) were analyzed by Likert scaled items (online questionnaire) and assessment of drop out rates in the different study phases. Secondary endpoints were cognitive function and problems in everyday occupations assessed by Neuro-QoL™ v2.0 cognitive function short form [12], memory function tested by the WIT-2 tool [13], and concentration deficits evaluated by the D2-R test [14]. Health-related quality of life was analyzed by the EQ-5D-3L index and EQ VAS [15]. Social participation was evaluated by the Index for measuring participation restriction (IMET) score [16], and occupational performance by the Canadian occupational performance measure COPM based interviews [13]. ### Sample size As pilot study, the sample size was conceived pragmatically considering feasibility with regard to project funding ### Randomization Probands were randomized into the three groups employing an urn model (ratio interactive/video/control group: 1/1/2) by a member of the study team not involved in the treatment intervention. After randomization, patients were tested for occupational problems using a structured interview according to the Canadian occupational performance measure (COPM [13]), again by an independent team member not involved in the intervention. ### Statistical analyses Sample characteristics where characterized using descriptive and bivariate statistics. Within groups, changes between two time points were assessed by Wilcoxon signed rank testing. To analyze longitudinal changes between groups, covariance analyses with repeated measurements were performed with baseline values, interventional arm, and time points as covariables. Analyses of treatment effects were conducted according to the intention to treat (ITT) principle [17], and missing values were imputed applying the last observation carried forward (LOCF) strategy [18]. Adjusted differences between interventional versus control groups at follow up visits are reported with confidence intervals (CI). P values were corrected for multiple testing by Bonferroni Holm correction, and a p value p<0.05 was considered statistically significant. Calculations were performed employing R (V4.2.3) with the packages afex, eq5d, and ggplot2 [10, 19, 20]. ### Research Ethics The study protocol was approved by responsible research ethics boards of all participating centers (Hannover Medical School #9948_BO_K_2021, University Medical Center Göttingen 15/8/22Ü). The study was registered at the German Registry for Clinical Trials (trial number DRKS00026007). Participants provided written informed consent prior to enrollment. The project received funding through the German Federal Ministry for Education and Research (Grant number 01EP2103C). ## Results Initially, n=163 PCS patients were recruited, but n=5 had to be excluded secondarily due to failing the inclusion criteria (Fig. 1). In total, n=158 PCS patients were included into the final analysis. 65.2% of participants completed the 12-week interventional or control period and were available for evaluation and timepoint T2. 32.5% of probands in the interactive, and 53.8% of participants in the video group were lost to follow up at T2, as were 22.8% of control probands. An additional 2.5% of participants were lost to follow up at timepoint T3. ![Fig. 1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2024/05/10/2024.05.09.24307158/F1.medium.gif) [Fig. 1:](http://medrxiv.org/content/early/2024/05/10/2024.05.09.24307158/F1) Fig. 1: Flowchart illustrating study phases and proband numbers (PROM: patient reported outcome measures include NeuroQoL, EQ-5D, IMET) From cases in the interventional arms with follow up data, data on subjective treatment effects was available for 98.7% of probands, and 72.2% provided information on their personal OT experience. Psychological testing was performed in 98.1%, and COPM in 88% of probands with follow up evaluation. Participant numbers for each study arm and timepoint are illustrated in Fig. 1. The median age of participants was 38 years (IQR 30–45, range 16–67), and probands in the interventional groups were significantly younger than those in the control group (Table 1). The majority of participants (86.1%) were female, with more women in the interventional as in control groups. PCS participants in the interactive group presented with better memory performance (WIT-2) than those in control and video arms. Other characteristics that did not differ between the study groups are displayed in Table 1. Further information on sociodemographic characteristics is provided in supplementary Table 1. View this table: [Table 1:](http://medrxiv.org/content/early/2024/05/10/2024.05.09.24307158/T1) Table 1: Proband characteristics at baseline To further analyze the acceptance of our concept, we asked PCS patients to rate their OT experience during the 12-week intervention phase. In an online survey, they could rate their therapy perception between 0 (very negative) and 5 (very positive). Participants in the interactive group evaluated their OT experience with a mean of 4.2 points (range 2–5, n=30), and 83.3% rated the treatment as positive or very positive (Fig. 2). By contrast, probands in the video group rated their OT experience with an average of 3.3/5 points (range 1–5, n=27), and only 48.1% described their experience as positive or very positive (Fig. 2, difference in satisfaction p=0.001). ![Fig. 2:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2024/05/10/2024.05.09.24307158/F2.medium.gif) [Fig. 2:](http://medrxiv.org/content/early/2024/05/10/2024.05.09.24307158/F2) Fig. 2: Rating of study experience by participants in the two intervention groups Next, we performed an exploratory analysis of the intervention’s efficacy in alleviating PCS symptoms. In all groups, a significant improvement of concentration and memory, as well as occupational performance was observed during the first 12 weeks of the study (Table 2). However, only in participants after interactive online OT, a significant improvement in health-related quality of life, social participation, and cognitive function as assessed by Neuro-QoL occurred (Table 2). In comparison to controls, participants in the interactive group presented with significantly stronger improvement in health-related quality of life (EQ-5D-3L index, mean difference 0.11, 95% CI [0.02-0.19], p=0.01) and cognitive function (Neuro-QoL, mean difference 2.36, 95% CI [0.27-4.46], p=0.022, Table 2). View this table: [Table 2:](http://medrxiv.org/content/early/2024/05/10/2024.05.09.24307158/T2) Table 2: Effects of the study intervention on cognitive performance, quality of life, and occupational performance 24 weeks after the start of the study, all groups displayed significant improvement in concentration and memory performance, and participants in the control and interactive groups showed significant enhancement of social participation (Table 2). However, only PCS patients in the interactive group presented with significant improvement of all measured end points such as cognitive function, social participation, health-related quality of life, and occupational performance (Table 2). ## Discussion PCS is a growing global health problem which has been estimated to affect up to 11% of patients after SARS-CoV-2 infection [3]. In spite of high patient numbers worldwide and strong clinical need, effective treatment strategies are pending [21, 22]. Here, we present first results on the feasibility of online OT and explore the efficacy in PCS. The delivered parameters and data can be employed in larger randomized controlled clinical trials on novel PCS treatment strategies. Our data illustrates that online OT can be a valuable treatment approach in helping PCS patients better coping with their symptoms and restraints. We have shown that online delivered OT can significantly improve their cognitive function and quality of life. Online delivered OT has several advantages especially for people with PCS: It can easily be scaled meeting the current demand for treatment and may also be especially suitable for PCS people that struggle with impaired mobility or live in more remote places. In our study, online provision of OT was used by participants of all ages, illustrating the wide range of PCS patients that could be reached by such an approach. Around two thirds of PCS patients in the interactive therapy group completed the 12-week treatment course in the interactive group as compared to less than one half of those in the video group, and significantly more patients that were treated interactively rated their OT experience as positive. This illustrates that personal interaction significantly enhances acceptance of online treatment in PCS. Furthermore, PCS patients after interactive OT displayed significant treatment benefits when compared to both video and control group. Their cognitive function showed statistically significantly improvement and their health-related quality of life had increased by 0.11 points, a value clearly above the threshold of 0.03 previously described to be clinically relevant [23]. The fact that secondary outcomes such as memory and concentration capacity also improved in the control group could be explained by a natural amelioration of PCS symptoms over time, which has also been observed by other researchers [24]. Importantly, only patients receiving interactive OT showed significant improvement of all measured endpoints of cognitive function, occupational problems, quality of life, and social participation. Taken together, these findings advocate for high acceptance and therapeutic benefit of the interactive, person to person online OT in PCS patients. Our study has several limitations. Firstly, due to it’s novelty, *a priori* power calculations could not be performed and the number of enrolled participants may have been too low to detect subtle treatment effects. Also, the inhomogeneity of groups upon study start with regard to age, sex, and memory function may have impacted our results. The high rate of lost to follow up participants needs to be addressed in future studies. Unfortunately, we were unable to systematically assess reasons for study discontinuation in our cohort. The high proportion of female study participants can be interpreted as another limitation of our work. It may be explained by a higher rate of female PCS patients in general and the fact that women tend to seek medical help earlier than men [25, 26]. Furthermore, central outcomes such as symptom severity were self-reported. As this feasibility study was performed in unblinded fashion, this could have biased self-assessment. Finally, some of our test instruments such as WIT-2 and d2r are not validated for repeated measurements, which could have led to improvement of scorings at the second test date. In spite of these limitations, our study adds significant information to the field of PCS treatment. We provide detailed data on relevant clinical variables that can be employed in larger studies on PCS treatment in the future. Our exploratory analyses of treatment effects also support the notion that online OT is feasible in PCS and that interactive online OT may be a promising treatment strategy for affected patients. As such we hope our data helps to pave the way for new, effective, and scalable treatment options in PCS. ## Data Availability Data cannot be shared publicly because they contain personal information. Data are available from the Hannover Medical School Institutional Data Access (contact via Study director PD Dr. med. Alexandra Jablonka Clinic for Immunology and Rheumatology - OE 6830 Hanover Medical School Carl Neuberg Strasse 1 30625 Hannover Email: Jablonka.Alexandra{at}mh-hannover.de Phone: +49 511 532 3014) for researchers who meet the criteria for access to confidential data. ## Supplement View this table: [Supplementary Table 1:](http://medrxiv.org/content/early/2024/05/10/2024.05.09.24307158/T3) Supplementary Table 1: Differences between study arms adjusted for baseline scores * Received May 9, 2024. * Revision received May 9, 2024. * Accepted May 10, 2024. * © 2024, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution 4.0 International), CC BY 4.0, as described at [http://creativecommons.org/licenses/by/4.0/](http://creativecommons.org/licenses/by/4.0/) ## References 1. 1.Venkatesan P. NICE guideline on long COVID - The Lancet Respiratory Medicine. 2022. doi: doi:10.1016/S2213-2600(21)00031-X. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S2213-2600(21)00031-X&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=33453162&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F05%2F10%2F2024.05.09.24307158.atom) 2. 2.Chen Chen M. Global Prevalence of Post COVID-19 Condition or Long COVID: A Meta-Ajalysis and Systematic Review. 2022. 3. 3.Kavanagh KT, Cormier LE, Pontus C, Bergman A, Webley W. Long COVID’s Impact on Patients, Workers, & Society: A review. Medicine (Baltimore). 2024;103(12):e37502. Epub 2024/03/22. doi: 10.1097/MD.0000000000037502. PubMed PMID: 38518038; PubMed Central PMCID: PMCPMC10957027. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1097/MD.0000000000037502&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=38518038&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F05%2F10%2F2024.05.09.24307158.atom) 4. 4.Koczulla AR, Ankermann T, Behrends U, Berlit P, Böing S, Brinkmann F, et al. S1-Leitlinie Post- COVID/Long-COVID. Pneumologie. 2021;75:869–900. doi: 10.1055/a-1551-9734. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1055/a-1551-9734&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F05%2F10%2F2024.05.09.24307158.atom) 5. 5.Soriano JB, Murthy S, Marshall JC, Relan P, Diaz JV. A clinical case definition of post-COVID-19 condition by a Delphi consensus. The Lancet Infectious Diseases. 2021. doi: 10.1016/s1473-3099(21)00703-9. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/s1473-3099(21)00703-9&link_type=DOI) 6. 6.Koczulla AR, Ankermann T, Behrends U, Berlit P, Berner R, Boing S, et al. [German S1 Guideline Long-/Post-COVID]. Pneumologie. 2022;76(12):855–907. Epub 2022/12/09. doi: 10.1055/a-1946-3230. PubMed PMID: 36479679. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1055/a-1946-3230&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=36479679&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F05%2F10%2F2024.05.09.24307158.atom) 7. 7.Wilcox J, jawilcox@usc.edu, Jamie Wilcox O, OTR/L, is Associate Professor, Clinical Occupational Therapy, Keck Medical Center of USC, Chan Division of Occupational Science and Occupational Therapy, University of Southern California, Los Angeles, Frank E, efrank@usa.edu, Emily Frank O, MS, OTR, is Assistant Professor and Manager of Simulation Education and Innovation Initiatives, University of St. Augustine for Health Sciences, Austin, TX. Occupational Therapy for the Long Haul of Post-COVID Syndrome: A Case Report. The American Journal of Occupational Therapy. 2023;75(Supplement_1). doi: 10.5014/ajot.2021.049223. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.5014/ajot.2021.049223&link_type=DOI) 8. 8.Parry W, Fraser C, Crellin E, Hughes J, Vestesson E, Clarke GM. Continuity of care and consultation mode in general practice: a cross-sectional and longitudinal study using patient-level and practice-level data from before and during the COVID-19 pandemic in England. BMJ Open. 2023;13(11):e075152. Epub 2023/11/16. doi: 10.1136/bmjopen-2023-075152. PubMed PMID: 37968008; PubMed Central PMCID: PMCPMC10660661. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYm1qb3BlbiI7czo1OiJyZXNpZCI7czoxMzoiMTMvMTEvZTA3NTE1MiI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDI0LzA1LzEwLzIwMjQuMDUuMDkuMjQzMDcxNTguYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 9. 9.Dahmen A, Keller FM, Derksen C, Rinn R, Becker P, Lippke S. Screening and assessment for post-acute COVID-19 syndrome (PACS), guidance by personal pilots and support with individual digital trainings within intersectoral care: a study protocol of a randomized controlled trial. BMC Infect Dis. 2022;22(1):693. Epub 2022/08/16. doi: 10.1186/s12879-022-07584-z. PubMed PMID: 35971066; PubMed Central PMCID: PMCPMC9377288. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/s12879-022-07584-z&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=35971066&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F05%2F10%2F2024.05.09.24307158.atom) 10. 10.Singmann H BB, Westfall J, Aust F, Ben-Shachar M. \_afex: Analysis of Factorial Experiments\_. R package version 1.3-0. [https://CRANR-projectorg/package=afex](https://CRANR-projectorg/package=afex). 2023. 11. 11.Mikuteit M, Heinemann S, Roder S, Niewolik J, Schroder D, Vahldiek K, et al. Long-term Consequences of COVID-19 and the Pandemic: Protocol for a Web-Based, Longitudinal Observational Study (DEFEAT). JMIR Res Protoc. 2022;11(10):e38718. Epub 2022/09/16. doi: 10.2196/38718. PubMed PMID: 36108134; PubMed Central PMCID: PMCPMC9611102. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.2196/38718&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=36108134&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F05%2F10%2F2024.05.09.24307158.atom) 12. 12.healthmeasures.net. Neuro-QoL. https://www.healthmeasuresnet/explore-measurement-systems/neuro-qol#:~:text=Neuro-QoL%20TM%20%28Quality%20of%20Life%20in%20Neurological%20Disorders%29,by%20adults%20and%20children%20living%20with%20neurological%20conditions. 2022. 13. 13.Martin Kersting KA, Adolf Otto Jäger. Wilde-Intelligenz-Test 2. Hofgreve\_1st\_edition. 2008. 14. 14.Wollseiffen P, Ghadiri A, Scholz A, Struder HK, Herpers R, Peters T, et al. Short Bouts of Intensive Exercise During the Workday Have a Positive Effect on Neuro-cognitive Performance. Stress Health. 2016;32(5):514–23. Epub 2015/10/10. doi: 10.1002/smi.2654. PubMed PMID: 26449710. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/smi.2654&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=26449710&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F05%2F10%2F2024.05.09.24307158.atom) 15. 15.Ozkeskin M, Ozden F, Karaman B, Ekmekci O, Yuceyar N. The comparison of fatigue, sleep quality, physical activity, quality of life, and psychological status in multiple sclerosis patients with or without COVID-19. Mult Scler Relat Disord. 2021;55:103180. Epub 2021/08/06. doi: 10.1016/j.msard.2021.103180. PubMed PMID: 34352513; PubMed Central PMCID: PMCPMC8324500. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.msard.2021.103180&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=34352513&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F05%2F10%2F2024.05.09.24307158.atom) 16. 16.Schroder D, Mullenmeister C, Heinemann S, Hummers E, Klawonn F, Vahldiek K, et al. Social participation during the COVID-19 pandemic in persons with a high risk for a severe course of COVID- 19 - results of a longitudinal, multi-center observational study in Germany. Health Psychol Behav Med. 2023;11(1):2249534. Epub 2023/08/30. doi: 10.1080/21642850.2023.2249534. PubMed PMID: 37645515; PubMed Central PMCID: PMCPMC10461510. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1080/21642850.2023.2249534&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=37645515&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F05%2F10%2F2024.05.09.24307158.atom) 17. 17.T B. Intent-to-Treat Analysis Versus Per Protocol Analysis. Clinical trials. 2017:173–201. 18. 18.Gupta SK. Intention-to-treat concept: A review. Perspect Clin Res. 2011;2(3):109–12. Epub 2011/09/08. doi: 10.4103/2229-3485.83221. PubMed PMID: 21897887; PubMed Central PMCID: PMCPMC3159210. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.4103/2229-3485.83221&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21897887&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F05%2F10%2F2024.05.09.24307158.atom) 19. 19.Wickham H. ggplot2: Elegant Graphics for Data Analysis. . Springer-Verlag New York. 2016;ISBN 978-3-319-24277-4. 20. 20.Morton F NJ. \_eq5d: Methods for Analysing ‘EQ-5D’ Data and Calculating ‘EQ-5D’ Index Scores\_. R package version 0.14.0. [https://CRANR-projectorg/package=eq5d](https://CRANR-projectorg/package=eq5d). 2023. 21. 21.Kirchberger I, Meisinger C, Warm TD, Hyhlik-Durr A, Linseisen J, Gosslau Y. Post-COVID-19 Syndrome in Non-Hospitalized Individuals: Healthcare Situation 2 Years after SARS-CoV-2 Infection. Viruses. 2023;15(6). Epub 2023/06/28. doi: 10.3390/v15061326. PubMed PMID: 37376625; PubMed Central PMCID: PMCPMC10303962. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.3390/v15061326&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=37376625&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F05%2F10%2F2024.05.09.24307158.atom) 22. 22.Schmachtenberg T, Konigs G, Dragaqina A, Roder S, Muller F, Mullenmeister C, et al. “There is no one who helps you with it”: experiences of people with long COVID regarding medical care, therapeutic measures, and barriers in the German healthcare system: results of a qualitative study with four focus groups. BMC Health Serv Res. 2023;23(1):1160. Epub 2023/10/27. doi: 10.1186/s12913-023-10170-x. PubMed PMID: 37884993; PubMed Central PMCID: PMCPMC10601213. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/s12913-023-10170-x&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=37884993&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F05%2F10%2F2024.05.09.24307158.atom) 23. 23.Coretti S, Ruggeri M, McNamee P. The minimum clinically important difference for EQ-5D index: a critical review. Expert Rev Pharmacoecon Outcomes Res. 2014;14(2):221–33. Epub 2014/03/15. doi: 10.1586/14737167.2014.894462. PubMed PMID: 24625040. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1586/14737167.2014.894462&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24625040&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F05%2F10%2F2024.05.09.24307158.atom) 24. 24.Steinmetz A, Gross S, Lehnert K, Lucker P, Friedrich N, Nauck M, et al. Longitudinal Clinical Features of Post-COVID-19 Patients-Symptoms, Fatigue and Physical Function at 3- and 6-Month Follow-Up. J Clin Med. 2023;12(12). Epub 2023/06/28. doi: 10.3390/jcm12123966. PubMed PMID: 37373660; PubMed Central PMCID: PMCPMC10299126. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.3390/jcm12123966&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=37373660&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F05%2F10%2F2024.05.09.24307158.atom) 25. 25.Bai F, Tomasoni D, Falcinella C, Barbanotti D, Castoldi R, Mule G, et al. Female gender is associated with long COVID syndrome: a prospective cohort study. Clin Microbiol Infect. 2022;28(4):611 e9– e16. Epub 2021/11/12. doi: 10.1016/j.cmi.2021.11.002. PubMed PMID: 34763058; PubMed Central PMCID: PMCPMC8575536. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.cmi.2021.11.002&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=34763058&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F05%2F10%2F2024.05.09.24307158.atom) 26. 26.Sagar-Ouriaghli I, Godfrey E, Bridge L, Meade L, Brown JSL. Improving Mental Health Service Utilization Among Men: A Systematic Review and Synthesis of Behavior Change Techniques Within Interventions Targeting Help-Seeking. Am J Mens Health. 2019;13(3):1557988319857009. Epub 2019/06/12. doi: 10.1177/1557988319857009. PubMed PMID: 31184251; PubMed Central PMCID: PMCPMC6560805. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/1557988319857009&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F05%2F10%2F2024.05.09.24307158.atom)