A Mobile App for Prolonged Grief among Bereaved Parents: Study Protocol for a Randomized Controlled Trial ========================================================================================================= * Rakel Eklund * Maarten C. Eisma * Paul A. Boelen * Filip Arnberg * Josefin Sveen ## ABSTRACT **Introduction** Bereaved parents have elevated risk to develop mental health problems, yet, few studies have evaluated the effect of psychosocial interventions developed for bereaved parents. Cognitive behavioral therapy (CBT), both face-to-face or digitally delivered, has shown to be an effective intervention for prolonged grief symptoms. Self-help mobile apps offer various advantages and studies show improved mental health after app interventions. No app has yet been evaluated targeting prolonged grief in bereaved parents. Therefore, the aim of this planned study is to develop and examine the effectiveness of a CBT-based mobile app, called *My Grief*, in reducing symptoms of prolonged grief, as well as other psychological symptoms, in bereaved parents. Another aim is to assess users’ experiences and adverse events of *My Grief*. **Methods and analysis** We will conduct a two-armed randomized waitlist-controlled trial. Parents living in Sweden, who lost a child to cancer between one and ten years ago, with elevated symptoms of prolonged grief, will be recruited to participate in the trial. The content of *My Grief* covers four main domains (Learn; Self-monitoring; Exercises; Get support) and builds on principles of CBT and the proven-effective PTSD Coach app. Participants in the intervention group will fill out online questionnaires at baseline and at 3-, 6- and 12-months follow-ups, and the waitlist-controls at baseline and at 3 months. The primary outcome will be prolonged grief symptoms at the 3 months follow-up. Secondary outcomes are posttraumatic stress and depression symptoms, quality of life, and cognitive behavioral variables (i.e., avoidance, rumination, negative cognitions). **Ethics and dissemination** Ethical approval has been received from the Swedish Ethical Review Authority (project no. 2021-00770). If the app is shown to be effective, the app will be made publicly accessible on app stores, so that it can benefit other bereaved parents. **Trial registration** Clinicaltrials.gov, identifier: [NCT04552717](http://medrxiv.org/lookup/external-ref?link_type=CLINTRIALGOV&access_num=NCT04552717&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F26%2F2021.04.23.21256003.atom). **STRENGTHS AND LIMITATIONS** * This is the first study to examine whether access of a self-help app can have beneficial effect on bereaved parent’s mental health, quality of life * This study will examine the effect of the app on cognitive-behavioral processes proposed to underlie the development of prolonged grief. * Generalizability of findings from this study may be limited as parents who want to participate in such study may experience fewer barriers to talk about the loss and seek help for their grief. * This study includes parents who have lost a child to cancer, hence the findings may not be generalizable to other causes. * This study uses self-report questionnaires, hence we do not establish formal diagnosis of prolonged grief disorder. KEYWORDS * Bereavement * Intervention * Parents * Pediatric cancer * Prolonged grief * My Grief * Smartphone application ## INTRODUCTION The death of one’s child can be a traumatic life experience and bereaved parents are at increased risk of developing both mental and physical health problems (1–6). While most bereaved individuals adjust to the loss of a loved one without professional intervention, a significant minority experience a persistent, severe and disabling grief reaction, called prolonged grief. Prolonged Grief Disorder (PGD), a diagnosis characterized by such severe grief responses, was recently included in the International Classification of Disorders eleventh edition (7). A similar version of PGD is scheduled to be included in the text revision of 5th edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5-TR for a commentary see Boelen et al., 2020 (8)). Across both disorders, core symptoms are persistent and pervasive yearning for the deceased, persistent and pervasive cognitive preoccupation with the deceased, as well as accessory symptoms presumed indicative of intense emotional pain, such as difficulty accepting the loss, a feeling of that one has lost a part of one’s self, and difficulty in engaging in social activities. Such severe grief reactions often co-occur with, yet are distinct from, disorders such as depression and posttraumatic stress (9), and relate to suicidal ideation (10), as well as reductions of quality of life (11). Bereaved parents are at high risk to develop prolonged grief (12–14). For example, 16% of cancer bereaved parents may have reactions indicative of PGD (15). Yet, there is a lack of studies evaluating the effect of psychosocial interventions for bereaved parents (16,17). Thus, the development and evaluation of accessible interventions to prevent and reduce negative mental health consequences after child loss appears clinically important. A growing body of evidence shows that cognitive behavioral therapy (CBT) is effective in treating prolonged grief symptoms when delivered face-to face (18–21), or via internet (22–24). Briefly, the cognitive-behavioral model of prolonged grief proposes that three core processes explain the occurrence and persistence of grief symptoms: insufficient integration of the loss with existing autobiographical knowledge; negative global beliefs about oneself, the world and the future and catastrophic misinterpretations of grief symptoms; and anxious avoidance (i.e., cognitive and overt avoidance of reminders of the loss) and depressive avoidance (i.e., avoidance of social, occupational and recreational activities, and behavioral withdrawal) (25). Accordingly, CBT treatments of prolonged grief typically includes creating a coherent, meaningful autobiographical narrative about the loss; challenging negative beliefs and catastrophic misinterpretations through cognitive restructuring; gradually confronting persons in vitro or in vivo with avoided aspects of the loss (e.g., places, objects, memories) through exposure techniques; and/or helping people to set new life-goals and engage in new, meaningful activities (26). Increasingly, researchers are also focused on examining the efficacy of other, complementary therapeutic techniques, which may be helpful in reaching these treatment goals, such as mindfulness-based therapy and relaxation (27–29). Mobile apps offer additional advantage over face-to-face and web-based interventions because of their availability, accessibility, the immediate support they can provide, and their anonymity (e.g., reducing barriers to seeking help for grief), low costs, and possible tailoring to the user (e.g., the user are in control over when and how to use the app) (30). Most individuals own a smartphone, regardless of socioeconomic background or living conditions, and many spend 2-5 hours a day using their smartphone (31). Moreover, people with mental health issues report daily use of smartphones to connect to other people and search for health-related information (32,33). Hence, mobile apps have a great potential to be used as self-help interventions for mental health problems. Indeed, various mobile apps for mental health have shown to be effective (34,35). Treatment trials have shown that mobile apps can decrease a variety of psychological symptoms, including posttraumatic stress (36,37) but also depression (38), anxiety (39), and substance use (e.g., tobacco, alcohol and drugs) (40). Despite the availability of a large number of mobile apps in app stores that claim to improve mental health, empirical evidence is lacking for most mobile applications (30,34,35). To our knowledge, no evidence-based app to reduce grief for bereaved parents exists. Based on the existing knowledge, we believe an app targeting prolonged grief using elements of CBT could potentially be effective in improving mental health in bereaved parents. The general goal of the present intervention study is to evaluate the effectiveness of an app for bereaved parents, which aims to facilitate the grieving process. The intervention includes access to a self-management mobile app, called *My Grief*, and is based on the cognitive-behavioral conceptualization framework of prolonged grief (18,25). The intervention also includes other evidence-based techniques from CBT such as elements of mindfulness and deep muscle relaxation practices, as these techniques have shown promising effects on loss-related mental health for bereaved individuals (27). The main aim of this study is to examine the effectiveness of the app *My Grief* as compared to a waiting list comparison in reducing symptoms of prolonged grief in bereaved parents. The primary hypothesis is that the parents in the intervention group will report decreased levels of prolonged grief symptoms after having access to the app. A second aim is to examine the effect of the app on related mental health problems (posttraumatic stress symptoms, depression symptoms, quality of life) and cognitive behavioral variables putatively explaining the effect of CBT techniques (i.e., grief avoidance, grief rumination and negative grief cognitions). The secondary hypotheses are that the parents in the intervention group will report improved mental health (i.e., lower symptom levels of depression and posttraumatic stress, higher quality of life), and lower grief avoidance, grief rumination and negative grief-related cognitions. A third aim is to assess participants experience of using the app, e.g., perceived satisfaction helpfulness, and adverse events. ## METHODS AND ANALYSIS ### Design We plan to conduct a two-armed parallel-group randomized waitlist-controlled trial comparing the effects of access to the *My Grief* for three months compared to waitlist. Randomization will take place after the pre-assessment is completed, using a random number generator ([www.random.org](http://www.random.org)) by a blinded independent researcher, using block randomization with an allocation ratio of 1:1. Participants will be informed of group allocation immediately after randomization (Figure 1). ![Figure 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/04/26/2021.04.23.21256003/F1.medium.gif) [Figure 1.](http://medrxiv.org/content/early/2021/04/26/2021.04.23.21256003/F1) Figure 1. Design of the RCT ### Participants and procedures Parents living in Sweden, who lost a child to cancer between 1 and 10 years ago, with elevated symptoms of prolonged grief, will be recruited to participate in the intervention. Potential participants are identified using the Swedish Childhood Cancer Registry, the Cause of Death Registry, and the Swedish Population Register at the Swedish Tax Agency. By linking the Cause of Death Registry with the Swedish Childhood Cancer Registry, children diagnosed with a malignancy and who died due to the malignancy 1 to 10 years previously will be identified. Next, the children’s parents are identified through the Swedish Population Register and will be sent a letter with an invitation to participate in the study. People who are interested in participation are directed to a website, [www.minsorg.com](http://www.minsorg.com), where they can access information about the study aims and procedures. On the web-site they can sign up to the study and complete an online screening questionnaire which automatically direct eligibly participants to an informed consent form and the pre-assessment online questionnaire, in REDcap (41). After filling in the pre-assessment they are randomized by an independent person to either the intervention or waiting list group. Participants in the intervention group will receive a phone call from a researcher one week after the intervention started to ensure that the app is working properly. Participants in the intervention group are allowed to use the *My Grief* app for three months. The control group will be informed that they are on waiting list and will be offered access to the *My Grief* app after three months (Figure 1). Recruitment is planned to start August 2021. ### Eligibility criteria Inclusion criteria for participation are: 1) being a parent of a child who has died of cancer between 1 and 10 years previously, 2) having elevated symptom levels of prolonged grief, 3) understanding and speaking Swedish, and 4) having access to a smartphone. Exclusion criteria are self-reported ongoing suicidal thoughts or psychosis, assessed with single-items in the screening questionnaire. ### Sample size A required sample size of 154 participants was calculated in G*Power version 3.1, based on the primary research question. We considered a moderate effect size to be clinically meaningful (*f* = 0.25), within a repeated measure ANOVA, a desired power of 0.80, *α* = 0.05, and an assumed strong association (*r* = 0.50) between the pre-assessment and post-assessment. The estimate includes an anticipated attrition rate of 16% (42). ### Intervention *My Grief* is a self-help app for smartphone users, compatible with both iOS and Android. The app builds on principles of CBT and a PGD online-treatment protocol (43). It is based on a cognitive-behavioral conceptualization of prolonged grief and proposes that three “grief tasks” are critical in alleviating grief (18,25). These tasks are 1) facing the loss and the pain that goes with it, 2) keeping confidence in yourself, others, life and future, and 3) engaging in helpful activities that promote adjustment to the new situation. Interventions used to accomplish these tasks include psychoeducation and normalization of grief reactions, exposure to avoided aspects of the loss, and goal setting and behavioral activation. The structure of the app includes four main sections (Figure 2) and is based on PTSD Coach app with permission from the Veterans’ Affairs National Center for PTSD and Department of Defense’s DHA Connected Health (36,44). ![Figure 2.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/04/26/2021.04.23.21256003/F2.medium.gif) [Figure 2.](http://medrxiv.org/content/early/2021/04/26/2021.04.23.21256003/F2) Figure 2. Structure of the *My Grief* app. The four main sections in *My Grief* include: 1. *Learn*. This section provides psychoeducation about grief. It covers what is normal and prolonged grief; what commonly experienced thoughts, feelings and behaviors are after loss; the three grief tasks; and coping with grief within the family. The latter topic includes tips on how to understand different family members’ grieving processes, how to help each other, how to continue doing things together, how to support the remaining children in the family (i.e., siblings to the deceased child) in their grief process, and how to talk to children about death. In each part, there are links to corresponding exercises in section 3. 2. *Self-monitoring*. This section includes a rating scale (score 0-10) that users can employ to assess the daily intensity of their grief and the highest and lowest grief levels during the day. It also provides space to note on what happened at that time. The section gives users both visual and written feedback from themselves as the results are presented together with previous assessments. This enables users to monitor their grief intensity and symptoms over time, to recognize situations when grief levels are low or high, and to identify activities and internal and external stimuli associated with increases and decreases in grief; this helps them to learn more about one’s own grief and to improve adaptive ways of coping. User can use the rating scale as many times as they want, whenever they want. Participants are encouraged to fill in the scale daily and they can choose to receive a daily reminder to fill in the scale. 3. *Exercises*. This section provides the user with self-guided exercises. A majority of the exercises include recorded audio. For example, the user can choose to read or listen to instructions for a particular exercise. Some of the exercises were taken from the PTSD Coach Sweden (45), including mindfulness exercises (e.g., body scan, mindful breathing, learning to be aware of one’s senses), progressive muscle relaxation, deep breathing, and stress reduction and positive psychology exercises. Other exercises were derived from CBT (18,25). The writing exercise section includes tasks covering the three grief tasks in the CBT model. Three writing exercises, drawing from an internet-based exposure treatment (43), are related to task one. In these writing exercises, participants expose themselves to the story of loss and are encouraged to confront implications of the irreversibility of the separation from the deceased. For example, in the exposure to the story of the loss the participants are instructed to write down what happened around the time of the death, in three steps, in order to confront feelings, thoughts and situations which are difficult and emotionally painful. One exercise is related to grief task two and instructs participants to every day take a few minutes to think positive about the future and what they want for the future and to write this down in a diary. One exercise related to grief task three, is based on behavioral activation principles. It consists of encouragement to plan a moment every day to engage in an activity that potentially elicits some pleasure or joy. 4. *Get support*. This section provides the user with contact details to different support functions and help-lines (including phone numbers, chats, e-mail addresses, and websites) for both the parent and his/her family members. These support functions or help-lines include the Childhood Cancer Foundation, a suicide prevention organization, and different networks for parents who lost a child. It also includes psycho-education regarding how the user can create and expand one’s own support network throughout reaching out for help to family and friends. Participants can create a list of phone-numbers to family, friends and help-lines in this section as well. ### Data collection Participants complete questionnaires online. Time points for data collected via online questionnaires at t0 (baseline), t1 (3 months), t2 (6 months, only intervention group) and t3 (12 months, only intervention group) (Table 1; Figure 1). If the participant has not completed the online questionnaire, two reminder emails will be sent out for each measurement time-point. View this table: [Table 1.](http://medrxiv.org/content/early/2021/04/26/2021.04.23.21256003/T1) Table 1. Timepoints for measurements #### Sociodemographic and loss-related variables A self-constructed questionnaire will be used to gather information about the participants’ demographic information, such as age, gender, education, employment, the child’s form of cancer and date of the child’s death. These data will be used to describe the sample. #### Primary outcome *Prolonged grief symptoms* will be measured by “Prolonged Grief Disorder-13” (PG-13). It consists of 13 items including 11 items assessing cognitive, behavioral and emotional symptoms during the past month, rated on a 5-point scale (not at all – several times a day/overwhelmingly). It also contains two items on duration and impairment (yes/no). PG-13 is scored by summarizing the 11 items regarding symptoms. The total score ranges from 11 to 55, with higher scores indicates more severe PGD (46). The instrument is validated in a Swedish sample with bereaved parents and indicates satisfactory psychometric properties (15). #### Secondary outcomes *Posttraumatic stress disorder symptoms* will be measured with the Posttraumatic Stress Disorder Checklist for DSM-5 (PCL-5) at baseline and follow up. It consists of 20 items describing symptoms of posttraumatic stress. Participants rate on a 5-point scale (not at all – extremely, 0-4) to what extent they experience symptoms. The total score ranges from 0-80, and a higher score indicates more symptoms of posttraumatic stress (47). The Swedish version has shown satisfactory psychometric properties (48). *Depression symptoms* will be assessed with the Patient Health Questionnaire (PHQ-9), which consists of nine items describing symptoms of depression. Participants rate to what extent they experience these symptoms during the last two weeks on a 4-point scale (not at all – nearly every day, 0-3). The total score ranges from 0-27, and a higher score indicates greater symptom severity (49). *Quality of life* will be measured with the Brunnsviken Brief Quality of Life Inventory, BBQ). It consists of 12 items covering six different life domains. Participants rate on a 5-point scale (strongly disagree – strongly agree, 0-4), to what extent they agree with the statement. Total score ranges from 0-96. The instrument is validated in a Swedish sample (50). *Grief-specific avoidance* will be measured with the Depressive and Anxious Avoidance in Prolonged Grief Questionnaire (DAAPGQ). The questionnaire consists of nine items; five items measure depressive avoidance of activities and four items measures anxious avoidance of stimuli reminding of the loss. Participants rate on an 8-point scale (not at all true for me – completely true for me, 0-7) to what extent they experience the symptoms (51). Total score ranges from 0-72. The DAAPGQ was translated into Swedish by two grief researchers (JS & RE) at the Department of Neuroscience, Uppsala University in 2020 following European Organization for Research and Treatment of Cancer (EORTC) guidelines (52). *Grief-specific rumination* will be measured with the Utrecht Grief Rumination Scale (UGRS). The instrument consists of 15 items measuring different aspects of grief rumination. The participants rate on a 5-point scale (never-very often, 1-5) how often they experienced certain thoughts over the last month (53). Total scores range from 15-75 and generate an overall grief rumination score. The instrument is validated in a Swedish sample with bereaved parents and indicates satisfactory psychometric properties (54). *Negative grief cognitions* will be measured using a short version of Grief Cognitions Questionnaire (GCQ-18). It consists of 18 items, with statements regarding negative grief cognitions. Participants rate on a 6-point scale to what extent they agree with the statement (disagree strongly – agree strongly, 0-5). The total score ranges from 0-90 (55) and a higher score indicates stronger endorsement of negative cognitions (56). The GCQ was translated into Swedish by two grief researchers (JS & RE) at the Department of Neuroscience, Uppsala University in 2020 following EORTC guidelines (52). #### Users’ experiences: perceived satisfaction, helpfulness and adverse events A questionnaire with 25 items (9 of them with free-text response) regarding the user experience of the app will be used after participants have had access to the app for three months. The questionnaire includes questions regarding for example the perceived helpfulness and benefits of the app, which sections and tools the participants used most commonly and why, and if any parts of the app could be improved. Adverse events are assessed through the question “Did the use of the app have any negative consequences?” Participants who answered yes are asked to expand upon this. ### Data management Study data is managed using REDCap electronic data capture tools (41) hosted at Uppsala University. All data will be de-identified with a code number. The key to the codes will be stored separately, and is only available to members from the research group. ### Statistical methods and analysis T-tests and χ2 tests will be used to compare groups on all loss-related and sociodemographic variables. To examine intervention effects on the primary and secondary outcome variables, multiple regression models with the direct and interaction effect of condition × time with the primary endpoint at 3 months follow-up will be performed. Missing data at follow-up will be handled under the assumption of missing at random. Data of all randomized participants will be included in the analyses (i.e., intention-to-treat analysis). Cohen’s *d* and a 95% confidence interval will be calculated to assess the within and between-group effect sizes at post-intervention and follow-ups. Within group Cohen’s *d*’s, the standardized mean difference between the pre- and the post-assessments for each group, will be calculated (57). Between groups Cohen’s *d*’s will also be calculated by dividing the differences between change scores of both groups across time by the pooled standard deviation of both groups at baseline (58). ### Patient and public involvement Two parents that lost their children to cancer were taking part in reading the content of the app and help out with translation of some questionnaires. The app will be pilot tested by 10-15 bereaved parents during April - May 2021. The parents will be asked to use *My Grief* for four weeks. After that, an in-depth assessment of the user experiences of the app will be conducted via telephone, by a member of the research team with questions, e.g., what it was like to use the app, how often they used it, which tools they used most commonly and why, and also whether they have suggestions to improve the app. The inputs and results of this testing may lead to changes in the intervention. ### Ethics and dissemination All participants will fill out their consent to participate before enrolment, and they will be informed that they can decline their participation at any time without giving a reason. The pilot study (project no. 2020-01704) and the RCT (project no. 2021-00770) have received ethical approval from the Swedish Ethical Review Authority. Collected data will be handled confidentially, according to the European Union General Data Protection Regulation. If the app is shown to be effective, the app will be made publicly accessible on app stores, so that it can benefit other bereaved people. Our findings will be presented to the Swedish Childhood Cancer foundation and other non-profit organizations for bereaved people. Colleagues will be informed about our findings during presentations at conferences and publications in scientific journals. Taking part in this intervention could generate negative feelings and bring back negative memories, as it will elicit thoughts about the loss of the child. Any participant that reports experiencing harm or negative consequences as a result of their participation can, upon their request, be referred to an appropriate health care provider. However, we anticipate that participants can also experience positive outcomes, such as learning more about their own grief, increases in self-awareness, and improvements in mental health. Previous research shows that parents who lost a child to cancer valued participation in research as a positive experience despite extensive questionnaires of potentially sensitive character (59). Previous research also shows that participants who have experienced trauma show no negative effects of using the similar app PTSD Coach, and indicate that the app is both acceptable and feasible to use (42,44,45,60). Therefore, we believe that the benefits of participation in the study outweigh the risks. ## DISCUSSION In this study protocol, we describe the development and planned evaluation of the self-management smartphone app *My Grief* for parents with prolonged grief symptoms after losing a child to cancer. This study will clarify whether the access of an app can have beneficial effects on bereaved parent’s mental health, quality of life and on cognitive-behavioral processes proposed to underlie the development of prolonged grief. Offering a self-help app to bereaved parents in order to facilitate their grief process may have potential advantages, such as reducing barriers to seeking help, e.g., finding it too painful to speak about the loss, difficult to find appropriate help, or the negative effects of mental health stigma on help-seeking (13,61). The app is available free of charge to the users, and could be used in any geographic location and does not require visiting a health care organization. However, the *My Grief* app is not a guided treatment as it does not include any personal feedback from health care professionals or the research group, which could be perceived as a limitation. Studies on the PTSD Coach app have had dropout rates below 25% (36,45) and an ongoing RCT on the PTSD Coach Sweden, has a dropout rate of 11% (personal communication). Generalizability of findings from this study may be limited for a number of reasons. Possibly, people who already received therapy or other social support prior to the loss may be more willing to participate in this study, because they may experience fewer barriers to seek help or talk about psychological problems (13,61). Similarly, people who are more willing to use technology, such as mobile apps or internet-treatments, would probably be more willing to participate in an app-based study (61–63). The generalizability of study outcomes may be affected in two ways by this selection bias. Tech-savvy users may appreciate the mode of delivery more which could have a positive impact on outcomes. Alternatively, those with more experience of technology could have higher standards and therefore higher demands of the app, which could affect their user experience and outcome in more negative ways. As seen in previous studies with the PTSD Coach app, some participants may experience difficulties with downloading or installing the app, or to remember to use it more than once during an ongoing intervention (64,65). In the *My Grief* app, a daily reminder can be set up to remind them to rate their grief in the grief chart self-assessment. The research group will also make a phone call to each user, about one week from registration, to check if everything is working. We expect that these measures will increase participant involvement in using the app. This study includes parents who have lost a child to cancer, hence the findings may not be generalizable to other causes, such as accidents and suicide, and more research is needed including parents who have lost a child due to other causes. To conclude, this RCT will provide new insight to the effectiveness of a self-management app for prolonged grief in bereaved parents. If the app is found to be beneficial, it will provide a valuable addition to the bereavement support offered to bereaved parents in Sweden and may complement other psychological, medical and social interventions for prolonged grief. In addition, a next step could be to develop versions of the app for other groups of bereaved individuals and in other languages. ## Data Availability Data will be available upon request to the principal investigator (JS) and unidentifiable data from this trial will be stored in data repositories at www.OSF.io. ## DECLARATIONS ### Competing interests The authors declare that they have no competing interests. ### Funding This research was funded by the Swedish Childhood Cancer Fund (PR2018-0047; TJ2018-0002). This funding source had no role in the design of this study and will not have any role during its execution, analyses, interpretation of the data, or decision to submit results. ### Data Availability Statement Data will be available upon request to the principal investigator (JS) and unidentifiable data from this trial will be stored in data repositories at [www.OSF.io](http://www.OSF.io). ### Author’s contribution JS is principal investigator and grant holder. RE and JS are executive researchers and wrote the ethics proposals. RE, JS, ME, FA and PB developed the study design. RE, JS and ME developed the draft of the manuscript. FA and PB read, revised, and approved the draft of the manuscript. All authors approved the final manuscript. ## Acknowledgement Thanks to the Veterans’ Affairs National Center for PTSD and Department of Defense’s DHA Connected Health for letting us base the *My Grief* app on the PTSD Coach source code. A special thanks to the two bereaved parents helping us with reading and commenting on the content in the app. * Received April 23, 2021. * Revision received April 23, 2021. * Accepted April 26, 2021. * © 2021, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution-NonCommercial 4.0 International), CC BY-NC 4.0, as described at [http://creativecommons.org/licenses/by-nc/4.0/](http://creativecommons.org/licenses/by-nc/4.0/) ## REFERENCES 1. 1.Arnold J, Gemma PB, Cushman LF. Exploring parental grief: Combining quantitative and qualitative mesures. Arch Psychiatr Nurs. 2005;19(6):245–55. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.apnu.2005.07.008&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=16308124&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F26%2F2021.04.23.21256003.atom) 2. 2.Kreicbergs U, Valdimarsdóttir U, Onelöv E, et al. Anxiety and depression in parents 4-9 years after the loss of a child owing to a malignancy: a population-based follow-up. Psychol Med. 2004;34(8):1431. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1017/S0033291704002740&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=15724874&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F26%2F2021.04.23.21256003.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000225680700006&link_type=ISI) 3. 3.Morris S, Fletcher K, Goldstein R. The grief of parents after the death of a young child. J Clin Psychol Med Settings. 2019;26(3):321–38. 4. 4.October T, Dryden-Palmer K, Copnell B, et al. Caring for parents after the death of a child. Pediatr Crit Care Med. 2018;19(8):61–68. 5. 5.Pohlkamp L, Kreicbergs U, Sveen J. Bereaved mothers’ and fathers’ prolonged grief and psychological health 1-5 years after loss–a nationwide study. Psycho-Oncology. 2019;28;1530–1536 [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F26%2F2021.04.23.21256003.atom) 6. 6.Stroebe M, Schut H, Stroebe W. Health outcomes of bereavement. The Lancet. 2007;370(9603):1960–73. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S0140-6736(07)61816-9&link_type=DOI) 7. 7.World Health Organization: ICD-11 for Mortality and Morbidity Statistics; 6B42 Prolonged grief disorder. [https://icd.who.int/browse11/l-m/en#/](https://icd.who.int/browse11/l-m/en#/)[http://id.who.int/icd/entity/1183832314](http://id.who.int/icd/entity/1183832314) (2020). Accessed 17 Nov 2020. 8. 8.Boelen P, Eisma MC, Smid GE, et al. Prolonged grief disorder in section II of DSM-5: a commentary. Eur J Psychotraumatology. 2020;11;1. 9. 9.Boelen PA, van de Schoot R, van den Hout MA, et al. Prolonged grief disorder, depression, and posttraumatic stress disorder are distinguishable syndromes. J Affect Disord. 2010;125(1):374–8. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jad.2010.01.076&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=20189657&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F26%2F2021.04.23.21256003.atom) 10. 10.Latham AE, Prigerson HG. Suicidality and bereavement: complicated grief as psychiatric disorder presenting greatest risk for suicidality. Suicide Life Threat Behav. 2004;34(4):350–62. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1521/suli.34.4.350.53737&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=15585457&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F26%2F2021.04.23.21256003.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000225913600002&link_type=ISI) 11. 11.Maccallum F, Bryant RA. Symptoms of prolonged grief and posttraumatic stress following loss: A latent class analysis. Aust N Z J Psychiatry. 2019;53(1):59–67. 12. 12.Kersting A, Brähler E, Glaesmer H, et al. Prevalence of complicated grief in a representative population-based sample. J Affect Disord. 2011;131(1–3):339–43. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jad.2010.11.032&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21216470&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F26%2F2021.04.23.21256003.atom) 13. 13.Lichtenthal WG, Corner GW, Sweeney CR, et al. Mental health services for parents who lost a child to cancer: If we build them, will they come? J Clin Oncol. 2015;33(20):2246. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiamNvIjtzOjU6InJlc2lkIjtzOjEwOiIzMy8yMC8yMjQ2IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDQvMjYvMjAyMS4wNC4yMy4yMTI1NjAwMy5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 14. 14.McCarthy MC, Clarke NE, Ting CL, et al. Prevalence and predictors of parental grief and depression after the death of a child from cancer. J Palliat Med. 2010;13(11):1321–6. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1089/jpm.2010.0037&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=20954828&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F26%2F2021.04.23.21256003.atom) 15. 15.Pohlkamp L, Kreicbergs U, Prigerson HG, et al. Psychometric properties of the Prolonged Grief Disorder-13 (PG-13) in bereaved Swedish parents. Psychiatry Res. 2018;267;560–5. 16. 16.Kochen EM, Jenken F, Boelen PA, et al. When a child dies: a systematic review of well-defined parent-focused bereavement interventions and their alignment with grief-and loss theories. BMC Palliat Care. 2020;19;28 17. 17.1. Wolfe J Lövgren M, Sveen J. Family Bereavement Care. In: Wolfe J, editor. Palliative Care in Pediatric Oncology. Springer; 2018. p. 245–264 18. 18.Boelen P, de Keijser J, van den Hout MA, et al. Treatment of complicated grief: a comparison between cognitive-behavioral therapy and supportive counseling. J Consult Clin Psychol. 2007;75(2):277–284. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1037/0022-006X.75.2.277&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=17469885&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F26%2F2021.04.23.21256003.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000245394600008&link_type=ISI) 19. 19.Bryant RA, Kenny L, Joscelyne A, et al. Treating prolonged grief disorder: A randomized clinical trial. JAMA Psychiatry. 2014;71(12):1332–9. 20. 20.Rosner R, Pfoh G, Kotoučová M, et al. Efficacy of an outpatient treatment for prolonged grief disorder: A randomized controlled clinical trial. J Affect Disord. 2014;167;56–63. 21. 21.Shear K, Frank E, Houck PR, et al. Treatment of complicated grief: a randomized controlled trial. JAMA Psychiatry. 2005;293(21):2601–8. 22. 22.Eisma M, Boelen PA, van den Bout J, et al. Internet-Based Exposure and Behavioral Activation for Complicated Grief and Rumination: A Randomized Controlled Trial. Behav Ther. 2015;46(6):729–48. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F26%2F2021.04.23.21256003.atom) 23. 23.Kersting A, Dölemeyer R, Steinig J, et al. Brief internet-based intervention reduces posttraumatic stress and prolonged grief in parents after the loss of a child during pregnancy: a randomized controlled trial. Psychother Psychosom. 2013;82(6):372–81. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F26%2F2021.04.23.21256003.atom) 24. 24.Litz BT, Schorr Y, Delaney E, et al. A randomized controlled trial of an internet-based therapist-assisted indicated preventive intervention for prolonged grief disorder. Behav Res Ther. 2014;61;23–34. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.brat.2014.07.005&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25113524&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F26%2F2021.04.23.21256003.atom) 25. 25.Boelen P, Van Den Hout MA, Van Den Bout J. A cognitive-behavioral conceptualization of complicated grief. Clin Psychol Sci Pract. 2006;13(2):109–28. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/j.1468-2850.2006.00013.x&link_type=DOI) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000237781700001&link_type=ISI) 26. 26.Doering BK, Eisma MC. Treatment for complicated grief: state of the science and ways forward. Curr Opin Psychiatry. 2016;29(5):286–91. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1097/YCO.0000000000000263&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F26%2F2021.04.23.21256003.atom) 27. 27.Knowles LM. A Randomized Controlled Pilot Trial of a Mindfulness Intervention for Grief in Widows and Widowers. The university of Arizona; 2019. 28. 28.O’Connor M, Piet J, Hougaard E. The Effects of Mindfulness-Based Cognitive Therapy on Depressive Symptoms in Elderly Bereaved People with Loss-Related Distress: A Controlled Pilot Study. Mindfulness. 2014:1;5;400 – 409. 29. 29.Lenferink LI, de Keijser J, Wessel I, et al. Cognitive behavioral therapy and mindfulness for relatives of missing persons: a pilot study. Pilot Feasibility Stud 2019;5(1):1–17. 30. 30.Olff M. Mobile mental health: a challenging research agenda. Eur J Psychotraumatology. 2015;6;1. 31. 31.Pew Research Center: Mobile Fact Sheet. [https://www.pewresearch.org/internet/fact-sheet/mobile/](https://www.pewresearch.org/internet/fact-sheet/mobile/) (2021). Accessed 25 Mar 2021. 32. 32.Ben-Zeev D, Davis KE, Kaiser S, et al. Mobile Technologies Among People with Serious Mental Illness: Opportunities for Future Services. Adm Policy Ment Health. 2013 Jul;40(4):340–3. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s10488-012-0424-x&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22648635&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F26%2F2021.04.23.21256003.atom) 33. 33.Naslund JA, Aschbrenner KA, Bartels SJ. How People with Serious Mental Illness Use Smartphones, Mobile Apps, and Social Media. Psychiatr Rehabil J. 2016;39(4):364–7. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F26%2F2021.04.23.21256003.atom) 34. 34.Bush NE, Armstrong CM, Hoyt TV. Smartphone apps for psychological health: A brief state of the science review. Psychol Serv. 2019;16;2. 35. 35.Wang K, Varma DS, Prosperi M. A systematic review of the effectiveness of mobile apps for monitoring and management of mental health symptoms or disorders. J Psychiatr Res. 2018;107;73–8. 36. 36.Kuhn E, Kanuri N, Hoffman JE, et al. A randomized controlled trial of a smartphone app for posttraumatic stress disorder symptoms. J Consult Clin Psychol. 2017;85;3. 37. 37.Kuhn E, van der Meer C, Owen JE, et al. PTSD Coach around the world. Mhealth. 2018;4. 38. 38.Birney AJ, Gunn R, Russell JK, et al. MoodHacker mobile web app with email for adults to self-manage mild-to-moderate depression: randomized controlled trial. MHealth. 2016;4. 39. 39.Firth J, Torous J, Nicholas J, et al. Can smartphone mental health interventions reduce symptoms of anxiety? A meta-analysis of randomized controlled trials. J Affect Disord. 2017;15;218;15–22. 40. 40.Rizvi SL, Dimeff LA, Skutch J, et al. A pilot study of the DBT coach: an interactive mobile phone application for individuals with borderline personality disorder and substance use disorder. Behav Ther. 2011;42(4):589–600. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.beth.2011.01.003&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22035988&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F26%2F2021.04.23.21256003.atom) 41. 41.Harris PA, Taylor R, Thielke R, et al. Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;1;42(2):377–81. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jbi.2008.08.010&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=18929686&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F26%2F2021.04.23.21256003.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000264958800018&link_type=ISI) 42. 42.Miner A, Kuhn E, Hoffman JE, et al. Feasibility, acceptability, and potential efficacy of the PTSD Coach app: A pilot randomized controlled trial with community trauma survivors. Psychol Trauma Theory. 2016;8;3. 43. 43.Lenferink L, de Keijser J, Eisma M, et al. Online cognitive–behavioral therapy for traumatically bereaved people: study protocol for a randomised waitlist-controlled trial. BMJ Open. 2020;10;9. 44. 44.Kuhn E, Greene C, Hoffman J, et al. Preliminary evaluation of PTSD Coach, a smartphone app for post-traumatic stress symptoms. Mil Med. 2014;179(1):12–8. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.7205/MILMED-D-13-00271&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24402979&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F26%2F2021.04.23.21256003.atom) 45. 45.Cernvall M, Sveen J, Bergh Johannesson K, et al. A pilot study of user satisfaction and perceived helpfulness of the Swedish version of the mobile app PTSD Coach. Eur J Psychotraumatology. 2018;9. 46. 46.Prigerson HG, Horowitz MJ, Jacobs SC, et al. Prolonged grief disorder: Psychometric validation of criteria proposed for DSM-V and ICD-11. PLoS Med. 2009;6;8 47. 47.Blevins CA, Weathers FW, Davis MT, et al. The posttraumatic stress disorder checklist for DSM-5 (PCL-5): Development and initial psychometric evaluation. J Trauma Stress. 2015;28(6):489–98. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/jts.22059&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=26606250&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F26%2F2021.04.23.21256003.atom) 48. 48.Sveen J, Bondjers K, Willebrand M. Psychometric properties of the PTSD Checklist for DSM-5: a pilot study. Eur J Psychotraumatology. 2016;7;1. 49. 49.Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1046/j.1525-1497.2001.016009606.x&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=11556941&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F26%2F2021.04.23.21256003.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000171184700005&link_type=ISI) 50. 50.Lindner P, Frykheden O, Forsström D, et al. The Brunnsviken Brief Quality of Life Scale (BBQ): Development and Psychometric Evaluation. Cogn Behav Ther. 20163;45(3):182– 95. 51. 51.Boelen P, Van den Bout J. Anxious and depressive avoidance and symptoms of prolonged grief, depression, and post-traumatic stress disorder. Psychol Belg. 2010;50;1. 52. 52.Kulis D, Bottomley A, Velikova G, et al. EORTC Quality of life group translation procedure. 4th edition. European Organization for Research and Treatment of Cancer; 2017. 53. 53.Eisma M, Stroebe MS, Schut HA,et al. Development and psychometric evaluation of the Utrecht Grief Rumination Scale. J Psychopathol Behav Assess. 2014;36(1):165–76. 54. 54.Sveen J, Pohlkamp L, Kreicbergs U, et al. Rumination in bereaved parents: Psychometric evaluation of the Swedish version of the Utrecht Grief Rumination Scale (UGRS). PLoS One. 2019;14;3. 55. 55.Doering BK, Boelen PA, Eisma MC, et al. Validation of a German Version of the Grief Cognitions Questionnaire and Establishment of a Short Form. Front Psychol. 2020;11. 56. 56.Boelen P, Lensvelt-Mulders GJ. Psychometric properties of the grief cognitions questionnaire (GCQ). J Psychopathol Behav Assess. 2005;27(4):291–303. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s10862-005-2409-5&link_type=DOI) 57. 57.Morris SB, DeShon RP. Combining effect size estimates in meta-analysis with repeated measures and independent-groups designs. Psychol Methods. 2002;7;1. 58. 58.Morris SB. Estimating effect sizes from pretest-posttest-control group designs. Organ Res Methods. 2008;11(2):364–86. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/1094428106291059&link_type=DOI) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000253949700009&link_type=ISI) 59. 59.Kreicbergs U, Valdimarsdóttir U, Steineck G, et al. A population-based nationwide study of parents’ perceptions of a questionnaire on their child’s death due to cancer. The Lancet. 2004;364(9436):787–9. 60. 60.Keen SM, Roberts N. Preliminary evidence for the use and efficacy of mobile health applications in managing posttraumatic stress disorder symptoms. Health Syst. 2017;6(2):122–9. 61. 61.Lenferink LI, de Keijser J, Eisma MC, et al. Treatment gap in bereavement care:(Online) bereavement support needs and use after traumatic loss. Clin Psychol Psychother. 2021;1;10 62. 62.Arjadi R, Nauta MH, Bockting CL. Acceptability of internet-based interventions for depression in Indonesia. Internet Interv. 2018;13;8–15. 63. 63.Lu J, Yao JE, Yu C-S. Personal innovativeness, social influences and adoption of wireless Internet services via mobile technology. J Strateg Inf Syst. 2005;14(3):245–68. 64. 64.Pacella-LaBarbara ML, Suffoletto BP, Kuhn E, et al. A Pilot Randomized Controlled Trial of the PTSD Coach App Following Motor Vehicle Crash-Related Injury. Acad Emerg Med. 2020;27;1126–1139 65. 65.Shakespeare-Finch J, Alichniewicz KK, Strodl E, et al. Experiences of Serving and Ex-Serving Members with the PTSD Coach Australia App: Mixed Methods Study. J Med Internet Res. 2020;22;10.