From many voices, one question: Community co-design of a population-based qualitative cancer research study =========================================================================================================== * Susannah K. Ayre * Elizabeth A. Johnston * Xanthia E. Bourdaniotis * Leah Zajdlewicz * Vanessa L. Beesley * Jason D. Pole * Aaron Hansen * Harry Gasper * Danica Cossio * Gemma Lock * Belinda C. Goodwin ## Abstract **Purpose** This study formed the development stage of a population-based survey aiming to: (i) understand the needs and experiences of people affected by cancer in Queensland, Australia and (ii) recruit a pool of participants for ongoing cancer survivorship research. The current study aimed to co-design and test a single qualitative survey question and study invitation materials to maximise acceptability of, and participation in, the survey and future research. **Methods** Fifty-two community members participated across 15 co-design workshops and 20 pretest interviews. During workshops, participants generated and refined ideas for an open-ended survey question and provided feedback on a study invitation letter. The use of a single, open-ended question aims to minimise participant burden while collecting rich information about needs and experiences. The research team then shortlisted the question ideas and revised study invitation materials based on workshop feedback. Next, using interviews, community members were asked to respond to a shortlisted question to test its interpretability and relevance and to review revised invitation materials. Content analysis of participant feedback was used to identify principles for designing study materials. **Results** Ten principles for designing qualitative survey questions were identified from participant feedback. Key principles included: *define the question timeframe and scope; provide reassurance that responses are valid and valued;* and *use simple wording*. For the study invitation materials, 11 principles were identified, including these key principles: *communicate empathy and sensitivity; facilitate reciprocal benefit;* and *include a ‘human element’.* The qualitative survey question and study invitation materials created using these principles were considered relevant and acceptable for use in a population-based survey. **Conclusions** Through community consultation and co-design, this study identified principles for designing qualitative data collection and invitation materials for use in cancer survivorship research. These principles can be applied by other researchers to develop study materials that are sensitive to the needs and preferences of community members. Keywords * Cancer survivors * citizen science * community-based participatory research * focus groups * oncology * qualitative ## Introduction In recent decades, an ageing population and low uptake of healthy lifestyle behaviours have resulted in more people being diagnosed with cancer, and improvements in cancer detection and treatment means people are living longer post-diagnosis [1,2]. While people diagnosed with cancer have unique disease trajectories, a common experience of cancer and its treatment is the widespread impact on a person’s health and wellbeing, often continuing well after treatment completion [3]. Informal caregivers (i.e., family and friends) are closely involved in supporting their loved ones to manage the impact of cancer and its treatment, often with minimal preparation for their caregiving role [4]. Consequently, caregivers can experience poor health and wellbeing due to the prolonged stress and physical demands involved [5]. In the context of increasingly resource-constrained healthcare systems, there is a growing need for community-based supportive care services that are effective in supporting the increasing number of cancer survivors and caregivers [6]. The delivery of effective supportive care services cannot be achieved without a comprehensive understanding of the needs and experiences of the cancer survivors and caregivers for whom these services are provided to. Evidence indicates that patient- and family-centred interventions result in higher satisfaction with healthcare, increased knowledge and skills for managing self-care behaviours, reduced reliance on healthcare services, and improved quality of life for both patients and caregivers [7]. Many instruments have been used in research and clinical practice to assess needs [8,9]. The Supportive Care Needs Survey-Short Form (SCNS-SF34) [10], Cancer Survivors’ Unmet Needs (CaSUN) [11], Comprehensive Needs Assessment Tool for Cancer Caregivers (CNAT-C) [12], and Supportive Care Needs Survey for partners and caregivers (SCNS-P&C) [13] are among the most widely used. However, such instruments rely on set items with pre-determined responses that may not capture the full scope of needs and do not allow respondents to express their experiences in their own words [14]. Thus, qualitative survey methods are necessary to achieve a comprehensive understanding of the needs and experiences of people affected by cancer at the population level. While qualitative research has typically been conducted with small samples, advancements in artificial intelligence and machine learning analytic techniques provide an opportunity to analyse large volumes of open-text data in a timely manner to inform service delivery [15]. To date, no suitable qualitative survey exists, providing an opportunity for community participation in co-designing materials to capture the supportive care needs and experiences of people affected by cancer. Co-design research methods encompass various levels of consumer engagement in the research process, including participation in study conceptualisation, design, conduct, and reporting [16]. Consumer involvement in research can contribute to better study outcomes, including higher enrolment and retention rates [17]. Additionally, thorough pretesting of study materials with consumers is recommended to ensure materials are easy to understand, sensitively worded, and able to elicit meaningful data to address research aims [18]. Through active and repeated engagement with community members, this study aimed to: (i) develop and test a qualitative survey question for collecting rich information about the supportive care needs and experiences of people affected by cancer, and (ii) design study invitation materials that are relevant and acceptable to cancer survivors and their caregivers. The use of a single, open-ended question aims to minimise participant burden and maintain a broad investigation of supportive care needs, rather than the traditional itemised approach. The materials developed in this study will be used in a new population-based study for understanding the needs and experiences of adults affected by cancer in Queensland, Australia and establishing a research-ready pool of participants to take part in ongoing cancer survivorship research. Findings from the current study will provide principles for researchers to apply when designing qualitative data collection tools and study invitation materials for research into supportive care needs and experiences, particularly in the cancer context. ## Materials and methods This study comprised two phases of qualitative research: 1) *co-design workshops* and 2) *pretest interviews.* As outlined in **Fig 1**, both phases included community members and the research team working collaboratively to co-design a qualitative survey question and study invitation materials. Ethical approval for this study was obtained from the University of Southern Queensland Human Research Ethics Committee (ref: ETH2023-0140). This study is reported as per the Consolidated Criteria for Reporting Qualitative Research (COREQ) Checklist [19] (see **S1 Table**). ### Participants and recruitment This study was conducted in Queensland, Australia. Queensland has almost one third of its population living outside of major cities [20], which presents several challenges to accessing cancer treatment and support due to the greater travel distances and costs involved [21]. For both the co-design workshops and pretest interviews, eligible participants were aged 18 years or older and English-speaking. Additional eligibility criteria for interview participants included a personal experience with cancer, either as a survivor or caregiver. Digital and printed recruitment flyers were distributed via networks associated with Cancer Council Queensland or the broader research team between 11 October 2023 and 14 February 2024. To support the recruitment of priority populations, such as culturally and/or linguistically diverse (CALD) groups, the research team submitted study information to a health consumers network [22] for inclusion in their e-newsletter. As data collection advanced, recruitment was supplemented through snowball sampling, with workshop participants invited to share recruitment flyers with friends, family members, and colleagues. Prospective participants self-enrolled into a workshop and/or interview via an online participant information and consent form administered through REDCap (hosted by the University of Southern Queensland) [23,24]. Consenting participants were then contacted by telephone and/or email to arrange a time for their participation. For the interviews, new participants were recruited alongside eligible workshop participants to obtain feedback from people with and without prior knowledge of the study. Recruitment for the co-design workshops and pretest interviews continued until a diverse sample had been achieved and the research questions had been adequately explored, determined by the authors through concurrent data collection and analysis. Due to the large number of online registrations for the interviews, new and existing participants were purposively sampled based on their demographic characteristics, including gender, ethnicity, Indigenous status, and geographical location, as well as their experience with cancer (i.e., survivor or caregiver) to ensure that diverse perspectives were represented [25]. To acknowledge their contributions to the study, workshop and interview participants received a voucher valued at AU$100.00 (approx. 120 minutes) and AU$50.00 (approx. 60 minutes), respectively. ## Data collection ### Phase 1: Co-design workshops Each workshop included two to four participants and was facilitated by two female researchers with undergraduate or postgraduate degrees in health science fields and training in qualitative data collection (SA, XB, and/or EJ). The facilitators had no prior relationship with the participants. At the start of each workshop, the facilitators introduced themselves, including their role in the research team and their academic background. Workshops were conducted as either online (*n*=9), in-person (*n*=1), or hybrid (i.e., online and in-person) (*n*=5) sessions using Microsoft Teams. In-person participants attended the session at one of two not-for-profit organisations, where participants were provided with the relevant materials (e.g., pen, paper). Participants attending online were asked to source these materials themselves. Workshops were audio-recorded and transcribed via Microsoft Teams. The workshops comprised several activities, with accompanying information and instructions provided on presentation slides. An overview of the workshop protocol is available in **S2 Table**. The first activity in the workshop used the nominal group technique [26,27] to generate and refine a pool of qualitative questions that could be used in the population-based survey for understanding the supportive care needs and experiences of people affected by cancer. This technique fosters balanced participation, serving as an effective and efficient method for achieving group consensus [27]. First, participants were asked to individually brainstorm ideas for how to word the qualitative question. A preamble to the question drafted by the research team was shared with participants as a prompt for question generation (see **S2 Table** for further details). Participants were instructed that this question should be a standalone, broad, open-ended question that allows respondents to describe their needs and experiences using their own words, with the purpose of generating data that would inform service delivery at Cancer Council Queensland. Second, participants shared their questions with the group following a ‘round-robin’ process, during which a facilitator typed the questions verbatim onto the presentation slides. Third, participants collectively reflected on the proposed questions, sought clarification from one another, and adjusted wording as needed (e.g., removing potentially insensitive words). Finally, participants privately voted on their two most preferred questions using an online or paper-based poll. Votes were tallied to identify questions with the highest scores which were then presented to the group for further discussion and refinement, resulting in a total of one to five questions per group. The second activity in the workshop involved participants providing feedback on the wording and format of an invitation letter for the population-based survey. This letter was drafted by the research team based on an example from a previous registry study. It comprised a single page of information about the research project, including its aims, instructions on how to participate, and permissions to recruit participants via the registry. During the workshops, participants were also prompted to discuss an appropriate time post-diagnosis to invite individuals to complete the survey. Key principles endorsed by workshop participants for developing a qualitative survey question were presented to the investigator team, alongside questions that were open-ended, broad in scope, and aligned with these principles (see *Data analysis* section for methods used to identify key principles). The investigator team, comprising clinicians, researchers, and academics with expertise in cancer survivorship, supportive care, medical oncology, behavioural science, and digital health (*n*=7; see **S3 Table**), were asked to rank their five most preferred questions (1 = ‘most preferred’, 5 = ‘least preferred’) via an anonymous online survey in REDCap [23,24]. Four of the highest ranked questions were shortlisted for testing during interviews. Study invitation materials were also revised based on key principles endorsed by participants in the workshops. ### Phase 2: Pretest interviews Online semi-structured interviews were conducted, audio-recorded, and transcribed using Microsoft Teams. Each interview was facilitated by one researcher (SA or XB). A summary of the interview protocol is available in **S4 Table**. Participants firstly reviewed the revised invitation materials and provided feedback on their readability and design. They were also asked to discuss an appropriate time for sending individuals a reminder letter to complete the survey. Participants were then randomly presented with one of the four shortlisted questions and given five uninterrupted minutes to respond to and submit their written response via the online chat function. Drawing on principles of the ‘think aloud’ method [28], participants then verbalised their thoughts, assumptions, and decisions while reading, interpreting, and responding to the question. Scripted and spontaneous probes were used to clarify interpretation as needed. Participants were then presented with the three alternative questions and asked to nominate their preferred question based on interpretability and relevance. After 14 interviews, there was a clear consensus on the most appropriate question to include in the survey (*n*=13 votes). A further six interviews were then conducted to optimise and finalise the wording of the selected question using the ‘think aloud’ method [28] to confirm its interpretability and relevance. Following the 20 interviews, feedback on the revised study invitation materials were applied by the research team. ### Demographic survey Age, gender, country of birth, language spoken at home, ethnicity, postcode of residential address, and personal history with cancer (including patient or caregiver status) were collected via an online survey in REDCap [23,24] at the start of each co-design workshop. For participants who did not attend a workshop, demographic data were collected through structured questions at the end of their interview. ### Data analysis Descriptive statistics were used to summarise participant characteristics for the co-design workshops and pretest interviews. Transcripts generated via Microsoft Teams were reviewed for accuracy alongside the audio recordings. Transcripts were then analysed using content analysis to identify key principles endorsed by participants for developing a qualitative survey question and designing study invitation materials. Content analysis involves the systematic coding of text into categories based on the words and language used, centring participants’ voice in the analysis [29]. Each transcript was coded by one author (XB, SA, or EJ), with decisions regularly discussed with other authors and documented using an audit trail. ## Results In total, 15 co-design workshops with 44 participants and 20 pretest interviews were completed (see **Fig 2**). Twelve of the 20 interview participants had also completed a co-design workshop. The characteristics of participants in the two phases of consumer consultation are summarised in **Table 1**. Both phases included representation from population subgroups, including 5-7% who identified as Aboriginal and/or Torres Strait Islander, 9-15% who used English as a second language, 20% who were born overseas, and 27-30% who lived in a rural area. View this table: [Table 1.](http://medrxiv.org/content/early/2024/06/26/2024.06.24.24308902/T1) Table 1. Characteristics of participants in the co-design workshops (*n*=44) and pretest interviews (*n*=20) to design materials for a population-wide study on the supportive care needs and experiences of people affected by cancer. ### Qualitative survey question Analysis of the 15 co-design workshop responses yielded 16 eligible questions (see **Table 2**). Additionally, 10 principles were identified from participant feedback during the workshops for developing qualitative data collection tools (see **Table 3**). These principles were to: *avoid assumptions and leading questions; define the question timeframe and scope; directly address the respondent; foster a collectivist perspective; gather experiential data from respondents for researchers to identify solutions; prompt an open-minded response; provide reassurance that responses are valid and valued; use an engaging design and accessible formatting* (e.g., large and easy to read text)*; use sensitive language;* and *use simple wording*. View this table: [Table 2.](http://medrxiv.org/content/early/2024/06/26/2024.06.24.24308902/T2) Table 2. Eligible questions generated in co-design workshops for designing a population-wide study on the supportive care needs and experiences of people affected by cancer. View this table: [Table 3.](http://medrxiv.org/content/early/2024/06/26/2024.06.24.24308902/T3) Table 3. Principles endorsed by participants during co-design workshops for developing a qualitative survey to collect information on supportive care needs and experiences of people affected by cancer in a population-based study. A flowchart showing idea generation and shortlisting for the qualitative survey question is presented in **Fig 3**. During the workshops, participants generated a total of 173 questions with 42 questions selected through participant voting. Of these 42 questions, 14 (33%) did not meet pre-defined criteria (i.e., not open-ended, not broad in scope) and 1 question was a duplicate, warranting their exclusion. An additional 11 (26%) questions were excluded for not aligning with the principles endorsed by workshop participants. Although participants advocated for including a timeframe within the question, a limited number of questions aligned with this principle. Rather than excluding these questions, a timeframe was added as needed (e.g., ‘right now’ was added to Question 1; see **Table 2**). Similarly, few questions complied with the principles of prompting an open-minded response (e.g., ‘in an ideal world’) and fostering a collectivist perspective (e.g., ‘you or those you care for’). Questions that did not align with these principles were not excluded as the population-based study aimed to capture actual needs and experiences from the perspective of individual respondents. From the 16 eligible questions, preferential voting by the investigator team resulted in a shortlist of 4 questions. In line with principles endorsed by workshop participants, team members were in favour of including prompts alongside the question, with the most popular prompts being: ‘Share as much detail as you would like to’ (*n*=5, 71%) and ‘For example, you might like to consider your practical, emotional, psychological, financial, relational, and cultural needs’ (*n*=5, 71%). **Table 4** summarises participants’ interpretations of and feedback on these questions and prompts in the pretest interviews. Participants’ responses to the shortlisted questions are provided in **S5 Table** for comparison. View this table: [Table 4.](http://medrxiv.org/content/early/2024/06/26/2024.06.24.24308902/T4) Table 4. Feedback from participants in the pretest interviews regarding the four shortlisted questions for a population-wide study on the pportive care needs and experiences of people affected by cancer.a Of the four shortlisted questions, interview participants preferred the two-part questions that explicitly asked about needs *and* experiences (i.e., Options 1 and 2) (see **Table 4**). Participants thought this question structure would generate richer information, particularly from respondents who find it difficult to articulate their needs. Of these two options, most participants (*n*=13/14) endorsed Option 2 as it was easier to read and interpret, applicable to both cancer survivors and their caregivers, and relevant to any timepoint post-diagnosis. Participants recommended clarifying the timeframe that ‘right now’ referred to. For the question prompts, it was suggested to substitute complex words (i.e., replace ‘relational’ with ‘social’), remove words with similar meanings (i.e., remove ‘psychological’ and retain ‘emotional’), and broaden the scope (i.e., add ‘physical’ and ‘spiritual’). Option 2 was revised accordingly, with the wording of this question also changed to present tense to provide further clarification of the timeframe. These revisions resulted in the final question: *Thinking about the past month, how is cancer affecting your life and what do you need? Share as much detail as you would like to. For example, you might like to consider your physical, emotional, practical, financial, social, cultural, and spiritual needs, or any other needs you might have*. In the final six pretest interviews, this question demonstrated capacity to elicit relevant, detailed data on the unmet supportive care needs and experiences of people affected by cancer (see **S5 Table**). ### Study invitation materials Ten principles for designing study invitation materials were identified from participant feedback during the co-design workshops and validated during the pretest interviews. These principles are presented in **Table 5** alongside an explanation and participant quotes. These principles were to: *communicate empathy and sensitivity; consider appropriate timing; convey credibility and legitimacy; facilitate reciprocal benefit; include a ‘human element’; increase accessibility and ease of participation; optimise readability; promote inclusivity; provide reassurance around privacy; motivate and incentivise participation;* and *support informed decisions*. An eleventh principle, *promote inclusivity*, emerged from the interview data only (see **Table 5**). **Table 5** also provides examples of how each principle was applied in this study to develop invitation materials for the proposed population-based survey. For example, following the co-design workshops, a flyer was created to accompany the letter, which included a personal quote from a cancer survivor emphasising the value of the research for people impacted by cancer. View this table: [Table 5.](http://medrxiv.org/content/early/2024/06/26/2024.06.24.24308902/T5) Table 5. Principles for designing study invitation materials endorsed by participants during the co-design workshops and pretest interviews for co-igning a population-wide study on the supportive care needs and experiences of people affected by cancer. The revised invitation materials presented to participants in the 20 pretest interviews were highly accepted, with 19 (95%) participants indicating they would likely respond to the qualitative survey question. The one participant who indicated they would not complete the survey was reluctant to scan a quick response (QR) code. Therefore, instructions on alternative methods for completing the survey were emphasised on the invitation materials in the final revision stage, alongside several other minor changes, such as increasing the font size and simplifying the language used. ## Discussion This qualitative study used co-design methods to develop and test study materials for capturing the supportive care needs and experiences of cancer survivors and their caregivers in a future population-based survey. Principles for designing qualitative data collection tools and study invitation materials were identified in workshops with community members and validated in pretest interviews. These principles can be used more broadly by health and survivorship researchers to design study materials that align with community preferences. To date, studies examining strategies to optimise participation in cancer research have focused primarily on methods of advertisement (e.g., social media, text messages), incentives, eligibility criteria, and outcome measures [30,31]. However, few studies have investigated community preferences for invitation materials. A conceptual model developed by Chhatre and colleagues [32] describes strategies for recruiting cancer patients into clinical trials using a patient-centred approach. Recommended strategies mapped onto four concepts, including trust, communication, expectations, and attitudes, and ranged from protecting patient health information to emphasising the altruistic value of research involvement [32]. These findings align with principles endorsed by community members in the current study, which supports the applicability of these principles across clinical and observational research settings. To the authors’ knowledge, few studies have reported on the development and testing of qualitative surveys for health research, despite the importance of question wording in survey-based studies [33]. Principles identified in the current study both validate and expand on those previously identified in best practice guidelines for qualitative research [33–35]. For example, similar to consumers in this study, Braun and colleagues [33] recommend that survey questions are short and unambiguous, void of assumptions, and include examples to guide the scope of responses. Similar to other widely used surveys [10–12], a timeframe was also added to the question (i.e., the past month) to minimise participant burden when responding, enable repeated data collection over time, and allow comparability of responses by time since diagnosis. The current study also identified additional principles for designing a qualitative survey. For example, leveraging the expertise of respondents by asking them to share their experiences, rather than just their needs, enables researchers to identify trends and gaps in care at the population-level. Considering that the principles in this study were endorsed by a diverse sample of cancer survivors and caregivers, the principles identified may also be applicable to studies investigating the supportive care needs and experiences of people affected by other health conditions. The single, open-ended survey question designed in the current study was developed to collect rich, detailed information on the supportive care needs and experiences of people affected by cancer for the purpose of informing service delivery. Current literature on supportive care needs is largely based on data derived from quantitative measures. These measures are confined to specific supportive care domains, with needs in the cognitive, spiritual, sexual, or financial domains often overlooked or excluded from shorter versions of tools [14,36]. In contrast, the question developed in this study asks about supportive care needs in the context of participants’ experiences (i.e., how cancer is affecting their life). Based on participant feedback in the workshops, the question includes a prompt that lists various domains of potential need. When this prompt was tested in interviews, its inclusion did not appear to constrain or direct participant responses. Therefore, the question provides an opportunity for respondents to share their experiences and to define what is important to them. The final question demonstrated applicability and acceptability among a diverse sample of cancer survivors and caregivers. Thus, the question presents a novel method for assessing the supportive care needs and experiences of people affected by cancer. In the current study, there were some divergent views among community members regarding how to design a qualitative survey question. For example, some participants suggested asking about supportive care needs in an open-minded manner, using phrases such as ‘in an *ideal* world’ and ‘what support do you *wish* you had’. However, this principle conflicted with other participants’ suggestions to define the scope of the question by providing realistic examples of what supportive care services may be provided, to manage expectations of the research outcomes. Similarly, some participants noted that using terms like ‘ideal’ could be insensitive as they may imply a sense of choice or control in a person’s cancer trajectory. Therefore, the principle of asking about needs in an open-minded manner was not applied in the current study but may be suitable to other populations or contexts depending on the research aims and scope. ### Strengths and limitations This study used an iterative qualitative design, facilitating active and repeated engagement of community members in developing and testing study materials. Including a subset of participants in both phases of consumer consultation enabled the principles identified in workshops to be validated through member checking in interviews [25]. The use of two different consultation methods was another key strength; the workshops fostered collaborative group discussion which supported idea generation, while the interviews provided a platform for in-depth exploration of individual perspectives and experiences [25]. Finally, the study included a diverse sample, involving people who were born overseas, used English as a second language, identified as Aboriginal and/or Torres Strait Islander, and lived in a rural area. The main limitation of this study is the potential for self-selection bias. The consumer consultations relied on individuals agreeing to participate in a research study and being able to speak English. Given that an estimated 900,000 people in Australia have low proficiency in spoken English [37], and that CALD groups experience poorer health outcomes compared to the general population [38], future research should work with non-English speaking people to design study materials that facilitate their participation in cancer research [39]. ## Conclusions Through active and repeated consultation with community members, this study identified principles for designing qualitative data collection tools and study invitation materials for use in cancer survivorship research. These principles were used to design and test an open-ended survey question and study invitation materials for use in a population-based study of the supportive care needs and experiences of cancer survivors and their caregivers. These principles can also be used by other researchers to optimise community participation in their qualitative research and to inform support service providers about the needs and experiences of consumers. ## Supporting information Supplementary Material [[supplements/308902_file02.docx]](pending:yes) ## Data Availability All data produced in the present study are available upon reasonable request to the authors. ## Supporting information **S1 Table:** Completed Consolidated Criteria for Reporting Qualitative Research (COREQ) checklist. **S2 Table:** Overview of protocol for co-design workshops. **S3 Table:** Expertise of the co-investigator research team who voted on the questions generated from the co-design workshops for inclusion in the pretest interviews. **S4 Table:** Overview of protocol for pretest interviews. **S5 Table:** Responses to the shortlisted and final question in the pretest interviews. **Fig 1.** Overview of study procedures to co-design materials for a population-wide study on the supportive care needs and experiences of people affected by cancer. **Fig 2.** Flowchart of participant recruitment and selection for the co-design workshops and pretest interviews to design materials for a population-wide study on the supportive care needs and experiences of people affected by cancer. aInvalid responses were identified based on a combination of factors (e.g., duplicated IP addresses with different names, invalid postcodes or phone numbers, replicated responses in a short period of time, unusual completion times). Where necessary, responses flagged as potentially invalid were investigated further through phone and/or email contact. bIndividuals were purposively selected to achieve maximum variation in the age, gender, ethnicity, and geographic location of participants. c12 of the 20 participants in the pretest interviews also participated in a co-design workshop. **Fig 3.** Flowchart of idea generation and shortlisting to develop a single, open-ended question for a population-wide study on the supportive care needs and experiences of people affected by cancer. ai.e., Terms such as ‘quality of life’ and ‘daily living’. bi.e., Terms such as ‘cancer journey’. ci.e., Questions that imply a negative experience, such as ‘challenging’. di.e., Questions such as ‘What would make life easier for you?’ ## Acknowledgements The authors thank all individuals who participated in a workshop and/or interview. * Received June 24, 2024. * Revision received June 24, 2024. * Accepted June 26, 2024. * © 2024, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/) ## References 1. [1].Coleman MP, Forman D, Bryant H, Butler J, Rachet B, Maringe C, et al. Cancer survival in Australia, Canada, Denmark, Norway, Sweden, and the UK, 1995–2007 (the International Cancer Benchmarking Partnership): An analysis of population-based cancer registry data. The Lancet 2011;377:127–38. doi:10.1016/S0140-6736(10)62231-3. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S0140-6736(10)62231-3&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21183212&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F26%2F2024.06.24.24308902.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000286292800025&link_type=ISI) 2. [2].Sung H, Ferlay J, Siegel RL, Laversanne M, Soerjomataram I, Jemal A, et al. Global Cancer Statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin 2021;71:209–49. doi:10.3322/caac.21660. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.3322/caac.21660&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=33538338&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F26%2F2024.06.24.24308902.atom) 3. [3].Wu H-S, Harden JK. Symptom burden and quality of life in survivorship: A review of the literature. Cancer Nurs 2015;38:E29–54. doi:10.1097/NCC.0000000000000135. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1097/NCC.0000000000000135&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24831042&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F26%2F2024.06.24.24308902.atom) 4. [4].Harrison R, Raman M, Walpola RL, Chauhan A, Sansom-Daly UM. Preparing for partnerships in cancer care: An explorative analysis of the role of family-based caregivers. BMC Health Serv Res 2021;21:620. doi:10.1186/s12913-021-06611-0. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/s12913-021-06611-0&link_type=DOI) 5. [5].Teixeira RJ, Remondes-Costa S, Graça Pereira M, Brandão T. The impact of informal cancer caregiving: A literature review on psychophysiological studies. Eur J Cancer Care (Engl) 2019;28:e13042. doi:10.1111/ecc.13042. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/ecc.13042&link_type=DOI) 6. [6]. World Health Organization. Health employment and economic growth: An evidence base. World Health Organization; 2017. 7. [7].Park M, Giap T-T-T, Lee M, Jeong H, Jeong M, Go Y. Patient-and family-centered care interventions for improving the quality of health care: A review of systematic reviews. Int J Nurs Stud 2018;87:69–83. doi:10.1016/j.ijnurstu.2018.07.006. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.ijnurstu.2018.07.006&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=30056169&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F26%2F2024.06.24.24308902.atom) 8. [8].Tian L, Cao X, Feng X. Evaluation of psychometric properties of needs assessment tools in cancer patients: A systematic literature review. PLOS ONE 2019;14:e0210242. doi:10.1371/journal.pone.0210242. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0210242&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F26%2F2024.06.24.24308902.atom) 9. [9].Prue G, Santin O, Porter S. Assessing the needs of informal caregivers to cancer survivors: A review of the instruments. Psychooncology 2015;24:121–9. doi:10.1002/pon.3609. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/pon.3609&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24930811&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F26%2F2024.06.24.24308902.atom) 10. [10].Boyes A, Girgis A, Lecathelinais C. Brief assessment of adult cancer patients’ perceived needs: Development and validation of the 34-item Supportive Care Needs Survey (SCNS-SF34). J Eval Clin Pract 2009;15:602–6. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/j.1365-2753.2008.01057.x&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19522727&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F26%2F2024.06.24.24308902.atom) 11. [11].Hodgkinson K, Butow P, Hunt GE, Pendlebury S, Hobbs KM, Lo SK, et al. The development and evaluation of a measure to assess cancer survivors’ unmet supportive care needs: The CaSUN (Cancer Survivors’ Unmet Needs measure). Psychooncology 2007;16:796–804. doi:10.1002/pon.1137. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/pon.1137&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=17177268&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F26%2F2024.06.24.24308902.atom) 12. [12].Shin DW, Park J-H, Shim E-J, Park J-H, Choi J-Y, Kim SG, et al. The development of a comprehensive needs assessment tool for cancer-caregivers in patient-caregiver dyads. Psychooncology 2011;20:1342–52. doi:10.1002/pon.1857. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/pon.1857&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22102594&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F26%2F2024.06.24.24308902.atom) 13. [13].Girgis A, Lambert S, Lecathelinais C. The supportive care needs survey for partners and caregivers of cancer survivors: development and psychometric evaluation. Psychooncology 2011;20:387–93. doi:10.1002/pon.1740. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/pon.1740&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=20878835&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F26%2F2024.06.24.24308902.atom) 14. [14].Hart NH, Crawford-Williams F, Crichton M, Yee J, Smith TJ, Koczwara B, et al. Unmet supportive care needs of people with advanced cancer and their caregivers: A systematic scoping review. Crit Rev Oncol Hematol 2022;176:103728. doi:10.1016/j.critrevonc.2022.103728. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.critrevonc.2022.103728&link_type=DOI) 15. [15].Engstrom T, Strong J, Sullivan C, Pole JD. A Comparison of Leximancer Semi-automated Content Analysis to Manual Content Analysis: A Healthcare Exemplar Using Emotive Transcripts of COVID-19 Hospital Staff Interactive Webcasts. Int J Qual Methods 2022;21:16094069221118992. doi:10.1177/16094069221118993. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/16094069221118993&link_type=DOI) 16. [16].Slattery P, Saeri AK, Bragge P. Research co-design in health: A rapid overview of reviews. Health Res Policy Syst 2020;18:17. doi:10.1186/s12961-020-0528-9. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/s12961-020-0528-9&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32046728&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F26%2F2024.06.24.24308902.atom) 17. [17].Domecq JP, Prutsky G, Elraiyah T, Wang Z, Nabhan M, Shippee N, et al. Patient engagement in research: A systematic review. BMC Health Serv Res 2014;14:89. doi:10.1186/1472-6963-14-89. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/1472-6963-14-89&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24568690&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F26%2F2024.06.24.24308902.atom) 18. [18].Willis GB, Artino AR. What do our respondents think we’re asking? Using cognitive interviewing to improve medical education surveys. J Grad Med Educ 2013;5:353–6. doi:10.4300/JGME-D-13-00154.1. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.4300/JGME-D-13-00154.1&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24404294&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F26%2F2024.06.24.24308902.atom) 19. [19].Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): A 32-item checklist for interviews and focus groups. Int J Qual Health Care J Int Soc Qual Health Care 2007;19:349–57. doi:10.1093/intqhc/mzm042. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/intqhc/mzm042&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=17872937&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F26%2F2024.06.24.24308902.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000251963800004&link_type=ISI) 20. [20].Australian Institute of Health and Welfare. Rural and remote health. Australian Government; 2023. 21. [21].Ambroggi M, Biasini C, Del Giovane C, Fornari F, Cavanna L. Distance as a Barrier to Cancer Diagnosis and Treatment: Review of the Literature. The Oncologist 2015;20:1378–85. doi:10.1634/theoncologist.2015-0110. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTM6InRoZW9uY29sb2dpc3QiO3M6NToicmVzaWQiO3M6MTA6IjIwLzEyLzEzNzgiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyNC8wNi8yNi8yMDI0LjA2LjI0LjI0MzA4OTAyLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 22. 22.Health Consumer Queensland. Health Consumers Queensland 2024. [https://www.hcq.org.au/](https://www.hcq.org.au/). 23. [23].Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 2009;42:377–81. doi:10.1016/j.jbi.2008.08.010. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jbi.2008.08.010&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=18929686&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F26%2F2024.06.24.24308902.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000264958800018&link_type=ISI) 24. [24].Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O’Neal L, et al. The REDCap consortium: Building an international community of software platform partners. J Biomed Inform 2019;95:103208. doi:10.1016/j.jbi.2019.103208. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jbi.2019.103208&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=31078660&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F26%2F2024.06.24.24308902.atom) 25. [25].Liamputtong P. Qualitative Research Methods 5e eBook. Melbourne, AUSTRALIA: Oxford University Press Australia and New Zealand; 2020. 26. [26].Delbecq AL, Van de Ven AH, Gustafson DH. Group Techniques for Program Planning: A Guide to Nominal Group and Delphi Processes. 1975. 27. [27].McMillan SS, King M, Tully MP. How to use the nominal group and Delphi techniques. Int J Clin Pharm 2016;38:655–62. doi:10.1007/s11096-016-0257-x. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s11096-016-0257-x&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=26846316&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F26%2F2024.06.24.24308902.atom) 28. [28].Willis G. Cognitive interviewing in survey design: State of the science and future directions. In: Vannette DL, Krosnick JA, editors. Palgrave Handb. Surv. Res., Cham: Springer International Publishing; 2018, p. 103–7. doi:10.1007/978-3-319-54395-6_14. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/978-3-319-54395-6_14&link_type=DOI) 29. [29].Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs 2008;62:107–15. doi:10.1111/j.1365-2648.2007.04569.x. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/j.1365-2648.2007.04569.x&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=18352969&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F26%2F2024.06.24.24308902.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000254192000012&link_type=ISI) 30. [30].Wang RR, Schweitzer JB, Hernandez S, Molina SC, Keegan TH. Strategies for recruitment and retention of adolescent and young adult cancer patients in research studies. J Clin Transl Sci 2023:1–27. doi:10.1017/cts.2023.669. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1017/cts.2023.669&link_type=DOI) 31. [31].Liu J, Gutierrez E, Tiwari A, Padam S, Li D, Dale W, et al. Strategies to improve participation of older adults in cancer research. J Clin Med 2020;9:1571. doi:10.3390/jcm9051571. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.3390/jcm9051571&link_type=DOI) 32. [32].Chhatre S, Jefferson A, Cook R, Meeker CR, Kim JH, Hartz KM, et al. Patient-centered recruitment and retention for a randomized controlled study. Trials 2018;19:205. doi:10.1186/s13063-018-2578-7. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/s13063-018-2578-7&link_type=DOI) 33. [33].Braun V, Clarke V, Boulton E, Davey L, McEvoy C. The online survey as a qualitative research tool. Int J Soc Res Methodol 2021;24:641–54. doi:10.1080/13645579.2020.1805550. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1080/13645579.2020.1805550&link_type=DOI) 34. [34].Braun V. Successful Qualitative Research: A Practical Guide for Beginners. London, UK: SAGE Publications Ltd; 2013. 35. [35].Patton M. Qualitative Research & Evaluation Methods. 4th ed. SAGE Publications Ltd; 2015. 36. [36].Lisy K, Langdon L, Piper A, Jefford M. Identifying the most prevalent unmet needs of cancer survivors in Australia: A systematic review. Asia Pac J Clin Oncol 2019;15:e68–78. doi:10.1111/ajco.13176. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/ajco.13176&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=31215167&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F26%2F2024.06.24.24308902.atom) 37. [37].Australian Bureau of Statistics. Proficiency in spoken English (ENGLP) 2022. [https://www.abs.gov.au/articles/cultural-diversity-australia](https://www.abs.gov.au/articles/cultural-diversity-australia) (accessed March 12, 2024). 38. [38].Butow PN, Aldridge L, Bell ML, Sze M, Eisenbruch M, Jefford M, et al. Inferior health-related quality of life and psychological well-being in immigrant cancer survivors: a population-based study. Eur J Cancer Oxf Engl 1990 2013;49:1948–56. doi:10.1016/j.ejca.2013.01.011. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.ejca.2013.01.011&link_type=DOI) 39. [39].Charles RHC, Sosa E, Patel M, Ertunmwunsee L. Health disparities in recruitment and enrollment in research. Thorac Surg Clin 2022;32:75–82.