Health service improvement using positive patient feedback: systematic review and change model ============================================================================================== * Rebecca Lloyd * James Munro * Kerry Evans * Amy Gaskin-Williams * Ada Hui * Mark Pearson * Mike Slade * Yasuhiro Kotera * Giskin Day * Joanne Loughlin-Ridley * Clare Enston * Stefan Rennick-Egglestone ## Abstract **Background** Patients, families, and communities regularly provide feedback about care and treatment received from healthcare services, most of which is positive. The aim of this review was to examine how positive feedback creates change within healthcare settings. **Methods** Included documents were empirical studies where the full text is publicly available in English, and where a change has occurred within healthcare services attributed to positive feedback from service users, their families, or the community. They were identified through database searches (ACM Digital Library, AMED, ASSIA, CINAHL, MEDLINE and PsycINFO), forwards and backwards citation, and expert consultation. Data was synthesised into a change model describing forms, mediators and moderators of change. A protocol was prospectively registered: [https://osf.io/5x46c](https://osf.io/5x46c). **Results** Sixty-eight papers were included, describing research conducted in 32 countries across six continents, with qualitative (n=51), quantitative (n=10), and mixed (n=7) methods. Only two described interventional studies. The most common form of feedback was ‘appreciation’ (n=28). The most common recipients were nurses (n=29). Positive feedback was most commonly given in hospitals (n=27) and community healthcare (n=19). Positive feedback mostly led to positive outcomes categorised as (a) short-term emotional change for healthcare workers (including feeling motivated and improved psychological wellbeing), (b) work-home interactional change for healthcare workers (such as improved home-life relationships), and (c) work-related change for healthcare workers (such as improved performance and staff retention). Undesirable changes included embarrassment when receiving feedback, tension in the patient-professional relationship, and envy when not receiving positive feedback. **Conclusion** Positive feedback can provide the opportunity to create meaningful health service change. Healthcare managers may wish to use positive feedback more regularly, and to identify and address barriers to staff receiving feedback. Further interventional research is required to establish the effectiveness of receiving positive feedback in creating change, and to understand the influence of feedback content. Keywords * patient feedback * change model * complex intervention * systematic review * health service ## Introduction The term ‘feedback’ often refers to the process whereby the effect of an action is fed back to change future actions. Feedback can be positive, where the gap between actual and desired experience is narrow, for example, when healthcare treatment aligns with patient wishes. Feedback can also be negative, where the gap between actual and desired experience is wide (1). For example, when healthcare treatment falls short of patient wishes. People working in health services regularly receive feedback about the treatment provided to patients, including from the patients themselves, family members, and informal carers (2). Patient feedback differs from patient engagement, which can be defined as patients taking an active role in their healthcare experience to meet a particular objective, such as accessing additional support groups (3). The most frequent form of feedback from healthcare service users is informal feedback, usually exchanged through conversations day-to-day (2), but also via letters and online forums (4). Formal feedback is a structured evaluation, often collected through methods such as national or local surveys (5). Both types of feedback can be given in-person or online and can include generic content (such as ‘fantastic care’), or specific (such as ‘the food was fantastic during my hospital stay’) (6). Some feedback is solicited, such as staff requesting patients to complete feedback surveys (7), whereas some is unsolicited (8). Positive feedback is much more common than negative feedback, with a linguistic analysis of comments posted on the UK’s National Health Service (NHS) Choices website finding positive evaluations to be three times as likely as negative (6). Positive feedback tends to be shorter, often expressed just as a single word such as ‘fantastic’ (9), and may be conceptualised as including material displays, such as gift-giving, cards, and donations to healthcare services (10). Positive feedback is evident in a variety of forms, such as favourable responses to surveys (4), online comments (9), compliment letters (11), and informal thanks (4). Positive and negative evaluations may also be given in combination, forming ‘mixed’ feedback (12). Increasingly, feedback is received through online sources, with online feedback being mostly positive in tone (13). Expressions of positive feedback may differ culturally; British culture tends to be less emotionally expressive than American culture (14). Eastern cultures tend to value low arousal emotions such as peacefulness, whereas Western cultures tend to value high arousal emotions such as happiness (15). One purpose of collecting service user feedback is to assist with performance monitoring and assurance, such as comparison between healthcare providers, impact of service changes, informing commissioning decisions, and compliance with standards. Another purpose is to share understanding and information to assist with service choices for other service users, highlight service problems and hold services accountable, and increase staff understanding of service user experience (16). Service users may want to give positive feedback to acknowledge, reward, and promote desired behaviour in healthcare staff (11). This frequently includes expressions of gratitude, conceptualised as the communication of an emotion or state which signals recognition that others have done something to benefit us (17). Expressions of gratitude and positive feedback are interrelated, but not synonymous. Gratitude can describe an individual’s attitude, moral values, daily habits, or emotional state, with the intention of reciprocity often at its core (17). In some cases, expressions of gratitude can serve as a positive evaluation of an individual or group accomplishment, and therefore be a form of positive feedback. For example, grateful postcards and letters sent to palliative care units from patients and families recognised the care and treatment received, the value of palliative care, and offered messages of support and encouragement about the service (18). Similarly, throughout the COVID-19 pandemic, many healthcare service users used Twitter to express their gratitude for the work, effort, saving and caring of healthcare staff and services (19). However, not all expressions of gratitude will be given with the intention of recognising accomplishments, such as habitually thanking healthcare staff in the expectation that it would ensure continuation of good treatment (20). Similarly, not all positive feedback will include expressions of gratitude, with some offering objective descriptions of excellent care and treatment practices. The current review will characterise expressions of gratitude towards healthcare staff as a type of positive feedback, acknowledging how these concepts interrelate and discriminating between them where possible. Patient feedback is given in abundance and the use of readily available patient feedback may offer a cost-effective way to create meaningful change within healthcare services (4). In one case study, service user accounts of distress during admission to mental health inpatient services were used as a resource to inform service improvement work. An 80% drop in complaints was observed over the following 14 months after implementation (21). Similarly, the NHS in England uses the Friends and Family Test (FFT) to collect information about patient experience of what is going well and what needs improving (22). The FFT was able to highlight positive patient views about remote appointments during the pandemic. In Buckinghamshire Healthcare NHS Trust, for example, patients felt that video or telephone appointments were safer, saved time, removed need for finding and paying for parking, allowed more time for talking, was better for the environment, and were more likely to be on time (23). This provides valuable insight in how patients are experiencing changes to healthcare services. In Japan, healthcare workers also reported that positive communication and acknowledgement, including from patients, acted as a mental health resource during the Covid-19 pandemic (24). Formal processes exist within healthcare services, such as the UK’s NHS, to use service user feedback. In the UK, registered healthcare professionals are often required to collect and reflect on service user feedback as a formal requirement of practice. The UK Nursing and Midwifery Council (NMC) describe the process of revalidation required for all nurses and midwives in the UK to maintain their registration with the NMC, promote good practice, and strengthen public confidence (25). The revalidation process requires five pieces of feedback which can come from a variety of sources and forms, including from service users. Similarly, the General Medical Council (GMC) require reflection on feedback from service users at least once in each revalidation cycle, which is required every five years (26). Doctors with the GMC are encouraged to reflect on feedback from existing sources of patient feedback, such as letters, cards, or team feedback, and should cover the whole scope of their practice. However, the Health and Care Professionals Council (HCPC) standard guidelines state that asking for, receiving, and reflecting on service user feedback is not a specific requirement, but can be useful for continuing professional development (CPD) (27). This feedback refers to evidence that changes made in line with CPD standards have been beneficial to the service user, such as letters produced for a CPD audit. Positive feedback from service users therefore has the potential to be used in current formal practice requirements for UK healthcare professionals. However, some have described the process as a ‘hoop jumping’ exercise with no impact on patient care, and some take issue with using feedback because patient-facing working patterns do not create equitable patient-facing opportunities (28).. The infrequency at which patient feedback is required for formal processes may contribute to the view that patient feedback is unrepresentative and tokenistic. Despite expressing sceptical views, healthcare staff have described its value as beneficial (28). Feedback can also be used for quality improvement. Aggregating feedback can provide insight into quality of care for service users and highlight real-time priorities for service inspections and improvement (29). The NHS promotes two models for improving quality by implementing changes (30). The first is the five-step improvement approach, which offers a systematic framework for improvement projects. The five stages are preparation (preliminary planning such as defining aims, objectives, and collecting baseline data), launch (the official start of a project), diagnosis (understanding the current process and defining the problem being addressed), implementation (testing potential solutions to the problem), and evaluation (achievements and learning are captured to make improvements the norm in that service). The second quality improvement model fits into the implementation phase of the five-stage improvement approach. The model for improvement asks three preliminary questions: what are we trying to accomplish? How will we know that a change is an improvement? And what changes can we make that will result in the improvements that we seek? The model consists of four components: plan, do, study, act (PDSA). Improvements can be made by planning how to test change, carrying out what has been planned, measuring the outcomes of the test, and acting on the results to modify and improve services (30). However, there are a range of organisational barriers to the effective use of patient feedback by health services (31). Staff can lack the time or skills required to interpret formal feedback (4), and might be reluctant to engage with feedback communicated informally through online platforms such as Facebook or Twitter (9, 32). In some contexts, online feedback is emerging at a faster rate than health services could respond to (16). An example is Care Opinion, an online service for the collection of feedback that enables staff responses, but conversations are often closed with a ‘thank you’ in response to positive feedback (4) rather than with an account of how this feedback was used to create change. Even where informal feedback is acted on by healthcare staff, the improvements made are often informally implemented in real-time and hence are not captured by quality improvement methods (33). Formal methods of processing service user feedback are also focussed on complaints in healthcare and positive feedback is often overlooked as a useful source of feedback (34). Healthcare staff may assume that feedback is negative in tone (13), and can dismiss or fail to value positive feedback (9). The lack of credibility afforded to positive feedback may be due to its tendency to be shorter and may be viewed by staff working in quality improvement as lacking direct measurability compared with clinical outcomes or complaints (33). Three reviews have investigated the value of gratitude in healthcare settings (35-37). A meta-narrative review of 56 studies investigated gratitude in healthcare with a particular focus of interpersonal experiences (36). The review described how gratitude can act as ‘social capital’ as it empowers and motivates recipients through strengthened social bonds, connectedness, and an increased willingness to reciprocate. Day (2020) also highlights how patient gratitude can benefit staff wellbeing, such as being protective against burnout and having physical health benefits and may be an indicator of quality of care. A scoping review (35) included 32 studies from three databases, and examined the characteristics, focus, and effects of gratitude. It found that gratitude influenced healthcare professionals professionally and personally, generating positive feelings such as pride, satisfaction, and a sense of wellbeing. It also generated reciprocal gratitude among other healthcare professionals. The review highlighted a limited evidence base and concluded that a systematic investigation into the effects of patient gratitude was needed, in line with Medical Research Council (MRC) recommendations on intervention development processes (38). A narrower systematised review on the impact of gratitude in healthcare settings included 23 studies from three databases (37). The review found one harmful change, where service user gift-giving resulted in healthcare staff feeling tension and pressure to meet patient expectations, undermining the service user-professional relationship. The review found that patient gratitude can also create helpful changes for healthcare staff, identified as work-related change (such as improved team performance and work-related satisfaction), direct benefits to staff health (such as increased sleep quality and decreased headaches), and proximal emotional change (such as feeling rewarded, proud, motivated, and fulfilled). In some cases, change was mediated by team information sharing, and was moderated by the psychological demands of the job role. A preliminary change model was produced as a result of the review findings which presented a summarised version of the change process. Following expressions of gratitude from patients, healthcare staff experience a change in their perceptions, either within their relationships with patients or colleagues or the way they experience work. Psychological demands of staff job role moderated this change. A change in perception lead to the harmful and helpful changes previously described, with helpful changes mediated by work-related satisfaction and increased information sharing. ### Aims and objectives Whilst three reviews have examined patient gratitude in healthcare settings, none has examined the impact of positive feedback more broadly. The aim of this review is to examine how positive feedback received by health services about care and treatment can create change within healthcare settings. The objectives were (1) to identify measures used to quantify change; (2) to create a model describing types of change and how it occurs; and (3) to identify recommendations for the collection and use of positive feedback by health services. ## Methods A systematic review of empirical studies was conducted. Positive feedback was defined as a response from healthcare service users, families or the community indicating concordance between desired and actual experiences regarding their care or treatment, delivered to healthcare staff or systems. The 2021 update of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist was used in reporting the review (39). A review protocol was prospectively registered with the Open Science Framework ([https://osf.io/5x46c](https://osf.io/5x46c)), which extended the protocol for a prior review (37), with extensions validated through a scoping review. A narrative synthesis of review data was performed to create a preliminary model of change (40). ### Search strategy #### Electronic database searches Databases were selected to cover a range of domains relating to healthcare service delivery. Searches were conducted from inception to 18th March 2022 on PsycINFO, AMED, MEDLINE, CINAHL, and the ACM Digital Library (ACM DL), and from inception to 15th December 2021 on ASSIA (the shorter date was due to a constraint in institutional access). The ACM DL indexes papers where computation and human interaction with technology is a primary focus and was included as feedback is frequently collected via electronic systems. Search terminology was extensively tested during a previously conducted systematised review focusing on expressions of patient gratitude (37), extended for the current review to encompass positive feedback beyond gratitude and healthcare systems more generally, and informed by the learning from the scoping searches. Scoping searches identified terms which were synonymous with ‘positive feedback’, such as ‘positive evaluation’ and ‘praise’, and terms which described healthcare systems, such as ‘healthcare services’ and ‘healthcare communities’. Search terms which linked less closely to positive feedback but produced a high volume of documents, such as recognition, were searched in titles only. In the initial filter by title, the screening team took care not to exclude papers in the event of ambiguity. The following search strategy was used for MEDLINE, PsycINFO, and AMED (all searched through Ovid): 1. Health* staff.ti,ab. 2. Health* worker*.ti,ab. 3. Medical staff.ti,ab. 4. Medical worker*.ti,ab. 5. Exp Health Personnel/ 6. Health* system*.ti,ab. 7. Health* service*.ti,ab. 8. Health* organi#ation*.ti,ab. 9. Health* communit*.ti,ab. 10. 1 or 2 or 3 or 4 or 5 or 6 or 7 or 8 or 9 11. Grat*.ti,ab. 12. Appreciat*.ti,ab. 13. Recog*.ti. 14. Thank*.ti. 15. Positive* feedback.ti,ab. 16. Positive* evaluat*.ti,ab. 17. Praise*.ti,ab. 18. 11 or 12 or 13 or 14 or 15 or 16 or 17 19. 10 and 18 20. Remove duplicates from 19 This search strategy was amended for CINAHL and ASSIA (amendments in S1 File). The ACM Digital Library only allows searches constructed using combinations of keywords, which generates a series of online pages of possible matches in order of relevance. Keyword combinations were identified from the MEDLINE search strategy (searches in S1 File). For each keyword combination, results pages were sequentially inspected for potentially includable documents, and inspection was discontinued when three subsequent pages of non-relevant results were observed. When developing the search strategy, documents from the prior review (37) were used as marker papers to evaluate search strategy sensitivity. #### Citation tracking Reference lists for included documents were manually inspected for further includable documents (backwards referencing). Forward referencing of included documents was conducted using Google Scholar. Forward and backward citation was repeated on additional included documents until no further documents were included. #### Expert consultation Once the final list of includable documents from electronic databases was identified, three experts in healthcare service delivery were asked to identify any potentially includable documents which had been omitted. Experts consisted of a healthcare manager responsible for feedback, an academic expert, and a technology creator who collects feedback about healthcare. Proposed documents were inspected for inclusion by the researcher. Forwards and backward referencing was conducted on additional included documents identified during expert consultation and repeated until no further documents were included. ### Document inclusion The Population, Intervention, Comparison, Outcome, Study Design (PICOS) search tool was used to specify inclusion (41). #### Study design Included documents were empirical studies where the full text is publicly available in English, with a clearly defined research method. Documents were included where a change has occurred within healthcare services attributed to positive feedback from service users, their families, or the community. Change was inclusive of individual healthcare staff changes, such as behavioural, emotional, and attitudinal shift, and systematic or procedural change within healthcare structure. Documents describing systematic, literature, or scoping reviews, policy statements, conference abstracts, protocols, and documents presented in a blog format were excluded. Documents were excluded where it was unclear whether change occurred as a result of positive feedback, where the identified change preceded positive feedback or directionality was ambiguous (e.g., where a change in healthcare staff or systems caused positive service user feedback), or where the impact of positive feedback was not presented as a study finding but was briefly mentioned as a discussion point. #### Context Included documents described research in the context of a healthcare setting, defined as any formal service where healthcare is being delivered, such as in hospitals, outpatient services, hospices, healthcare education, or correctional medical facilities. This was not limited to private or public healthcare services. Documents describing community healthcare settings were also included if staff were providing a formal healthcare service in the community. Documents were excluded where they describe positive feedback occurring within a healthcare system in relation to research being conducted, such as feedback about participation in a randomized clinical trial. #### Intervention Included documents described the voluntary expression of positive feedback from healthcare service users, their families, or community members, relating to the care or treatment provided, with healthcare workers or healthcare services as recipients. This included positive feedback expressed verbally and in invariant forms (such as in writing), and positive feedback provided both in-person and remotely (such as online). Expressions of gratitude were included as they may indicate service user feelings about care and treatment and hence can be used as a source of information by healthcare staff or systems. Studies describing ‘recognition’ of healthcare staff or services in relation to appreciation of care and treatment provided were included. Documents were excluded if (1) the type of service user feedback was not identified as positive, was negative or mixed, ambiguous, or was hypothetical (2) the source of positive feedback was not healthcare service users, families, communities, or was ambiguous (3) positive feedback from healthcare service users, families, or communities was not distinct from feedback provided by peers or the organisation, or (4) expressions of positive feedback were not voluntary (for example, where service users felt that their care and treatment may be negatively impacted if they do not express positive feedback). Feedback was assumed to be given voluntarily unless otherwise stated. Documents describing recognition awards or honours informed by the treatment and care experiences of healthcare service users, such as the Diseases Attacking the Immune System (DAISY) Award (42), were excluded. Similarly, documents describing feedback given via Appreciative Inquiry (a strength-based approach to creating change with a focus on appreciation and positive conversations) were excluded if service user involvement was not explicitly stated or distinguishable from peer or organizational feedback (43). Documents describing donations or gifts to healthcare services were excluded if the motivation for donation was not explicitly described as positive feedback or gratitude towards the healthcare staff or system (37). Studies which describe positive recognition of healthcare staff regarding social status rather than care or treatment provided, such as community support, approval, acceptance, or respect, were excluded (44). Studies were also excluded where healthcare service user satisfaction with care and treatment was described, but not explicitly delivered as positive feedback to healthcare staff or services. #### Participants Included documents described participants as working within a formal healthcare environment. The following were in scope: paid or volunteer workers within any healthcare system worldwide; students carrying out a formal healthcare role as part of their studies. Documents describing research into healthcare systems at an organizational level (e.g., where there were no staff participants) were also included. Healthcare systems were defined as any healthcare structure delivering care services to healthcare users. Documents were excluded where authors did not state whether feedback was provided within a healthcare setting, if participant roles were informal such as unpaid familial caregivers, or if participants were unable to receive feedback. ### Analysis plan Documents from database searches were exported to EndNote (45) and duplicates were removed. Documents were screened for eligibility, filtered on title in stage one and abstract in stage two. Concordance checking was conducted on a randomly selected 20% of exclusions by a second researcher [SRE] for both stages (title and abstract) of exclusion. Selection processes were piloted until a concordance rate of 95% was achieved on exclusions. Stage 3 screened remaining documents for eligibility based on full text. Retrieved documents were reviewed for inclusion by two researchers, with 100% concordance required on inclusions and exclusions for Stage 3. Uncertainty about the eligibility of a document from both researchers led to it being carried forward to the next stage of screening. At Stage 3, reasons for exclusion were recorded and agreement was required between RL and SRE. #### Data abstraction and synthesis A data abstraction table (DAT) was modified from the systematised review (37). The DAT was amended for the purpose of the current systematic review and was piloted using a small number of includable documents to ensure appropriate and efficient design. The DAT categorised information about study context (such as country of study and healthcare setting), study methodology (such as measures and purpose of measures), recipients and givers of feedback (including healthcare role and healthcare service), type of positive feedback considered, and forms of observed change. For types of feedback, donations were recorded under the higher category of ‘gifts’. The observed change was split into sections: outcomes, mechanisms, moderators, facilitators, barriers, and mediators. Outcomes were defined as observed changes that have occurred following positive feedback. Mechanisms were defined as processes which produce change. Moderators were defined as factors which alter the degree of change following positive feedback. Facilitators were defined as factors enhancing the observed change. Barriers were defined as factors impeding the observed change. Mediators were defined as factors creating an indirect pathway between two variables for the change process to occur (46). Specific links between outcomes, mechanisms, mediators, moderators, facilitators, and barriers were retained in the DAT, for example if an included document presented evidence that a specific outcome was produced by a specific mechanism. Items were listed in all relevant categories where there was variation in categorisation among studies. Where papers reported more than one study within a single paper, only data from relevant studies were extracted. Quality assessment score was also reported in the DAT, and if a section of the DAT was not clearly stated in a document, it was recorded as ‘N/A’. #### Change model development Each category was assessed for similar items and were combined to develop a synthesised typology. A preliminary change model was produced to describe outcomes, mechanisms, mediators, and factors enhancing or supporting change. Moderators, facilitators, and barriers were combined into two tables reflecting factors that enhance change and factors that hinder change. The change model was reviewed by an expert panel consisting of national and local health service representatives experienced with working with feedback, the director of a company providing a public online feedback platform (JM), and three experienced researchers. #### Subgroup analysis Subgroup analyses were planned for documents which identify change through expressions of healthcare service user gratitude, and for documents which were assessed as having high quality methodology. Quality of included documents was assessed using the Mixed Methods Appraisal Tool (MMAT) due to its rigorous assessment of mixed methods study methodologies and high applicability (47). An additional unplanned subgroup-analysis compared mainly public versus mainly private healthcare settings. ## Results ### Summary of papers Database searches identified 17,619 records once duplicates were removed. Sixty-eight papers were included (see Fig 1). The PRISMA checklist is in S2 File. ![Fig 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2022/09/14/2022.09.10.22279800/F1.medium.gif) [Fig 1.](http://medrxiv.org/content/early/2022/09/14/2022.09.10.22279800/F1) Fig 1. PRISMA Flow Diagram of Included and Excluded Screening Process. ### Characteristics of included studies A summary DAT is in Table 1, and the full DAT is in S3 Table. One included study presented methodology and results across two papers (48, 49) which were merged to form one record [ID 67]. Where several papers were created from a single study, these were considered companion papers. Three studies had corresponding companion papers [ID 3 and 4; ID 11 and 12; ID 45 and 46]. View this table: [Table 1.](http://medrxiv.org/content/early/2022/09/14/2022.09.10.22279800/T1) Table 1. Summary data abstraction table Research was located in 32 countries across six continents (Table 2). Two studies were located in multiple countries (50, 51). One study did not state the study location (52). View this table: [Table 2.](http://medrxiv.org/content/early/2022/09/14/2022.09.10.22279800/T2) Table 2. Research location of included studies in order of quantity Multiple papers from the same study counted as having a signal location unless reporting results fro different locations. The median year of publication was 2015 (Table 3). View this table: [Table 3.](http://medrxiv.org/content/early/2022/09/14/2022.09.10.22279800/T3) Table 3. Year of publication for included papers in chronological order with corresponding study IDs Multiple papers from the same study were included separately due to differing publication dates Most studies were qualitative, and all but two studies were observational, in that they presented evidence relating to existing uses of positive feedback (Table 4). View this table: [Table 4.](http://medrxiv.org/content/early/2022/09/14/2022.09.10.22279800/T4) Table 4. Methods of included papers, in order of quantity Multiple papers from the same study were counted as having a single study methods. Three companion papers were not counted in the ‘total quantity’ column. Many papers used multiple methods, each counted separately in the ‘quantity’ column. The two intervention studies were as follows: #### Riskin et al, 2019 [ID 49] This study used pre-recorded video to simulate the impact on Neonatal Intensive Care Unit (NICU) team performance of gratitude expressed by two different sources. NICU teams (n = 43) were randomly assigned to 1 of 4 conditions: (1) maternal gratitude (2) physician-expressed gratitude (3) combined maternal and physician gratitude, or (4) control (same agents communicated neutral statements). Subsequent team performance in a training workshop was evaluated by a blinded panel, on a five-point Likert scale. Maternal gratitude produced a significant positive affect on team performance (3.9 ± 0.9 vs 3.6 ± 1.0; P = .04). Most of this effect was explained by the positive impact of gratitude on team information sharing (4.3 ± 0.8 vs 4.0 ± 0.8; P = .03). As a result, accuracy of diagnostic work was improved (95% CI = 0.018 to 0.395; *P* = .03) #### Weaver, 2020 [ID 65] This study evaluated the impact of using a gamified feedback system on a medical-surgical unit in the US. The feedback system allowed service users to use a tablet to input free-text comments, which were later sent as text alerts to nurses and technicians. Its impact was evaluated using interviews, focus groups, and surveys. Healthcare staff described that receiving recognition and appreciation through the feedback system made them feel good, boosted confidence, morale and motivation, and helped them to feel comfortable in their job. Staff were initially enthusiastic about using the feedback system, which was seen to support the effect of positive feedback. Similarly, when staff became less enthusiastic and motivated to use the system over time, this hindered the effects of positive feedback. Night shift staff reported less opportunity to receive feedback from service users. The system was hindered by the lengthy process of accumulating points and rewards, making feedback from service users less timely, consistent, or meaningful. ### Characteristics of positive feedback in included studies Positive feedback was described in included studies as having a variety of forms, most commonly described in their original papers as appreciation and gratitude (Table 5). The form of feedback was categorised as material or ambiguous. Material feedback referred to physical items given by service users, families, or the community. In a substantial number of included papers, the precise form of feedback was not explicitly stated, and hence was ambiguous. For example, gratitude might incorporate a variety of actions, but this was often not stated in published work. View this table: [Table 5.](http://medrxiv.org/content/early/2022/09/14/2022.09.10.22279800/T5) Table 5. Positive feedback in included studies in order of quantity Multiple papers from the same study were counted as having a single type of feedback Included studies identified that positive feedback was delivered by service users (n = 53), the community (n = 18), and families (n = 16), with some studies identifying multiple sources of feedback. Recipients of positive feedback were described using a broad variety of labels, most commonly identified as clinical staff providing direct care and treatment to service users (n = 68) (Table 6). In some studies, non-clinical staff received feedback (n = 3). View this table: [Table 6.](http://medrxiv.org/content/early/2022/09/14/2022.09.10.22279800/T6) Table 6. Feedback recipients of positive feedback in included studies in order of quantity Multiple papers from the same study were counted as a single feedback recipient Healthcare staff worked in a range of settings, categorised as clinical (primarily provides a health-related medical function) and non-clinical (primary purpose is not to provide a direct health-related medical function). Most studies considered clinical settings (n = 74) (Table 7). Two included papers did not explicitly state the setting (53, 54). View this table: [Table 7.](http://medrxiv.org/content/early/2022/09/14/2022.09.10.22279800/T7) Table 7. Feedback settings of positive feedback delivery in included studies in order of quantity Multiple papers from the same study were counted separately only if the setting differed between papers ### Objective 1: Measures of change There was a considerable variation in the outcome domains and measures used in studies (n = 11) (Table 8). The remaining 57 studies did not include a standardised outcome measure. A measure was concluded to be standardised if a citable reference was available. View this table: [Table 8.](http://medrxiv.org/content/early/2022/09/14/2022.09.10.22279800/T8) Table 8. Outcome domains and outcome measures used in included studies ### Objective 2: Model development #### Outcomes All identified outcomes were reported as change for healthcare staff. Three papers reported a change in the therapeutic staff-service user relationship rather than the healthcare staff individually, listed under the category most relevant to reported outcomes. Outcomes reporting a change in staff-service user relationships describe a strengthened therapeutic alliance (55-57). Most papers identified helpful changes to healthcare staff and services (Table 9). View this table: [Table 9.](http://medrxiv.org/content/early/2022/09/14/2022.09.10.22279800/T9) Table 9. Helpful outcomes identified in included studies, arranged by higher-level category and sub-category Multiple papers from the same study were counted separately only if reporting different outcomes. Some outcomes were described ambiguously in their original papers and therefore included in, but not expanded on, in the table. Some papers identified undesirable changes (Table 10). View this table: [Table 10.](http://medrxiv.org/content/early/2022/09/14/2022.09.10.22279800/T10) Table 10. Undesirable changes for healthcare staff identified in included studies One change was identified which could be viewed as both helpful and undesirable. An altered responsiveness to grateful service users who give philanthropic gifts could be viewed as helpful as responding more quickly to those giving gifts may increase the likelihood of future donations (56). However, altered responsiveness may undermine the professional relationship between staff and service-users and result in a decreased responsiveness to those not giving gifts. #### Mechanisms A mechanism is a process by which positive feedback causes change. Mechanisms identified in included studies are in Table 11. View this table: [Table 11.](http://medrxiv.org/content/early/2022/09/14/2022.09.10.22279800/T11) Table 11. Mechanisms identified as cause of change in included studies #### Moderators, facilitators, and barriers Factors were identified which can alter the degree of change following positive feedback. Some factors enhanced the effect of positive feedback (Table 12). View this table: [Table 12.](http://medrxiv.org/content/early/2022/09/14/2022.09.10.22279800/T12) Table 12. Factors enhancing the effect of positive feedback in included studies Type of factor refers to facilitators [F], or moderators [M]. Some studies also identified barriers to change, where the effect of positive feedback was hindered (Table 13). View this table: [Table 13.](http://medrxiv.org/content/early/2022/09/14/2022.09.10.22279800/T13) Table 13. Factors hindering the effect of positive feedback in included studies Three studies described working in oncology as enhancing the effects of positive feedback. One study described having increased intimacy and closeness with oncology service users, facilitating feelings of reward and satisfaction (58). Another described how working in oncology felt more worthwhile and like a gift, with service users expressing deep appreciation which is not seen in other wards. In comparison, working in a medical-surgical unit can feel robotic (59). One study described how working in oncology had fewer psychological demands (60). The psychological demands of the healthcare role impacted the degree of change between service user gratitude and burnout. Emergency units were perceived to have higher psychological demands than oncology wards, due to work shifts, workloads, and the shorter, more superficial relationships with service users. For emergency nurses, personal accomplishment as a mediator of burnout diminished with increased psychological demands. In contrast, oncology nurses had higher perceptions of service user gratitude and higher personal accomplishment. The institutional context may influence the extent to which staff members are able to encounter and engage with positive feedback. Occupational identity was also identified in another study as factor enhancing the effect of service user gratitude, with changes to energy within relationships, spousal family satisfaction, and relationship-based family performance (61). Receiving service user gratitude improved healthcare staff’s home environment, and this was amplified when staff strongly identified with their role. In one study, appreciation reduced the relationship between intrinsic motivation (a type of motivation that is based on inherent pleasure or passion, rather than extrinsic rewards such as money or fame) and the perception of illegitimate tasks (62). Illegitimate tasks were unnecessary (tasks that could have been avoided with better organisation) or unreasonable (tasks that were not the responsibility of that staff member). Motivated staff perceived a higher number of unnecessary tasks being assigned to them, but appreciation from service users reduced this relationship. #### Mediators A mediator is a factor which is essential in the change process and must be in place for change to occur. In the study by Riskin et al (2019), team information sharing partially mediated the impact of gratitude (63). In a study by Tang et al (2021) energy within relationships mediated the effect of service user gratitude and spousal family satisfaction (95% CI = 0.007 to 0.042; *P* = .02) and relationship-based family role performance (95% CI = 0.010 to 0.054; *P* = .03) (61). Receiving gratitude from service users acts as an energy resource within relationships, which healthcare staff are then able to utilise in the family domain. As a result, increased relational energy led to increased familial satisfaction. ### Change model Forms of change are summarised in a model presented in Fig 2, which extends a preliminary model from a prior review (37). ![Fig 2.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2022/09/14/2022.09.10.22279800/F2.medium.gif) [Fig 2.](http://medrxiv.org/content/early/2022/09/14/2022.09.10.22279800/F2) Fig 2. How positive feedback from service users, families, and communities can create change in healthcare settings conceptualised in a change model Listed factors are not exhaustive. ### Subgroup analyses #### Quality assessment Only one study (reported on in two papers) did not meet the 60% threshold for quality assessment due to a lack of a clear research question (50, 64). Findings from this study were not consequential to the change model due to these being reinforced by other studies (50). #### Studies conducted in a mostly public versus mostly private healthcare system One difference between studies conducted in a mostly public healthcare system (UK) and mostly private healthcare systems (US) was the type of positive feedback provided. All UK studies described ambiguous types of positive feedback. While many US studies also described ambiguous feedback, two described material feedback in the form of cards, flowers, and gifts (56, 65). One undesirable change was identified in both UK and US studies. In the UK, research identified that students feel embarrassed when receiving positive feedback from feedback forms via tutors (66), whereas in the US, tension and pressure surrounding the service user-professional relationship was identified after gift-giving (56). ## Discussion ### Summary of findings The review included a broad range of papers presenting evidence that change can be created in health services using positive patient feedback. The largest body of evidence relates to beneficial short-term emotional changes experienced by healthcare workers as the result of receiving feedback, such as feeling more hopeful and motivated, and to beneficial work-related change (such as increased retention and reduced burnout). Beneficial changes to the home environment were also documented. A small number of undesirable changes were identified. These included feeling embarrassed when receiving feedback, feeling envy and stress when not rewarded with positive feedback, and feeling guilt, tension, and pressure when accepting gifts. Tensions surrounding service user gift-giving may arise due to health professionals being restricted to only accepting ‘trivial’ gifts, which may create uncertainty in staff regarding boundaries due to vague definitions (67). The type of gift (such as those marking an occasion, inexpensive, or ‘over the top’) and recipient (such as individual staff or donation to the service) may influence staff reactions. Gifts which fail to align with ethical practice, such as ‘over the top’ displays of gratitude, may be more likely to produce undesirable change (68). Importantly, only two intervention studies were identified (63, 65), and neither quantified effect in a real-world healthcare setting. This means that no evidence on the size of effect produced by positive feedback was available. This points to a substantial gap in knowledge which might be addressed by future research studies. A broad range of measures were used in quantitative studies, suggesting a lack of consensus in the research community on the most important constructs to consider, and how to assess them. Most work has been conducted within the last 10 years, which potentially relates to the widespread emergence of technological solutions to the collection and distribution of feedback, creating the potential for new forms of intervention. The current review has identified factors which enhance or hinder the creation of change through feedback. Some of these factors relate directly to the nature of specific healthcare roles and professions. For example, change was enhanced if feedback recipients worked in roles which allow more meaningful interaction with service users, and hindered for feedback recipients working night shifts and hence potentially having less direct contact with patients. This suggests that positive feedback may not be an accurate measure for assessing quality of care as some staff are not given the opportunity to influence and receive feedback. It is unlikely that feedback will be equally received by staff across services due to their varying nature with the implementation of a single feedback system. Tailoring feedback systems to the settings and contexts in which staff work may be beneficial to ensure similar opportunities to receive feedback but understanding the fundamental differences between services is crucial when assessing quality improvement priorities. ### Relationship to prior work The current review extends a previous systematised review which investigated how expressions of service user gratitude creates change in healthcare services (37). Due to the current review having a mostly broader focus, 68 papers were included compared to 26 papers in the previous review, and this has resulted in a broader range of short-term emotional benefits and undesirable impacts being identified. In a scoping review investigating service user gratitude in healthcare, receiving gratitude was found to enhance healthcare worker wellbeing, act as a positive force against stress, increase motivation, increase reciprocated gratitude, and reduce burnout (35). Aparicio and colleagues identified 32 includable papers, only two of which were included in the current review (59, 60). Despite a lack of cross-over in included studies due to differences in inclusion criteria, the findings remain consistent. For instance, gratitude acting as a positive force against distress is also seen in the current review, categorised as increased psychological wellbeing and a protective force against trauma. The methodology of the current review builds on the scoping review by examining literature systematically, in line with MRC recommendations (38). The benefits of positive feedback identified in this review may be particularly relevant for the occupational health of healthcare staff. For example, the number of nurses leaving the profession rose in 2021 by 25% (69), with increased workload leading to higher levels of burnout (70). Healthcare workers have been found to have high levels of intrinsic motivation, where motivation to perform well is a product of inner drives. This was particularly evident in permanent healthcare staff (71). Validation of having done good work may therefore be positively reinforced with positive feedback and be of greater value than for those who are extrinsically motivated by factors such as financial reward or promotion (72). Increased intrinsic motivation may boost affective commitment and lead to reduced turnover intention among healthcare staff (73). Similarly, finding intrinsic meaning in their work was helpful for healthcare workers in Japan to cope during the Covid pandemic (24)). Self-determination theory also suggests that intrinsic motivation can assist with the development of professional identity for healthcare staff (74). Shifting healthcare staff attitudes surrounding service user feedback may be essential for implementing meaningful change which utilises positive feedback due to the belief that feedback is largely negative (13). The Lewin Change model describes three steps for creating change (75), starting with ‘unfreezing’ whereby a shift away from current beliefs is initiated through challenging defensiveness towards change and dismantling current views. This may be possible through exposure to positive feedback. The second stage is ‘movement’ which describes a change occurring, such as beneficial outcomes as a result of positive feedback. The third stage is ‘refreezing’ which describes a replacement of old views and processes with new ones, which begins to normalise the new methods of operating. For positive feedback in healthcare, this may reflect system-level change such as policy implementation. However, this model may be limited to healthcare staff’s willingness to engage with positive feedback. The idea of a ‘learning organisation’ was introduced by Senge, who described a group of people continually working to enhance their capacities and create results that they want (76). A learning organisation describes one which is not operating as a machine, but rather a humanistic never-ending process of development and learning. Adapted for healthcare settings, learning organisations have five disciplines (77). ‘Open systems thinking’ describes services being viewed as a whole rather than isolated by disease, procedures, or structures, and aims to create interconnectedness beyond departmental boundaries. ‘Improving individual capabilities’ describes striving for excellence by improving personal proficiencies of staff. ‘Team learning’ describes learning as a collective rather than via single professionals. ‘Updating mental models’ describes updating the deeply held assumptions and generalisations held by individuals within the organisation and finding new ways of operating. Finally, ‘a cohesive vision’ describes empowering and enabling staff being counterbalanced by strategic direction and clear values to guide individual action to produce shared understanding. Healthcare systems have identified that being a ‘learning organisation’ encourages a culture celebrating innovation and success (77). Positive feedback may offer a means for learning organisations to create a cultural shift towards valuing positive service user experiences rather than focussing solely on negative incidents and risk reduction. ### Strengths and limitations A strength of the review is that a broad range of publications databases was searched, including a database specific to computing publications and rarely used in systematic reviews, which is important when feedback is routinely collected through technological means. Compared to the prior narrower review, broader inclusion criteria have enabled the inclusion of papers describing changes to healthcare systems, enabling the identification of changes such as increased referral intentions following positive feedback from service users about a particular service (78). The addition of search terms such as ‘positive feedback’ and ‘positive evaluation’ have enabled new forms of change to be identified, such as non-clinical staff benefiting from positive feedback as well as those in clinical roles. A strength of the review is that inclusion criteria were carefully designed to exclude papers where there was ambiguity about the source of feedback or the direction of change, meaning that studies were excluded where causality was uncertain, such as in studies using correlation analyses (79). This has provided a solid foundation to develop a change model. Another strength of the review is that it was inclusive of studies which were conducted in non-WEIRD (western, educated, industrialised, rich, and democratic) countries, despite being limited to papers published in English. For example, included studies reflected healthcare systems in eight African regions. Although emotional expressions differ across cultures (15), positive feedback was deemed helpful to healthcare organisational outcomes. Findings were robust across studies despite differing locations and healthcare systems, reinforcing the value of positive feedback. A limitation of the review is that the definition of positive feedback is not straightforward. A subgroup analysis was planned for documents which identify change through expressions of healthcare service user gratitude specifically. Ambiguity in the distinction between positive feedback and gratitude definitions meant that the subgroup analysis could not be performed. Medical definitions of positive feedback describe the body being amplified from its normal state (80), but this review did not include positive physical or medical signals from service users. However, seeing a patient improve was described in some studies as a form of positive feedback (81). Physiological markers may not reflect positive healthcare experiences and would not reflect quality of care given by palliative care teams. Further, service user gratitude was seen to create change for other service users (20), but this was excluded as it could not be considered a change for healthcare staff or systems. Furthermore, positive feedback was defined as a response from healthcare service users, families or the community indicating concordance between desired and actual experiences regarding their care or treatment, delivered to healthcare staff or systems. However, the assumption was made that positive feedback was expressed with the intention of communicating this concordance between desired and actual care, but other contextual and motivating factors may have existed, such as feeling obligated to give positive responses when asked for feedback in person (82), service users attempting to influence their future care and treatment and prevent punitive treatment for negative feedback (20), and social norms surrounding expressions of thanks which may be expressed habitually (83). ### Implications of the review and change model #### Implications for practice Managers of health service units seeking to address problems such as staff burnout or low motivation should consider the integration of mechanisms for making positive feedback available to staff members and should seek to identify barriers to the use of positive feedback in their units. Health service managers in units already making use of positive feedback should examine whether particular staff groups are disadvantaged, for example if working in circumstances that make the provision of positive feedback more difficult, or increasing exposure of positive feedback to individuals from minority ethnic backgrounds who may be more likely to receive complaints (84). Policymakers should consider adopting policies that encourage the collection and distribution of positive feedback. Requirements of healthcare professional bodies to make use of feedback in reflective practice might be used to motivate change, though it is unclear whether this phenomenon extends beyond the UK. This may also exclude individuals whose roles do not require professional registration. Integrating positive feedback from service users, families, or communities into standard clinical supervision rather than formal requirements may create an attitudinal shift away from revalidation scepticism to become an essential part of practice (28). Effective clinical supervision can prevent burnout (85), and positive feedback may enhance these benefits. #### Implications for research There is a need for the research community to conduct and replicate intervention studies of precisely designed feedback interventions, ideally in the form of randomised controlled trials designed to collect evidence on effectiveness and cost-effectiveness. The research community should seek to reach consensus on the most important measures to be assessed in trials, to enable meta-analyses pooling findings from multiple trials to be conducted. Future research may investigate the effects of positive feedback depending on healthcare role, comparing those who have consistent access to feedback (such as oncology staff) (59), to those who feel overlooked and undervalued (such as healthcare assistants) (86). Future research may investigate the effects of positive feedback at multiple levels of the organisation, such as individual impacts like resilience, and organisational culture and system-level change, and whether the effect of positive feedback changes depending on individual or team receipt. The research community should also aim to investigate the influence of feedback content and form in eliciting change and whether content has practical utility. Examples include whether content of feedback is meaningful to staff, and if relationships with service users are more significant than numerical indicators of satisfaction. Feedback with specific utility, such as an appointment being ‘on time’, may also produce differing effects to interpersonal emotional connections. This may assist with the development of a typology to characterise feedback and assist with understanding whether positive feedback should be used and delivered universally. Research may also benefit from being co-designed with healthcare workers with practical knowledge to enhance the functional integration of findings into clinical practice. ## Conclusions Positive feedback from service users, families, and the community can lead to meaningful change. Change is largely positive, with emotional, familial, and work-related change being recognised. However, some undesirable changes were identified in relation to healthcare staff emotions. Overall, positive feedback provides the opportunity to create meaningful change but requires further interventional investigation. ## Data Availability All relevant data are within the manuscript and its Supporting Information files. ## Supporting information captions S1 File. Amendments to search strategy for CINAHL, ASSIA and the ACM Digital Library S2 File. PRISMA checklist S3 Table. Full data abstraction table ## Acknowledgements For the purposes of open access, the authors have applied a CC BY public copyright license to any author accepted manuscript version arising from this submission * Received September 10, 2022. * Revision received September 10, 2022. * Accepted September 14, 2022. * © 2022, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution 4.0 International), CC BY 4.0, as described at [http://creativecommons.org/licenses/by/4.0/](http://creativecommons.org/licenses/by/4.0/) ## References 1. 1.Ramani S, Könings KD, Ginsburg S, van der Vleuten CPM. Feedback Redefined: Principles and Practice. Journal of General Internal Medicine. 2019;34(5):744–9. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s11606-019-04874-2&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F14%2F2022.09.10.22279800.atom) 2. 2.Hardavella G, Aamli-Gaagnat A, Saad N, Rousalova I, Sreter KB. How to give and receive feedback effectively. Breathe. 2017;13(4):327–33. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYnJlYXRoZSI7czo1OiJyZXNpZCI7czo4OiIxMy80LzMyNyI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIyLzA5LzE0LzIwMjIuMDkuMTAuMjIyNzk4MDAuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 3. 3.Barello S, Graffigna G, Vegni E. Patient Engagement as an Emerging Challenge for Healthcare Services: Mapping the Literature. Nursing Research and Practice. 2012;2012:905934. 4. 4.Locock L, Graham C, King J, Parkin S, Chisholm A, Montgomery C, et al. Understanding how front-line staff use patient experience data for service improvement: an exploratory case study evaluation. 2020;8:13. 5. 5.Coulter A, Locock L, Ziebland S, Calabrese J. Collecting data on patient experience is not enough: they must be used to improve care. BMJ : British Medical Journal. 2014;348:g2225. 6. 6.Brookes G, Baker P. What does patient feedback reveal about the NHS? A mixed methods study of comments posted to the NHS Choices online service. BMJ open. 2017;7(4):e013821. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYm1qb3BlbiI7czo1OiJyZXNpZCI7czoxMToiNy80L2UwMTM4MjEiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMi8wOS8xNC8yMDIyLjA5LjEwLjIyMjc5ODAwLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 7. 7.Stahl K, Groene O. ASK ME!—Routine measurement of patient experience with patient safety in ambulatory care: A mixed-mode survey. PLOS ONE. 2021;16(12):e0259252. 8. 8.Marsh C, Peacock R, Sheard L, Hughes L, Lawton R. Patient experience feedback in UK hospitals: What types are Available and what are their potential roles in quality improvement (QI)? Health Expectations. 2019;22(3):317–26. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F14%2F2022.09.10.22279800.atom) 9. 9.Maxwell E, Lamont T. Improving care by using patient feedback. 2019. 10. 10.Capozzi JD, Rhodes R. Gifts from Patients. JBJS. 2004;86(10). 11. 11.Gillespie A, Reader TW. Identifying and encouraging high-quality healthcare: an analysis of the content and aims of patient letters of compliment. BMJ quality & safety. 2021;30(6):484–92. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoicWhjIjtzOjU6InJlc2lkIjtzOjg6IjMwLzYvNDg0IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjIvMDkvMTQvMjAyMi4wOS4xMC4yMjI3OTgwMC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 12. 12.James TL, Villacis Calderon ED, Cook DF. Exploring patient perceptions of healthcare service quality through analysis of unstructured feedback. Expert Systems with Applications. 2017;71:479–92. 13. 13.Powell J, Atherton H, Williams V, Mazanderani F, Dudhwala F, Woolgar S, et al. Using online patient feedback to improve NHS services: the INQUIRE multimethod study. Health Services and Delivery Research. 2019;7(38). 14. 14.Lewandowska-Tomaszczyk B, Wilson PA. Expressive and reserved cultural linguistic schemas: British and American pride clusters. Cultural linguistics and world Englishes: Springer; 2021. p. 261–93. 15. 15.Lim N. Cultural differences in emotion: differences in emotional arousal level between the East and the West. Integrative medicine research. 2016;5(2):105–9. 16. 16.Maxwell E. Patient feedback: how effectively is it collected and used. Nurs Times. 2020;116(12):27–9. 17. 17.Emmons RA, McNamara P. Sacred emotions and affective neuroscience: Gratitude, costly signaling, and the brain. Where God and science meet: How brain and evolutionary studies alter our understanding of religion. 2006;1:11–31. 18. 18.Aparicio M, Centeno C, Carrasco JM, Barbosa A, Arantzamendi M. What are families most grateful for after receiving palliative care? Content analysis of written documents received: a chance to improve the quality of care. BMC palliative care. 2017;16(1):1–11. 19. 19.Day G, Robert G, Leedham-Green K, Rafferty AM. An outbreak of appreciation: A discursive analysis of tweets of gratitude expressed to the National Health Service at the outset of the COVID-19 pandemic. Health Expectations. 2022;25(1):149–62. 20. 20.Campbell C, Scott K, Skovdal M, Madanhire C, Nyamukapa C, Gregson S. A good patient? How notions of ‘a good patient’ affect patient-nurse relationships and ART adherence in Zimbabwe. BMC infectious diseases. 2015;15:404. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F14%2F2022.09.10.22279800.atom) 21. 21.The Point of Care Foundation. Case study 1: Oxleas Mental Health Trust 2022 [Available from: [https://www.pointofcarefoundation.org.uk/resource/experience-based-co-design-ebcd-toolkit/case-studies/case-study-1-oxleas-mental-health-trust/](https://www.pointofcarefoundation.org.uk/resource/experience-based-co-design-ebcd-toolkit/case-studies/case-study-1-oxleas-mental-health-trust/). 22. 22.NHS England. Friends and Family Test 2022 [Available from: [https://www.england.nhs.uk/fft/](https://www.england.nhs.uk/fft/). 23. 23.NHS England. Using the Friends and Family Test to gain insight on the trust’s response to the pandemic: NHS England; 2022 [Available from: [https://www.england.nhs.uk/fft/case-studies/using-the-fft-to-gain-insight-on-the-trusts-response-to-the-pandemic/](https://www.england.nhs.uk/fft/case-studies/using-the-fft-to-gain-insight-on-the-trusts-response-to-the-pandemic/). 24. 24.Kotera Y, Ozaki A, Miyatake H, Tsunetoshi C, Nishikawa Y, Kosaka M, et al. Qualitative Investigation into the mental health of healthcare workers in Japan during the COVID-19 Pandemic. International journal of environmental research and public health. 2022;19(1):568. 25. 25.Nursing & Midwifery Council. Revalidation 2021 [Available from: [https://www.nmc.org.uk/revalidation/](https://www.nmc.org.uk/revalidation/). 26. 26.General Medical Council. Your supporting information – feedback from patients or those you provide medical services to 2022 [Available from: [https://www.gmc-uk.org/registration-and-licensing/managing-your-registration/revalidation/guidance-on-supporting-information-for-appraisal-and-revalidation/your-supporting-information\---|feedback-from-patients-or-those-to-whom-you-provide-medical-services](https://www.gmc-uk.org/registration-and-licensing/managing-your-registration/revalidation/guidance-on-supporting-information-for-appraisal-and-revalidation/your-supporting-information\---|feedback-from-patients-or-those-to-whom-you-provide-medical-services). 27. 27.Health & Care Professionals Council. Standards of continuing professional development 2018 [Available from: [https://www.hcpc-uk.org/standards/standards-of-continuing-professional-development/](https://www.hcpc-uk.org/standards/standards-of-continuing-professional-development/). 28. 28.Tazzyman A, Ferguson J, Hillier C, Boyd A, Tredinnick-Rowe J, Archer J, et al. The implementation of medical revalidation: an assessment using normalisation process theory. BMC Health Services Research. 2017;17(1):749. 29. 29.Griffiths A, Leaver MP. Wisdom of patients: predicting the quality of care using aggregated patient feedback. BMJ Quality & Safety. 2018;27(2):110. 30. 30.NHS Improving Quality. Five steps towards quality improvement: A simple guide to improving services. 2014. 31. 31.Wensing M, Vingerhoets E, Grol R. Feedback based on patient evaluations: a tool for quality improvement? Patient Education and Counseling. 2003;51(2):149–53. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S0738-3991(02)00199-4&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=14572944&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F14%2F2022.09.10.22279800.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000186527700008&link_type=ISI) 32. 32.Ramsey LP, Sheard L, Lawton R, O’Hara J. How do healthcare staff respond to patient experience feedback online? A typology of responses published on care opinion. Patient Experience Journal. 2019;6(2):42–50. 33. 33.Donetto S, Desai A, Zoccatelli G, Robert G, Allen D, Brearley S, et al. Organisational strategies and practices to improve care using patient experience data in acute NHS hospital trusts: an ethnographic study. 2019;7:34. 34. 34.Day G. Enhancing relational care through expressions of gratitude: insights from a historical case study of almoner–patient correspondence. Medical Humanities. 2020;46(3):288. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NjoibWVkaHVtIjtzOjU6InJlc2lkIjtzOjg6IjQ2LzMvMjg4IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjIvMDkvMTQvMjAyMi4wOS4xMC4yMjI3OTgwMC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 35. 35.Aparicio M, Centeno C, Robinson C, Arantzamendi M. Gratitude between patients and their families and health professionals: A scoping review. Journal of Nursing Management. 2019;27(2):286–300. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F14%2F2022.09.10.22279800.atom) 36. 36.Day G, Robert G, Rafferty AM. Gratitude in health care: A meta-narrative review. Qualitative health research. 2020;30(14):2303–15. 37. 37.Lloyd R, Rennick-Egglestone S. A systematic review investigating how expressions of patient gratitude can create change in healthcare settings [Protocol Registration]. National Institute for Health Research. 2021;PROSPERO 2021 CRD42021265334.. 38. 38.Craig P, Dieppe P, MacIntyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions 2019 [Available from: [www.mrc.ac.uk/complexinterventionsguidance](http://www.mrc.ac.uk/complexinterventionsguidance). 39. 39.Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. Systematic reviews. 2021;10(1):1–11. 40. 40.Popay J, Roberts H, Sowden A, Petticrew M, Arai L, Rodgers M, et al. Guidance on the conduct of narrative synthesis in systematic reviews. A product from the ESRC methods programme Version. 2006;1(1):b92. 41. 41.Methley AM, Campbell S, Chew-Graham C, McNally R, Cheraghi-Sohi S. PICO, PICOS and SPIDER: a comparison study of specificity and sensitivity in three search tools for qualitative systematic reviews. BMC health services research. 2014;14(1):1–10. 42. 42.The DAISY Foundation. What is The DAISY Award? 2022 [Available from: [https://www.daisyfoundation.org/daisy-award](https://www.daisyfoundation.org/daisy-award). 43. 43.Trajkovski S, Schmied V, Vickers M, Jackson D. Using appreciative inquiry to transform health care. Contemporary nurse. 2013;45(1):95–100. 44. 44.Cox CL. ‘Healthcare Heroes’: problems with media focus on heroism from healthcare workers during the COVID-19 pandemic. Journal of Medical Ethics. 2020;46(8):510. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToibWVkZXRoaWNzIjtzOjU6InJlc2lkIjtzOjg6IjQ2LzgvNTEwIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjIvMDkvMTQvMjAyMi4wOS4xMC4yMjI3OTgwMC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 45. 45.The EndNote Team. EndNote. EndNote X9 ed. Philadelphia, PA: Clarivate; 2013. 46. 46.Baron RM, Kenny DA. The moderator–mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. 1986;51:1173–82. 47. 47.Hong QN, Fàbregues S, Bartlett G, Boardman F, Cargo M, Dagenais P, et al. The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers. Education for information. 2018;34(4):285–91. 48. 48.Zulu JM, Kinsman J, Michelo C, Hurtig A-K. Hope and despair: community health assistants’ experiences of working in a rural district in Zambia. Human resources for health. 2014;12:30. 49. 49.Zulu JM, Michelo C, Kinsman J, Hurtig A-K. 1/3. Hope and despair: the community health assistant role in Zambia. British Journal of Healthcare Assistants. 2015;9(9):458–65. 50. 50.Kelly D, Lankshear A, Wiseman T, Jahn P, Mall-Roosmae H, Rannus K, et al. The experiences of cancer nurses working in four European countries: A qualitative study. European journal of oncology nursing : the official journal of European Oncology Nursing Society. 2020;49:101844. 51. 51.Prytherch H, Kagoné M, Aninanya GA, Williams JE, Kakoko DC, Leshabari MT, et al. Motivation and incentives of rural maternal and neonatal health care providers: a comparison of qualitative findings from Burkina Faso, Ghana and Tanzania. BMC Health Services Research. 2013;13(1):149-. 52. 52.Danet AD, Jimenez Cardoso PM, Perez Villares JM. Emotional paths of professional experiences in transplant coordinators. Rutas emocionales en las experiencias profesionales de los equipos de coordinacion de trasplantes. 2020;40(1):74–90. 53. 53.MacLeod MLP, Zimmer LV, Kosteniuk JG, Penz KL, Stewart NJ. The meaning of nursing practice for nurses who are retired yet continue to work in a rural or remote community. BMC Nursing. 2021;20(1):1–13. 54. 54.Warburton J, Moore ML, Clune SJ, Hodgkin SP. Extrinsic and intrinsic factors impacting on the retention of older rural healthcare workers in the north Victorian public sector: a qualitative study. Rural and Remote Health. 2014;14(3):[131]-[46]. 55. 55.Martinez-Taboas A, Cordero-Soto MM, Davila T, Oben A, Pujals K, Medina M, et al. Gifts in psychotherapy: Attitudes and experiences of Puerto Rican psychotherapists. Revista Puertorriquena de Psicologia. 2014;25(2):328–39. 56. 56.Wright SM, Wolfe L, Stewart R, Flynn JA, Paisner R, Rum S, et al. Ethical concerns related to grateful patient philanthropy: The physician’s perspective. Journal of General Internal Medicine. 2013;28(5):645–51. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s11606-012-2246-7&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23225219&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F14%2F2022.09.10.22279800.atom) 57. 57.Zwack J, Schweitzer J. If every fifth physician is affected by burnout, what about the other four? Resilience strategies of experienced physicians. Academic Medicine. 2013;88(3):382–9. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1097/ACM.0b013e318281696b&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23348093&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F14%2F2022.09.10.22279800.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000315522600027&link_type=ISI) 58. 58.Peteet JR, Ross DM, Medeiros C, Walsh-Burke K, et al. Relationships with patients in oncology: Can a clinician be a friend? Psychiatry: Interpersonal and Biological Processes. 1992;55(3):223–9. 59. 59.Raingruber B, Wolf T. Nurse perspectives regarding the meaningfulness of oncology nursing practice. 2015(1538-067X (Electronic)). 60. 60.Converso D, Loera B, Viotti S, Martini M. Do positive relations with patients play a protective role for healthcare employees? Effects of patients’ gratitude and support on nurses’ burnout. Frontiers in Psychology. 2015;6. 61. 61.Tang PM, Ilies R, Aw SS, Lin KJ, Lee R, Trombini C. How and when service beneficiaries’ gratitude enriches employees’ daily lives. Journal of Applied Psychology. 2021. 62. 62.Muntz J, Dormann C. Moderating effects of appreciation on relationships between illegitimate tasks and intrinsic motivation: A two-wave shortitudinal study. European Journal of Work and Organizational Psychology. 2020;29(3):391–404. 63. 63.Riskin A, Bamberger P, Erez A, Riskin-Guez K, Riskin Y, Sela R, et al. Expressions of gratitude and medical team performance. Pediatrics. 2019;143(4). 64. 64.Hendren K, Luo QE, Pandey SK. The state of mixed methods research in public administration and public policy. Public Administration Review. 2018;78(6):904–16. 65. 65.Weaver SH. The impact of real-time patient feedback using a gamified system. Nursing Management. 2020;51(12):14–22. 66. 66.Pal LM, Dixon RE, Faull CM. Utilising feedback from patients and their families as a learning strategy in a Foundation Degree in palliative and supportive care: A qualitative study. Nurse Education Today. 2014;34(3):319–24. 67. 67.Royal College of Nursing. Gifts and wills 2022 [Available from: [https://www.rcn.org.uk/Get-Help/RCN-advice/gifts-and-wills](https://www.rcn.org.uk/Get-Help/RCN-advice/gifts-and-wills). 68. 68.Zolkefli Y. Healthcare Dilemma Towards Gift Giving by Patients. The Malaysian Journal of Medical Sciences: MJMS. 2021;28(5):137. 69. 69.Nursing Notes. New NMC figures reveal sharp rise in nurses leaving the profession 2021 [Available from: [https://nursingnotes.co.uk/news/workforce/new-nmc-figures-reveal-sharp-rise-in-nurses-leaving-the-profession/](https://nursingnotes.co.uk/news/workforce/new-nmc-figures-reveal-sharp-rise-in-nurses-leaving-the-profession/). 70. 70.Greenglass ER, Burke RJ, Fiksenbaum L. Workload and burnout in nurses. Journal of Community & Applied Social Psychology. 2001;11(3):211–5. 71. 71.Kumar P, Mehra A, Inder D, Sharma N. Organizational commitment and intrinsic motivation of regular and contractual primary health care providers. Journal of family medicine and primary care. 2016;5(1):94. 72. 72.Kotera Y, Conway E, Van Gordon W. Ethical Judgement in UK Business Students: Relationship with Motivation, Self-Compassion and Mental Health. International Journal of Mental Health and Addiction. 2019;17(5):1132–46. 73. 73.Galletta M, Portoghese I, Battistelli A. Intrinsic Motivation, Job Autonomy and Turnover Intention in the Italian Healthcare: The Mediating Role of Affective Commitment. Journal of Management Research. 2011;3(2):E7. 74. 74.Wilkins EB. Facilitating Professional Identity Development in Healthcare Education. New Directions for Teaching and Learning. 2020;2020(162):57–69. 75. 75.1. Dorwin Cartwright. Lewin K. Field theory in social science: selected theoretical papers (Edited by Dorwin Cartwright.). 1951. 76. 76.Senge PM. The fifth discipline: The art and practice of the learning organization: Broadway Business; 2006. 77. 77.Davie HTO, Nutley SM. Developing learning organisations in the new NHS. BMJ. 2000;320(7240):998. [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjEyOiIzMjAvNzI0MC85OTgiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMi8wOS8xNC8yMDIyLjA5LjEwLjIyMjc5ODAwLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 78. 78.Chou WC, Tinetti ME, King MB, Irwin K, Fortinsky RH. Perceptions of physicians on the barriers and facilitators to integrating fall risk evaluation and management into practice. Journal of general internal medicine. 2006;21(2):117–22. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s11606-006-0244-3&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=16336618&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F14%2F2022.09.10.22279800.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000235867800006&link_type=ISI) 79. 79.Prins JT, Hoekstra-Weebers JEHM, Gazendam-Donofrio SM, van de Wiel HBM, Sprangers F, Jaspers FCA, et al. The role of social support in burnout among Dutch medical residents. Psychology, Health & Medicine. 2007;12(1):1–6. 80. 80.Davis CP. Medical Definition of Feedback 2021 [Available from: [https://www.medicinenet.com/feedback/definition.htm](https://www.medicinenet.com/feedback/definition.htm). 81. 81.McCollum R, Otiso L, Mireku M, Theobald S, de Koning K, Hussein S, et al. Exploring perceptions of community health policy in Kenya and identifying implications for policy change. Health Policy and Planning. 2016;31(1):10–20. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/heapol/czv007&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25820367&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F14%2F2022.09.10.22279800.atom) 82. 82.Dudhwala F, Boylan A-M, Williams V, Powell J. VIEWPOINT: What counts as online patient feedback, and for whom? DIGITAL HEALTH. 2017;3:2055207617728186. 83. 83.Ohashi J. Linguistic rituals for thanking in Japanese: Balancing obligations. Journal of Pragmatics. 2008;40(12):2150–74. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.pragma.2008.04.001&link_type=DOI) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000260734000007&link_type=ISI) 84. 84.Wise J. Poor induction and lack of honest feedback is blamed for higher rate of GMC referrals among BAME doctors. BMJ. 2019;365:4391. 85. 85.Edwards D, Burnard P, Hannigan B, Cooper L, Adams J, Juggessur T, et al. Clinical supervision and burnout: the influence of clinical supervision for community mental health nurses. Journal of Clinical Nursing. 2006;15(8):1007–15. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/j.1365-2702.2006.01370.x&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=16879545&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F14%2F2022.09.10.22279800.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000239006400010&link_type=ISI) 86. 86.Fee A, Muldrew D, Slater P, Payne S, McIlfatrick S, McConnell T, et al. The roles, responsibilities and practices of healthcare assistants in out-of-hours community palliative care: A systematic scoping review. Palliative Medicine. 2020;34(8):976–88.