Abstract
Recent years have seen a rise in digital interventions to improve coordination between care homes and NHS services, supporting remote sharing of data on the health of care home residents. Such interventions were key components in the response to the COVID-19 pandemic. This paper presents findings from the qualitative component of an evaluation of an implementation of the HealthCall Digital Care Homes application, across sites in northern England. The implementation commenced prior to the pandemic and continued throughout.
Semi-structured, qualitative interviews were held with stakeholders. Interviews were conducted remotely (October 2020 -June 2021). Data were analysed via a reflexive thematic analysis then mapped against Normalization Process Theory (NPT) constructs (coherence, collective action, cognitive participation, and reflexive monitoring) providing a framework to assess implementation success.
Thirty-five participants were recruited: 16 care home staff, six NHS community nurses, five relatives of care home residents, four HealthCall team members, three care home residents, and one local authority commissioner. Despite facing challenges such as apprehension towards digital technology among care home staff, the application was viewed positively across stakeholder groups. The HealthCall team maintained formal and informal feedback loop with stakeholders. This resulted in revisions to the intervention and implementation. Appropriate training and problem solving from the HealthCall team and buy-in from care home and NHS staff were key to achieving success across NPT constructs.
While this implementation appears broadly successful, establishing rapport and maintaining ongoing support requires significant time, financial backing, and the right individuals in place across stakeholder groups to drive implementation and intervention evolution. The digital literacy of care home staff requires encouragement to enhance their readiness for digital interventions. The COVID-19 pandemic has pushed this agenda forward. Problems with stability across the workforce within care homes need to be addressed to avoid skill loss and support embeddedness of digital interventions.
What is known about this topic?
Improving healthcare delivery in UK care homes is a health policy priority.
Digital interventions designed to enhance the referral process between care homes and NHS services and improve the healthcare delivery in care homes have become increasingly common in the UK. The HealthCall Digital Care Homes application is one such intervention.
These interventions and their implementations require evaluation to ensure that they operate as intended, function coherently and are considered appropriate and legitimate to the care home setting.
What this paper adds?
The HealthCall Digital Care Homes app is a feasible, appropriate and legitimate intervention for referral, triage and health care support for non-urgent health care needs of care home residents.
The ongoing involvement of end users in further developing the intervention, and the level of monitoring and support provided by the implementation team appears to be key to the implementation’s success.
The digital preparedness of UK care homes is limited. Ensuring that care homes are digitally enabled, with a digitally literate workforce, should be a policy and research priority.
Background
Residents in long-term residential and nursing care homes have complex health and social care needs. This population has a high degree of multimorbidity, disability and frailty, with impaired cognitive and behavioural functioning (Gordon et al., 2014), which has increased over the past 20 years (Barker et al., 2021). Estimates indicate that emergency admissions and accident and emergency attendances among care home residents are 40-50% higher than the general population ≥75 years (Smith, 2015). Of such admissions ∼50% could be avoided (Harrison et al., 2016). Such complexity can place strain on care homes and the community NHS services that support them.
Improving the quality of healthcare provision in care homes is a priority for the NHS and adult social care (BGS, 2011, 2021). Digital technologies to support communication between care homes and NHS services could support this goal (BGS, 2021). Such interventions use smart devices for the transfer of data such as vital signs observations for the calculation of Early Warning Scores. The National Early Warning Score (NEWS) has been a common component of digital interventions within care homes and community NHS settings (Brangan et al., 2018; Hodgson et al., 2022; Russell et al., 2020; Scott et al., 2019; Stocker et al., 2021) and is being implemented in other countries including Norway (Steinskog et al., 2021). Such interventions have met with some success, including improving communication between health care services and care homes, and instilling confidence in care home staff (Hodgson et al., 2022; Oung, 2021; Scott et al., 2019; Stocker et al., 2021) though the complexity of the care home setting may present barriers (Russell et al., 2020). The need for remote communication between care homes and services produced by the COVID-19 pandemic has led to increased use of and support for digital interventions within care homes (BGS, 2021; Chu et al., 2021; Edelman et al., 2020; Stocker et al., 2021).
HealthCall Digital Care Homes Application
HealthCall is a collaboration of seven NHS Foundation Trusts across the Northeast of England and North Cumbria (NHSHealthCall, [online]). It focuses on producing digital solutions to health care challenges. One such solution is the Digital Care Homes application, designed to enhance reporting of non-urgent referrals. The app aims to shorten referral times between care homes and NHS services, with the transfer of relevant information through the app as opposed to care home staff waiting in a queue on the phone. Through the app care home staff can record:
vital signs to calculate NEWS
contextual information (free text format) including “soft” signs of deterioration (changes in behaviour, mood, sleep, appetite, toileting).
The reporting structure uses the Situation, Background, Assessment, Recommendation (SBAR) tool (Leonard et al., 2004), designed to promote organised communication of necessary, contextual information about patients. The referral is reviewed by a clinician at a Single Point of Access (SPA), who requests further information from the care home or triages to an appropriate service. The care home is notified of action taken. Senior carers are most likely to use the app as part of their role.
Care homes are given a digital device and in-house training from HealthCall’s local Clinical Trainers. Training covers the app’s purpose, using the digital device, taking vital signs and what to record on the SBAR tool. App use is monitored by HealthCall. Members of community NHS teams, such as community nurses, also communicate with HealthCall and can support care homes with the app.
This paper concerns the qualitative component of an evaluation of the Digital Care Homes application’s implementation into residential and nursing care homes in Northern England.
Patient and Public Involvement (PPI)
Patients and the public were involved at the idea generation stage, confirming that research to improve care for care home residents is viewed as a priority. A PPI panel was established. Research questions, topic guide, study design, findings and dissemination strategies, were discussed via a series of online meetings.
Methods
A phenomenological approach was undertaken. Methods of qualitative inquiry were used, seeking to gain in-depth data about participants’ experiences of and views towards the intervention and its implementation.
Identification and sampling
Relevant stakeholders included the local HealthCall team, local authority staff involved in the implementation, care home staff and residents, relatives of residents, and community NHS staff.
Care home and NHS staff were recruited using purposive sampling aiming for variety in terms of care home size and type, and type of clinician. Convenience and snowball sampling were then used to increase sample size. Residents and relatives were recruited using convenience and snowball sampling.
Recruitment
A member of the local HealthCall team made initial contact, via email, with their colleagues, a Local Authority Commissioner who worked on the implementation, care homes and NHS services on behalf of the research team. They provided a brief description of the evaluation and contact details for the research team who then followed-up on this initial contact.
Care home staff introduced the evaluation to residents who had capacity to provide informed consent. Relatives were sought using a short advert through online community networks. Interested stakeholders were given a PIS and offered the opportunity to ask questions about the evaluation and their participation. PIS were adapted for each stakeholder category. If the wish to participate was upheld a suitable time for data collection was arranged. As the evaluation was conducted remotely, informed consent was secured electronically or verbally, meeting Health Research Authority principles for remote consent.
Data Collection
Data were collected between November 2020 and July 2021 via semi-structured interviews, one-on-one, dyadic, and small group. Interviews were conducted online using video conferencing platforms or by telephone. The topic guide was developed based on similar evaluations conducted by members of the research team (Russell et al., 2020; Stocker et al., 2021) and evaluation aims. As is typical for semi-structured interviews, the topic guide acted as an aide-mémoire rather than being rigidly followed. Interviews were audio-recorded with permission from the participant(s). Data collection ceased once data sufficiency (Dey, 1999) was realised.
Data Analysis
An initial phase of analysis followed the six-phase process for reflexive thematic analysis (TA) (Braun & Clarke, 2019, 2021): familiarisation, generating initial codes, searching for themes, reviewing themes, defining themes and analysis write-up.
Tentative initial codes were discussed among the team based on relevant previous work. Rather than “bracketing” these potential codes they were included in the initial phase of coding and removed if not relevant, thereby informing, but not leading, early analysis.
In reflexive TA coding is “fluid, organic, and recursive” where codes can “expand, contract, be renamed, split apart … collapsed together … and even be abandoned” (Braun & Clarke, 2021). This reflects our approach to this process. RS, ZC, and SR led the analysis, independently coding transcripts, and meeting regularly to review codes and collaborate on the production, reviewing and defining of themes. Developing analysis was discussed with the wider qualitative team, NP and BH, at various stages of data collection and analysis, supporting the sense making work of analysis (Braun & Clarke, 2019, 2021).
Data were then considered against Normalization Process Theory (NPT) (May & Finch, 2009; Ross et al., 2019) constructs of coherence, collective action, cognitive participation, and reflexive monitoring to provide a framework to evaluate implementation success (see Table 3). Similar approaches have been undertaken elsewhere (Asiedu et al., 2019; Ross et al., 2019; Russell et al., 2020). Conducting a TA prior to considering NPT constructs ensured that the voices of participants were accounted for, and analysis was not driven solely by an existing framework.
Results
Participants
Thirty-five participants were recruited (see Table 1). The majority, sixteen, were care home staff. Six of the eight care homes were residential only, two were independently run and they varied in size. Six NHS community nurses, three residents and five relatives participated. The relatives were not related to residents interviewed. Five participants directly involved in implementation were interviewed: four from the local HealthCall team and one Local Authority Commissioner.
Twenty-four interviews were one-to-one. Community Nurse 1 was interviewed individually and participated in a group interview. Twenty-two participated via video conferencing.
Findings
The TA process resulted in three themes Theme 1: “It’s a bit like anything new”: Anticipated, unexpected and implicit challenges of implementation, Theme 2. Communication and Training and Theme 3. Efficiency and Appropriacy, as detailed below. Exemplar quotes are presented in Table 2.
Theme 1. “It’s a bit like anything new”: Anticipated, unexpected and implicit challenges of implementation
The implementation faced challenges anchored on pre-existing skills and confidence of staff, workplace habits and inter-professional dynamics, and problems with the technology.
Digital skills and confidence
Poor digital skills and limited confidence using digital devices among care home staff was widely acknowledged across stakeholder groups. Older care home staff were viewed as particularly apprehensive. HealthCall participants identified this as a considerable, yet unanticipated challenge. There was an assumption that the general prevalence of smart technology meant staff would be digitally literate. However, the need for digital skills training was viewed as greater than for training on vital signs observations.
Some care home staff mentioned their own lack of digital confidence. This was flagged as a training need that went beyond the Digital Care Homes application.
Practices, Habits, and Cultures
Care home staff could fall back into pre-intervention practices, particularly using the phone for referrals rather than the app. CHM1, while supportive of the intervention and aware that changing behaviour could take time, believed the volume of information required by the app could seem more time consuming than picking up the phone. The local HealthCall team believed such challenges should be anticipated in the introduction of novel interventions. HC3 - Trainer stated the need to stress that the app was “not an extra job, it’s an ‘instead of’ job” during training to tackle this issue.
Reverting to using the phone to make a referral also occurred as a response to the COVID-19 pandemic. The local HealthCall team assumed this was due to anxiety caused by COVID-19, a view shared by CN1: “they just want to speak to a human […] That’s a human response”. CN1 felt this questioned how embedded the intervention was prior to the pandemic.
Negative views toward care home staff were expressed by two community nurses. While they acknowledged the challenges within care homes, including staff turnover, and the pressure faced by care home nurses, they characterised some staff as “needy” and “manipulative” in their use of the app. These community nurses also believed that care home staff would make “excuses” for when a resident’s observations could not be obtained. This highlights the potential for problematic relationships between stakeholders. That obtaining observations is not always possible was understood by HealthCall and the option to not put observations into the app was something HealthCall provided.
Technology and Operations
Issues with the technology could disrupt the use and embedding of the intervention. The technology could occasionally not work as intended, for example, referrals sent but not received. Unreliable Wi-Fi signals in some care homes could restrict app use to certain parts of care homes or to a desktop computer, typically within the manager’s office, rather than a tablet. HC3 - Trainer believed app use would decline where the convenience of using it was hampered, an issue that poor Wi-Fi signals created. HealthCall discussed problem solving such issues by installing the app onto smartphones with 4G, expanding online access.
HC1 warned that care homes have been “bombarded” with digital technology, especially in response to COVID-19, and was concerned that care homes might end up with too many tablets and applications causing a burden to staff and the IT capability of care homes.
Theme 2: Communication and Training
The HealthCall team maintained relationships with NHS services and care homes, working with them and supporting them as required, and adjusting the training and the app due to this collaborative approach.
Relationships and support
The local HealthCall team discussed the processes involved in developing a rapport with care homes, monitoring use of the app and providing additional support and problem solving, whether this was training or technical support, as required. This work was proactive and involved communication between the HealthCall team, the Single Point of Access, NHS community staff and the care homes, and thus considerable co-ordination.
The local HealthCall team’s relationships with community NHS services could be harnessed to further support the care homes and identify problems. Buy-in from community nurses meant that these stakeholders, who maintain regular contact with the care homes, could encourage engagement with the app. Relatedly, members of the local HealthCall team spoke about having to negotiate expectations and relationships between care homes and NHS services in relation to the intervention. However, the negative views expressed by two community nurses (discussed in Theme 1) suggests these negotiations may be an ongoing requirement for the intervention to function coherently. HealthCall also contacted care homes to check how they were coping with COVID-19, potentially further embedding these relationships.
Relatives of residents were not explicitly familiar with HealthCall. Relatives were ambivalent about whether they should be informed of the intervention. Whether families were informed about or aware of the intervention could differ across the care homes. Relatives felt that families would not mind how healthcare professionals were contacted, as long as residents received appropriate health interventions.
Appropriacy of training
The HealthCall Trainers had appropriate experience and knowledge for their job such as considerable clinical experience and one had a background in intervention implementation. HC1 - Trainer also commented positively on their own HealthCall induction: I don’t want to blow smoke, but it was the best induction I’ve had. Some community nurses provided training during the early phases of the implementation which meant the app was introduced to care homes by someone they were familiar with.
Training was delivered to staff within their own care home. Therefore, practice taking vital signs and using the app occurred in a real-world setting. This was followed up with further visits from the Trainers. The approach to training was well received by care homes and care home staff viewed the Trainers as patient and approachable.
HealthCall amended the approach to training in response to the different phases of implementation, the COVID-19 pandemic, and to address poor digital literacy levels amongst care home staff. In response to the pandemic, the implementation was accelerated to ensure all care homes had use of the app for remote monitoring. The Trainers engaged in pragmatic workarounds, delivering training flexibly. This compromised the depth of the training and further resource had to be spent later to “mop up” (HC2 -Trainer) staff that had missed the training delivered in the early months of the pandemic.
Application and implementation evolution
Various participants discussed the app being developed with care homes and NHS staff and acknowledged the feedback loop of ongoing communication between these stakeholders and HealthCall. This meant that the app improved and evolved with insight from end users, enhancing its appropriacy and legitimacy. The language used within the app also evolved and other adjustments, such as allowing care home staff to not report all vital signs if a resident refused, were added.
The perceived successes of the implementation relied on monitoring app use, providing training and technical support, listening to and responding to feedback from various stakeholders. However, HC4 noted that this created considerable work and was at risk of stretching resources: all of that needs to be constantly updated otherwise the system won’t work and that’s getting busier and busier […] to cope with.
Theme 3. Efficiency and Appropriacy
Enhancing resident care and improving efficiency
Despite issues with digital skills in care homes the view that the intervention was easy to use was common. Care home and NHS staff highlighted the improvements to efficiency afforded by the app, enhancing its legitimacy within this setting. For care home staff, the ease of use and prompt referral process meant they had more time for other tasks and for residents. For community nurses, having vital signs and contextual information about residents in advance of a visit was valuable: …it helps with your priorities… CN1. The HealthCall team and LA Commissioner also highlighted these benefits.
While the residents interviewed did not appear to be fully aware of the intervention, one resident, Resident1, recalled having her vital signs taken and being seen by a medical professional quickly. She described this as giving her “peace of mind in a very short time”. Resident2 mentioned being happy to have her temperature taken every morning. This was mentioned when discussing COVID-19, and as such does not necessarily speak to the app. Relatives were also not fully aware of the intervention. Opinions towards it, as an abstract idea, explained during interviews, were generally positive.
Accountability and legitimacy
A key element of the app is how accountability has been addressed. While care home staff are responsible for recognising a potential decline in a resident’s health and communicating relevant information within a referral, the SPA acts as a safety net. SPA staff are clinically trained with access to patient records via digital health records, providing them with further information on the resident of concern. If SPA have concerns about the information received from a care home, they can contact the care home for clarification. As the clinical experience of care home staff is variable and often limited, placing the responsibility for interpretation of clinical information and response onto the SPA removes this potential burden of clinical accountability from the care homes.
Care home staff spend considerable time with their residents and typically recognise ‘soft’ signs of deterioration. This pre-existing knowledge was deemed vital for the intervention to perform coherently. This intervention legitimised these skills by placing them on par of importance with more objective observations such as vital signs. The local HealthCall team and community nurses appreciated that NEWS alone is not an appropriate tool for diagnosis, but part of a wider overview of the resident. This recognition prevented the intervention from having an onus on obtaining all vital signs, which is not always possible.
Upskilling
Stakeholders believed the app improved the digital literacy and capability of care home staff. This may have been influenced by the increased need for remote monitoring and digital communication created by COVID-19. Improvements in communication were noted with participants across stakeholder groups observing that clinical knowledge among care home staff had advanced and the information they provided to support referrals had improved.
Normalisation Process Theory
Table 3, below, outlines how the findings from the thematic analysis relate to NPT constructs (further detail provided in Appendix S1). Resident and relative stakeholders’ awareness of the intervention was limited and their involvement in the implementation passive as opposed to active. As such the NPT findings relate chiefly to other participants.
Discussion
The core themes presented above provide a clear narrative around the challenges faced by the ongoing implementation of the Digital Care Homes app, and how those involved have sought to find solutions, harnessing a feedback loop born of the open and positive communication the implementers created. When considered against NPT constructs, the findings confirm that the implementation has been comprehensive and adaptive, with proactive and appropriately skilled individuals driving the implementation, which is appropriate for a complex intervention.
The intervention has broadly been viewed as a legitimate and valuable contribution to care work and health care delivery, achieving buy-in from key stakeholders. This buy-in was informed by positive experiences with the app, chiefly the ease of use and efficient referral time. Community nurses appreciated the additional information they received that enabled them to better prepare for their visits. These positive opinions suggest that this intervention was meeting its aims. Findings from previous work evaluating interventions like the Digital Care Homes app (Russell et al., 2020; Stocker et al., 2021) suggests that, for this kind of intervention to achieve buy-in from care home staff and community NHS services implementation teams should: -
work with key stakeholders in developing the intervention and implementation
account for the challenging nature of care homes including multiple competing priorities and medically complex residents
understand that obtaining vital signs from residents is not always achievable and care home staff should not be accountable for clinical decisions.
respect care home staffs’ ability to recognise soft signs of deterioration and acknowledge the importance of such information
provide training that is comprehensive with a practical element (taking vital signs on care home residents in-house), delivered by those with appropriate clinical skills and experience with care homes
monitor engagement and use of the intervention, flagging any further support needs
provide ongoing support with digital technology and further training.
The development and implementation process undertaken by HealthCall appears to have accounted for these issues.
It should be noted that NEWS was developed for use in acute rather than community settings (RCP, 2017). Concerns have been raised about the use of NEWS with medically complex populations (Grant, 2018; Grant & Crimmons, 2018) questioning its appropriacy for use with care home residents. NEWS is not a standalone tool, and should be considered alongside further contextualised information about a patient (RCP, 2017). A reliance on NEWS within a similar intervention implemented in northern England was ultimately addressed, with a revised version of the implementation reducing reliance on NEWS while acknowledging the importance of soft signs of deterioration (Russell et al., 2020; Stocker et al., 2021). The Digital Care Home app has used a similar approach, avoiding reliance on NEWS alone and emphasising the importance of soft signs of deterioration and further contextual information. This shows that interventions of this ilk have evolved over time to become better suited to the medical complexity of care home residents and the skills of care home staff.
This qualitative evaluation has raised three issues that could influence future implementations of this and similar interventions. Firstly, despite being part of this implementation’s success, the level of monitoring and staffing required to maintain the ongoing success of the implementation could pose barriers to maintaining current levels of support and the replicability of this intensive implementation process.
Secondly, the belief held by two community nurses that care home staff could be “needy”, and “manipulative” is problematic, suggesting a potential for strained relationships across core stakeholders; a disconnect between care homes’ and community nurses’ understandings concerning expectations and the purpose of the app. Negative views towards care staff may be linked to the stigma and diminished status given to those working in aged care and long-term care facilities (Manchha et al., 2021; Ostaszkiewicz et al., 2016). Implementors of similar interventions should be alert to the potential for such cultural issues to influence implementation success.
Thirdly, digital skills and preparedness in care homes are limited. This issue needs to be addressed, not just for the success of the Digital Care Homes app, but to ensure that care homes are better prepared for future pandemics and digital interventions in general, including interventions designed to support the well-being of residents (Gutman & Shade, 2020; Stadler, 2021; Subramaniam & Woods, 2016; Zamir et al., 2020). The UK Government has pledged to have all care homes digitised by March 2024 (DHSC, 2022). Upholding this pledge appears to be vital to ensuring adult social care can provide a range of person-centred care interventions, and timely and appropriate health care.
Strengths and limitations
We captured the experiences and views of a range of stakeholders, including care home residents who are often excluded from such evaluations due to challenges of recruitment. Most care home staff interviewed were senior carers, the most common user of the Digital Care Homes application, providing data on the real world, practical experience of the intervention. This is a strength this evaluation.
No care home nurses were recruited and from the NHS perspective we only spoke with community nurses. This may have influenced the findings produced.
Conclusion
The HealthCall Digital Care Homes app appears to be a feasible, appropriate and legitimate intervention to support improved referral, triage and health care support for non-urgent health care needs of care home residents. The comprehensive implementation process that welcomed feedback to support improvements to the intervention and implementation is the core of this intervention’s success. For this and similar interventions to achieve success nationally, implementations require rapport building and a willingness among those driving the implementation to listen to the views of end users. Ensuring that care homes are digitally enabled with a digitally literate workforce will require structural and economic support from national and local policy makers and care home providers.
Data Availability
In line with our research approvals and participant consent, data for this work are not publicly available.
Conference Presentations
This paper, in draft form, was delivered as an oral conference presentation at the 6th International Long-term care Policy Network (ILPN) Conference in London on September the 10th 2022.
Conflict of Interest
Authors declare that they have no competing interests.
Author Contribution
NP, JK, SM were involved from the idea generation phase. SR, RS and ZC drafted study documents, collected data and led the analysis. BH and NP oversaw the qualitative work. SR drafted this paper, with contributions from co-authors.
Ethics Approval
Ethical approval was granted by HRA and Health and Care Research Wales (ref: 20/LO/0962) and Newcastle University (ref: 12966/2020). The team adhered to accepted ethical standards, ensuring that informed consent was obtained from participants prior to the collection of data. Data were organised in secure shared folders. Only members of the qualitative team were privy to any non-anonymised data. Data were anonymised for analysis and reporting.
Acknowledgements
The team would like to thank all participants for their time, HDRUK for their funding and support, and the members of the HDRUK Northern Partnership Care Homes Project Team involved in this evaluation.
Footnotes
Conflict of Interest Authors declare that they have no competing interests.