Abstract
Infant Mental Health relates to how well a child develops socially and emotionally from birth to age three. There is a well-established link between parent-infant relationship quality, Infant Mental Health, and longer-term social and emotional development, however, there is a lack of evidence-based interventions that support the parent-infant relationship and/or protect against poor Infant Mental Health. Little Minds Matter is a specialist Infant Mental Health service developed in Bradford (UK) to support parent-infant relationships by providing training and consultation for professionals and direct clinical work to families. The efficacy of this intervention will depend upon how well it becomes embedded within the early years system. This study aims to apply a systems approach to evaluate this service and provide a perspective on the challenges to embedding a complex service within a healthcare system. Multiple methods will be used to investigate embeddedness within the wider early years system. Routine collected quantitative data about the service will be used to develop a system map showing interaction with related services. Qualitative data will be collected through interviews with individuals involved in the design and provision of the Little Minds Matter service, and professionals working within the early years system. Framework analysis will be used to analyse the data inductively and deductively within a systems approach. The findings from this study will provide evidence for the ongoing implementation of the Little Minds Matter Service for providers and commissioning bodies. Exploring this methodological approach to evaluation will have application more broadly for researchers evaluating complex interventions and services within a wider system.
Introduction
Infant mental health (IMH) relates to how well a child develops socially and emotionally from birth to age three [1]. Secure parent-infant relationships are the foundation for protecting IMH [2]. If an infant feels safe and secure, and experiences the world as a consistent, loving place, they are more likely to build a healthy brain and grow into a confident person who enjoys happy relationships [3]. The association between parent-infant relationship quality, IMH, and children’s longer term social and emotional development is now well evidenced [2,4-6. Despite this, there is a lack of evidence-based interventions that support the parent-infant relationship [3, 7] and/or protect against poor IMH [8].
In their recent evidence report, the Parent-Infant Foundation identified a ‘baby blind-spot’ within current Child and Adolescent Mental Health Service provision in England, with many services not accepting referrals for children under 2 years, thereby missing opportunities to intervene at the earliest opportunity [9]. The Parent-Infant Foundation consensus statement recommends improving outcomes in the first 1,001 days of a child’s life, establish specialist IMH services at a local level and provide care continuity with a skilled workforce [10]. There are currently 45 such specialist parent-infant relationship or infant mental health teams in the UK offering theoretically grounded interventions in their therapeutic provision [11]. In order to provide support to those families in need, these services need appropriate referrals from professionals working across the early years services who come into contact with families. However, identification of issues in the parent-infant relationships by these professionals may be challenging. Whilst NICE guidance highlights the importance of assessing the relationship parents have with their children, there are no assessment tools recommended for use in the critical first 12 months after birth, and those recommended for pre-school children require clinical expertise to complete [12]. As a consequence, healthcare professionals working in universal settings with families with young children may lack the confidence and/or ability to assess this relationship [13-14].
To address these challenges, one such specialist IMH service, Little Minds Matter (LMM), has been designed to provide direct therapeutic support for the parent-infant relationship at any time from pregnancy up to 24 months post birth. The aim of the service is to influence the wider early years system to raise awareness of IMH in the community and empower professionals to confidently identify issues and support parents within their usual practice. Success of the intervention depends on becoming embedded within the early years system, so that relevant services have an awareness of IMH and are able to utilise the services offered by LMM.
The aim of this study protocol is to describe the evaluation of the Little Minds Matter intervention using a systems evaluation approach.
Methods
Design
This is a systems evaluation approach using multi-methods including quantitative and qualitative data and systems mapping.
Study setting
This study is being conducted in Bradford, a large district in the North of England with a young, ethnically diverse population, many of whom live in areas of high deprivation. The early years system is defined as all the services that work with families with young children to promote children’s health and development from conception to primary school entry at age 5. This includes universal care (e.g., midwifery and health visiting), targeted services (e.g., mental health services and social care) and a wide range of voluntary and charitable sector (VCS) organisations delivering support and interventions. Significant to the early years services in Bradford are two large programmes of work providing additional support to the early years system in inner-city areas: Better Start Bradford, a National Lottery Community Fund programme that commissions a number of preventative interventions to improve socio-emotional development, language and communication development and nutrition in children aged 0-3 [15];and the Reducing Inequalities in Communities programme that funds interventions to reduce inequalities across the life course including the early years [16].
The intervention
Little Minds Matter (LMM) is a specialist IMH service developed to support the parent-infant relationship during pregnancy until the infant is 24 months old. We acknowledge that not all caregivers are parents in a biological or legal sense, for clarity we also include within the scope of this paper parents as those who provide daily care to a child, and act as a ‘parent’ whether they are biological parents or not [17]. The service is commissioned by both the Better Start Bradford and Reducing Inequalities in Communities programmes and is delivered by Bradford District Care NHS Foundation Trust. According to the theory of change for LMM, a key mechanism for an improved parent-infant relationship is mind-mindedness which is defined as the ability of parents to tune in to their children’s thoughts and feelings [18]. The service acts on this mechanism in a number of ways, firstly by raising awareness across the early years workforce, and wider community, of the importance of the parent-infant relationship to later child outcomes. Secondly by training and supporting the early years workforce who work directly with families to identify, and support, families with ‘concerning’ relationships, and finally by providing direct clinical work with families in need. The service defines a ‘concerning’ relationship as one where a parent does not appear to be aware of their infant’s feelings, and are unable to exhibit mind-mindedness. The service is delivered through four strands of activity described in Figure 1. Strand one is delivered by a VCS partner and strands two, three and four are delivered by a team of approximately 10 professionals. This includes Clinical Psychologists, Family Therapists and those with a background in Health Visiting, Midwifery and Social Care settings. The service has undergone a thorough service design, including a theory of change, logic model and agreed implementation targets for each strand for which routine monitoring data is gathered. Further information relating to this design process can be requested from the corresponding author.
Overview of Little Minds Matter service
A Systems approach to evaluation
The Medical Research Council updated their guidance for evaluating complex interventions in 2021, advocating for consideration of the context within which an intervention operates including the conditions needed to realise the mechanisms for change [19]. In a systems approach to evaluating health interventions, interventions are conceptualised as ‘events in systems that either leave a lasting footprint or wash out depending on how well the dynamic properties of the system are harnessed’ [19]. An essential initial component of a systems approach is exploring and understanding the context into which the intervention is introduced and with which it interacts, essentially the pre-intervention context.
Additionally, mapping of the system of interest is often a preliminary but integral part of a systems evaluation. The pre-intervention context and system map are then used as key tools in the systems approach to enable four avenues of inquiry: 1) how the intervention couples with the context; 2) tracking changes in relationships within the system; 3) the distribution and transformation of existing resources; and 4) the displacement of pre-intervention activities [20]. Using this approach the study aims to look at how the intervention and the early years system have changed over time in relation to IMH, and the dynamic relationship of these changes.
Using implementation data and qualitative interviews with stakeholders, the objectives of the study are to explore and describe:
What the early years system looked like before LMM was implemented (i.e., the pre-intervention context).
Changes that have occurred in the early years system since LMM was first introduced, to include the displacement of any pre-intervention activities and transformation of existing resources.
The ways in which LMM has become embedded within (i.e., coupled with) the early years system.
Factors that have facilitated or hindered the implementation of LMM.
Whether LMM has succeeded in increasing the knowledge and understanding of IMH in professionals working within the early years system.
Development of a system map
To describe the early years system in Bradford and identify key stakeholders to participate in interviews we will conduct a scoping exercise to identify early years services and projects in Bradford. This scoping exercise will involve exploring existing pathways within the early years system and conversations with stakeholders including health and social care professionals, researchers and those involved in the LMM service design process. From this we will produce a list of services and projects that work with families in the early years system to promote children’s health and development. These services and projects will then be placed into a systems map, with services and projects placed in concentric circles, based upon the degree to which supporting the parent-infant relationship is a core objective of that service’s remit (see Figure 2). Implementation data is routinely collected about which organisations and professional groups have interacted with LMM via the training, consultation and clinical work strands since the service’s launch. This quantitative data will then be plotted onto the system map to provide a visual description of the way in which services and professionals have engaged with LMM.
Example template map
Qualitative Data collection
The systems map will then be used within qualitative interviews to help elucidate the pre-intervention context, the fit of LMM within the system and the extent of interaction between services and LMM and facilitate other lines of questioning. Qualitative data collection will be undertaken with three different groups of stakeholders: group one, individuals involved in the development of LMM; group two, individuals employed by LMM but not involved in service design; group three, individuals employed in roles supporting families with young children (see Figure 3). Data will be obtained using interviews and focus groups as appropriate. For groups two and three, interviews will be undertaken at two time points to observe change in the system over time. Interviews will take place face-to-face or through video conferencing depending on the participant’s choice. To report our qualitative findings, we will adhere to the Standards for Reporting Qualitative Research (SRQR) and the COnsolidated criteria for REporting Qualitative research (COREQ) [21].
Data collection process
Participants
Study participants are eligible for interview if they are an individual working within the early years system, who is either:
Employed by the National Health Service (NHS), social care, Better Start Bradford and related organisations/projects, local authority, and VCS in a service which supports the parent-infant relationship.
OR
Were involved in the design and development of the LMM service.
We aim to recruit between 25-35 participants at each time point: four in group one; approximately seven in group two and 25 in group three. Group one participants are identified by liaising with the Better Start Bradford team; group two participants will be identified by the clinical lead of LMM and recruitment to group three will be dependent on the services identified in the systems map and interviews with participants in group one and group two. Sampling will be purposive, targeting staff working at the team lead or managerial level in organisations that are considered most appropriate in order to gain organisational oversight and a wider view of service integration and training within the team. In most cases only one person per service will be interviewed and interviews with participants from services with a remit to support the parent-infant relationship will be prioritised (i.e., those in the inner circles of the systems map, see Figure Two). This approach will support data saturation given the range of participation from varied projects.
The study participants will be approached by email from the primary Researchers (SM and AE). Email addresses will be accessed through contacts with the Better Start Bradford and Little Minds Matters teams as well as contacts within the Better Start Bradford Innovation Hub following agreement by the relevant research and development offices. Emails will include the consent form and study information sheet. The information sheet includes details of the full study, indicating which participant groups we intend to approach for a second interview. Written or verbal consent will be taken prior to interview. Participation can be face to face or through video call therefore verbal consent will be recorded separately from the interview and stored in a different location on the Bradford Teaching Hospital Foundation Trust’s online secure archive in password protected folders.
Data collection
Data collection will be scheduled to ensure that those involved in the design and commissioning of LMM and LMM staff are interviewed first. This will allow for review of the system map (with any significant omissions added or clarifications made prior to the other interviews) and review of the list of organisations that the researchers intend to invite to interview in group three. Additionally information will be captured and review of the topic guides for the subsequent interviews with staff from other services in the early years system will be undertaken. At times it may be more viable to collect data through focus groups rather than one-to-one interviews. This decision will be taken pragmatically on a case-by-case basis according to the preference of the participants. At time point one, all three groups will be questioned on a range of subjects as described in figure 3, including their role in the service, understanding of the LMM service, the reach of LMM across the early years system and interaction between LMM, other services and professional groups. For groups one and two, a copy of the draft map will be shared with participants prior to their data collection session. This will enable these participants to review the map in preparation for questions in the interview about which services have existing relationships with LMM and which additional services it would be desirable to establish relationships with. Group three will not be asked to review the map as we are only interested in their relationship with LMM and not with other services in the early years system.
At time point two, 9-12 months later, participants from groups two and three will be invited to attend a second interview or focus group. Wherever possible this will be the same individuals, agreement to approach participants again will be discussed at the end of their time one interview, but where these people have moved on an alternative appropriate individual will be approached. Again they will be asked questions about their service, understanding of the LMM service, the reach of LMM into and interaction between LMM, their/other services and professional groups. At this time point group two will also review the map again, which will now include additional data from the time between qualitative data collection periods. The review of the map and interview questions will facilitate exploration of change in the early years system over the intervening period. Separate topic guides have been created for the different groups and will be used by the member of the research team conducting each interview. The topic guides may be amended following piloting. With this approach we will achieve a whole-system perspective, including an understanding of the pre-intervention context.
Ethical Approval and Study Governance
Health Research Authority (HRA) approval was granted on 25th August 2022 (IRAS project ID: 311645 REC reference: 22/HRA/3477) for research undertaken within the NHS Trusts and Sponsorship approval received for Bradford Teaching Hospitals NHS Foundation Trust on 3rd October 2022 and for Bradford District Care NHS Foundation Trust on 18th October 2022. University of York Department of Health Sciences Research Governance Committee approval was granted for research undertaken with non-NHS trusts via a Chair’s Action letter (30 September 2022).
Data management
Data will be managed confidentially in line with ethical approval. Interviews will be transcribed and anonymised then the recordings deleted. All data related to the map development, transcripts and consent information will be stored in the Bradford Teaching Hospital Foundation Trust online secure archive in password protected folders. Transcripts will be stored separately from identifiable and consent information. Transcripts will be managed on Computer Assisted Qualitative Data Analysis Software (CAQDAS) software, NVivo version 14 (Lumivero, 2023).Transcript data and consents will be stored for ten years after which time they will be destroyed.
Data Analysis
Quantitative Data
Descriptive statistics will provide counts of the number of professionals and organisations within the early years system who have engaged with each of the strands of the LMM service.
Qualitative Data
Framework analysis will be used to analyse the data using Computer Assisted Qualitative Data Analysis Software (CAQDAS) software, NVivo. Framework Analysis [22] will be used to organise and analyse the data. This approach is well suited to this study because it is anticipated that a large amount of data will be generated, requiring a structure to manage and reduce the data to respond to the research questions. It uses a matrix format to organise the data into rows or cases (representing participants) and columns (representing codes) to support comparison of data across, as well as within cases [22].
Verbatim transcription will be completed by a transcription service approved by Bradford Institute for Health Research. Where focus groups are undertaken, we will approach the data as a group interview transcript analysed in the same way as the individual interview transcripts. Once transcribed, familiarisation with the data will be increased by reading of the transcripts while listening to the recorded interview. Once familiarised with the data three transcripts will be selected, one from each participant group. Using these three transcripts a coding framework will be developed. Initially codes will be deductively informed from the existing literature, in addition, two researchers will engage in open coding to enable themes to emerge from these three interview transcripts. Therefore, the coding will be both inductively and deductively informed, limiting the extent to which key findings might be missed. Once developed and agreed the framework will be utilised to code the remaining transcripts. As with the coding process, themes will be both inductively and deductively derived through discussion with the wider research team. We will not employ restrictions on coding, such as stopping analysis in response to data saturation because of the variety of professionals and services interviewed, new themes and relevant information may arise in each interview. This process will reduce the potential for bias and enhance the quality of the analysis.
Discussion
This study will use a multi-methods systems approach, integrating implementation data, systems mapping and qualitative data to evaluate the extent and ways in which the LMM service has become embedded within the early years system in Bradford (UK) to improve IMH.
Strengths of the outlined study are numerous, systems approaches, a defining feature of this study, are relatively new to health research and in keeping with the most recent guidance from the Medical Research Council [19]. The integration of a service into a wider system is often a key factor in the success of the service and the impact it has across the system. The approach outlined in this protocol offers a way to evaluate whether a service has become embedded and is able to influence a system. Such approaches may offer a pragmatic solution to evaluation, given there are often fluctuations in service provision and time limitations upon service providers and researchers. Furthermore, this study will provide future researchers with a valuable example of conducting such an evaluation of a service. The study findings will provide learning for the LMM service and early years commissioners in Bradford to enable them to adapt their service as required. Moreover, findings will provide a comprehensive understanding of the barriers and successes to system change for other similar services to review their practice.
This study may be limited as it will only describe the impact of one service on one system in one location, however the knowledge and understanding gained about IMH services will provide an evidence base for similar service development elsewhere. In particular, this study has particular relevance to the current government initiative, the best start for life [4], given the focus this policy has on the first two years of life and developing strong parent-infant relationships. A further limitation is that the understanding of the pre-intervention context is being accessed retrospectively by asking participants to reflect on provision before the introduction of LMM. This may impact on the understanding that can be gained about how much change has been brought about by the LMM service into the early years system in Bradford.
Conclusion
IMH services appear to be a valuable early years service, but their efficacy depends upon becoming embedded within the wider early years system. Evaluation of this with a system approach will provide learning for these services on the challenges and successes of embedding a complex service within a healthcare system.
Data Availability
Data from this study can not be made available due to the qualitative nature of the study and ethical limitations. However, deidentified research data from the BiB and BiBBs cohorts can be made available to those who agree to the terms and conditions of this.
