Inequalities in children’s mental health care: analysis of routinely collected data on prescribing and referrals to secondary care
====================================================================================================================================
* William P Ball
* Corri Black
* Sharon Gordon
* Bārbala Ostrovska
* Shantini Paranjothy
* Adelene Rasalam
* David Ritchie
* Helen Rowlands
* Elaine Thompson
* Magdalena Rzewuska
* Katie Wilde
* Jessica E Butler
## Abstract
**Introduction** One in eight children in the United Kingdom are estimated to have a mental health condition, and many do not receive support or treatment. The COVID-19 pandemic appears to have exacerbated this issue. Prevalence of poor mental health is not evenly distributed across age-groups, by sex or socioeconomic groups. Equity in access to mental health care is a policy priority but relatively under-researched.
**Methods** We linked previously unlinked records for all mental health prescriptions and referrals to specialist mental health outpatient care between the years of 2015 and 2021 for children aged 2 to 17 years in a single NHS Scotland health board region. We analysed trends in prescribing, referrals, and acceptance to out-patient treatment over time, and measured differences in treatment and service use rates by age, sex, and area deprivation.
**Results** We identified 18,732 children with 178,657 mental health prescriptions and 21,874 referrals to specialist outpatient care. Prescriptions increased by 59% over the study period. Boys received double the prescriptions of girls and the rate of prescribing in the most deprived areas was double that in the least deprived. Referrals increased 9% overall. Initially, boys and girls both had an annual referral rate of 2.7 per 1,000, but this fell 6% for boys and rose 25% for girls. Referral rate for the youngest decreased 67% but increased 21% for the oldest. The proportion of rejected referrals increased steeply since 2020 from 17% to 30%. The proportion of referrals accepted for girls rose to 62% and the mean age increased 1.5 years.
**Discussion** The large increase in mental health prescribing and changes in referrals to specialist outpatient care aligns with emerging evidence of increasing poor mental health, particularly since the start of the COVID-19 pandemic. The static size of the population accepted for specialist treatment amid greater demand, and the changing demographics of those accepted, indicate clinical prioritisation and unmet need.
Keywords
* Child & Adolescent Mental Health
* Mental Health Prescribing
* CAMHS
* Health Inequalities
## Background
Research from the United Kingdom estimates that around 1 in 8 children and young people have a diagnosable mental health condition, and that this prevalence has increased over time [1]. Many of these young people do not receive treatment [2, 3]. This suggests an unmet need in child and adolescent mental health care which is concerning for those currently experiencing mental health difficulties and also has implications for future population health as around half of all long-term mental disorders are thought to start by age 14, and three-quarters by age 24 [4]. Childhood and adolescence are key periods in lifetime mental health trajectories.
Service structures to address child and adolescent mental health vary across the United Kingdom but are broadly similar. NHS Scotland provides Child and Adolescent Mental Health Services (CAMHS) for people aged under 18 and consists of multi-disciplinary teams who assess and provide treatment or interventions for young people with emotional, developmental, environmental or social factors which impact on their mental health [5]. CAMHS in Scotland are structured into 4 tiers based on the type of services offered – universal and targeted services in the community (Tiers 1 & 2), locality teams based in hospital settings largely providing treatments in specialist outpatient clinics (Tier 3) and more specific services requiring additional expertise such as inpatient psychiatry (Tier 4).
The prevalence of mental health conditions is not evenly distributed across the population, with key differences between groups based on age, sex and socioeconomic conditions. Older children, girls and those from deprived areas are all more likely to present with poor mental wellbeing [6–8]. This is reflected in rates of referral to specialist CAMHS [9] and in mental health prescribing [10]. Addressing unequal access to CAMHS has been a longstanding Scottish Government priority [5] and prompted the introduction of wait time targets among other policy changes. Mental health and inequalities remain a key concern in the period of transition and recovery from the impacts of COVID-19 [11]. Trends across the UK suggest increasing prevalence of mental health problems [7] and inequalities by area deprivation [8], although comprehensive and detailed data is lacking.
Mental health prescribing in children has increased dramatically since the early 2000s in Western Europe and the United States of America [12, 13]. Recent analysis of mental health prescribing in parts of the United Kingdom has previously been conducted for people of all ages, but this did not include a detailed exploration of trends in younger age groups [10, 14]. Additionally, aggregated open data on prescribing and referrals to specialist outpatient (Tier 3) services are available in Scotland but they provide limited insight beyond overall counts. Here we investigate individual-level records which allows for more detailed analysis and monitoring of social and demographic characteristics associated with mental health prescribing and service use. Additionally, prescribing and outpatient service data have never been analysed together. National analysis has provided high-level summary insights, but analysis of sub-national trends are needed to provide improved local understanding to inform service and workforce planning [15]. This research addresses three key questions:
1. What is the incidence of mental health prescribing and referral to specialist outpatient care? Has this changed through time?
2. Is there evidence of unmet need for specialist care?
3. Are there inequalities in the distribution of treatment (and unmet need)?
We describe the prevalence of prescribing of medications commonly used to treat mental health conditions in children and explore trends in specialist outpatient (Tier 3 CAMHS) referrals, rejections, and treatment both before and during the COVID-19 pandemic. We describe social and demographic characteristics for these populations, including sex, age, and home-area deprivation. Finally, we quantify inequality in rates of prescription and referral by area deprivation.
## Methods
### Study Setting
The study setting is the NHS Grampian health board region located in the North East of Scotland which covers the Aberdeen City, Aberdeenshire and Moray local authority areas. The population is roughly evenly split between urban and rural areas and the health board is relatively less deprived than others in Scotland. Some areas area ranked in the 10% most deprived by Scottish Index of Multiple Deprivation [16] but these areas account for just 1% of the health board population, compared with 15% living in areas ranked in the 10% least deprived [17]. The annual size of the under-18 aged population in NHS Grampian has remained static at roughly 111,000 individuals throughout this study period [17].
### Data Sources
Prescription data are from the national Prescribing Information System (PIS) [18] which provides records for all medicines which are prescribed or dispensed in a community setting in Scotland which includes most outpatient prescriptions which are commonly dispensed in this setting. Child and Adolescent Mental Health Services (CAMHS) data [19] is an NHS Grampian dataset which is used to report official waiting-list statistics at the national level. Home area-level socioeconomic information is sourced from version 2 of the 2020 Scottish Index of Multiple Deprivation (SIMD) [16] which has been linked to individual records using data zone of residence at the time of prescription or referral. Rates for outcomes have been calculated using official mid-year population estimates for the NHS Grampian health board region [17].
Linkages between datasets were made using the Community Health Index (CHI) number which is a unique identifier from the CHI population register for Scotland [20]. Data linkage and management was conducted by Grampian Data Safe Haven (DaSH) [21] staff on a secure server using accredited procedures to collect, link and pseudonymise patient-level records. Access to de-identified records was allowed through the Trusted Research Environment (TRE) for only named and approved researchers and outputs in the form of aggregate summary data, tables or figures were subject to disclosure control procedures to reduce the risk of identifiable information being shared.
### Study Population
Records were available for all mental health prescriptions and referrals to specialist CAMHS between 1st January 2015 and 31st October 2021 for individuals resident in the NHS Grampian Health Board region. This study includes individuals with at least one mental health prescription or specialist CAMHS referral during the study period. Records were restricted to individuals aged between 2 and 17 years. Under 2 year olds were excluded due to small numbers of records. The upper age limit was chosen to match the population who can be referred to specialist CAMHS in Scotland which is normally restricted to people aged under 18 years.
### Data
Mental health prescriptions were identified by British National Formulary (BNF) item codes recorded in PIS or by item name where there was no item code recorded. Five classes of medications have been identified as relating to mental health. They are defined as medications appearing in the following BNF subsections: 4.1 Hypnotics and Anxiolytics, 4.2 Drugs used in psychoses and related disorders, 4.3 Antidepressant drugs, 4.4 Central Nervous System Stimulants and drugs used for ADHD and 4.10 Drugs used in substance dependence [22]. These subsections align with classification of mental health medications used previously by Public Health Scotland [10] with two differences: Medications used to treat dementia were excluded as this analysis relates to children. We also included drugs normally used in the treatment of substance dependence, which are of relevance to mental health.
Specialist CAMHS referrals were identified by date of referral. Rejected referrals (i.e. those which do not result in further assessment or treatment in specialist outpatient CAMHS) were identified by referrals where there was a recorded date of rejection. For analysis of accepted/rejected referrals, those where the referral was still pending (i.e. they have no appointment or rejection date) were excluded by only looking at rejected/accepted referrals made on or before the 1st June 2021. Home area deprivation was measured by SIMD2020 deciles based on the recorded area of residence at the time of prescription or referral. Decile 1 is assigned to small areas ranked in the top 10% of most deprived areas in Scotland and decile 10 is assigned to the 10% least deprived areas nationally. Rates of prescription and referral have been calculated from counts (i.e. total number of prescriptions or referrals) and mid-year population estimates for people aged between 2 and 17 in NHS Grampian which are available by year, age group, sex and home-area deprivation decile [17]. These population estimates are available for each year between 2015-2020 and rates for 2021 are calculated based on the 2020 population sizes.
### Data Processing
Prescribing data is missing for two months in the study period (April 2019 & December 2020) and data for 2021 is only complete until the end of May. Where average monthly prescribing rates (both prescriptions per month and monthly rate per population) for the affected years have been reported, these are calculated from the total count available divided by the number of months in the year with complete data. Where monthly counts have been calculated into rates and reported (e.g. by BNF section in Figure 2) the two missing monthly totals have been imputed based on the previous monthly total.
From mid-2019 to mid-2020 there is a marked drop in the number of prescriptions in total, and specifically for the ‘Hypnotics and Anxiolytics’ BNF section (see Figures 1 & 2). Most prescriptions in this section both before and after this time period are for melatonin which has some licensed and some unlicensed preparations. Unlicensed preparations of prescribed medications are not indexed in the PIS pricing codes and are thus not recorded in the PIS system which means it is not possible to determine if this drop reflects a true drop in melatonin prescribing.
[Figure 1](http://medrxiv.org/content/early/2022/06/23/2022.06.14.22276082/F1)
Figure 1
Monthly mental health prescription rate per 1,000 children aged 2-17. Dashed line indicates the first UK COVID-19 lockdown beginning 2020/03/23. Grey points for melatonin prescriptions only, Red for all prescriptions excluding melatonin.
### Statistical Methods
The primary outcomes examined were counts, rates and proportions of the population who received mental health prescriptions or specialist CAMHS referrals (both accepted and rejected). Secondary outcomes evaluated were differences between these counts and rates by age, sex and deprivation
Relative and absolute inequality gaps in rates of mental health prescription and specialist CAMHS referral by area deprivation were quantified by calculating Slope Index of Inequality (SII) and Relative Index of Inequality (RII) using the linear regression approach [23]. SII is an absolute measure which estimates the difference between rates in the most and least deprived groups, accounting for differential population size. RII is a relative measure which estimates the difference between rates in the most deprived group compared with the mean rate in the population [24]. Both SII and RII have been calculated for annual rates and for the mean of annual rates over the whole study period.
## Results
### Overview
The average annual population size between 2015 and 2020 for children aged 2-17 in NHS Grampian was 99,591. The average annual proportion of children with at least one mental health prescription was 3.1% and with a specialist CAMHS referral was 2.8%. There was a total of 178,657 mental health prescriptions for 8,170 children (Table 1) and 21,874 CAMHS referrals for 15,022 children (Table 2) over the study period. Period prevalence of mental health prescription was 8.2% (2015 to May 2021) and for specialist CAMHS referral was 15% (2015 – October 2021). A total of 18,732 unique individuals were identified across prescribing and referrals datasets, with 4,460 (24%) appearing in both. 3,710 children had a prescription but no referral (45% of all with a prescription) and 10,562 had a referral but no mental health prescription (48% of all with a referral). The mean annual number of prescriptions was 25,522 (for an average of 3,093 individuals) and the mean annual number of specialist CAMHS referrals was 3,125 (for an average of 2,823 individuals).
View this table:
[Table 1](http://medrxiv.org/content/early/2022/06/23/2022.06.14.22276082/T1)
Table 1
Summary of mental health prescriptions for children. Note: Data for 2021 are partial and cover to the end of May only. 2019 and 2020 have missing data for one month each (see Methods), monthly averages have been calculated from number of available month
View this table:
[Table 2](http://medrxiv.org/content/early/2022/06/23/2022.06.14.22276082/T2)
Table 2
Summary of referrals to specialist CAMHS. Note: Data for 2021 are partial and cover to the end of October only. Monthly average for 2021 has been calculated from the number of months available.
### Mental Health Prescriptions
#### General Trends
The monthly rate of mental health prescription per 1,000 children has risen by 56% over the study period, from an average of 20 per month in 2015 to 31 per month up until the end of May in 2021. A drop in monthly rate of prescription can be seen at the start of the 1st UK COVID-19 lockdown in March 2020. There is a prolonged drop in the rate of prescriptions for melatonin specifically from August 2019 to August 2020 (Figure 1) which represents either a real drop in the number of prescriptions during this period, or that prescriptions for melatonin were filled with preparations which are not recorded as billable items in the PIS dataset (S. McTaggart, personal communication, 14th September 2021).
Rises in the rate of prescription are observed for each class of medication apart from treatments of substance dependence (Figure 2). Prescriptions of medications to treat anxiety and sleep disorders (Hypnotics and Anxiolytics) have increased 91% from 565 per month in 2015 to 1,082 in 2021. Antidepressant prescriptions have risen by 59% (316 monthly in 2015, 502 in 2021), ADHD medications have risen by 45% (965 in 2015, 1,395 in 2021) and drugs used for psychoses and related disorders have risen by 35% (118 in 2015, 159 in 2021), although most of this rise occurred between 2015 and 2016 and the subsequent trend is not clear.
The monthly rate of mental health prescription per 1,000 children has increased over the study period in each age group apart from the youngest (Figure 3). Rates of prescription have consistently been higher in older age groups. The largest increase over the period was for children in the lower primary school age group, which rose by 60% from an average of 10 prescriptions per month per 1,000 children in 2015, to 17 per month in 2021. The rate of prescription in pre-school aged children dropped by 22% from an average of 2 per month per 1,000 children in 2015 to 1.7 per month in 2021.
[Figure 2](http://medrxiv.org/content/early/2022/06/23/2022.06.14.22276082/F2)
Figure 2
Monthly mental health prescriptions by BNF Section (January 2015 – May 2021). Dashed line indicates the first UK COVID-19 lockdown beginning 2020/03/23. Note: Y axis scale varies and drugs for treatment of substance dependence are not shown due to low monthly counts
[Figure 3](http://medrxiv.org/content/early/2022/06/23/2022.06.14.22276082/F3)
Figure 3
Monthly mental health prescription rate per 1,000 children by school age group. Note: the drop in melatonin prescriptions recorded from mid 2019 to mid 2020 is more pronounced in younger ages. Dashed line represents the start of the 1st UK COVID-19 lockdown.
The monthly prescription rate per 1,000 children increased for both boys and girls over the study period (Figure 5a). Boys had consistently higher rates of prescription over the study period, but girls saw the larger increase. The monthly rate of prescription per 1,000 children for boys rose by 45% from an average of 29 per month in 2015 to 43 in 2021. For girls the rate was 10 per month in 2015 and rose by 84% to 19 per month in 2021. The drop in melatonin prescriptions had a more marked effect on monthly prescription rates for boys than girls in 2019 and 2020 but does not affect the 2021 average rate.
#### Group Differences
Over the whole study period boys accounted for 73% of total prescriptions and 57% of unique individuals with a prescription. The overall rate of prescription for boys (28 per person) was double that of girls (14 per person). Prescriptions for girls are mostly concentrated in older ages and the distribution of prescriptions generally increases with age (Figure 5b). The distribution of age at prescription for boys is more evenly spread than for girls, with a larger number of individuals receiving a prescription at all ages apart from the oldest ages (16 and 17 years) where more girls received prescriptions. Gender differences in prescribing are consistent over the study period and mental health prescribing has increased for both boys and girls (Figure 5a) although the increase was larger for boys.
The medicines with the most prescriptions over the whole study were used to treat ADHD (top drug: methylphenidate hydrochloride) and were more common for boys and in younger age groups. Medications to treat ADHD accounted for more than half of all mental health prescriptions for children in upper primary and lower secondary school (Figure 4). The medicines prescribed to the most individuals was medication for sleep disorders (top drug: melatonin) which are mostly prescribed in younger ages. Antidepressants had the second-most individuals who received a prescription with 3,427 over the study and they are the most prescribed for upper secondary aged children (Figure 4).
[Figure 4](http://medrxiv.org/content/early/2022/06/23/2022.06.14.22276082/F4)
Figure 4
Proportion of total prescriptions by BNF Section and school age group
[Figure 5](http://medrxiv.org/content/early/2022/06/23/2022.06.14.22276082/F5)
Figure 5
a) Monthly prescription rate per 1,000 children by sex. b) Count of unique individuals with a mental health prescription by age at prescription. Note: includes period of lower melatonin prescribing which is more prominent for boys.
#### Inequalities by Area Deprivation
There is a clear social gradient in mental health prescribing by home-area socioeconomic deprivation. Over the whole study period, the average annual rate of prescription for children living in the most deprived 10% of neighbourhoods was double that of the least deprived, with 34 prescriptions per 100 children in the most deprived areas and 17 per 100 in the least deprived. The average annual proportion of the population in the most deprived 10% of neighbourhoods receiving a mental health prescription was 4%, which was double the proportion in the least deprived decile at 2%. The mean age at first prescription for those in the most deprived decile is 11.9 years (SD: 4.4), almost 11 months younger than those in the least deprived decile (Mean: 12.8 years SD: 3.8).
The social gradient was consistent over the study period, with those in the most deprived decile receiving around 23 additional prescriptions per year per 100 children compared with those in the least deprived decile (Figure 6a). Relative to the average for the whole population the annual rate of mental health prescription in the most deprived area was between 40-50% higher (Figure 6b).
[Figure 6](http://medrxiv.org/content/early/2022/06/23/2022.06.14.22276082/F6)
Figure 6
a) Slope Index of Inequality and b) Relative Index of Inequality for annual mental health prescriptions per 100 children by area deprivation. Point ranges denote annual SII and RII with confidence intervals. Dashed lines denote mean annual SII and RII over the entire study period and the shaded red area represents the mean annual confidence intervals.
### Specialist CAMHS Referrals
#### General Trends
The rate of referrals to specialist CAMHS rose by 9% from 32 per 1,000 children per year in 2015, to 35 in 2021. In 2015 the mean number of referrals to specialist CAMHS per month was 266, which rose by 11% to a mean of 295 through October in 2021. The increase in monthly referrals has mainly occurred in the period following the first UK COVID-19 lockdown in March 2020, after an initial drop in referrals (Figure 7a).
[Figure 7](http://medrxiv.org/content/early/2022/06/23/2022.06.14.22276082/F7)
Figure 7
a) Monthly rate of referrals per 1,000 children b) Quarterly referral rate per 1,000 children by age group (January 2015 to October 2021)
There were different patterns of referral through time by age group, with decreasing referrals for younger children and increasing referrals for older age groups (Figure 7b). Children in the youngest age group had a 70% reduction in the rate of referrals per quarter from an average of 2.9 per 1,000 children per quarter in 2015, to 0.9 per 1,000 per quarter in 2021. For the oldest age group this number increased by 23% from an average of 14 per 1,000 per quarter in 2015 to 17 per 1,000 per quarter in 2021.
#### Group Differences and Change
The monthly specialist CAMHS referral rate was the same between boys and girls until the start of the first UK COVID-19 lockdown, after which there was an increase for girls but not for boys (Figure 8a). Both boys and girls had average monthly referral rate of 2.7 per 1,000 children in 2015 which rose by 25% for girls in 2021 to 3.4 per 1,000 per month and fell 6% for boys to 2.5.
[Figure 8](http://medrxiv.org/content/early/2022/06/23/2022.06.14.22276082/F8)
Figure 8
a) Monthly referral rate per 1,000 children by sex. b) Distribution of age at referral for unique individuals by sex
The distributions of age at referral differ for boys and girls (Figure 8b). For boys, referral rates are higher at younger ages and remain steady through the teen years. Boys have more individuals with a referral at each year of age than girls up until 11 years. Referrals for girls follows a different pattern, with growing numbers of individuals referred as age increases, until 12 when there is a rapid rise in referrals.
#### Inequalities by Area Deprivation
Over the entire study period, there is a gradient in referral rates by home-area deprivation level. The rate of referral for children living in the most deprived areas is 1.9 times that in the least deprived areas. The social gradient has been consistently high over the study period. The most deprived areas see between 2 and 2.5 additional referrals per 100 children each year (Figure 9a). The rate of referral in the most deprived areas has been between 30-40% higher than the average of the whole population each year (Figure 9b). The mean age at which children in the most deprived areas are first referred to specialist CAMHS is 10 years and 5 months, over a year younger than the average in the least deprived areas (mean: 11 years and 8 months).
[Figure 9](http://medrxiv.org/content/early/2022/06/23/2022.06.14.22276082/F9)
Figure 9
a) Slope Index of Inequality and b) Relative Index of Inequality for annual specialist CAMHS referrals per 100 children by area deprivation. Point ranges denote annual SII and RII with confidence intervals. Dashed lines denote mean annual SII and RII
#### Rejected Referrals
The proportion of referrals to specialist CAMHS which were rejected nearly doubled from 17% in 2015 to 30% in 2021 (Figure 10a). The proportion of referrals which were rejected increased following the first UK COVID-19 lockdown (Figure 10a). Characteristics of people with rejected referrals also changed through time. The proportion of referrals for boys that were rejected increased throughout the study period. In contrast, the proportion of referrals for girls that were rejected remained roughly static until after the 1st COVID-19 lockdown when their rejection rate rose (Figure 10b). Between 2015 and the end of 2017 rejection rates were between 10% and 20% for all age groups. Since 2018, the proportion of referrals being rejected in pre-school aged children rose to 67% in 2021 while rejection rates for secondary school aged children remained steady at roughly 20% (Figure 10c).
[Figure 10](http://medrxiv.org/content/early/2022/06/23/2022.06.14.22276082/F10)
Figure 10
a) Monthly proportion of referrals rejected b) Monthly proportion of referrals rejected by sex c) Quarterly proportion of referrals rejected by age group
#### Accepted Referrals
Changes in the populations receiving referrals and rejections has changed the characteristics of who was able to access specialist CAMHS treatment over the study period. The proportion of new patients receiving specialist outpatient treatment who were girls increased from an even standing with boys in the early part of the study period, to almost two-thirds girls each month in 2021 (Figure 11). Since January 2019 there has only been one month in which more accepted referrals were for boys. In addition, the mean age of children whose referrals were accepted increased over the study period, from 11 years and 4 months (SD: 4.2) in 2015 to 12 years and 10 months (SD: 3.2) in 2021.
[Figure 11](http://medrxiv.org/content/early/2022/06/23/2022.06.14.22276082/F11)
Figure 11
Monthly proportion of accepted referrals which were for girls (2015 - 2021). Dashed line indicates even referral acceptance for boys and girls
## Discussion
### Principle Findings
We found a substantial increase of mental health prescribing in children across medicines used to treat a variety of mental health conditions – with rates of anti-anxiety and sleep medication prescriptions increasing by 90% and anti-depressants by 60%. There are stark differences in who is receiving prescriptions for mental health drugs – in younger children prescriptions are predominantly for boys to treat ADHD, and in older children prescriptions are predominantly for girls to treat depression.
Overall, we found that referrals to specialist CAMHS were stable until the 2020 COVID-19 lockdown, after which there was an increase particularly among girls and those in older age groups. We found that the proportion of referrals which were being rejected increased before the COVID-19 pandemic, then accelerated following the first 2020 lockdown. The increase in rejected referrals has had the biggest impact in the youngest ages and for boys. This has resulted in a static number of accepted referrals but a change in the characteristics of the treated population who are more likely to be girls and in older age groups.
We also found a clear and persistent social gradient by area deprivation for rates of both mental health prescribing and specialist CAMHS referral. Rates for both prescribing and referrals to specialist care for children living in the most deprived areas were twice as high compared with the least.
### Strengths and Limitations
The data used in this study are comprehensive for the entire population of children in the NHS Grampian region. The Prescribing Information System database is the definitive data source for medicines prescribed and dispensed in the community in Scotland. The CAMHS referrals data used in this study are required to be recorded locally by the Scottish Government for quarterly reporting of national statistics on patient waiting times. National statistics are published by government organisations and given this official status to indicate that they meet the highest standards of trustworthiness, quality and public value. This work adds value to these high-quality administrative healthcare records through individual level linkage of socioeconomic and demographic information. Investigation of the individual level records also reveals trends which are not captured in aggregate statistics available as open data. This detailed descriptive analysis will support future research aiming to identify hypotheses for potential mechanisms which may explain these findings, inform service planning and policies to provide treatment for equitably.
The data available to this study are of a high quality but do not represent the totality of mental health care services which are available to children and young people. Notably, data from community-based services (in lower tiers of the CAMHS treatment structure), including GP interactions and support provided by charitable and private healthcare organisations are not available. As a result, it is not possible to say whether changes in the pattern of service use of specialist CAMHS represents a need which is being met elsewhere. As administrative data sources, records of prescriptions and CAMHS referrals also do not include detailed information on clinical indications. In the case of prescribing data, although medicines are grouped in the BNF based on their common usage, some medications are indicated for the treatment of a variety of conditions or can be used ‘off license’. PIS prescribing records do not include clinical indication and for this reason, we are unable to determine conclusively why any given prescription has been given to a patient. For CAMHS referrals, additional information was not available about the clinical complaints of those receiving referrals, or for those whose referrals are rejected. It is therefore not possible to determine whether those whose referrals are rejected receive subsequent treatment elsewhere for the complaint which prompted the initial CAMHS referral.
This work was informed by public involvement and engagement activities at each stage, including in research design, analysis methods and interpretation of results. A full description of these activities is included in the supplementary materials (Appendix 1).
### How does it compare with other work?
#### Overall
Rates of anti-depressant prescribing for children in England were observed to be increasing in those aged 12-17 between 2005 and 2017 [25] and the incidence of first prescription in 3-17 year olds almost doubled between 2006 and 2015 [26]. Monitoring of ADHD prescribing in under-16s in the UK found similar large increases in prevalence between the early 1990s mid 2010s [27, 28] and that almost all of these increases were for by boys. Trends of increasing rates of mental health prescribing for children in the United Kingdom precede the period studied here and this appears to be continuing.
Scottish open data on referrals to specialist CAMHS is available in aggregated totals and statistics on the NHS Grampian health board are reported from the same source data as in this project [29]. There are differences in counts between the open data for Grampian and in this study, likely due to differences in inclusion/exclusion and data processing. However, the overall trends observed are concordant with the open data. There are increasing CAMHS referrals nationally over the study period, with an accelerated increase following the initial COVID-19 lockdown in 2020, although this is not universal across all health boards. NHS Grampian and the whole of Scotland saw increases in the unadjusted count of annual CAMHS referrals of 21% and 18% respectively between 2015 and 2021. This is larger than the rate increase observed in our data partly because it is a raw count and does not account for population size and because counts for 2021 are complete in the open data. The monthly count of referrals in NHS Grampian for the remaining months of 2021 not available in this study were all above the previous monthly average for the year [30].
Another study analysed 476 CAMHS referrals over a single year in one local authority area in Scotland [9]. They found similar trends by age, with almost half of referrals being for those aged between 13 and 18 which is roughly concordant with this work where people aged between 12 and 17 account for 59% of all referrals which has increased over our study period. The single year study found a higher proportion of referrals for boys than girls which was also observed in NHS Grampian in the early part of the study, but the trend has now reversed with 56% of referrals in 2021 being for girls. The earlier study observed very few referrals from the most deprived quintile based on SIMD but reported raw counts only and did not calculate rates from the number of individuals living in each quintile. This means it is not possible to determine whether their finding is a result of uneven population distribution by deprivation or indicative of a genuine difference in referral by deprivation. The small sample size and lack of time series data from this study also makes comparison difficult as demographic changes have occurred over time in the populations referred to CAMHS in NHS Grampian.
#### Sex/Gender
Epidemiological studies of neurodevelopmental and mental health disorders and service use in children and young people consistently report gender differences. This study is concordant with national reporting for the whole population (including adults) which found markedly higher levels of mental health prescribing for females than males, apart from medicines used to treat ADHD [10]. Open data for CAMHS referrals do not include a breakdown by sex so it is not possible to compare the pattern of increasing referrals for females in Grampian following the pandemic with the national picture. However, an audit of rejected referrals in seven Scottish health boards found that males accounted for a larger proportion (54%) than females, which is concordant with the findings of this work. The audit was conducted over a single year, so it is not possible to comment on trends through time.
A rapid literature review conducted in 2019 by the Scottish Government [31] looked specifically at evidence of worsening mental wellbeing among adolescent girls in Scotland. This found evidence of generally increasing prevalence of self-reported poor mental wellbeing in a variety of indicators among adolescents generally, but particularly for adolescent girls. The review concluded that there is little robust causal evidence to explain this observation.
There are competing hypotheses about whether the observed differences in mental health service use reflect *natural* differences in incidence and prevalence of mental health disorders between boys and girls, socially constructed expectations around mental health and behaviours, or the way these expectations influence professionals who make or assess referrals. Boys and girls are thought to manifest their mental health, social and behavioural patterns in different ways [32], although it is unclear the extent to which this is a consequence of biological or social processes. There is also concern that neurodevelopmental diagnostic criteria may not adequately reflect symptom manifestations in females [33], which may lead to delays in or lack of diagnosis and/or treatment compared with younger boys [34].
#### Prevalence of poor mental health
Alongside our findings of increasing mental health prescribing and CAMHS referrals in children and young people over time, other work has observed a national increase in the prevalence of poor mental health [35]. The Scottish Schools Adolescent Lifestyle and Substance Use Survey (SALSUS), which looks specifically at 13- and 15-year olds found continuous rises in the proportion with borderline or abnormal responses to the Strengths and Difficulties Questionnaire (SDQ) from 2010 to 2018 [36]. They also found that the average Warwick-Edinburgh Mental Wellbeing Scale (WEMWBS) had decreased between 2015 to 2018, which suggests worsening mental wellbeing. Both indicators also had clear patterns by sex, with 15-year-old girls having the highest rate of borderline/abnormal SDQ and the lowest average WEMWBS scores. The Scottish Health Survey (SHeS) also looked at WEMWBS scores in children aged between 13 and 15 and found higher mental wellbeing scores in boys than girls [8]. SALSUS reported social gradients in both SDQ and WEMWBS scores by deprivation, with the highest rates of poor mental health being found in the most deprived areas.
#### Potential Mechanisms
The aims of this study are descriptive in nature and it is not possible to determine the mechanisms which produce the observed trends. For instance, increasing mental health prescribing and referrals to CAMHS could result from increasing prevalence of mental health disorders in the population, improved recognition of the need to seek help among young people and their carers, or improved access to treatments and referral pathways.
The same is also true of sex differences in referral and treatment for mental health conditions, although increasing CAMHS referral in girls but not boys since the start of the COVID-19 pandemic should prompt further investigation. Patterns of help-seeking behaviour may differ between boys and girls and this may also interact with age. Girls tend to appear in these records at older ages and in larger numbers, whilst boys are more likely to be in younger age groups. It may be that girls present later because their needs are not recognised at earlier ages, or that boys in need are less likely to be referred for or receive treatment once they reach adolescence.
Local changes in the demographics of the population treated by CAMHS, with higher rejections for younger boys and higher acceptances for older girls, predated the onset of the COVID-19 pandemic. Given the roughly static number of accepted referrals throughout the study period, this change in those accepted for treatment may reflect a conscious change in service prioritisation or greater levels of clinical acuity in specific population groups. Without more detailed information around reason for referral or rejection, this is not possible to determine.
Higher incidence of mental health prescribing and referral for specialist CAMHS for children in the most deprived areas has been persistent throughout the study period. The mechanisms through which area-level deprivation could influence mental health are varied [37] and include a lack of access to material resources, support services and socioeconomic opportunities which might improve mental wellbeing.
#### Unanswered Questions and future research
Future work should explore the incidence and prevalence of diagnosable mental health conditions in Scotland to allow for comparison with patterns of increasing mental health prescription and increasing demand for specialist CAMHS. This would help to determine whether patterns from administrative and service use sources reflect underlying trends in incidence or changes in recognition of mental health conditions and help-seeking behaviour.
More comprehensive data from primary care and other mental health support services available to children and young people should be made available for future research. In particular, community-based services (e.g. CAMHS tier 1 and 2) and GP data should be prioritised as these are likely to be the first point of contact with health professionals for people in need of support around mental health. Data from educational settings and charitable organisations providing mental health support are also likely to provide useful information. Future analysis of mental health prescribing and CAMHS referral should incorporate more detailed information related to clinical indications as well as reasons for referral and rejection. Public involvement in this work highlighted that deeper analysis of rejected referrals in the future was important and that this should explore patient pathways using routine sources of data as well as make use of qualitative methods to explore help seeking behaviours in children and their carers.
Whilst we have been able to describe patterns in prescribing and CAMHS referral by some demographic and socioeconomic characteristics, other important factors have not been possible to investigate. The limited availability and poor quality of ethnicity indicators in administrative healthcare records may underestimate inequalities [38] and individual or household indicators of socioeconomic position were not available to us. Future research should look to link reliable sources of social data with administrative health records to better understand the complex mechanisms which influence child and adolescent mental health and service/treatment access.
#### Implications
The findings of this work indicate there is a bottleneck between rising mental healthcare need at the primary level (prescriptions) and the static size of the population of children treated by specialists in tertiary care. However, lack of data availability prevent analysis of care in general practice or secondary tier care centres. The National Health Service should include a more comprehensive collection and sharing of data for mental health services data at all levels, so potential redirection of care or services gaps can be detected.
This study also found substantial differences in care use between the sexes across age groups, and much higher need in the most socioeconomically deprived communities. Children’s mental health care services should consider structural changes in provision which account for different patterns of need for these different populations. Frequent monitoring of care use is needed, as indicated by the rapid changes we found in specialist CAMHS referrals for older adolescent girls since the start of the COVID-19 pandemic.
## Supporting information
Credit taxonomy [[supplements/276082_file02.pdf]](pending:yes)
GRIPP2-Short Form reporting of PPIE work [[supplements/276082_file03.pdf]](pending:yes)
## Data Availability
All analysis was carried out in the Grampian Data Safe Haven (project ID: DaSH477) on pseudonymised individual-level data. Per Scottish Safe Haven Charter, only aggregate data can be released from the Grampian Data Safe Haven for publication, but all individual-level data will be archived for 5 years on project completion and may be accessed by application to the Grampian Data Safe Haven (email dash{at}abdn.ac.uk) on condition that appropriate project approvals were secured. Following the archiving period this data will be deleted. Data analysis and figure generation was conducted using R (version 4.0.3) in RStudio (version 1.4.1103). All relevant analysis code files and summary data are available in the supplementary materials and are hosted on the project GitHub repository ([https://github.com/AbdnCHDS/NDL\_prescribing\_referrals\_paper](https://github.com/AbdnCHDS/NDL_prescribing_referrals_paper)).
[https://github.com/AbdnCHDS/NDL\_prescribing\_referrals\_paper](https://github.com/AbdnCHDS/NDL_prescribing_referrals_paper)
## Statements and Declarations
## Funding
This work was supported by the Health Foundation Networked Data Lab Programme.
### Competing Interests
The authors have no competing interests to declare that are relevant to the content of this article.
### Ethical Approval
This project was approved by the North Node Privacy Advisory Committee (NNPAC) (project ID: 6-063-21). NNPAC provides researchers with streamlined access to NHS Grampian data for research purposes and committee approval incorporates approvals from: the project sponsor, ethics panel, the local Caldicott Guardian, and NHS Research & Development.
### Data/Material/Code Availability
All analysis was carried out in the Grampian Data Safe Haven (project ID: DaSH477) on pseudonymised individual-level data. As per Scottish Safe Haven Charter, only aggregate data can be released from the Grampian Data Safe Haven for publication, but all individual-level data will be archived for 5 years on project completion and may be accessed by application to the Grampian Data Safe Haven (email dash{at}abdn.ac.uk) on condition that appropriate project approvals were secured. Following the archiving period this data will be deleted.
Data analysis and figure generation was conducted using R (version 4.0.3) in RStudio (version 1.4.1103). All relevant analysis code files and summary data are available in the supplementary materials and are hosted on the project GitHub repository ([https://github.com/AbdnCHDS/NDL\_prescribing\_referrals\_paper](https://github.com/AbdnCHDS/NDL_prescribing_referrals_paper) or [https://doi.org/10.5281/zenodo.6655991](https://doi.org/10.5281/zenodo.6655991)).
## Public Involvement
There is widespread agreement that public participation is necessary for health data-intensive projects [39]. We formed, trained, and involved a PPIE group of nine persons interested in health data usage for public benefit through a series of interactions throughout the research cycle including narrowing the focus of the research topic, developing analytical plans, sense-checking interpretations and improving the readability and accessibility of the results.
We also held group interaction with nine carers/parents and community workers who work with families and children. They reviewed near-final findings, remarked on usefulness and relevance, and suggested areas for further investigation. A comprehensive report of this effort utilising the GRIPP-2 reporting checklist for public involvement [40] is available in the supplementary materials (Appendix 1).
## Authors Contributions
Contributor Roles Taxonomy (CRediT) [41] has been used to make author contributions explicit and is available in the supplementary materials accompanying this publication.
## Acknowledgements
We thank The Health Foundation for providing financial support to allow this analysis to be conducted and for facilitating the Networked Data Lab partnerships which have informed this work. The Health Foundation is an independent charity committed to bringing about better health and healthcare for people in the UK We thank the NHS Grampian Health Intelligence team for facilitating use of this data. We also thank the Grampian Data Safe Haven (DaSH) for processing the data used in this study, as well as providing the secure platform used in this analysis and administrative support. We are grateful to members of the public who have made invaluable contributions to this work. This work uses data provided by patients and collected by the NHS as part of their care and support.
## Footnotes
* No changes to manuscript. Additional supplemental files added.
* Received June 14, 2022.
* Revision received June 22, 2022.
* Accepted June 23, 2022.
* © 2022, Posted by Cold Spring Harbor Laboratory
This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/)
## References
1. 1.Sadler K, Vizard T, Ford T, et al. (2018) Mental Health of Children and Young People in England, 2017: Summary of key findings. NHS Digital
2. 2.Radez J, Reardon T, Creswell C, et al. (2021) Why do children and adolescents (not) seek and access professional help for their mental health problems? A systematic review of quantitative and qualitative studies. Eur Child Adolesc Psychiatry 30:183–211. [https://doi.org/10.1007/s00787-019-01469-4](https://doi.org/10.1007/s00787-019-01469-4)
[CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/S00787-019-01469-4/FIGURES/5&link_type=DOI)
[PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F06%2F23%2F2022.06.14.22276082.atom)
3. 3.Radez J, Reardon T, Creswell C, et al. (2021) Adolescents’ perceived barriers and facilitators to seeking and accessing professional help for anxiety and depressive disorders: a qualitative interview study. Eur Child Adolesc Psychiatry. [https://doi.org/10.1007/s00787-020-01707-0](https://doi.org/10.1007/s00787-020-01707-0)
4. 4.Kessler RC, Angermeyer M, Anthony JC, et al. (2007) Lifetime prevalence and age-of-onset distributions of mental disorders in the World Health Organization’s World Mental Health Survey Initiative. World Psychiatry 9
5. 5. Scottish Government (2020) Child and Adolescent Mental Health Services (CAMHS): NHS Scotland National Service Specification. Scottish Government, Edinburgh
6. 6.Gould N (2006) Mental health and child poverty. Joseph Rowntree Foundation, York
7. 7.Barr B, Kinderman P, Whitehead M (2015) Trends in mental health inequalities in England during a period of recession, austerity and welfare reform 2004 to 2013. Social Science & Medicine 147:324–331. [https://doi.org/10.1016/j.socscimed.2015.11.009](https://doi.org/10.1016/j.socscimed.2015.11.009)
8. 8. Scottish Government (2020) The Scottish Health Survey: 2019 edition - Volume 1 - Main Report. Scottish Government
9. 9.Smith J, Kyle RG, Daniel B, Hubbard G (2018) Patterns of referral and waiting times for specialist Child and Adolescent Mental Health Services. Child Adolesc Ment Health 23:41–49. [https://doi.org/10.1111/camh.12207](https://doi.org/10.1111/camh.12207)
10. 10.Public Health Scotland (2021) Medicines used in Mental Health: Years 2010/11 - 2019/20. Public Health Scotland
11. 11. Scottish Government (2020) Mental Health – Scotland’s Transition and Recovery. Scottish Government, Edinburgh
12. 12.Bachmann CJ, Aagaard L, Burcu M, et al. (2016) Trends and patterns of antidepressant use in children and adolescents from five western countries, 2005–2012. European Neuropsychopharmacology 26:411–419. [https://doi.org/10.1016/j.euroneuro.2016.02.001](https://doi.org/10.1016/j.euroneuro.2016.02.001)
[CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.euroneuro.2016.02.001&link_type=DOI)
[PubMed](http://medrxiv.org/lookup/external-ref?access_num=26970020&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F06%2F23%2F2022.06.14.22276082.atom)
13. 13.Steinhausen H-C (2015) Recent international trends in psychotropic medication prescriptions for children and adolescents. Eur Child Adolesc Psychiatry 24:635–640. [https://doi.org/10.1007/s00787-014-0631-y](https://doi.org/10.1007/s00787-014-0631-y)
14. 14.NHS Business Services Authority (2021) Medicines Used in Mental Health – England – Quarterly Summary Statistics July to September 2021 | NHSBSA. [https://www.nhsbsa.nhs.uk/statistical-collections/medicines-used-mental-health-england/medicines-used-mental-health-england-quarterly-summary-statistics-july-september-2021](https://www.nhsbsa.nhs.uk/statistical-collections/medicines-used-mental-health-england/medicines-used-mental-health-england-quarterly-summary-statistics-july-september-2021). Accessed 13 Jun 2022
15. 15.Hansen AS, Christoffersen CH, Telléus GK, Lauritsen MB (2021) Referral patterns to outpatient child and adolescent mental health services and factors associated with referrals being rejected. A cross-sectional observational study. BMC Health Serv Res 21:1063. [https://doi.org/10.1186/s12913-021-07114-8](https://doi.org/10.1186/s12913-021-07114-8)
16. 16.Scottish Government (2020) [Data] Scottish Index of Multiple Deprivation 2020 (version 2)
17. 17.National Records of Scotland (2021) [Data] Population Estimates by Scottish Index of Multiple Deprivation (SIMD)
18. 18.Public Health Scotland Data and Intelligence (2022) [Data] Prescribing Information System (PIS)
19. 19.NHS Grampian (2022) [Data] Child and Adolescent Mental Health Services (CAMHS) data
20. 20.Public Health Scotland Data and Intelligence (2022) Community Health Index (CHI)
21. 21.Grampian Data Safe Haven | The Institute of Applied Health Sciences | The University of Aberdeen. [https://www.abdn.ac.uk/iahs/facilities/grampian-data-safe-haven.php](https://www.abdn.ac.uk/iahs/facilities/grampian-data-safe-haven.php). Accessed 1 Jun 2022
22. 22.Joint Formulary Committee (2022) British National Formulary, 83rd ed. BMJ Group and Pharmaceutical Press, London
23. 23.Regidor E (2004) Measures of health inequalities: part 2. Journal of Epidemiology & Community Health 58:900–903. [https://doi.org/10.1136/jech.2004.023036](https://doi.org/10.1136/jech.2004.023036)
[Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiamVjaCI7czo1OiJyZXNpZCI7czo5OiI1OC8xMS85MDAiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMi8wNi8yMy8yMDIyLjA2LjE0LjIyMjc2MDgyLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==)
24. 24.1. Vaccarella S,
2. Lortet-Tieulent J,
3. Saracci R, et al.
Conway DI, McMahon AD, Brown D, Leyland AH (2019) Chapter 4. Measuring socioeconomic status and inequalities. In: Vaccarella S, Lortet-Tieulent J, Saracci R, et al. (eds) Reducing social inequalities in cancer: evidence and priorities for research. IARC Scientific Publication
25. 25.Jack RH, Hollis C, Coupland C, et al. (2020) Incidence and prevalence of primary care antidepressant prescribing in children and young people in England, 1998–2017: A population-based cohort study. PLoS Med 17:e1003215. [https://doi.org/10.1371/journal.pmed.1003215](https://doi.org/10.1371/journal.pmed.1003215)
[PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F06%2F23%2F2022.06.14.22276082.atom)
26. 26.Sarginson J, Webb RT, Stocks SJ, et al. (2017) Temporal trends in antidepressant prescribing to children in UK primary care, 2000–2015. Journal of Affective Disorders 210:312–318. [https://doi.org/10.1016/j.jad.2016.12.047](https://doi.org/10.1016/j.jad.2016.12.047)
27. 27.Beau-Lejdstrom R, Douglas I, Evans SJW, Smeeth L (2016) Latest trends in ADHD drug prescribing patterns in children in the UK: prevalence, incidence and persistence. BMJ Open 6:e010508. [https://doi.org/10.1136/bmjopen-2015-010508](https://doi.org/10.1136/bmjopen-2015-010508)
28. 28.Renoux C, Shin J, Dell’Aniello S, et al. (2016) Prescribing trends of attention-deficit hyperactivity disorder (ADHD) medications in UK primary care, 1995–2015. Br J Clin Pharmacol 82:858–868. [https://doi.org/10.1111/bcp.13000](https://doi.org/10.1111/bcp.13000)
[PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F06%2F23%2F2022.06.14.22276082.atom)
29. 29.Public Health Scotland (2022) [Data] Child and Adolescent Mental Health Waiting Times
30. 30.Ball WP (2022) Child and Adolescent Mental Health Service (CAMHS) Referrals Open Data for Scotland. [https://will-ball.github.io/camhs_summary/](https://will-ball.github.io/camhs_summary/). Accessed 10 Jun 2022
31. 31.Scottish Government (2019) Exploring the reported worsening of mental wellbeing among adolescent girls in Scotland
32. 32.Currie C, Zanotti C, Morgan A, et al. (2012) Social determinants of health and well-being among young people. Health behaviour in school-aged children (HBSC) study: international report from the 2009-2010 survey. World Health Organization, Regional Office for Europe, Copenhagen
33. 33.Hull L, Mandy W (2017) Protective effect or missed diagnosis? Females with autism spectrum disorder. Future Neurology 12:159–169. [https://doi.org/10.2217/fnl-2017-0006](https://doi.org/10.2217/fnl-2017-0006)
34. 34.Ohan JL, Visser TAW (2009) Why Is There a Gender Gap in Children Presenting for Attention Deficit/Hyperactivity Disorder Services? Journal of Clinical Child & Adolescent Psychology 38:650–660. [https://doi.org/10.1080/15374410903103627](https://doi.org/10.1080/15374410903103627)
35. 35.Tod E, Parkinson J, McCartney G (2013) Scotland’s mental health: Children and young people 2013. Full report, December 2013. NHS Health Scotland / ScotPHO, Edinburgh
36. 36.Scottish Government (2020) Scottish Schools Adolescent Lifestyle and Substance Use Survey (SALSUS). Mental Wellbeing Report (2018). Edinburgh
37. 37.Visser K, Bolt G, Finkenauer C, et al. (2021) Neighbourhood deprivation effects on young people’s mental health and well-being: A systematic review of the literature. Social Science & Medicine 270:113542. [https://doi.org/10.1016/j.socscimed.2020.113542](https://doi.org/10.1016/j.socscimed.2020.113542)
38. 38.Scobie S, Spencer J, Raleigh V (2021) Ethnicity coding in English health service datasets. Nuffield Trust
39. 39.Aitken M, Tully MP, Porteous C, et al. (2019) Consensus Statement on Public Involvement and Engagement with Data-Intensive Health Research. IJPDS 4:. [https://doi.org/10.23889/ijpds.v4i1.586](https://doi.org/10.23889/ijpds.v4i1.586)
40. 40.Staniszewska S, Brett J, Simera I, et al. (2017) GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research. Res Involv Engagem 3:13. [https://doi.org/10.1186/s40900-017-0062-2](https://doi.org/10.1186/s40900-017-0062-2)
[CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/s40900-017-0062-2&link_type=DOI)
[PubMed](http://medrxiv.org/lookup/external-ref?access_num=29062538&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F06%2F23%2F2022.06.14.22276082.atom)
41. 41.Brand A, Allen L, Altman M, et al. (2015) Beyond authorship: attribution, contribution, collaboration, and credit. Learn Pub 28:151–155. [https://doi.org/10.1087/20150211](https://doi.org/10.1087/20150211)