Rationalising neurosurgical head injury referrals: The development and implementation of the Liverpool Head Injury Tomography Score (Liverpool HITS) for mild traumatic brain injury ==================================================================================================================================================================================== * Conor SN Gillespie * Christopher M Mcleavy * Abdurrahman I Islim * Sarah Prescott * Catherine J McMahon ## Abstract **Objectives** To develop and implement a radiological scoring system to define a ‘surgically significant’ mild Traumatic Brain Injury (TBI), stratify neurosurgical referrals and improve communication between referral centres and neurosurgical units. **Design** Retrospective single centre case-control analysis of ten continuous months of mild TBI referrals. **Setting** A major tertiary neurosurgery centre in England, UK. **Participants** All neurosurgical referrals with a mild TBI (GCS 13-15) during the period of 1st January to 30th October 2017 were eligible for the study. 1248 patients were identified during the study period, with 1144 being included in the final analysis. **Interventions** All patients’ CT head results from the referring centres were scored retrospectively using the scoring system and stratified according to their mean score, and if they were accepted for transfer to the neurosurgical centre or managed locally. **Main outcome measure** Determine the discriminatory and diagnostic power, sensitivity and specificity of the scoring system for predicting a ‘surgically significant’ mild TBI. **Results** Most patients referred were male (59.4%, N=681), with a mean age of 69 years (SD=21.1). Of the referrals to the neurosurgical centre, 17% (n=195) were accepted for transfer and 83% (n=946) were not accepted. The scoring system was 99% sensitive and 51.9% specific for determining a surgically significant TBI. Diagnostic power of the model was fair with an area under the curve of 0.79 (95% CI 0.76 to 0.82). The score identified 495 (52.2%) patients in ten months of referrals that could have been successfully managed locally without neurosurgical referral if the scoring system was correctly used at the time of injury. **Conclusion** The Liverpool Head Injury Tomography Score (HITS) score is a CT based scoring system that can be used to define a surgically significant mild TBI. The scoring system can be easily used by multiple healthcare professionals, has high sensitivity, will reduce neurosurgical referrals, and could be incorporated into local, regional and national head injury guidance. ## Introduction Traumatic brain injury (TBI) is a significant source of morbidity and mortality worldwide, with approximately 69 million affected individuals each year1. In England and Wales, 1.4 million patients attend hospital emergency departments following head injuries1-3. TBI is an increasingly prevalent problem, with studies reporting a 50%+ increase in emergency department admissions within the last ten years for patients with TBI4-6. TBI is also a highly pertinent neurosurgical problem, and accounts for up to 50% of neurosurgical on-call workload7, 8. TBI can be classified into mild, moderate, and severe9, 10. This classification has been described in a plethora of ways, including the clinical features of the patient (such as post-injury length of amnesia and loss of consciousness), however in the acute phase (first 24 hrs) of a TBI it is recommended to classify it into mild, moderate and severe depending on the presenting Glasgow Coma Scale (GCS), with mild being a GCS of 13-15, moderate being 9-12 and severe being less than 911. Seventy-five to 80% of TBI is classified as mild12, 13. The National Institute for Health and Care Excellence (NICE) guidelines recommend involving neurosurgical centres early if appropriate in TBI management, however the majority of patients referred to neurosurgical centres for management of their mild TBI are not accepted for transfer and are thus managed locally14, 15. Indeed, a recent systematic review and meta-analysis suggests that 3.5% of those with a mild TBI go on to receive neurosurgical intervention15. In contrast, Neurosurgical referrals for trauma are constantly increasing and have increased by 50% in the last 5 years in the UK16, 17. This increase18 coincides with recent surveys that suggest referrers find many aspects of referral to a neurosurgical centre difficult, and a lack of training in under- and postgraduate medical programmes indicate that many doctors may not be aware of what injuries in mild TBI constitute a neurosurgical emergency which merits referral19, 20. Relative low satisfaction with the referral process and most particularly, the reported unwillingness of on-call neurosurgeons to accept patients to tertiary centres also suggests that there is an issue with communication on both the sides of the referral pathway21, 22. NICE currently recommends TBI patients with a moderate or severe injury to be referred to a neurosurgical unit for advice and input with regards to management and potential transfer. For mild TBI, referral to a neurosurgeon should be considered if an injury is ‘surgically significant’; with those not eligible for this being managed locally according to locally developed pathways23. However, there are currently no national (e.g. NICE) or international guidelines available elucidating the nature of a ‘surgically significant’ mild TBI. This is generally considered to be a mild TBI that warrants referral to an on-call neurosurgeon, and what constitutes this is recommended to be determined by local centres and trust protocols, working together with tertiary neurosurgical centres and emergency departments23. There are several issues with this. Firstly, development of local protocols could lead to variability in referral and acceptance rates across centres which has been explored in previous studies relating to the management of TBI24, 25. This is more pertinent for referral centres without readily available access to a neurosurgical centre26. In many local trusts, all computed tomography (CT) head scans reported as ‘abnormal’ after a mild TBI are often referred to neurosurgical centres, leading to inappropriate referrals17, 25, 27. Indeed, at our centre roughly 82% of these referrals are not accepted for transfer and managed locally. This accounts for up to 1200 extraneous referrals per centre per year28. As very few mild TBI patients end up receiving neurosurgical management, this means that most referrals are not accepted for transfer to neurosurgical centres and are managed locally17, 29. There is little data available regarding the scope of avoidable neurosurgical referrals for mild TBI and the impact that being able to identify this may have. Given that NICE is responsible for national guidance, a national pathway and method of determining a surgically significant mild TBI would help stratify patients that need to be referred to a neurosurgical centre for advice, management or potential transfer. A recognised guidance and scoring system would also reduce avoidable referrals (patients that would be referred to a neurosurgeon on-call only to be later not accepted) thus reducing time spent awaiting the response to the referral by the local referring hospital and associated healthcare costs. In addition, a method of grading the severity of a mild TBI would provide quantification of the severity of mild TBI between referring hospital and neurosurgical centre, facilitating communication and improving satisfaction rates with the referral process. Our hypothesis was that by stratifying the number of patients that need to be referred based on referral criteria, we would reduce the number of those avoidable. This would improve workload for on-call neurosurgeons and, if this was a numerically scored system, it would provide an objective and documentable method of communication between the referrer and the neurosurgical centre. ## Methods ### Summary The authors used advice from senior consultant neurosurgeons with a specialist interest in neurotrauma at the Walton Centre NHS Foundation Trust, a specialist tertiary centre for neurology and neurosurgery, as well as a local research and trauma network that includes radiologists, surgeons of other disciplines, specialist trauma nurses and consultant trauma surgeons to propose and develop the scoring system. This was then correlated with a radiology specialist trainee (the principle developer of the scoring system) to assess feasibility and relatability of the score. This was then fed back to the neurosurgical team for approval. To detect the margin for the study, we accessed referrals for two months of mild TBI referrals from the ORION online neurosurgical referral system as a pilot study in 2017 to estimate how many referrals were accepted compared to not accepted, and the potential number of referrals that could be managed locally and thus did not need to be referred28, 30. As the vast majority of TBI patients receive a CT scan on arrival to most referral centres prior to neurosurgical referral, it was decided to base the scoring system on the results and injuries accrued from this. This would enable the scoring system to be deciphered and interpreted by all radiologists that report the scan, in addition to specialist doctors such as emergency medicine and neurosurgical trainees and consultants. This would also enable the score to be calculated rapidly. The scoring system was drafted primarily by the Radiology specialist trainee (CML) and reviewed by consultants at our centre, as well as presented at numerous trauma and departmental meetings to review, discern and make modifications before the study. This was then reviewed by a consultant neurosurgeon with a specialist interest in trauma (CM) and finalised. ### Explanation of scoring parameters The scoring system contains different categories broadly based on anatomical location of radiologically apparent injuries. To calculate the score, the radiological injuries the patient has sustained from each injury category are combined to form a cumulative total with the following outcomes. Scores of ‘0’, ‘1’ or ‘2’ were defined as a “none surgically significant injuries”- and patients with this score can be managed according to local guidance and protocol at the referral centre (e.g. a hospital emergency department). A score of ‘3’ or more was determined as a surgically significant injury that should prompt a referral to a neurosurgical centre for guidance with regards to management and potential transfer. This may be because of the high mortality and morbidity associated with a single injury (e.g. Extradural haemorrhage (EDH)) or a combination of multiple concerning injuries (e.g. multiple contusions) 31, 32. The scoring system and how to interpret it using a clinical example are outlined in Figures 2-3. ![Figure 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2019/08/26/19004499/F1.medium.gif) [Figure 1.](http://medrxiv.org/content/early/2019/08/26/19004499/F1) Figure 1. Current NICE head Injury guidance (correct as of July 2019) ![Figure 2.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2019/08/26/19004499/F2.medium.gif) [Figure 2.](http://medrxiv.org/content/early/2019/08/26/19004499/F2) Figure 2. Liverpool Head Injury Tomography Score (HITS) for mild TBI •Score 0 – Normal scan. Clinical decision to admit for neurological observations. Does not require Neurosurgical opinion. •Score 1 – Abnormal scan. Admit locally for neurological observations. Follow head injury guidelines. •Score 2 – Abnormal scan. Admit for neurological observations. Rescan at 24 hours. Follow head injury guidelines. •Score 3 or above – Surgically significant injury. Refer to neurosurgery on-call ![Figure 3.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2019/08/26/19004499/F3.medium.gif) [Figure 3.](http://medrxiv.org/content/early/2019/08/26/19004499/F3) Figure 3. Example case using the Liverpool HIT score (HITS) in a patient presenting to the emergency department with left sided weakness and a GCS of 14 ![Figure 4.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2019/08/26/19004499/F4.medium.gif) [Figure 4.](http://medrxiv.org/content/early/2019/08/26/19004499/F4) Figure 4. Methods ![Figure 5.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2019/08/26/19004499/F5.medium.gif) [Figure 5.](http://medrxiv.org/content/early/2019/08/26/19004499/F5) Figure 5. Receiver Operating Characteristic (ROC) curve for Liverpool Head Injury Tomography Score (HITS). The scoring system was then tested and validated retrospectively. For this we accessed data on every mild TBI referral to our centre for ten continuous months (1st January 2017-30th October 2017). This included every patient that was referred to our centre with a TBI and a GCS of 13-15 during this period. This was accessed with assistance from our local trauma and research network (TARN) and ORION coordinator (SP) to determine if they were accepted for neurosurgical intervention or managed locally. Local audit approval was obtained. Each individual patient’s referral details and CT head scan (with or without a report from a local radiologist) were accessed. Each individual scan was reviewed and scored retrospectively using the scoring system. This was used to determine how many patients were accepted, the HIT score of each patient and how effective the scoring system was at defining a surgically significant injury. We stratified the patients according to whether they had been accepted or not by our centre for transfer or any form of intervention as our outcome measure. This included non-surgical intervention (e.g. acceptance for monitoring and observation) or surgical intervention (e.g. evacuation of a haemorrhage and intracranial pressure (ICP) monitoring). We then compared the differences between those accepted and those managed locally and their respective HIT scores. Our second outcome measure was to determine if the score could be safely used prospectively, and that it would not incorrectly categorise a patient as having a ‘non-surgically significant injury’ (i.e. a HIT score of 0, 1 or 2) who was then accepted by the neurosurgical centre for transfer. To ensure validity and exclude observer bias, after the scores had been calculated a random sample of 50 patients were analysed to check for validity by CML and a consultant radiologist, with no modifications being made to the patients’ original score following this review. The combined patient details, acceptance status and score were then imported and analysed with descriptive frequencies using SPSS v24.0 (IBM, Armonk, NY, USA). We also carried out sensitivity and specificity analysis, and a Receiver Operating Characteristic (ROC) curve was calculated to determine the overall discriminatory power of the scoring system, with the Area under the curve (AUC) representing the correct prediction rate for the score33. The null hypothesis of the study was that the scoring system would incorrectly categorise patients with a ‘none-surgically significant’ injury and recommend local management, whom ended up being accepted by a neurosurgical centre. If the scoring system were to be effective, it would categorise all patients that were accepted for neurosurgical input as having a surgically significant injury (a score of ‘3’ or more). The number of correct predictions using the score forms the basis of this study, with a diagram of the score development and outline illustrated in Figure 2. The inclusion and exclusion criteria are also outlined below. ### Patient and Public Involvement Patients or the public were not involved in the design, or conduct, or reporting, or dissemination of our research. As the scoring system and its interpretation, reporting and clinical significance is carried out by healthcare specialists, It was not appropriate to involve patients in the design stage of the study. ## Results ### Identifying number of mild TBI referrals during study period Of the ten continuous months of referral data examined, 1248 patients were referred to our centre with a suspected mild TBI. Of the 1248 patients eligible for the study, 1144 were included in the final analysis. 101 patients were ineligible for the study, with most of these (n=59) due to inability to access patient CT scans on our referral system. This is due to the neurosurgical referral being from a hospital that is from another county or country, or the referring hospital using an electronic reporting system inaccessible to our centre. In addition, the identity of 42 patients could not be traced and were noted as ‘unknown male’ or ‘unknown female’ on reports and admissions data. These were also excluded. Finally, further inspection of the data set revealed three patients coded erroneously that were accepted with presenting GCS scores of 6, 7 and 9 respectively and these were excluded due to not qualifying as a mild TBI. This left 1144 patients in the total analysis, who were referred to our centre as a neurosurgical on-call referral, had a mild TBI with a GCS of 13-15, and who could be identified by name and age. ### Patient characteristics and referral outcomes Males were most likely to be referred due to mild TBI (59.4%, N=681) compared to females (40.6%, N=466). The mean age of referred patients was 69 years (SD=21.1). The most common score overall was 3 points (253 from the not accepted group, 86 from the accepted group). This was due to a large number of subdural haematomas (both acute, chronic and acute-on chronic) being present in the cohort, which scores 3 points (n=283). Of the 1144 patients referred with a GCS of 13-15 during the ten-month study period, 195 (17.0%) were accepted by the centre for transfer and 949 (83.0%) were not accepted. There was a statistically significant difference (P<0.001) in the mean scores of the accepted group (4.8 points [SD=2.2]) compared to the non-accepted group (2.42 points [SD=2.311]). The range of HIT scores for the accepted group was 13 (2-15), and the range of scores for the local management group was 15 (0-15). Of those patients not accepted, 454 (47.8%) scored three or more points on the HIT score and thus should have been referred to the neurosurgical centre. However, 495 patients (52.2%) scored 0, 1 or 2 points on the scoring system. They therefore were referrals for patients that could have been managed locally according to local mild TBI protocol without neurosurgical discussion. Of those accepted, almost all patients (99.0%, n=193/195) had a HIT score of 3 or greater (mean score 4.79). This means that the score would have been correct in establishing surgically significant referral injuries for all but two patients. Of those accepted, two patients scored less than 3 but were still admitted to the neurosurgical centre. On further investigation, this was because one of the patients also had severe cervical spine injuries that included a fracture to the odontoid peg and was accepted with a view to treat the spinal injuries, and the second patient was accepted due to a lack of beds at our nearby trauma centre and the patient was admitted for neurological observations as a courtesy to the trauma centre. #### Sensitivity and specificity analysis The study was 99.0% sensitive including the two aforementioned patients (100% sensitive when excluding them) and 51.9% specific. The positive predictive value (PPV) of the scoring system was 29.8%, and the negative predictive value of the scoring system was 99.6%. The Receiver Operating Characteristic (ROC) curve used to examine sensitivity and specificity together is shown below. Diagnostic power of the model was fair, with an Area under the curve (AUC) of 0.791 with a 95% Confidence Interval (CI) of 0.76 to 0.8233. ## Discussion Perhaps the most notable point of our study was that roughly 83% of referrals to neurosurgical centres for mild TBI are not accepted for transfer, and of these approximately half are likely to not warrant neurosurgical intervention. Thus if using the scoring system these patients would be safely managed locally. This would improve communication between both referring and neurosurgical centres, reduce workload for on call neurosurgeons, and quantify which types of TBI are most likely to require intervention. From our results for ten months of referral data, implementing the scoring system would reduce mild TBI referrals by up to 600 referrals per neurosurgical centre per year. Based on the sensitivity of the study, almost none of these patients would require a transfer to a neurosurgical centre. However, this figure may vary depending on the size of the centre and acceptance variability. The sensitivity is very high, which indicates that the scoring system is able to delineate what a ‘surgically significant’ mild TBI is, in addition to reducing the number of inappropriate referrals. This means that the score is highly unlikely to miss any surgically significant injuries, and thus will recommend referral for almost all injuries that go on to be transferred to a neurosurgical centre. The specificity is not high which indicates that the score becomes less accurate for predicting need for admission due to TBI as the mean score increases. Analysing our admissions data, this was mainly due to the presence of patients that were deemed ‘not appropriate for neurosurgical intervention’ whether this be due to catastrophic injury, increasing age or multiple co-morbidities. In this situation, patients would score highly on initial assessment but not be accepted by a centre, creating a false positive result. These patients will therefore often be rejected by the centre for reasons not linked to the severity and score of the mild TBI. The study included all patients referred to the centre for ten consecutive months, indicating a real time analysis of TBI referrals. In addition, we were able to collect over 1200 patient cases and validate the scoring system using this data. The fact that the score does not miss out any patients or at least very few patients that would have been accepted also validates it as a highly sensitive marker of surgically significant TBI. Perhaps the second benefit of this scoring system is it appears to be proficient in determining a surgically significant mild TBI-in that we mean a mild TBI that will require transfer to a neurosurgical centre for any reason. Of the 195 patients accepted for transfer, only two had a HIT score of less than the referral cut-off of three, and these were accepted for other reasons outside of injury severity score. The first patient was accepted due to having complex cervical spine injuries and was accepted under the spinal team, and one patient was accepted due to a lack of general trauma beds at a nearby trauma centre. This is the first scoring system of its kind to the authors’ knowledge. There are CT based scoring systems that accurately predict TBI mortality (such as Marshall and Rotterdam scores)34-36 however none of these are specific to mild TBI, nor do they reference referral criteria for being accepted to a neurosurgical unit37. This means the potential impact on practice is high, as there is no current way of deciphering a surgically significant mild TBI at the level of national guidance. Moreover, the scoring system is easy to use and can be calculated quickly by healthcare professionals. It is known that many patients suffer psychological and long-term residual effects after a mild TBI3, 38, 39, and thus the scoring system is not intended to discourage head injury referrals to specialist care, rather to stratify patients that require acute neurosurgical referral. Indeed, at our centre we have implemented a mild TBI outpatient clinic to facilitate this and be utilised in conjunction with the scoring system for patients not referred acutely. ### Implications for policy Our results have several implications for policy. As there is currently no national guidance, and no other UK units currently have such a scoring system in place according to a recent trauma meeting. It may be possible for this score to be utilised on a local, regional and national scale. In addition, the lack of specific national guidance on this topic makes the scoring system particularly pertinent. Additionally, given the previously discussed dissatisfaction with the on-call referral process, this score has a place in placating necessary referrals and improving this process. The score is currently being implemented prospectively at our centre with a view for other centres to use the score upon finalisation and publication. It is hoped that, as the implementation of the scoring system increases, it will be modified based on evolving feedback to improve the efficacy, awareness and effectiveness of the score. ### Study strengths and limitations There are several limitations to this study. Firstly, the study was carried out retrospectively at a single tertiary centre with a wide population reach. It is unclear how this may affect the number of referrals and those saved each year, in addition to the mechanism of injury distribution for each centre. However, we analysed continuous data from ten consecutive months of referral data at a UK tertiary centre, making the results pertinent nationally. Second, the retrospective nature of the study does not enable a real-time estimate of the effectiveness of the score to be established; however, the scans were taken at the point of referral to best simulate this enabling translation into real life practice. Third, the score lacks specificity as a few patients with high scores were not accepted, and this was primarily down to intervention not being plausible or feasible given the patient’s clinical status. Lastly, we were unable to measure patient survival rates for patients who were not accepted for transfer. This is due to differing trust IT systems with the only information available about the patient to us being the referral outcome and does not include management data as this will have been carried out and monitored by the referring centre. Thus, we are unable to completely guarantee that the patients did not receive neurosurgical management elsewhere. ## Conclusions The Liverpool Head Injury Tomography Score (HITS) is a novel, CT based scoring system to classify mild TBI according to surgical significance and whether the patient requires further neurosurgical centre referral. The scoring system can be used by a myriad of healthcare specialists, is simple to use and has close to 99% sensitivity for predicting a surgically significant mild TBI. This may also be used to stratify and reduce inappropriate referrals to neurosurgical centres by up to 50%, saving workload and improving communication between neurosurgical and referring centres. If implemented correctly, the score could be incorporated into local, regional and potentially national guidance. **What is known about this topic** * - Traumatic Brain Injury (TBI) is a highly prevalent neurosurgical problem and the number of referrals are increasing year on year * - 75-80% of TBI is classified as mild (GCS 13-15) * - The majority of referrals to neurosurgical centres for patients with mild TBI are not accepted for transfer * - At present there is no national guidance to stratify what mild TBI can be managed locally and what needs to be referred to a neurosurgical centre **What this study adds** * - The Liverpool head injury tomography score (HITS) is a novel, CT head based scoring system to quantify the severity of mild TBI * - The scoring system is 99% sensitive for detecting a surgically significant mild TBI * - This could be used to stratify patients and reduce avoidable neurosurgical referrals at local, regional and potentially national level. ## Disclosures The authors report no conflict of interests concerning the materials, design and results of this study. ## Presentations This work has been presented as an oral presentation by CML at 2019 British Society Of Emergency Radiologists (BSER) 2019 meeting and as an oral presentation by CG at the Society of British Neurosurgeons (SBNS) spring meeting 2019. ## Data Availability Anonymised statistical data and analysis are available from the corresponding author. ## Author contributions Conception and design: McMahon, Mcleavy, Gillespie. Acquisition of data: Prescott, Gillespie. Analysis and Interpretation of data: Gillespie, Mcleavy, Islim. Drafting the article: Gillespie, Islim, Mcleavy. Critically revising the article: Gillespie, Mcleavy, Islim, McMahon. All authors agree with the final version of the submitted manuscript. CG is the lead author and guarantor. ## Ethical approval Ethical approval was granted by the Walton Centre NHS Foundation trust research and audit team upon commencement of the study. ## Competing interests All authors have completed the ICMJE uniform disclosure questionnaire at [www.icmje.org/coi\_disclosure.pdf](http://www.icmje.org/coi_disclosure.pdf) and declare: no support from any organisation for the submitted work; no financial relationships with an organisations or groups that might have an interest in the submitted work in the previous three years; no other relationships or activities that could appear to have influenced the submitted work. ## Transparency declaration The lead author (CG) affirms that this manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as planned have been explained. ## Data sharing Anonymised statistical data and analysis are available from the corresponding author. ## Funding statement The authors received no external funding or sponsorship in the conception, design and implementation of the study. ## Copyright The Corresponding Author has the right to grant on behalf of all authors and does grant on behalf of all authors, a worldwide licence to the Publishers and its licensees in perpetuity, in all forms, formats and media (whether known now or created in the future), to i) publish, reproduce, distribute, display and store the Contribution, ii) translate the Contribution into other languages, create adaptations, reprints, include within collections and create summaries, extracts and/or, abstracts of the Contribution, iii) create any other derivative work(s) based on the Contribution, iv) to exploit all subsidiary rights in the Contribution, v) the inclusion of electronic links from the Contribution to third party material where-ever it may be located; and, vi) licence any third party to do any or all of the above. ## Dissemination declaration Dissemination of the results to study participants and patient organisations outside of the main study findings is not possible at this stage. ## Preprint declaration This manuscript is a preprint and should not be disseminated or used to guide policy until formal publication. ## Appendix- Data Tables View this table: [Table 1:](http://medrxiv.org/content/early/2019/08/26/19004499/T1) Table 1: Mean Liverpool HITS scores of referred patients View this table: [Table 2:](http://medrxiv.org/content/early/2019/08/26/19004499/T2) Table 2: Liverpool HITS Score individual patient score results compared to decision to admit to the Neurosurgical centre * Received August 10, 2019. * Revision received August 19, 2019. * Accepted August 26, 2019. * © 2019, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/) ## References 1. 1.Davis T, Ings A. Head injury: triage, assessment, investigation and early management of head injury in children, young people and adults (NICE guideline CG 176). Arch Dis Child Educ Pract Ed 2015;100(2):97–100. [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiZWRwcmFjdCI7czo1OiJyZXNpZCI7czo4OiIxMDAvMi85NyI7czo0OiJhdG9tIjtzOjM5OiIvbWVkcnhpdi9lYXJseS8yMDE5LzA4LzI2LzE5MDA0NDk5LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 2. 2.Dewan MC, Rattani A, Gupta S, Baticulon RE, Hung YC, Punchak M, et al. Estimating the global incidence of traumatic brain injury. J Neurosurg 2018:1–18. 3. 3.Stocchetti N, Zanier ER. Chronic impact of traumatic brain injury on outcome and quality of life: a narrative review. Critical care (London, England) 2016;20(1):148-. 4. 4.Hsia RY, Markowitz AJ, Lin F, Guo J, Madhok DY, Manley GT. Ten-year trends in traumatic brain injury: a retrospective cohort study of California emergency department and hospital revisits and readmissions. BMJ open 2018;8(12):e022297–e. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYm1qb3BlbiI7czo1OiJyZXNpZCI7czoxMjoiOC8xMi9lMDIyMjk3IjtzOjQ6ImF0b20iO3M6Mzk6Ii9tZWRyeGl2L2Vhcmx5LzIwMTkvMDgvMjYvMTkwMDQ0OTkuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 5. 5.Marin JR, Weaver MD, Yealy DM, Mannix RC. Trends in visits for traumatic brain injury to emergency departments in the United States. Jama 2014;311(18):1917–9. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jama.2014.3979&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24825648&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F08%2F26%2F19004499.atom) 6. 6.Michelson EA, Huff JS, Loparo M, Naunheim RS, Perron A, Rahm M, et al. Emergency Department Time Course for Mild Traumatic Brain Injury Workup. The western journal of emergency medicine 2018;19(4):635–40. 7. 7.Gordon WE, Gienapp AJ, Jones M, Michael LM, 2nd, Klimo P, Jr.. An Analysis of the On-Call Clinical Experience of a Junior Neurosurgical Resident. Neurosurgery 2018. 8. 8.Van den Brand CL, Karger LB, Nijman STM, Hunink MGM, Patka P, Jellema K. Traumatic brain injury in the Netherlands, trends in emergency department visits, hospitalization and mortality between 1998 and 2012. Eur J Emerg Med 2018;25(5):355–61. 9. 9.Hawryluk GW, Manley GT. Classification of traumatic brain injury: past, present, and future. Handb Clin Neurol 2015;127:15–21. 10. 10.Najem D, Rennie K, Ribecco-Lutkiewicz M, Ly D, Haukenfrers J, Liu Q, et al. Traumatic brain injury: classification, models, and markers. Biochem Cell Biol 2018;96(4):391–406. 11. 11.Saatman KE, Duhaime A-C, Bullock R, Maas AIR, Valadka A, Manley GT, et al. Classification of traumatic brain injury for targeted therapies. Journal of neurotrauma 2008;25(7):719–38. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1089/neu.2008.0586&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=18627252&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F08%2F26%2F19004499.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000257634000002&link_type=ISI) 12. 12.Katz DI, Cohen SI, Alexander MP. Mild traumatic brain injury. Handb Clin Neurol 2015;127:131–56. 13. 13.Prince C, Bruhns ME. Evaluation and Treatment of Mild Traumatic Brain Injury: The Role of Neuropsychology. Brain Sci 2017;7(8). 14. 14.Lawrence T, Helmy A, Bouamra O, Woodford M, Lecky F, Hutchinson PJ. Traumatic brain injury in England and Wales: prospective audit of epidemiology, complications and standardised mortality. BMJ open 2016;6(11):e012197–e. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYm1qb3BlbiI7czo1OiJyZXNpZCI7czoxMjoiNi8xMS9lMDEyMTk3IjtzOjQ6ImF0b20iO3M6Mzk6Ii9tZWRyeGl2L2Vhcmx5LzIwMTkvMDgvMjYvMTkwMDQ0OTkuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 15. 15.Marincowitz C, Lecky FE, Townend W, Borakati A, Fabbri A, Sheldon TA. The Risk of Deterioration in GCS13-15 Patients with Traumatic Brain Injury Identified by Computed Tomography Imaging: A Systematic Review and Meta-Analysis. J Neurotrauma 2018;35(5):703–18. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1089/neu.2017.5259&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=29324173&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F08%2F26%2F19004499.atom) 16. 16.Storey M, Webster S. Giving ourselves a head start: improving the quality of documentation of referrals to neurosurgery. BMJ quality improvement reports 2015;4(1):u203531.w2516. 17. 17.Marincowitz C, Lecky FE, Morris E, Allgar V, Sheldon TA. Impact of the SIGN head injury guidelines and NHS 4-hour emergency target on hospital admissions for head injury in Scotland: an interrupted times series. BMJ Open 2018;8(12):e022279. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYm1qb3BlbiI7czo1OiJyZXNpZCI7czoxMjoiOC8xMi9lMDIyMjc5IjtzOjQ6ImF0b20iO3M6Mzk6Ii9tZWRyeGl2L2Vhcmx5LzIwMTkvMDgvMjYvMTkwMDQ0OTkuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 18. 18.Mukerji N, Paluzzi A, Crossman J, Mitchell P, Nissen J. Emergency neurosurgical referrals in the North East of England - trends over four years 2008-2011. Br J Neurosurg 2013;27(3):334–9. 19. 19.Amarouche M, Neville JJ, Deacon S, Kalyal N, Adams N, Cheserem B, et al. Referrers’ point of view on the referral process to neurosurgery and opinions on neurosurgeons: a large-scale regional survey in the UK. BMJ Open 2017;7(11):e017495. 20. 20.Joshi SS, Murali-Krishnan S, Patankar P, Choudhari KA. Neurosurgical referral service using smartphone client WhatsApp: preliminary study at a tertiary referral neurosurgical unit. Br J Neurosurg 2018;32(5):553–7. 21. 21.Gulsin GS, Anichini G, Bhatt P. Perceptions, misconceptions and review of a neurosurgery on-call service in a university teaching hospital. Br J Neurosurg 2016;30(2):187–90. 22. 22.Matloob SA, Hyam JA, Thorne L, Bradford R. Improving neurosurgical communication and reducing risk and registrar burden using a novel online database referral platform. Br J Neurosurg 2016;30(2):191–4. 23. 23.NICE. Head injury: assessment and early management. 2014. [https://www.nice.org.uk/guidance/cg176](https://www.nice.org.uk/guidance/cg176) (accessed 22/07/2019 2019). 24. 24.van Essen TA, den Boogert HF, Cnossen MC, de Ruiter GCW, Haitsma I, Polinder S, et al. Variation in neurosurgical management of traumatic brain injury: a survey in 68 centers participating in the CENTER-TBI study. Acta Neurochir (Wien) 2019;161(3):435–49. 25. 25.Foks KA, Cnossen MC, Dippel DWJ, Maas A, Menon D, van der Naalt J, et al. Management of mild traumatic brain injury at the emergency department and hospital admission in Europe: A survey of 71 neurotrauma centers participating in the CENTER-TBI study. J Neurotrauma 2017. 26. 26.Sharma S, Gomez D, deMestral C, Hsiao M, Rutka J, Nathens AB. Emergency Access to Neurosurgical Care for Patients with Traumatic Brain Injury. Journal of the American College of Surgeons 2014;218(1):51–7. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jamcollsurg.2013.10.005&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24355876&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F08%2F26%2F19004499.atom) 27. 27.Gelinne A, Thakrar R, Tranmer BI, Durham SR, Jewell RP, Penar PL, et al. Differential Patterns of Referral to Neurosurgery: A Comparison of Allopathic Physicians, Osteopathic Physicians, Nurse Practitioners, Physician Assistants, and Chiropractors. World Neurosurg 2019. 28. 28.Gillespie C, McMahon CM, McLeavy CM. Pilot study to reduce Neurosurgical referrals in mild TBI. Unpublished trial study 2019. 29. 29.Lewis PR, Dunne CE, Wallace JD, Brill JB, Calvo RY, Badiee J, et al. Routine neurosurgical consultation is not necessary in mild blunt traumatic brain injury. J Trauma Acute Care Surg 2017;82(4):776–80. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F08%2F26%2F19004499.atom) 30. 30.Lecky F. Twenty-five years of the trauma audit and research network: a continuing evolution to drive improvement. Emerg Med J 2015;32(12):906–8. [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiZW1lcm1lZCI7czo1OiJyZXNpZCI7czo5OiIzMi8xMi85MDYiO3M6NDoiYXRvbSI7czozOToiL21lZHJ4aXYvZWFybHkvMjAxOS8wOC8yNi8xOTAwNDQ5OS5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 31. 31.Amoo M, O’Halloran PJ, Leo AM, O’Loughlin A, Mahon P, Lim C. Outcomes of emergency neurosurgical intervention in neuro-critical care patients with traumatic brain injury at Cork University Hospital. Br J Neurosurg 2018;32(6):585–9. 32. 32.Song SY, Lee SK, Eom KS, Investigators K. Analysis of Mortality and Epidemiology in 2617 Cases of Traumatic Brain Injury : Korean Neuro-Trauma Data Bank System 2010-2014. Journal of Korean Neurosurgical Society 2016;59(5):485–91. 33. 33.Hajian-Tilaki K. Receiver Operating Characteristic (ROC) Curve Analysis for Medical Diagnostic Test Evaluation. Caspian journal of internal medicine 2013;4(2):627–35. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24009950&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F08%2F26%2F19004499.atom) 34. 34.Mohammadifard M, Ghaemi K, Hanif H, Sharifzadeh G, Haghparast M. Marshall and Rotterdam Computed Tomography scores in predicting early deaths after brain trauma. Eur J Transl Myol 2018;28(3):7542. 35. 35.Mahadewa TGB, Golden N, Saputra A, Ryalino C. Modified Revised Trauma-Marshall score as a proposed tool in predicting the outcome of moderate and severe traumatic brain injury. Open Access Emerg Med 2018;10:135–9. 36. 36.Charry JD, Falla JD, Ochoa JD, Pinzon MA, Tejada JH, Henriquez MJ, et al. External Validation of the Rotterdam Computed Tomography Score in the Prediction of Mortality in Severe Traumatic Brain Injury. J Neurosci Rural Pract 2017;8(Suppl 1):S23–s6. 37. 37.Munakomi S, Bhattarai B, Srinivas B, Cherian I. Role of computed tomography scores and findings to predict early death in patients with traumatic brain injury: A reappraisal in a major tertiary care hospital in Nepal. Surg Neurol Int 2016;7:23. 38. 38.Bramlett HM, Dietrich WD. Long-Term Consequences of Traumatic Brain Injury: Current Status of Potential Mechanisms of Injury and Neurological Outcomes. Journal of neurotrauma 2015;32(23):1834–48. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1089/neu.2014.3352&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25158206&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F08%2F26%2F19004499.atom) 39. 39.Fleminger S, Ponsford J. Long term outcome after traumatic brain injury. BMJ (Clinical research ed.) 2005;331(7530):1419–20. [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjEzOiIzMzEvNzUzMC8xNDE5IjtzOjQ6ImF0b20iO3M6Mzk6Ii9tZWRyeGl2L2Vhcmx5LzIwMTkvMDgvMjYvMTkwMDQ0OTkuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9)