ABSTRACT
Objective The objective of this study was to examine the impact of timely treatment and identification of sepsis on patient outcomes at Sutter Health, a mixed-payer healthcare system in northern California, US.
Methods This observational, retrospective analysis considered electronic health record (EHR) data for individuals who presented with sepsis during 2016-17 at any of Sutter Health’s 22 emergency departments (ED). Impacts were assessed for the timing of broad-spectrum antibiotic and intravenous (IV) fluid initiation, first vital signs, sepsis screening, and lactate results. Outcomes were in-hospital mortality, hospital length of stay (LOS) and intensive care unit (ICU) hours for patients discharged alive.
Results The final sample size was 35,847 (N=9,638 severe sepsis, N=5,309 septic shock). Early fluid initiation had the largest estimated impacts: a mortality reduction of 2.85%[2.03%,3.68%] overall and 2.94%[1.44%,4.48%] for severe sepsis (within 1 hour of sepsis presentation), and 14.66%[9.23%,20.07%] for septic shock (within 3 hours); reduced LOS (days) 1.39[1.08,1.71] overall, 2.30[1.31,3.21] severe sepsis, 3.07[1.21,4.94] septic shock; and fewer ICU hours 25.93[16.95,34.66] overall, 35.06[14.7,56.99] severe sepsis, 41.99[15.70,70.68] septic shock (within 3 hours). Sepsis screening within 30 minutes was also associated with mortality reductions (3.88%[2.96%,4.90%] overall, 1.74%[0.08%,3.50%] severe sepsis, 6.78%[3.12%,10.33%] septic shock). The greatest improvement opportunity was estimated for joint initiation of antibiotics and IV fluids, with a modest additional mortality reduction of 0.80%[0.47%,1.17%] overall, 0.77%[0.34%,1.19%] severe sepsis, 2.94%[1.83%,3.97%] septic shock; LOS reduction of 0.37[0.28,0.46] overall, 0.29[0.17,0.43] severe sepsis, 0.25[0.01,0.51] septic shock (within 1 hour); ICU hours reduction of 4.85[3.26,6.57] overall, 5.07[2.55,7.67] severe sepsis, 3.85[1.69,6.24] septic shock (within 3 hours).
INTRODUCTION
Sepsis is a leading cause of in-hospital deaths, and early treatment of sepsis has been recognized as essential in the promotion of better outcomes.1,2 Septic patients on average also stay longer in the hospital, and the costs of sepsis management represent a substantial economic burden.1,3 The Surviving Sepsis Campaign (survivingsepsis.org) has provided guidance on implementation of 6-hour, 3-hour, and finally 1-hour bundles for sepsis care, and there is evidence that implementation of these guidelines has improved timeliness of sepsis treatment and outcomes for people with sepsis around the world.4-25 The Center for Medicare and Medicaid Services (CMS) in the US has also established a quality measure for hospitals based on compliance with a sepsis treatment bundle (SEP-1), although the bundle has received criticism, and there does not appear to be evidence that its implementation resulted in improved outcomes for people with sepsis.26-33
This study is a rigorous evaluation of sepsis treatment and identification timing on patient outcomes at 22 hospitals in a large health system during 2016-17. The specific focus is on adult patients whose sepsis onset occurred during or before their time in the emergency department (ED), and who went on to be admitted to the hospital.
Considered in this study were the timing of broad-spectrum antibiotic and intravenous (IV) fluid initiation, first vital signs, documentation of sepsis screening, and initial lactate laboratory test results. The following patient outcomes were measured: in-hospital mortality, hospital length of stay (LOS) for patients discharged alive, and hours spent in the intensive care unit (ICU) for patients who went to the ICU and were discharged alive. Impact was measured in two ways: (1) as the difference between 0% success and 100% success, and (2) as the difference between current practice and 100% success. The second estimate represents the potential opportunity presented for making additional improvements, based on current (2016-17) success rates.
METHODS
Analytical population
Sutter Health is a large, mixed-payer healthcare system in northern California, US. Sutter serves approximately 3.5 million patients per year in both the acute (hospital) and non-acute (e.g. physician office) setting. The analytical population for this study comprises 2016-17 adult hospital admissions at any of Sutter Health’s 22 acute care hospitals with emergency departments meeting the following criteria: (1) admission began in the ED, (2) severe sepsis clinical criteria were met (according to vital signs and lab values, see next section) while in the ED, and (3) treatment with broad-spectrum antibiotics and intravenous (IV) fluids (any volume) was initiated at any point during hospitalization (either while in the ED or after inpatient admission). The following were excluded: transfers from other healthcare facilities/hospitals, admissions for labor and delivery, elective admissions, and non-acute admissions (behavioral health, rehabilitation, and hospice).
Severe sepsis clinical criteria
We followed the CMS definition of severe sepsis – at least two symptoms of systemic inflammatory response syndrome (SIRS), and one symptom of organ dysfunction (see below).26 The definition of sepsis has changed over time; the newest definition no longer relies upon SIRS criteria, and the designation “ severe sepsis” has been eliminated.34 However, the older definition is used here because it most closely aligns with hospital definitions of sepsis at the time of this study (2016-17).
For the purposes of this study, the term “ sepsis onset” will refer to the first time these clinical criteria were met according to data in the medical record. This has also been referred to as sepsis “ time zero.”
SIRS criteria:
Temperature > 38.3°C or < 36.0°C
Heart rate > 90
Respiratory rate > 20 breaths/min or pC02< 32
White blood cell count > 12,000 or < 4,000 or > 10% bands
Signs of organ dysfunction:
Systolic blood pressure (SBP) < 90
Mean arterial pressure (MAP) < 65
Lactate > 2 mmol/L
Creatinine > 2 mg/dL
Bilirubin > 2 mg/ddL
Platelets < 100,000
INR > 1.5 or aPTT > 60 sec
Altered mental state (Glasgow coma scale < 15)
qSOFA criteria
Patients are at high risk of adverse outcomes, according to the quick Sequential [Sepsis-related] Organ Failure Assessment (qSOFA),34,35 if they meet any two of the following clinical criteria:
Altered mental state
Respiratory rate 22 breaths/min or more
SBP 100 mm Hg or less
The qSOFA was used in statistical models for severity adjustment, as described below.
Statistical methods
The impact of timely treatment was assessed by considering initiation of broad-spectrum antibiotics and IV fluids, both singly and in combination, within 1 and 3 hours of ED arrival and of sepsis onset. Because the focus of this study was the timing of treatment, no restriction was placed on the volume of IV fluids given, only on the timing of fluid initiation. To address the impact of early sepsis identification on outcomes, the following were considered, measured from ED arrival: vital signs taken within 10 minutes, sepsis screening documented within 15 or 30 minutes, and lactate resulted within 1 hour or 3 hours. The patient outcomes considered were in-hospital mortality, hospital LOS for patients discharged alive, and hours spent in the ICU for patients who went to the ICU and were discharged alive.
To assess impact, a counterfactual approach was used.36 Specifically, each outcome was modeled separately, and used to predict the expected result if the treatment or identification event was 100% successful or 0% successful – for example, if all patients were treated with broad-spectrum antibiotics within 1 hour of sepsis onset, versus being treated after 1 hour (G-computation estimator).37 We used logistic regression to model mortality, and negative binomial regression for hospital LOS and hours in the ICU. Separate models (153 in total) were constructed for each treatment/identification variable, outcome, and cohort (full cohort, severe sepsis, and septic shock).
We included the following variables in the outcome models estimating projected outcomes: patient demographics (age category by decade from 60-80+, sex, race, ethnicity), clinical characteristics (comorbidities, Charlson comorbidity index), prior utilization (number of hospitalizations in the prior year, number of ED visits in the prior 6 months), information on prior infection (sepsis diagnosis in the prior year, number of cellulitis diagnoses in the prior year, number of urinary tract infections in the prior year), proxies for severity at presentation (sepsis clinical criteria met at sepsis onset, qSOFA at sepsis onset, time to sepsis onset), and the probability of developing severe sepsis or septic shock based on clinical criteria at sepsis presentation.38-40 Time to sepsis onset was included as a severity measure because patients with early onset were observed to have higher mortality (see Appendix). The probability of developing severe sepsis or septic shock was modeled separately using logistic regression. The lactate criterion was excluded from the 18 models estimating impact of time to lactate result.
In each case, we computed two estimates of impact: (1) the difference between 0% success and 100% success, and (2) the difference between current practice and 100% success. Confidence intervals for impact estimates were constructed using the nonparametric bootstrap with 1000 iterations.
RESULTS AND DISCUSSION
The study population is described in Figure 1. Out of a total of 357,012 adult hospital admissions to Sutter Health acute care hospitals in 2016 and 2017, 41,757 (12%) were associated with a sepsis discharge diagnosis unrelated to childbirth or miscarriage. Of these, 253,331 (71%) met basic inclusion criteria (after applying exclusions described in the Methods section), including 39,210 (94%) of sepsis admissions. Severe sepsis clinical criteria were met while in the ED for 51,701 (20%) of all admissions and 20,736 (53%) of sepsis admissions meeting basic inclusion criteria. Finally, 35,847 (69%) of these patients were also treated with broad-spectrum antibiotics and IV fluids during hospitalization, including 19,675 (95%) with sepsis discharge diagnosis. The final study population therefore represents 10% of all 2016-17 adult hospital admissions and 47% of sepsis admissions.
The overall mortality rate for the study population was 8.58% (5.89% severe sepsis, 24.68% septic shock). Patients were discharged alive for 32,771 admissions (9,068 severe sepsis, 3,999 septic shock), and the average hospital LOS was 6.68 days overall, 6.62 for severe sepsis, and 10.12 for septic shock. ICU stays were part of 10,544 admissions where patients were discharged alive, including 2,395 of those for severe sepsis and 3,488 of those for septic shock. Patients spent on average 89.43 hours in the ICU (76.24 severe sepsis, 109.93 septic shock). Patients were screened for sepsis 99% of the time (N=35,837), and had a documented lactate lab result 93% of the time (N=33,472).
Descriptive data for the N=35,847 full study population are shown in Table 1. Data are summarized by admission, not by unique patient. The cohort was 63.8% white, 11.7% Black/African American, 11.1% Asian, and 2.54% other races. For 10.9% of admissions patient race was unknown or not reported. Hispanic ethnicity was reported for 15.4% of admissions. The most common comorbidities were diabetes without chronic complications (24.4%), congestive heart failure (19.1%), chronic pulmonary disease (25.5%), and renal disease (22.5%). Just over half of admissions were associated with a sepsis discharge diagnosis (13.2% simple, 26.9% severe, 14.8% shock), and 45.1% had no sepsis diagnosis. On average, broad-spectrum antibiotics were administered 2.5 hours (153 minutes) after ED arrival, and just under an hour (58 minutes) after severe sepsis clinical criteria were met (sepsis onset). IV fluids were first given about an hour (66 minutes) after ED arrival, and 5 minutes prior to sepsis onset. The median time to lactate result was 1.5 hours (79 minutes) after arrival in the ED. On average, vital signs were first taken on 5 minutes after arrival, and sepsis screening was documented 8 minutes after arrival.
Tables 2-4 display the estimated impact of treatment with broad-spectrum antibiotics and IV fluids within 1 and 3 hours of sepsis onset (defined as first emergence of severe sepsis clinical criteria in the medical record) on mortality, hospital LOS, and hours in the ICU. Tables 5-7 are analogous to Tables 2-4, but measure time-to-treatment from ED arrival instead of sepsis onset. Finally, Tables 8-10 show the impact on outcomes (mortality, hospital LOS, ICU hours) of the identification-related measures: time to lactate result, time to sepsis screen, and time to first vital sign taken.
Mortality
All versions of treatment within 1 and 3 hours of sepsis onset (Table 2) were found to have a positive impact on mortality, with estimated reductions in mortality rate ranging from 1.01% (antibiotics within 1 hour) to 2.85% (fluids within 1 hour) for the full cohort (N=35,847, mortality rate 8.58%), 1.03% (antibiotics within 1 hour) and 2.94% (fluids within 1 hour) for severe sepsis (N=9,638, mortality rate 5.89%), and from 5.80% (antibiotics within 1 hour) and 14.66% (fluids within 3 hours) for septic shock (N=5,309, mortality rate 24.68%). For all three cohorts, timely initiation of IV fluids was associated with the largest estimated mortality rate reduction.
The greatest opportunity for improvement in current practice, however, was not in the area of IV fluid initiation, because the vast majority of patients (89.8%) were already receiving fluids within 3 hours of sepsis onset (or prior to sepsis onset). The biggest potential gains were estimated to be in the area of increasing the combined initiation of antibiotics and fluids within 1 hour of sepsis onset – only 46.6% of patients (57.3% severe sepsis, 56.7% septic shock) received both treatments within this time frame. For all three cohorts, this combined treatment within 1 hour was associated with the largest mortality reduction as compared to current practice (0.8% for the full cohort, 0.77% for severe sepsis, and 2.94% for septic shock).
Looking at treatment within 1 and 3 hours of ED arrival (Table 5), estimated mortality rate reductions were lower, and less likely to be statistically significant (p<0.05). The largest estimated reductions were still in the area of IV fluid initiation, specifically within 3 hours of ED arrival (2.46% full cohort, 1.96% severe sepsis, 10.65% septic shock). The largest estimated impact of changing current practice was in administering antibiotics and fluids within 3 hours of ED arrival (0.49% mortality reduction overall, 2.04% reduction for septic shock).
Table 8 shows the estimated impact of timely lactate measurement, sepsis screening, and vital signs on mortality. Results suggest that taking vital signs within 10 minutes of ED arrival does not impact the mortality rate for any cohort, nor does receiving lactate test results within 1 hour of ED arrival (for those with a lactate result, N=33,742) Lactate results within 3 hours of arrival was associated with a reduction in mortality rate for the full cohort and for septic shock admissions (2.72% and 11.9%, respectively). For the latter, this is the largest estimated impact shown in Table 8. Sepsis screen completion within 30 minutes had the largest estimated impact for the full cohort and for severe sepsis admissions (mortality rate reduction 3.88% and 1.74%, respectively). Despite the high success of early sepsis screening (72.5% within 15 minutes, 86.6% within 30 minutes) and of lactate measurement within 3 hours (81.9%), these areas still showed the largest estimated impacts of a change to current practice, particularly within those who developed septic shock. Within this population, mortality rates could be reduced by an estimated 1.32% by returning lactate results within 3 hours in all cases, and by 0.95% if all sepsis screens were documented within 15 minutes of ED arrival. Within the full cohort, sepsis screening within 15 minutes was also the greatest identified opportunity, with an estimated mortality rate reduction of 0.59% with a change to current practice.
Results displayed in Tables 2, 5, and 8 can also be viewed in the forest plots shown in Figures 2-7.
Hospital length of stay
For patients discharged alive (N=32,771 full cohort, N=9,068 severe sepsis, N=3,999 septic shock), timely treatment in relation to sepsis onset (Table 3) was associated with statistically significant (p<0.05) reductions in hospital LOS (days). For all three cohorts, the largest estimated impact was associated with IV fluid initiation within 3 hours of sepsis onset – an estimated 1.39 fewer days overall, 2.3 days for severe sepsis admissions, and 3.07 days for septic shock. The next largest reduction in hospital LOS was associated with the combined treatment with antibiotics and IV fluids within 3 hours (1.12 days full cohort, 1.36 days severe sepsis, 1.67 days septic shock). The largest impact associated with a change in current practice was in administering both broad-spectrum antibiotics and IV fluids within 1 or 3 hours, for a modest 0.37- or 0.35-day reduction in overall average hospital LOS.
When treatment time was measured from ED arrival (Table 6), IV fluid initiation within 3 hours produced the largest estimated reductions in LOS (0.98 days full cohort, 1.31 days severe sepsis, 2.20 days septic shock); for the septic shock cohort, this was the only estimated impact in Table 6 whose 95% CI did not cross zero. The largest estimate associated with a change in current practice was for combined initiation of IV fluids and antibiotics within 3 hours of ED arrival (in 2016-17 52.6% of the full cohort received both treatments within this time frame), producing an estimated 0.31-day reduction in average LOS.
Table 9 shows that lactate measurement within 3 hours of ED arrival is associated with reduced hospital LOS, among those with a lactate result (N=30,489; N=9,029 severe sepsis, N=3,994 septic shock). The estimated reductions were 1.17 days for the full cohort, 0.96 days for severe sepsis, and 1.22 days for septic shock. Neither measurement of vital signs within 10 minutes or sepsis screening within 15/30 minutes appeared to impact LOS for severe sepsis and septic shock admissions; for the full cohort, sepsis screening within 30 minutes was associated with a modest (0.48-day) LOS reduction. The results in Table 9 do not reveal opportunities for impactful change to current practice – the largest projected LOS reduction is in lactate measurement within 3 hours for the full cohort, associated with an estimated 0.22-day lower average LOS. The results in tables 3, 6, and 9 are compared graphically for the three cohorts in Figures 8-13.
Hours in the intensive care unit
For patients discharged alive who went to the ICU, treatment with IV fluids within 3 hours after sepsis onset was associated with the largest estimated reduction in average hours spent in the ICU (25.93 hours for the full cohort, 35.06 hours for severe sepsis, and 41.99 hours for septic shock) (Table 4). The next most impactful treatment for the full cohort was IV fluid initiation within 1 hour (20.83-hour reduction); for severe sepsis and septic shock, IV fluids and broad-spectrum antibiotics within 3 hours of sepsis onset was estimated to have the next-largest impact (21.48-hour reduction and 23.5-hour reduction, respectively). For all three cohorts, treatment with IV fluids and antibiotics together within 3 hours of sepsis onset (delivered 69.5% of the time) was the best opportunity for change to current practice, with an estimated intervention effect of 4.85 fewer ICU hours overall, 5.07 for severe sepsis, and 3.85 for septic shock.
When measured from ED arrival (Table 7), IV fluid initiation within 3 hours was still associated with the largest estimated reductions in average ICU hours (23.78 full cohort, 19.06 severe sepsis, 35.66 septic shock). The largest estimated impact of a change to current practice for the full cohort was combined initiation of IV fluids and antibiotics within 3 hours (4.18 fewer hours), for severe sepsis was IV fluid initiation within 1 hour (5.74 fewer hours), and for septic shock was IV fluid initiation within 3 hours (3.36 fewer hours).
As with mortality and hospital LOS, measurement of vital signs within 10 minutes of ED arrival was not found to have an impact on hours spent in the ICU (Table 10). Lactate measurement within 3 hours was associated with an estimated 20.15 fewer ICU hours overall (19.99 severe sepsis, 13.34 septic shock). Lactate measurement within one hour was actually associated with an increase in ICU hours, which is most likely an indication that the 37.1% of admissions that had a lactate resulted very quickly were for sicker individuals. Sepsis screening within 15 and 30 minutes had an estimated impact of 6.04 and 6.93 fewer ICU hours in the full cohort, but none within those with severe sepsis or septic shock. The estimated impact of any change to current practice was small – if the percentage of patients with a lactate resulted within 3 hours of ED arrival increased from 83.2% to 100%, we could see a reduction of 3.49 average hours spent in the ICU (2.99 for severe sepsis, no change for septic shock). Figures 14-19 display the forest plots for Tables 4, 7, and 10.
Study Limitations
This study has several limitations. First, prospective identification of sepsis cases is challenging – as highlighted by the fact that 45.1% of admissions in the study population did not go on to have a sepsis discharge diagnosis. ED clinicians, however, may have to initiate treatment before sepsis has been confirmed, so we have attempted to provide a more complete picture (than would be provided by considering those who have a sepsis discharge diagnosis only) by showing the full cohort of individuals who could have been treated, as well as looking at the subset of admissions that resulted in severe sepsis and septic shock diagnoses. Second, in attempting to include measures of severity of condition at ED arrival, it was necessary to use time to sepsis onset (according to clinical criteria as described in this report) and the presence or absence of the clinical criteria at sepsis onset as proxies for severity at presentation – even though these values were in reality measured after ED arrival. For estimates that measure time from the door, this could potentially create complications with the time-ordering of events. Given that it is not unreasonable to assume that measured lab values and vital signs simply revealed issues that were present upon ED arrival, this was determined to be an acceptable risk for this analysis, and excluding measures of severity at presentation would have negatively impacted any ability to model the outcomes effectively. Finally, the structure of the analysis does not allow for comparison between treatments – for example, to answer the question of what additional impact treatment within 1 hour could have over treatment within 3 hours. This could be easily addressed in a future analysis with these data, but was not the focus of this particular study. Given that the focus of this study was on the timing of treatment initiation, the volume of IV fluids given during sepsis treatment was not considered. This is another area of potential future study.
CONCLUSIONS
This analysis suggests that treatment of patients with IV fluids and broad-spectrum antibiotics earlier had a positive impact on patient outcomes at Sutter Health during 2016-17. Prompt sepsis screening appeared to also be making a difference. The greatest opportunity presented, in terms of potential impact if current practice could be altered, was in the area of combined initiation of IV fluids and broad-spectrum antibiotics within one hour of sepsis presentation.
Data Availability
Data are not currently available for external use.