Abstract
Importance The mechanisms driving the recent decline in outpatient antibiotic prescribing are unknown.
Objective To estimate the extent to which reductions in the number of antibiotic prescriptions filled per outpatient visit (stewardship) and reductions in the monthly rate of outpatient visits (observed disease) for infectious disease conditions each contributed to the decline in annual outpatient antibiotic prescribing rate in Massachusetts between 2011 and 2015.
Design Outpatient medical and pharmacy claims from the Massachusetts All-Payer Claims Database were used to estimate rates of antibiotic prescribing and outpatient visits for 20 medical conditions and their contributions to the overall decline in antibiotic prescribing. Trends were compared to those in the National Ambulatory Medical Care Survey (NAMCS).
Setting Outpatient visits in Massachusetts between January 2011 and September 2015.
Participants 5,075,908 individuals with commercial health insurance or Medicaid in Massachusetts under the age of 65 and 495,515 patients included in NAMCS.
Main outcomes and measures The number of antibiotic prescriptions avoided through reductions in observed disease and reductions in per-visit prescribing rate per medical condition.
Results Between 2011 and 2015, the January antibiotic prescribing rate per 1,000 individuals in Massachusetts declined by 18.9% and the July antibiotic prescribing rate declined by 13.6%. The mean prescribing rate for children under 5 declined by 42.8% (95% CI 21.7%, 59.4%), principally reflecting reduced wintertime prescribing. The monthly rate of outpatient visits per 1,000 individuals in Massachusetts declined (p < 0.05) for respiratory infections and urinary tract infections. Nationally, visits for medical conditions that merit an antibiotic prescription also declined between 2010 and 2015. Of the estimated 358 antibiotic prescriptions per 1,000 individuals avoided over the study period in Massachusetts, 59% (95% CI 54%, 63%) were attributable to reductions in observed disease and 41% (95% CI 37%, 46%) to reductions in prescribing per outpatient visit.
Conclusions and relevance The decline in antibiotic prescribing in Massachusetts was driven by a decline in observed disease and improved antibiotic stewardship, with a contemporaneous reduction in visits for conditions prompting antibiotics observed nationally. A focus on infectious disease prevention should be considered alongside antibiotic stewardship as a means to reduce antibiotic prescribing.
Question How did the separate mechanisms of improved stewardship and reductions in observed disease contribute to a 5-year decline in outpatient antibiotic prescribing in Massachusetts from 2011-2015?
Findings In an observational analysis of insurance claims, reduced monthly rates of outpatient visits for infectious conditions and reduced probability of prescribing an antibiotic per outpatient visit both contributed to the decline in antibiotic prescribing. An estimated 358 antibiotic prescriptions per 1,000 individuals were avoided over the study period through the two mechanisms, 211 of which were attributable to reductions in outpatient visits and 147 to reduced antibiotic prescribing per visit.
Meaning Preventing the need for outpatient visits should be considered alongside antibiotic stewardship as a means of reducing antibiotic prescribing.
Introduction
Reducing antibiotic use, particularly given the extent of inappropriate prescribing1,2, is a central public health goal in the effort to address the growing challenge of antibiotic resistance3–5. Between 2011 and 2015, the annual rate of filled outpatient antibiotic prescriptions to Massachusetts insurance holders under the age of 65 dropped by 17%, with similar declines reported across the United States6,7. However, the mechanisms driving this decline have been unclear. One mechanism could be improved antibiotic stewardship8 resulting in less inappropriate use. An alternative mechanism could be a reduction in antibiotic prescribing driven by a reduction in the incidence of “observed disease” —that is, the combined population-level rate of infectious illness and the probability of seeking heath care in response to illness. This mechanism would lead to a reduction in antibiotic use because fewer outpatient visits occur where prescribing—appropriate or inappropriate—is possible.
Reductions in observed disease could be attributed to increasing levels of self-care for minor illnesses, increasing use of telemedicine9, shifts in diagnostic coding, changing patient attitudes toward antibiotics, or to an authentic decline in disease, potentially driven by improved disease prevention, management, and vaccination10,11. A potentially important mechanism for disease prevention was the 2010 licensure of the 13-valent pneumococcal conjugate vaccine (PCV13),12 which produced substantial declines in pneumococcal disease10,13. If a reduction in observed disease is a significant contributor to declining antibiotic use, it would challenge the assumption that improving antibiotic stewardship is the key lever to decrease antibiotic use and control the rise of antibiotic resistance14.
The current literature examining declines in outpatient antibiotic prescribing in recent decades is mixed and has largely focused on changes in the degree of inappropriate prescribing15–22. A study of observed disease with respect to antibiotic prescribing for respiratory illnesses in the UK between 1994 and 2000 found that declines in observed respiratory disease accounted for a greater portion of the overall decline in prescribed antibiotics than improved stewardship23. In contrast, a study in the United States found that declines in antibiotic prescribing between 1995 and 2002 were primarily associated with improved stewardship, not with declines in observed disease18.
To address the gap in the understanding which mechanisms explain the declines in antibiotic prescribing, we used administrative claims from Massachusetts and a nationally representative dataset of outpatient office visits to quantify the respective contributions of improved stewardship and reduced observed disease to declining outpatient antibiotic prescribing. Massachusetts provides an ideal test case given that over 97% of residents have health insurance24 and the vast majority of medical insurance claims are reported to a centrally managed database25. This provides an unparalleled opportunity to define the population’s patterns of healthcare use.
Methods
Study sample and data sources
Medical and pharmacy claims data were obtained from the Massachusetts All-Payer Claims Database (APCD), 5th edition25. The APCD contains insurance claims filed between 2011 and 2015 for 94% of Massachusetts residents under the age of 65 (Table S1). We examined trends through September 2015 because after October 2015, the ICD-10 diagnosis classification system was adopted nationally, unpredictably shifting observed prevalence of many conditions due to differences in coding26. We extracted all pharmacy claims for antibiotics using previously described methods6. We excluded pharmacy claims associated with individuals over the age of 65, since most of these individuals use traditional fee-for-service Medicare for their primary health insurance, and fee-for-service Medicare claims are not included in the APCD. Each antibiotic claim was associated with a unique patient identifier, the patient’s age, and the fill date6.
Outpatient physician encounters (‘visits’) were extracted from the APCD by pulling all medical claims associated with outpatient-associated Current Procedural Terminology (CPT) codes (Table S2). Each visit was associated with a unique patient identifier, the patient’s age, the service date, and up to seven ICD-9 coded diagnoses.
To examine national trends in observed disease, we extracted visits from the federal National Ambulatory Medicare Care Survey (NAMCS) dataset27 from 2002-2015. NAMCS is an annual, nationally representative survey of outpatient medical care in the United States. The dataset captures information on individual physician visits including up to three associated diagnoses. Each visit is weighted to allow extrapolation to national estimates.
Defining medical conditions and associated prescriptions
Each diagnosis associated with outpatient visits in our study sample was mapped to one of the 20 conditions previously defined as associated with antibiotic prescribing2. For each visit, the diagnosis that ranked highest on the scale of antibiotic appropriateness2 was assigned as that visit’s primary diagnosis. We linked antibiotic prescriptions with visits on the basis of patient identifier and time between visits and prescription events 16,28. Each prescription could be linked to at most one visit; if a patient underwent multiple visits within the week preceding a filled antibiotic prescription, only the visit nearest to the prescription was linked. A prescription could fail to link with a visit if the associated visit did not qualify as an outpatient physician visit (e.g. the prescription was written during a dentistry visit or as a follow-up from a hospital stay), if the patient received the antibiotic without a formal outpatient visit (i.e., ‘phantom prescribing’29), if the prescription was filled more than one week after the visit, or if the patient used separate forms of insurance for the visit and the prescription fill, thereby associating the two claims with different patient IDs.
Study outcomes and covariates
Our three primary outcomes were (a) the difference between the projected number of antibiotic prescriptions that would have been given over the study period in the absence of long-term trends in observed disease rates and (b) antibiotic prescribing rates as well as (c) the actual number of antibiotic prescriptions given over the study period. From these outcomes, we estimated the number of antibiotic prescriptions that were avoided due to changes in observed disease rates and/or changes in antibiotic prescribing rates. We measured these outcomes for each of the 20 potentially antibiotic meriting conditions independently. In a sensitivity analysis, we considered beneficiary age, sex, and county (Table S1) as covariates of observed disease and antibiotic prescribing rates.
We measured the monthly rate of antibiotic prescribing per 1,000 individual insurance enrollees, both overall and stratified by age, to assess longitudinal trends in prescribing. The denominator in each month consisted of the number of individuals enrolled in an insurance product for that entire month. In addition, we measured the annual physician visit rate per 1,000 people according to the NAMCS dataset for antibiotic-meriting and non-antibiotic-meriting conditions.
Statistical analysis
For each of the 20 medical conditions, we calculated the monthly outpatient visit rate and the monthly number of associated antibiotic prescriptions per 1,000 individuals, where the denominator in both cases consisted of the number of individuals enrolled in an insurance product for the entire month. We then calculated the monthly rate of antibiotic prescribing per visit by dividing the monthly antibiotic prescriptions per 1,000 individuals by the monthly physician visit rate per 1,000 individuals. We used locally estimated scatterplot smoothing (LOESS) regression30–32 to visually highlight seasonal variation in antibiotic prescribing rates and outpatient visits.
Next, we projected the total number of antibiotic prescriptions that were avoided due to reductions in observed disease. For each of the 20 medical conditions, we calculated the slope of the monthly physician visit rate per 1,000 individuals using linear regression. We then projected the predicted monthly outpatient visit rate had there been no mean change in observed disease by adjusting the monthly incidence to have the same intercept but a regression slope over time of zero. Multiplying this adjusted monthly outpatient visit rate (visits per month per 1,000 individuals) by the actual monthly prescribing rate for that condition (prescriptions per visit) gave the projected number of monthly antibiotic prescriptions (prescriptions per month per 1,000 individuals) had there been no change in observed disease. We subtracted the actual number of monthly antibiotic prescriptions per 1,000 individuals for each condition from these projections to obtain the number of prescriptions per 1,000 individuals avoided due to reductions in observed disease. To assess the sensitivity of our findings to longitudinal changes in the demographic and geographic characteristics of the study population, we repeated the analysis using Poisson regression adjusted for month (seasonality), age, sex, and beneficiary county.
We applied the same procedure to the monthly per-visit prescribing rate to project the number of antibiotic prescriptions avoided due to improvements in stewardship. Multiplying the projected (zero-slope) monthly prescribing rate (prescriptions per visit) by the actual outpatient visit rate (visits per month per 1,000 individuals) and subtracting from the actual number of prescriptions filled over the study period yielded the number of prescriptions per 1,000 individuals that would have been given in the absence of long-term changes in stewardship.
To examine national trends in observed disease, we calculated the slope of the annual incidence of observed disease per 1,000 people for the conditions that always or sometimes merit an antibiotic (tiers 1 and 2) and the conditions that never merit an antibiotic (tier 3) from the NAMCS dataset using linear regression2. For the tier 1 and 2 conditions, we examined the possibility that the trend in annual observed disease incidence may have changed slope between 2002 and 2015 by fitting a piecewise-linear regression with a single breakpoint. We considered possible breakpoints in each six-month interval in 2002-2015 (January 1st and July 1st of each year) and chose the breakpoint that yielded the fit with the minimum sum of squared errors.
Antibiotic prescribing has a strong seasonal trend given the increased prevalence of viral respiratory infections in the winter33. To compare winter vs. summer declines in antibiotic prescribing, we fit a seasonal (harmonic) regression model34 with variable amplitude to the monthly rate of antibiotic prescriptions per 1,000 individuals:
Here, yt is the number of antibiotic prescriptions filled in month t per 1,000 individuals, β0 and β1 are the intercept and slope of the mean monthly prescribing rate per 1,000 individuals, γ0 is the amplitude of the seasonality at the start of the study period, γ1 is the monthly change in the seasonal amplitude, δ is a horizontal shift, and εt is an error term assumed to have mean zero and constant variance over time. A transformation of variables (see Supplemental Information) allowed us to compare the change over time of the peak (winter) vs. trough (summer) antibiotic prescribing rates. Code is available at https://github.com/skissler/disease-stewardship-ms.
Results
The January antibiotic prescribing rate in Massachusetts declined from 78.5 prescriptions per 1,000 individuals in 2011 to 63.7 prescriptions per 1,000 individuals in 2015 (18.9% relative decrease), and the July antibiotic prescribing rate declined from 60.4 prescriptions per 1,000 individuals in 2011 to 52.2 prescriptions per 1,000 individuals in 2015 (13.6% relative decrease, Figure 1A). The mean monthly antibiotic prescribing rate declined by 42.8% (95% CI 21.7%, 59.4%) for children under the age of five (Figure 1B). Much of this decline is attributable to reduced wintertime prescribing: the winter monthly prescribing rate to children under the age of five declined at a rate of 1.2 prescriptions per 1,000 individuals per month (95% CI 0.89, 1.5) while the summer monthly prescribing rate declined at a rate of 0.30 prescriptions per 1,000 individuals per month (95% CI 0.012, 0.59) (Table S3, Figure S1).
Declines in observed disease and improvements in stewardship together contributed to an estimated 358 (95% CI 324, 391) avoided antibiotic prescriptions per 1,000 individuals in Massachusetts between 2011 and 2015. An estimated 59% (95% CI 54%, 63%) of this decline was attributable to reductions in observed disease (Table 1). There were significant declines (regression slope p-value<0.05) in the monthly outpatient visit rates per 1,000 individuals for bronchitis/bronchiolitis, otitis media (suppurative and non-suppurative), pharyngitis, pneumonia (bacterial and viral), sinusitis, and urinary tract infections (Figures S2—S3). Figure 2 depicts the monthly visit rates for two conditions with significant declines (sinusitis and suppurative otitis media) and two conditions with non-significant declines (miscellaneous bacterial infections and skin, cutaneous and mucosal infections); the remaining conditions are shown in the Supplemental Information.
The other 41% (95% CI 37%, 46%) of the overall decline in antibiotic prescribing was attributable to improved stewardship (Table 1). There were significant declines (regression slope p-value<0.05) in the monthly rate of antibiotic prescribing per outpatient visit for all conditions except influenza, miscellaneous bacterial infections, skin, cutaneous and mucosal infections, and urinary tract infections (Figures S4—S5). Figure 3 depicts the monthly per-visit antibiotic prescribing rates for two conditions with significant declines (sinusitis and suppurative otitis media) and two with non-significant declines (miscellaneous bacterial infections and skin, cutaneous and mucosal infections); the rest are depicted in the Supplemental Information. All findings were consistent with the demography- and geography-adjusted Poisson regression analysis (Table S4).
We evaluated whether an increase in prescribing antibiotics without an associated visit (phantom prescribing29) could account for the decline in outpatient visits for infectious disease indications. However, the proportion of prescriptions in each month that could not be linked to an outpatient visit decreased by 5.2% from 48.4% (95% CI 46.4%, 50.4%) to 43.2% (95% CI 41.2%, 45.2%), inconsistent with the hypothesis that an increase in phantom prescribing could explain decreased visits for infectious disease indications (Figure S6).
To evaluate whether the declines in visits for these indications seen in Massachusetts reflect national trends, and thus whether the trend in decreased observed disease might explain the national decrease in antibiotic prescribing, we assessed the annual visit rates per 1,000 people for antibiotic-meriting indications (tiers 1 and 2) and non-antibiotic-meriting conditions (tier 3)2 between 2002 and 2015 using the NAMCS dataset27 (Figure 4). There was no significant change in the annual incidence per 1,000 people for the tier 3 conditions (slope p-value = 0.09), but the annual incidence of the tier 1 and 2 conditions declined by 22.2% (95% CI 10.1%, 32.8%). A piecewise-linear fit to the annual visit rate per 1,000 people for the tier 1 and 2 conditions reveals an especially pronounced decline in incidence between 2010 and 2015 (Figure 4).
Discussion
Improved stewardship and reduced rates of observed disease together contributed to reducing antibiotic prescriptions by an estimated 358 per 1,000 individuals in Massachusetts between January 2011 and September 2015. This reduction in prescribing was especially pronounced for wintertime pediatric prescribing. Stewardship improved significantly for 16 of the 20 of the conditions we considered, while rates of observed disease declined significantly for eight conditions, seven of which are associated with respiratory infections. The estimated number of prescriptions avoided through reduced disease were somewhat higher than the number avoided through improved stewardship. Our findings suggest that the prevention of diseases that prompt health care visits, especially respiratory diseases, should be considered alongside antibiotic stewardship as a way to reduce antibiotic prescribing.
The reasons behind the reduced rate of outpatient visits remain unclear. Much of the decline in observed disease might be attributable to respiratory illness prevented by the administration of PCV13 to children.12,35 The national decline in outpatient visits for antibiotic-meriting illnesses beginning in 2010 is consistent with this hypothesis, as are the declines in otitis media, sinusitis, bronchitis/bronchiolitis, pneumonia, and overall pediatric wintertime antibiotic prescribing in Massachusetts between 2011 and 2015. Evidence from randomized controlled trials indicate that pneumococcal vaccination reduces rates of antibiotic use36 and reduces the burden of antibiotic resistant infections.37 However, changing patient perceptions regarding antibiotics or mounting barriers to health care could also have led to an increasing tendency to self-care for minor illnesses, though, in this model, the unchanging rates of visits for other infectious indications would indicate that such trends in self-care are indication specific. Further studies are needed to distinguish between these possibilities.
Antibiotic stewardship played an integral role in reducing antibiotic prescribing in Massachusetts between 2011 and 2015. This is consistent with reports of successful antibiotic stewardship programs nationally38. We anticipate that these programs will remain key elements of strategies to reduce antibiotic prescribing and combat the rise of antibiotic resistance. However, there is a growing recognition that other strategies, including patient education and vaccination, will be required to achieve maximal reductions in antibiotic prescribing39,40. These preventative strategies have generally been regarded as secondary to stewardship. Our findings challenge the focus on stewardship by demonstrating that disease prevention can produce declines in antibiotic prescribing similar in magnitude to those achieved through stewardship, even when antibiotic prescribing was not an express target of those prevention measures.
Our findings are subject to a number of limitations. We only considered outpatient antibiotic prescriptions; however, these account for 80-90% of all antibiotic prescriptions41, so we believe we have captured the majority of prescriptions given in Massachusetts during the study period. Our analysis was limited to antibiotics that generated an insurance claim, omitting any that may have been obtained through less traditional routes. Also, we were unable to link a substantial minority of antibiotic claims with outpatient visits, and while these may represent a roughly random sample of all of the observed prescriptions, it is unclear if our conclusions about the linked prescriptions extend to the unlinked prescriptions. Finally, the geographic scope of our analysis was limited to one state, though we note that substantial declines in the incidence of antibiotic-meriting conditions occurred nationally during the same timeframe.
Conclusions
Reductions in observed disease and improved stewardship similarly contributed to the decline in antibiotic prescribing in Massachusetts between 2011 and 2015. Our findings indicate that disease prevention could constitute a viable strategy for reducing antibiotic prescribing, on par with antibiotic stewardship. Further investigation into the causes of recent declines in respiratory disease could reveal new opportunities for intervention.
Data Availability
Massachusetts APCD data are available from the Center for Health Information and Analysis[25]. NAMCS data are available from the Centers for Disease Control and Prevention[27]. Code for reproducing our analysis is available at https://github.com/skissler/disease-stewardship-ms.
Funding statement
No funding was received for conducting this work. The authors were employees of the Harvard Chan School of Public Health or Massachusetts Department of Public Health.
Supplemental materials and methods
Measuring winter and summer declines in prescribing
To assess the difference between winter and summer declines in antibiotic prescribing in the under-five age group, we used nonlinear least squares regression as implemented in the Non-linearModelFit[] function in Mathematica2 to fit a sinusoid of the following form to the monthly number of antibiotic claims per 1,000 beneficiaries:
Here, yt is the number of antibiotic claims per 1,000 beneficiaries in month t, ut is the upper boundary of the sinusoid in month t, lt is the lower boundary of the sinusoid in month t, and δ is the horizontal phase shift of the sinusoid in months. We assumed that the upper and lower boundaries of the sinusoid were linear trends defined by the linear equations
Here, ε0 and ν0 are the intercepts of the upper and lower boundaries of the sinusoid, respectively, and ε1 and ν1 are the slopes. This is equivalent to Eq. (1) in the main text under the following transformation of variables:
The fitting algorithm identified the maximum likelihood values for the parameters μ0, μ1, ν0, ν1, and δ. Table S1 gives the fitted values for those parameters with 95% confidence intervals. Figure S1 depicts the fitted sinusoid with the envelope defined by ut and lt.