PT - JOURNAL ARTICLE AU - Vsevolozhskaya, Olga A. AU - Manz, Karina C. AU - Zephyr, Pierre M. AU - Waters, Teresa M. TI - Measurement Matters: Changing Penalty Calculations under the Hospital Acquired Condition Reduction Program (HACRP) Cost Hospitals Millions AID - 10.1101/2020.10.19.20215194 DP - 2020 Jan 01 TA - medRxiv PG - 2020.10.19.20215194 4099 - http://medrxiv.org/content/early/2020/10/21/2020.10.19.20215194.short 4100 - http://medrxiv.org/content/early/2020/10/21/2020.10.19.20215194.full AB - Background Since October 2014, the Centers for Medicare and Medicaid Services has penalized 25% of U.S. hospitals with the highest rates of hospital-acquired conditions under the Hospital Acquired Conditions Reduction Program (HACRP). While early evaluations of the HACRP program reported cumulative reductions in hospital-acquired conditions, more recent studies have not found a clear association between receipt of the HACRP penalty and hospital quality of care. We posit that some of this disconnect may be driven by frequent scoring updates. The sensitivity of the HACRP penalties to updates in the program’s scoring methodology has not been independently evaluated.Methods We used hospital discharge records from 14 states to evaluate the association between changes in HACRP scoring methodology and corresponding shifts in penalty status. To isolate the impact of changes in scoring methods over time, we used FY2018 hospital performance data to calculate total HAC scores using FY2015 through FY2018 CMS scoring methodologies.Results Comparing hospital penalty status based on various HACRP scoring methodologies over time, we found a significant overlap between penalized hospitals when using FY 2015 and 2016 scoring methodologies (95%) and between FY 2017 and 2018 methodologies (46%), but substantial differences across early vs later years. Only 15% of hospitals were eligible for penalties across all four years. We also found significant changes in a hospital’s (relative) ranking across the various years, indicating that shifts in penalty status were not driven by small changes in HAC scores clustered around the penalty threshold.Conclusions HACRP penalties have been highly sensitive to program updates, which are generally announced after performance periods are concluded. This disconnect between performance and penalties calls into question the ability of the HACRP to improve patient safety as intended.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThis study received funding support from Agency for Healthcare Research and Quality (R01HS025148).Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Not applicable.All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).Yes I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe data that support the findings of this study are available from the Healthcare Cost and Utilization Project (HCUP), but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are, however, available from the authors upon reasonable request and with permission of HCUP.HACRPHospital acquired conditions reduction programHACHospital-acquired conditionsCMSCenters for medicare and medicaid servicesAHRQAgency for healthcare research and qualityCDCCenters for disease control and preventionPSIPatient safety indicatorNHSNNational healthcare safety networkHAIHealthcare associate infectionFYfiscal yearHCUPHealthcare cost and utilization projectSIDState inpatient databasesSIRstandardized infection ratioCLABSIcentral line-associated bloodstream infectionCAUTIcatheter-associated urinary tract infectionSSIsurgical site infectionMRSAmethicillin-resistant staphylococcus aureusCDIclostridium difficile infectionICDInternational classification of diseases