Step-downs reduce workers’ compensation payments to encourage return to work. Are they effective? =================================================================================================== * Tyler J Lane * Luke R Sheehan * Shannon E Gray * Dianne Beck * Alex Collie ## Abstract **Objective** To determine whether step-downs, which cut the rate of compensation paid to injured workers after they have been on benefits for several months, are effective as a return to work incentive. **Methods** We aggregated administrative claims data from seven Australian workers’ compensation systems to calculate weekly scheme exit rates, a proxy for return to work. Jurisdictions were further subdivided into four injury subgroups: fractures, musculoskeletal, mental health, and other trauma. The effect of step-downs on scheme exit was tested using a regression discontinuity design. Results were pooled into meta-analyses to calculate combined effects and the proportion of variance attributable to heterogeneity. **Results** The combined effect of step-downs was a 0.86 percentage point (95% CI -1.45 to -0.27) reduction in the exit rate, with significant heterogeneity between jurisdictions (*I*2 = 68%, *p* = .003). Neither timing nor magnitude of step-downs was a significant moderator of effects. Within injury subgroups, only fractures had a significant combined effect (-0.84, 95% CI -1.61 to -0.07). Sensitivity analysis indicated potential effects within mental health and musculoskeletal conditions as well. **Conclusions** The results suggest some workers’ compensation recipients anticipate step-downs and exit the system early to avoid the reduction in income. However, the effects were small and suggest step-downs have marginal practical significance. We conclude that step-downs are generally ineffective as a return to work policy initiative. **What is already known about this subject?**A number of workers’ compensation systems around the world reduce payments to injured workers after they have been in the system for several months. In Australia, where each state, territory, and Commonwealth system employs step-downs, the stated policy objective is to increase the rate of return to work through financial incentives. However, there is little empirical evidence to either support or reject this claim. **What are the new findings?**The rate at which claimants exited workers’ compensation systems increased ahead of step-downs taking effect, suggesting an anticipatory effect. However, the effect was relatively small, changing the exit rate by less than a percentage point overall, with substantial heterogeneity between systems. **How might this impact on policy or clinical practice in the foreseeable future?**While statistically significant, the findings suggest that step-downs provide workers’ compensation claimants little incentive to return to work. Policymakers may need to reconsider step-downs as a component of scheme design, or justify them according to their original purpose, which was to save costs. Keywords * Regression discontinuity * workers’ * compensation * return to work ## Introduction Step-downs reduce the rate of income replacement paid to injured workers after they have been on benefits for a period of several months. They are found in a number of workers’ compensation systems around the world, including several in Europe (Andorra, Croatia, Slovakia, Sweden), Africa (Ethiopia, Republic of Congo, São Tomé and Príncipe, Zimbabwe), Asia (Indonesia, Laos, Singapore, Taiwan), Central America (Belize, Panama), the Middle East (Kuwait, Oman, Qatar), South America (Ecuador),1 and one American state (Ohio).2 Unique among these is Australia, where each of its nine major workers’ compensation systems implements step-downs.3 Step-downs are promoted as an incentive for claimants to return to work.4–6 However, there is little direct empirical evidence to support this claim,7,8 and that which exists is generally inconclusive.6,9 It also contrasts with the original purpose of step-downs when introduced across Australia in the 1980s and 90s, which was to reign in the rising cost of employers’ insurance premiums.7 Nevertheless, evidence that more generous benefits increase time off work indicates that an incentivising effect is plausible.4 We test whether step-downs increase the rate at which claimants exit workers’ compensation, and moderating effects of their timing and magnitude. Building on evidence that effects of benefit generosity vary by injury,10 we also tested effects in claims for fractures, mental health conditions, musculoskeletal conditions, and other trauma subgroups. ## Methods Study questions and analyses were pre-registered with the Open Science Framework.11 We reproduce the analytical approach here and note any deviations. ### Step-downs in Australia Australia’s six states, two territories, and Commonwealth government have their own workers’ compensation system for injured workers, which cover 94% of the workforce.12 Each scheme is cause-based, meaning benefits are contingent on attribution of the condition, whether an acute injury or gradual onset disease (collectively referred to as “injury” in this paper), to employment.13 There are considerable differences in overarching policy settings, including whether the scheme allows common law claims, is publicly or privately underwritten, and generosity of benefits.3 While each system employs step-downs, they vary in both timing and magnitude, as illustrated in Table 1. View this table: [Table 1.](http://medrxiv.org/content/early/2020/03/03/19012286/T1) Table 1. Wage replacement rate by jurisdiction and time on workers’ compensation benefits, up to 104 weeks; rate changes and values indicated with heatmap. Data derived from the Comparison of Workers’ Compensation Arrangements in Australia and New Zealand reports.3 Most of these systems have wage replacement caps that set a nominal maximum on what claimants may earn, and a few have minimums. In Queensland, claimants with an industrial agreement, which is a certified specification of industrial matters between employees and employers, are initially compensated at the greater of 85% their Normal Weekly Earnings (NWE, based on individual pre-injury earnings) or the industrial instrument, which at 26 weeks steps-down to the greater of 75% NWE or 70% Queensland Ordinary Time Earnings (QOTE, based on state mean earnings). Claimants not under an industrial instrument are initially compensated at the greater of 85% NWE or 80% QOTE, and step-down to the greater of 75% NWE or 70% QOTE. In the Northern Territory, step-downs are the greater of 1) 75% of weekly earnings up to a maximum nominal cap, or 2) the lesser of a flat rate plus additional income for each dependent or 90% of NWE. In Western Australia, claimants with an industrial agreement are not subject to step-downs and are compensated at 100% of their regular earnings throughout the life of the claim. However, overtime, bonuses, and allowances are compensated up to 13 weeks but not afterwards,14 meaning workers who rely on these extra sources of income are effectively subject to step-downs, though of varying magnitudes. Step-down rates are higher in Tasmania and Comcare (the Commonwealth system) if the claimant is back at work in some form of partial capacity.4,14 In these cases, the magnitude of initial and step-down compensation rates vary, though timings remained the same. In Victoria and to a lesser extent New South Wales, claimants from unionised industries often have industrial awards and enterprise agreements that top up payments and can make up any gaps between pre-injury earnings compensation.7,8 We were unable to account for these arrangements nor determine what proportion of the population was affected by them. ### Data Data were derived from the *National Data Set for Compensation-based Statistics*, an amalgamation of case-level administrative claims data from each system that is compiled by Safe Work Australia.15 The pre-registered inclusion criterion restricted eligibility to claims lodged since either July 2009 or the most recent change to step-down arrangements, whichever latest, up to June 2015. For instance, in July 2011 Tasmania altered step-down arrangements via legislative amendment. Only claims lodged afterwards were included in analyses. Post hoc, we added several other exclusions: * Claims affected by minimum and maximum caps for weekly payments * Claims lodged after June 2014 in South Australia to allow a one-year buffer with the change in step-downs arrangements implemented in July 2015 * Claims exempted from New South Wales’ 2012 legislative amendments, including several occupations (police, paramedics, firefighters, and coalmine workers) and dust diseases3 Our outcome – weekly scheme exit rate – was determined using cumulative compensated time off work. While scheme exit does not necessarily entail return to work, and cumulative compensated time off work underestimates the total actual duration, it is nevertheless considered the most accurate measure of time off work when using administrative data.16 Several jurisdictions including Victoria and South Australia determine the application of step-downs by counting any calendar week in which there was compensated time loss as a full week,6,17,18 whereas Comcare uses cumulative compensated time off work.4 In the Victorian and South Australian systems, this means that for some claims, step-downs applied earlier than specified in our analyses. ### Analysis We calculated scheme exit rates by dividing the number of claims exiting the system each week by those in it at the start of that week. Injury subgroups included fractures, mental health conditions, musculoskeletal conditions, and other trauma. Our pre-registered categorisation separated back and neck from other musculoskeletal conditions, though we have since decided to keep them together as a better conceptual fit. Neurological conditions and all other conditions were excluded due to low numbers. Data were left-censored at four weeks to exclude residual effects of employer excess, which are the post-injury periods for which employers are responsible for compensation payments. Anecdotal reports suggest claims are less likely to persist only a day or two beyond the employer excess period, tending either to resolve before the employer excess period ends, or to persist for a few days beyond that. In Australia, the longest employer excess periods are 10 working days/two weeks in Victoria/South Australia.3 We determined *a priori* that four weeks, while arbitrary, would be sufficient to remove any confounding due to this effect. Exit rates were calculated up to two years, or 104 weeks. Effects were evaluated with a regression discontinuity design, a powerful quasi-experimental approach that compares outcomes on either side of an arbitrary cut-off. When individuals are unable to control which side of the cut-off they are on, regression discontinuity simulates a randomised control trial.19,20 In this study, the assumption was inverted in that we evaluated whether claimants crossed this threshold. This means we cannot treat individuals on either side of the step-down cut-off as exposed or control groups and must interpret the results more cautiously.21 We incorporated parametric polynomial estimators to account for non-linear patterns in exit rates, testing up to 10 polynomial terms with separate or same slopes, erring on the side of overfitting,20 and selected best-fit models based on the Akaike Information Criterion.19 Initially, we tested only separate slopes, but in several cases the fitted lines noticeably diverged from data points near the step-down cut-off. Testing same-slope models as well addressed these issues. Results are reported as the percentage point change to the exit rate. Coefficients and standard errors were combined into random effects meta-analyses to determine combined effects and the proportion of variance attributable to heterogeneity. We tested the moderating effect of step-down timing and magnitudes using meta-regressions. Exit rates within a few subgroups became unstable as the number of claims in the system diminished over time. To account for this, we excluded data points where the number of remaining claimants for the week was <500, and did not conduct analyses where there were <20 aggregated data points after the step-down. To illustrate the issue, data points in regression discontinuity plots are coloured black where included and grey where excluded. These exclusions were an *ad hoc* approach to an analytical problem that only became apparent as we examined the full dataset. As a result, neither Tasmania nor the Australian Capital Territory had sufficient data and were thus excluded from analyses. ### Statistical software and analysis packages Analyses were conducted in R with RStudio using the following packages: *ggpubr*,22 *lubridate*,23 *metafor*,24 *metaviz*,25 *rdd*,26 *rddtools*,27 *scales*,28 *see*,29 *tidyverse*,30 and *zoo*.31 Aggregated data and R code are available on a FigShare repository.32 ## Results Data counts with crosstabulations for jurisdiction and injury type are summarised in Table 2. In total there were *N* = 294,732 claim records in this study, the majority of which were musculoskeletal (*N* = 177,623, 60%). The findings were first presented at the Actuaries Institute Injury and Disability Schemes Seminar in Canberra on 11 November 2019. View this table: [Table 2.](http://medrxiv.org/content/early/2020/03/03/19012286/T2) Table 2. Count and row percent of included claims by jurisdiction and injury type ### Step-down impact on scheme exit rates Across jurisdictions, the combined effect of step-downs on exit rates was a reduction of 0.86-percentage points (95% CI: -1.45 to -0.27). A significant, moderate proportion of the variance in effects was attributable to heterogeneity between jurisdictions (*I* 2= 68%, *p* = .003). Within individual schemes, all significant effects were negative. Three of four significant effects were observed in jurisdictions with the earliest step-downs, occurring at 13 weeks: New South Wales (-1.65, -3.25 to -0.06), Western Australia (-1.65, -3.07 to -0.23), and South Australia (-2.24, -3.38 to -1.10). Victoria also had a 13-week step-down, though the effect was non-significant (0.03, -0.88 to 0.95). The only significant effect outside of 13 weeks was in Comcare, where step-downs occur at 45 weeks (-1.29, -2.25 to -0.34). However, meta-regressions found that neither the timing (0.01, -0.08 to 0.09) nor magnitudes (0.02, -0.13 to 0.17) of step-downs significantly moderated the effect on exit rates. Results are summarised in Figure 1, and regression discontinuities are plotted in Figure 2. ![Figure 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/03/03/19012286/F1.medium.gif) [Figure 1.](http://medrxiv.org/content/early/2020/03/03/19012286/F1) Figure 1. Meta-analysis forest plot of jurisdictional and combined effects of step-downs. Band thickness reflects meta-analytic weight of each jurisdiction ![Figure 2.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/03/03/19012286/F2.medium.gif) [Figure 2.](http://medrxiv.org/content/early/2020/03/03/19012286/F2) Figure 2. Regression discontinuity plots illustrating impact of step-downs on exit rates by jurisdiction. Grey data points indicate excluded data (<500 denominator cases) ### Sensitivity analysis – confounding from competing incentives We identified potential confounding from competing scheme incentives such as 10% insurance premiums discounts in New South Wales for employers who return claimants to work within 13 weeks33 and bonuses for claims agents in Victoria who keep the rate of claims reaching 13 weeks low.34 Other such incentives may exist, though consultation with scheme representatives indicated this information is often confidential as a private arrangement between insurers and employers. We conducted sensitivity analyses on claimants unaffected by step-downs, which were identified based on pre-injury wages and maximum and minimum wage replacement caps. Significant changes among these claims would be evidence of confounding. Only three jurisdictions (Victoria, Queensland, and Western Australia) had sufficient data for this analysis. Effects were non-significant individually and combined (0.16, -0.50 to 0.82). These results are summarised in Supplementary Figure 1. ![Supplementary Figure 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/03/03/19012286/F4.medium.gif) [Supplementary Figure 1.](http://medrxiv.org/content/early/2020/03/03/19012286/F4) Supplementary Figure 1. Sensitivity analysis - claims unaffected by step-downs. Regression discontinuity plots and meta-analysis. ### Step-down impact by injury type Combined effects were significant only among fracture claims (-0.84, -1.61 to -0.07). Heterogeneity between sites was non-significant (*I*2 = 25%, *p* = .087). Meta-analyses by injury are summarised in Figure 3, and regression discontinuity plots are presented in Supplementary Figures 2 to 5. ![Supplementary Figure 2.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/03/03/19012286/F5.medium.gif) [Supplementary Figure 2.](http://medrxiv.org/content/early/2020/03/03/19012286/F5) Supplementary Figure 2. Fracture subgroup regression discontinuity plots. ![Figure 3.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/03/03/19012286/F3.medium.gif) [Figure 3.](http://medrxiv.org/content/early/2020/03/03/19012286/F3) Figure 3. Meta-analysis forest plot of jurisdictional and combined effects of step-downs by injury subgroup. Band thickness reflects meta-analytical weight of each jurisdiction. See Supplementary Figures 2-5 for individual regression discontinuity plots. ### Sensitivity analysis – step-down impact by injury type While combined effects were non-significant in mental health, musculoskeletal, and other trauma claims, magnitudes were similar across all injury types (-0.50 to -1.45) with considerable overlap in confidence intervals. There were also indications that a single jurisdiction was responsible for attenuation to non-significance in some injuries, such as the lone positive effect among musculoskeletal conditions in the Northern Territory (1.00, 0.04 to 1.96). We conducted “leave one out” sensitivity analyses, 25 which tested the effect of dropping each jurisdiction from meta-analyses. Combined effects for mental health conditions became significant with the exclusion of both Comcare (-1.74, -3.41 to -0.08) and South Australia (-1.71, -3.42 to 0.00), and for musculoskeletal conditions with the exclusion of the Northern Territory (-0.69, -1.35 to -0.03). Other trauma claims remained non-significant. These results are presented in Supplementary Figure 6. ![Supplementary Figure 3.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/03/03/19012286/F6.medium.gif) [Supplementary Figure 3.](http://medrxiv.org/content/early/2020/03/03/19012286/F6) Supplementary Figure 3. Mental health regression discontinuity plots. ![Supplementary Figure 4.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/03/03/19012286/F7.medium.gif) [Supplementary Figure 4.](http://medrxiv.org/content/early/2020/03/03/19012286/F7) Supplementary Figure 4. Musculoskeletal regression discontinuity plots. ![Supplementary Figure 5.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/03/03/19012286/F8.medium.gif) [Supplementary Figure 5.](http://medrxiv.org/content/early/2020/03/03/19012286/F8) Supplementary Figure 5. Other trauma regression discontinuity plots. ![Supplementary Figure 6.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/03/03/19012286/F9.medium.gif) [Supplementary Figure 6.](http://medrxiv.org/content/early/2020/03/03/19012286/F9) Supplementary Figure 6. Sensitivity analysis – “leave one out” meta-analysis by injury subgroup. ## Discussion ### Interpretations of step-down effects on scheme exit rates The local effect of step-downs on scheme exit rates was negative. The first potential explanation is that step-downs reduce the likelihood of return to work. This seems implausible given its lack of theoretical coherence and evidence that greater benefit generosity is positively associated with claim duration.10,35 The second interpretation is that step-downs have an anticipatory effect, where claimants leave compensation system early avoid reductions in income. As evidence for this interpretation, regression discontinuity plots suggest that where effects were statistically significant, scheme exit rates increased in the week prior to step-down. An alternative explanation posits that we mis-specified step-downs as occurring earlier than they actually do. This would be the result of our use of cumulative determinations of when step-downs apply contrary to jurisdictions that use calendar determinations, leading to discrepancies. For instance, in Victoria and South Australia, a claimant who works one day a in a five-day workweek would be subjected to a step-down after 13 weeks. In our dataset, this would correspond to 13 days or 2.6 weeks of compensated time off work and we would not count them as being affected by step-downs. However, we have identified several reasons to reject these discrepancies as the driver of the negative effect. For one, there were significant anticipatory effects in Comcare, where step-downs are determined by cumulative compensated time off work,4 as in our determination. For another, divergent estimates would be attributable to failed return to work attempts and graduated/partial working arrangements. Such claimants have demonstrated positive action to return to work and financial incentives may not provide a sufficient motivation to achieve sustained return to work. Additionally, claimants with graduated/partial working arrangements are less affected by step-downs since only the compensated portion of their wages are reduced. In Comcare, step-downs magnitudes decrease for claimants with partial working arrangements.4 We would also expect such exits to be more evenly distributed prior to step-downs. Instead, as noted above RDD plots suggest they are clustered in the week prior to step-down in a manner that deviates from the secular trend. This suggests these claimants are maximising payments under the higher initial rate of compensation. Our analytical approach – the regression discontinuity design – can only test local effects, i.e., at the cut-off. Evidence that greater benefit generosity increases time off work10,35 suggests step-downs may still have longer-term effects, even where there are no local effects. Plotted exit rate patterns generally indicate continuing logarithmic decay, particularly where local effects were non-significant. While this does not rule out longer-term effects, it suggests they are at most relatively small. ### Heterogeneity of effects and potential causes A moderate proportion of the variance in effects was attributable to heterogeneity. While neither the timing nor magnitude of step-downs were a significant moderator, there were only eight data points for the meta-regression, limiting statistical power. These factors may yet explain some of the differences in effect. For instance, most significant effects were observed among step-downs occurring at 13 weeks, the earliest timing. This aligns with employer and policymaker opinion that delaying step-downs diminishes their effectiveness.4,5 However, the 45-week Comcare step-down, the latest tested in this study, also had a significant effect. This suggests unmeasured factors such as the presence of organised unions, who can warn claimants about impending step-downs, may modify step-down effects, regardless of timing. ### Effects by type of injury There were significant combined effects in fracture claims and more tenuous evidence for effects in mental health and musculoskeletal condition claims. Fractures are generally considered less responsive to benefit generosity since they are more visible and easier to diagnose35 with less variability in recovery time.36 In other words, there is less discretionary time off work that may be influenced by benefits. Though contrary to expectations, the findings are not unprecedented. We previously found time off work among fracture claims sharply increased after Victoria raised the maximum wage replacement cap from 150% to 200% of average state earnings.10 This may be explained by the subset of fracture claims exposed to step-downs. Supplementary Figure 2 illustrates that unlike other injuries, fracture exit rates peak around two months post-claim, possibly reflecting the natural course of recovery.36 Claims exceeding this peak will be more complex on average and may be more responsive to benefit generosity.37 Mental health conditions are less visible and harder-to-diagnose, characteristics thought to increase sensitivity to benefit generosity. To our knowledge, our previous work is the only empirical investigation of how such claims respond to rate of compensation, though we found no evidence of an effect.10 However, the previous study examined the effect of initial rates of compensation, while here we measure a change in that rate. The psychological vulnerability of mental health claimants may mean the act of cutting benefits has a greater effect on scheme exit than variations in what they are paid from the start. Musculoskeletal conditions are similarly less visible and harder-to-diagnose, with a substantial body of literature demonstrating sensitivity to benefit generosity.35 The findings for other trauma were non-significant, though it would be premature to dismiss this as no effect given the combined point estimate was the largest in magnitude. Null results do not necessarily entail null effects. ### Statistical versus practical significance of findings While the findings were statistically significant, practical significance is less clear. For one, effects were fairly small. At the state level, the largest effect was -2.24 in South Australia. At injury level, the biggest effect was -5.28 among mental health claims in South Australia, though this and the other larger injury effect estimates had wide confidence intervals. Nevertheless, if these are reflective of the maximum potential impact of step-downs, they remain marginal. And if they are indeed anticipatory, the effects may be short-lived, with scheme exit rates returning to normal shortly after step-downs apply. Step-downs may have negative side effects on claimants. They have been linked to financial strain,6,38 which could worsen outcomes or even delay scheme exit, particularly later in the process.37 Further, economically-motivated return to work such as that driven by compensation benefits can increase the likelihood of reinjury.39 Scheme exit does not necessarily entail return to work and may result in cost-shifting to other income replacement systems.8,40 However, it seems unlikely that those who leave workers’ compensation in response to step-downs would go elsewhere if the causal mechanism is financial pressure. Other government-provided incapacity benefits are less generous than workers’ compensation.3,40 Some claimants may retire as this option generally entails less financial stress than other.41 However, these inferences assume an informed, calculated, and rational economic response to financial incentives. The cut in benefits may induce a negative psychological reaction in some claimants and lead to a scheme exit that is neither return to work nor an alternative that improves financial well-being. Meta-analyses suggested there was a moderate amount of heterogeneity between jurisdictions, which makes it difficult to make inferences about generalisability. However, the effects varied from small to approximately null, with a positive effect in a single subgroup (musculoskeletal conditions in the Northern Territory). The findings may be applicable to similarly cause-based, devolved workers’ compensation systems in developed economies like Canada and the United States, or other disability-based systems in developed countries, though it is unclear what the effects may be in underdeveloped settings. ### Strengths and limitations This study has several limitations, some we have already mentioned including discrepancies in determination of step-downs and inconsistent application of step-downs for some claimants. Regression discontinuity designs assume populations around the cut-off are unable to manipulate what condition they are exposed to.19 Our study inverted this assumption, since claimants were reacting to the step-down cut-off rather than being allocated by it to separate conditions. The theoretical implications are unclear, though it may provide greater flexibility in interpretation. Rather than simulating a randomised controlled trial as is the case when regression discontinuities meet certain assumptions,20 we can interpret the findings more qualitatively.21 Similar natural experiment designs like the interrupted time series also consider anticipatory effects.42 However, this means we also lose some of the strength in making causal attributions that a simulated randomised controlled trial would provide. This study also has several strengths. We applied a robust quasi-experimental approach, the regression discontinuity design, to national workers’ compensation data with population-level coverage. There were sufficient data to investigate impact by jurisdiction and most injury subgroups, and meta-analysis increased precision of estimates and provided evidence that effects varied by jurisdiction. Sensitivity analyses provided evidence that effects were not attributable to co-occurring incentives that may have confounded results. ## Conclusions The findings suggest that step-downs have an anticipatory effect, leading some workers’ compensation recipients to leave the system early in anticipation of a reduction in income. However, the effects are small and probably short-lived. Step-downs may still reduce costs to workers’ compensation systems, which is a legitimate policy goal. However, our findings suggest step-downs have marginal practical significance and are generally ineffective as a return to work policy initiative. ## Data Availability Aggregated data are publicly available on a FigShare repository, along with analytical code. Case-level data contain identifiable information and have not made available. We have provided cleaning file data at the FigShare repository to demonstrate our approach. The data source is the National Data Set for Compensation-based Statistics, provided by Safe Work Australia [https://doi.org/10.26180/5dba1e5b4277a](https://doi.org/10.26180/5dba1e5b4277a) ## Ethics This study received ethics approval from the Monash University Human Research Ethics Committee (CF14/2995 – 2014001663). ## Funding This study was funded by an Australian Research Council Discovery Project Grant (DP190102473), as part of the Compensation and Return to Work Effectiveness (COMPARE) Project, and by Safe Work Australia, a government statutory agency that develops national work health and safety and workers’ compensation policy. ## Conflicts of interest The authors previously received salary support from funding provided by the workers’ compensation systems investigated in this study. ## Acknowledgements We would like to thank the COMPARE Project’s Advisory Group who provided valuable insight when interpreting the results. We would also like to thank the two anonymous peer reviewers who provided invaluable commentary and greatly improved the quality of the manuscript. * Received November 13, 2019. * Revision received March 2, 2020. * Accepted March 3, 2020. * © 2020, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution 4.0 International), CC BY 4.0, as described at [http://creativecommons.org/licenses/by/4.0/](http://creativecommons.org/licenses/by/4.0/) ## References 1. 1.Social Security Administration. Social Security Programs Throughout the World. Social Security Programs Throughout the World. [https://www.ssa.gov/policy/docs/progdesc/ssptw/](https://www.ssa.gov/policy/docs/progdesc/ssptw/). accessed August 16, 2019. 2. 2.Texas Department of Insurance Workers’ Compensation Research Group. Comparison of State Workers’ Compensation Systems. Austin, TX [https://senate.texas.gov/cmtes/78/c780/comprswcompn0325.pdf](https://senate.texas.gov/cmtes/78/c780/comprswcompn0325.pdf). 3. 3.Safe Work Australia. Comparison of workers’ compensation arrangements in Australia and New Zealand. [https://www.safeworkaustralia.gov.au/collection/comparison-workers-compensation-arrangements-australia-and-new-zealand](https://www.safeworkaustralia.gov.au/collection/comparison-workers-compensation-arrangements-australia-and-new-zealand). Published 2019. accessed August 16, 2019. 4. 4.Department of Employment. Inquiry into the Safety, Rehabilitation and Compensation Amendment (Improving the Comcare Scheme) Bill 2015. Canberra, AU; 2015. 5. 5.Australian Industry Group. Independent Review of the Administration and Operation of the South Australian Return to Work Act 2014.; 2018. [https://www.agd.sa.gov.au/sites/default/files/submission\_review\_of\_the\_return\_to\_work\_act\_13.3.18\_final.pdf?v=1521521970](https://www.agd.sa.gov.au/sites/default/files/submission\_review\_of\_the\_return\_to\_work_act_13.3.18_final.pdf?v=1521521970). 6. 6.Cossey B, Latham C. Review of the Impact of the Workers Rehabilitation and Compensation (Scheme Review) Amendment Act 2008.; 2011. 7. 7.Purse K. Australian workers’ compensation policy: conflict, step-downs and weekly payments. Int Employ Relations Rev. 2003;9(1):23–44. 8. 8.Purse K, Meredith F, Guthrie R. Neoliberalism, workers’ compensation and the productivity commission. J Aust Polit Econ. 2003;54:45–66. 9. 9.Gray SE, Lane TJ, Hassani-Mahmooei B, Collie A. Evaluating the success of legislative amendments designed to reduce work disability. Policy Des Pract. 2019;2(3):291–304. doi:10.1080/25741292.2019.1610147 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1080/25741292.2019.1610147&link_type=DOI) 10. 10.Lane TJ, Gray SE, Sheehan LR, Collie A. Increased benefit generosity and the impact on workers’ compensation claiming behavior. J Occup Environ Med. 2019;61(3):e82–e90. doi:10.1097/jom.0000000000001531 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1097/jom.0000000000001531&link_type=DOI) 11. 11.Lane TJ. Step-downs in wage replacement rates across workers’ compensation jurisdictions in Australia: impact on scheme exit rate - public pre-registration of research questions and analytical approach. Open Science Framework. [https://osf.io/pt876/](https://osf.io/pt876/). Published 2019. accessed November 6, 2019. 12. 12.Lane TJ, Collie A, Hassani-Mahmooei B. Work-Related Injury and Illness in Australia, 2004 to 2014. Melbourne, AU; 2016. 13. 13.1. Loisel P, 2. Anema JR Lippel K, Lötters F. Public Insurance Systems: A Comparison of Cause-Based and Disability-Based Income Support Systems. In: Loisel P, Anema JR, eds. Handbook of Work Disability. New York, NY: Springer; 2013:183–202. doi:10.1007/978-1-4614-6214-9 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/978-1-4614-6214-9&link_type=DOI) 14. 14. WorkCover Tasmania. A Guide to Workers Rehabilitation and Compensation in Tasmania. Hobart, AU; 2017. 15. 15.Safe Work Australia. National Data Set for Compensation-Based Statistics Third Edition. Canberra, AU; 2004. 16. 16.Krause N, Dasinger LK, Deegan LJ, Brand RJ, Rudolph L. Alternative approaches for measuring duration of work disability after low back injury based on administrative workers’ compensation data. Am J Ind Med. 1999;35(6):604–618. doi: 10.1002/(SICI)1097-0274(199906)35:6<604::AID-AJIM8>3.0.CO;2-T [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/(SICI)1097-0274(199906)35:6<604::AID-AJIM8>3.0.CO;2-T&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=10332514&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F03%2F03%2F19012286.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000080176600008&link_type=ISI) 17. 17.WorkSafe Victoria. Claims Manual. [http://www1.worksafe.vic.gov.au/vwa/claimsmanual/Home.htm](http://www1.worksafe.vic.gov.au/vwa/claimsmanual/Home.htm). Published 2019. accessed August 21, 2019. 18. 18.Parliament of South Australia. Workers Rehabilitation and Compensation (Scheme Review) Amendment Act 2008.; 2008. 19. 19.Lee DS, Lemieux T. Regression discontinuity designs in economics. J Econ Lit. 2010;48(2):281–355. doi:10.1257/jel.48.2.281 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1257/jel.48.2.281&link_type=DOI) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000279239600001&link_type=ISI) 20. 20.Shadish WR, Cook TD, Campbell DT. Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Boston, MA: Houghton Mifflin; 2002. 21. 21.Hausman C, Rapson DS. Regression discontinuity in time: considerations for empirical applications. Annu Rev Resour Econ. 2018;10(1):533–552. doi:10.1146/annurev-resource-121517-033306 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1146/annurev-resource-121517-033306&link_type=DOI) 22. 22.Kassambara A. ggpubr: “ggplot2” Based Publication Ready Plots. 2019. [https://cran.r-project.org/package=ggpubr](https://cran.r-project.org/package=ggpubr). 23. 23.Grolemund G, Wickham H. Dates and Times Made Easy with lubridate. J Stat Softw. 2011;40(3):1–25. doi:10.18637/jss.v040.i03 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.18637/jss.v040.i01&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22523482&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F03%2F03%2F19012286.atom) 24. 24.Viechtbauer W. Conducting meta-analyses in R with the metafor package. J Stat Softw. 2010;36(3):1–48. [http://www.jstatsoft.org/v36/i03/](http://www.jstatsoft.org/v36/i03/). [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.18637/jss.v036.i11&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25285054&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F03%2F03%2F19012286.atom) 25. 25.Kossmeier M, Tran US, Voracek M. metaviz: Forest Plots, Funnel Plots, and Visual Funnel Plot Inference for Meta-Analysis. 2019. [https://cran.r-project.org/package=metaviz](https://cran.r-project.org/package=metaviz). 26. 26.Dimmery D. rdd: Regression Discontinuity Estimation. R package version 0.57. 2016. [https://cran.r-project.org/package=rdd](https://cran.r-project.org/package=rdd). 27. 27.Stigler M, Quast B. rddtools: Toolbox for Regression Discontinuity Design (‘RDD’). 2015. [https://cran.r-project.org/package=rddtools](https://cran.r-project.org/package=rddtools). 28. 28.Wickham H, Seidel D. scales: Scale Functions for Visualization. 2019. [https://cran.r-project.org/package=scales](https://cran.r-project.org/package=scales). 29. 29.Lüdecke D, Makowski D, Waggoner P, Ben-Shachar MS. see: Visualisation Toolbox for “easystats” and Extra Geoms, Themes, and Color Palettes for “ggplot2”. 2019. [https://cran.r-project.org/package=see](https://cran.r-project.org/package=see). 30. 30.Wickham H, Averick M, Bryan J, et al. Welcome to the Tidyverse Tidyverse package. J Open Source Softw. 2019;4(43):1686. doi:10.21105/joss.01686 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.21105/joss.01686&link_type=DOI) 31. 31.Zeileis A, Grothendieck G. zoo: S3 Infrastructure for Regular and Irregular Time Series. J Stat Softw. 2005;14(6):1–27. doi:10.1017/CBO9781107415324.004 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.18637/jss.v014.i09&link_type=DOI) 32. 32.Lane TJ, Sheehan LR, Gray SE, Beck D, Collie A. Step-downs analysis: aggregated data and analytical code. FigShare. doi:10.26180/5dcb6d1db426b [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.26180/5dcb6d1db426b&link_type=DOI) 33. 33.Markey R, Holley S, O’Neill S, Thornthwaite L. The Impact on Injured Workers of Changes To NSW Workers’ Compensation: June 2012 Legislative Amendments.; 2013. [https://www.mq.edu.au/\_\_data/assets/pdf\_file/0011/76637/1\_Dec\_The\_Impact\_on\_Injured\_Workers\_of\_Changes\_to\_NSW\_Workers\_.pdf](https://www.mq.edu.au/\\_\_data/assets/pdf\_file/0011/76637/1\_Dec\_The\_Impact\_on\_Injured\_Workers\_of\_Changes_to_NSW_Workers_.pdf). 34. 34.Glass D. Investigation into the Management of Complex Workers Compensation Claims and WorkSafe Oversight. Melbourne, AU; 2016. 35. 35.1. Dionne G Butler RJ, Gardner HH, Kleinman NL. Workers’ Compensation: Occupational Injury Insurance’s Influence on the Workplace. In: Dionne G, ed. Handbook of Insurance: Second Edition. Second. New York, NY: Springer; 2013:449–469. doi:10.1007/978-1-4614-0155-1 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/978-1-4614-0155-1&link_type=DOI) 36. 36.National Clinical Guideline Centre. Fractures (Non-Complex): Assessment and Management. London; 2016. [https://www.nice.org.uk/guidance/ng38/evidence/full-guideline-2358460765](https://www.nice.org.uk/guidance/ng38/evidence/full-guideline-2358460765). 37. 37.Krause N, Dasinger LK, Deegan LJ, Rudolph L, Brand RJ. Psychosocial job factors and return-to-work after compensated low back injury: a disability phase-specific analysis. Am J Ind Med. 2001;40(4):374–392. doi:10.1002/ajim.1112 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/ajim.1112&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=11598987&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F03%2F03%2F19012286.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000171326500005&link_type=ISI) 38. 38.Ezzy D, Walter M, Welch A. Quantitative Report for Phase 1 for the WorkCover Tasmania Board.; 2008. 39. 39.Jinks L. Why Pay More? The Effects of Increased Wage Replacement Benefits in Workers’ Compensation. J Econ Lit. 2019:1–60. [https://static1.squarespace.com/static/5d7544e446b1cb2e0218215e/t/5d909916e9279434ee4a27a6/1569757463955/JMP+Paper\_Jinks.pdf](https://static1.squarespace.com/static/5d7544e446b1cb2e0218215e/t/5d909916e9279434ee4a27a6/1569757463955/JMP+Paper_Jinks.pdf). 40. 40.Collie A, Di Donato M, Iles RA. Work disability in Australia: an overview of prevalence, expenditure, support systems and services. J Occup Rehabil. 2019;29(3):526–539. doi:10.1007/s10926-018-9816-4 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s10926-018-9816-4&link_type=DOI) 41. 41.Department of Human Services. A Guide to Australian Government Payments.; 2018. [https://www.humanservices.gov.au/sites/default/files/2018/09/co029-1809-rates.pdf](https://www.humanservices.gov.au/sites/default/files/2018/09/co029-1809-rates.pdf). 42. 42.Sheehan LR, Lane TJ, Collie A. The impact of income sources on financial stress in workers’ compensation claimants. 43. 43.Wagner AK, Soumerai SB, Zhang F, Ross-Degnan D. Segmented regression analysis of interrupted time series studies in medication use research. J Clin Pharm Ther. 2002;27(4):299–309. doi:10.1046/j.1365-2710.2002.00430.x [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1046/j.1365-2710.2002.00430.x&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=12174032&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F03%2F03%2F19012286.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000177464200009&link_type=ISI)