New IPECAD open-source model framework for the health technology assessment of early Alzheimer’s disease treatment: development and use cases
===============================================================================================================================================

* Ron Handels
* William L. Herring
* Sabine Grimm
* Anders Sköldunger
* Bengt Winblad
* Anders Wimo
* Linus Jönsson

## ABSTRACT

**Objectives** Market access and reimbursement decisions for new Alzheimer’s disease (AD) treatments are informed by economic evaluations. An open-source model with intuitive structure for model cross-validation can support the transparency and credibility of such evaluations. We describe the new IPECAD open-source model framework (version 2) for the health-economic evaluation of early AD treatment and use it for cross-validation and addressing uncertainty.

**Methods** A cohort state transition model using a categorized composite domain (cognition and function) was developed by replicating an existing reference model and testing it for internal validity. Then, features of existing “ICER” and “AD-ACE” models assessing lecanemab treatment were implemented for model cross-validation. Additional uncertainty scenarios were performed on choice of efficacy outcome from trial, natural disease progression, treatment effect waning and stopping rules, and other methodological choices. The model is available open-source as R code, spreadsheet and web-based version via [https://github.com/ronhandels/IPECAD](https://github.com/ronhandels/IPECAD).

**Results** In the IPECAD model incremental life years, QALY gains and cost savings were 21-31% smaller compared to the ICER model and 36-56% smaller compared to the AD-ACE model. IPECAD model results were particularly sensitive to assumptions on treatment effect waning and stopping rules and choice of efficacy outcome from trial.

**Conclusions** We demonstrated the ability of a new IPECAD opens-source model framework for researchers and decision-makers to cross-validate other (HTA submission) models and perform additional uncertainty analyses, setting an example for open science in AD decision modeling and supporting important reimbursement decisions.

## INTRODUCTION

Market access and reimbursement decisions for new Alzheimer’s disease (AD) treatments are informed by economic evaluations. Recently, AD drugs lecanemab (1) and donanemab (2) have been tested in phase 3 randomized trials. They targeted persons with mild cognitive impairment (MCI) or mild dementia who had abnormal levels of amyloid pathology, a biological hallmark of AD hypothesized to cause dementia. The trial results showed significant reductions of amyloid pathology and slower decline on clinical scales measuring cognition and function. Other drugs are under development and being tested in phase 3 trials.

The European Medicines Agency is currently assessing the quality, safety and efficacy of lecanemab with a planned decision for market authorization early 2024 (3). The National Institute for Health and Care Excellence (NICE) in the United Kingdom (UK) is currently appraising the clinical and cost-effectiveness of lecanemab with a planned publication in July 2024 (4). NICE, based on a stakeholder workshop (5), identified key issues in the assessment of new drugs for treating AD. These included lacking evidence on the validity of surrogate endpoints, meaningfulness of the clinical outcomes and limited understanding of natural disease progression. Other issues are the potentially large budget impact, the role of new diagnostic pathways and risk of inequalities by disparities in access to treatment (6). NICE highlighted the importance of transparency and credibility of decision-analytic economic models, a known issue in policy making (7). The use of open-source models for healthcare decision making has been considered very important by most responders of a survey among stakeholders in academia, industry and HTA agency (8).

In their review of transparency in decision modeling, Sampson et al. (9) found that transparency is manifested through open-source modeling in addition to collaboration, peer review, reference models, reporting standards and model registration. In addition, the concept of model cross-validation has been defined as “examining different models that address the same problem and comparing their results” in good research practice guidelines (10) and has been argued it could increase confidence in models if similar results are observed.

In 2019 the IPECAD open-source model (version 1) has been developed (11). It has been re-used outside its developing team (12, 13), used for cross-comparing a single model (14, 15) and used for cross-comparison among multiple models (16, 17). Following recommendations, it reflected disease progression by multiple domains of cognition, function and behavior (18–20). However, we experienced difficulties implementing a treatment effect comparable to those observed for new AD treatments, requiring assumptions on dependencies between domains and calibration, which we think limited model transparency.

For the appraisal of current and possible future AD drugs, we argue that an open-source model with intuitive model structure that is easy to use for model cross-validation is urgently needed to support transparency and credibility of new AD drug cost-effectiveness assessments. Therefore, we describe the new IPECAD open-source model framework (version 2) for the health-economic evaluation of early AD treatment and aim to apply it in 3 use cases for AD lecanemab treatment: 1) cross-validating an existing model with a similar structure (ICER (21)), 2) cross-validating an existing model with a more complex structure (AD-ACE (22)) and 3) assessing additional uncertainty scenarios.

We intend the use cases to act as an example of how the new IPECAD open-source model framework could support the cross-validation of a model submitted for appraisal to a reimbursement agency and support addressing uncertainty. We note a detailed evaluation of lecanemab is outside the scope of this study.

## METHODS

The new IPECAD open-source model framework was developed based on an existing cohort state-transition AD disease progression reference model assessing the potential health-economic impact of a hypothetical treatment in MCI due to AD (23). This model consists of states MCI and mild, moderate and severe dementia and death. We used original non-rounded transition probability input estimates available from the authors (AW and RH). The replicated model produced the same model outcomes in terms of mean person-years per state and alive when rounded to 2 decimal points, except for person-years in severe dementia after 40 years which had an absolute deviation of 0.01 person-years. We judged these outcomes as a sufficient reflection of internal validity. Next, we implemented new features for care setting, treatment stopping rules and treatment effect waning (i.e., decreasing of a treatment’s effect).

### MODEL RATIONALE, DESCRIPTION, ANALYTICS AND ASSUMPTIONS

We opted for a simple, commonly used model structure with transitions between states and a 1-year cycle length to serve transparency and credibility to its users. **Figure 1** shows the model structure detailing disease severity states as MCI and mild, moderate and severe dementia. It includes separate states for care setting and treatment status in MCI and mild dementia (i.e., on vs. off treatment) to allow various assumptions on treatment discontinuation and treatment effect waning.

![Figure 1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2024/04/07/2024.04.05.24305373/F1.medium.gif)

[Figure 1:](http://medrxiv.org/content/early/2024/04/07/2024.04.05.24305373/F1)

Figure 1: Graphical representation of new IPECAD open-source model framework. A limited number of all transitions (detailed in text) are shown.
Abbreviations: MCI, mild cognitive impairment; tx, on treatment.

The characteristics of the starting population include age, sex distribution and proportion in MCI and mild dementia (latter in off-treatment state for standard of care strategy and on-treatment state for intervention strategy).

Transitions among MCI and mild, moderate and severe dementia states reflect disease progression. Forward transitions (i.e., to more severe disease states) are allowed between all disease severity states. Backward transitions are allowed to all disease severity states except for transitions from moderate or severe dementia to MCI as these were not observed (24). Transitions are assumed to be time-independent (i.e., Markov assumption). This aligns with age not being a significant predictor (23), being a relatively small factor (25) or being adjusted for (24), but differs with progression dependent on time in state (26). Probabilities for remaining in the same state are calculated as 1 minus the probabilities for transitioning to other states.

Transitions from community to institution reflect changes in care setting. All disease severity states are duplicated for community and institution settings. The probability of transitioning from the community setting to the institution setting is conditional on disease severity, unidirectional (i.e., only from community to institution with no back-transition) and time independent.

Transitions to death can occur from any disease severity state. Mortality related to AD natural progression is assumed to be multiplicative to general population mortality. This is operationalized by multiplying the probabilities of death from a general population age- and sex-specific life table with the relative risk of death in each disease severity state. Due to age-specific mortality, the starting population reflects a single specific age and not an age range. Transitions between states other than death are assumed conditional on remaining alive during the cycle in question. We note transitions to death indirectly reflect time dependency in the form of age-specific mortality.

Transitions from on- to off-treatment reflect treatment discontinuation. Disease states for MCI and mild dementia in the community setting only are duplicated for on- and off- treatment. Disease states for MCI and mild dementia in the institution setting and for moderate and severe dementia in both settings reflect off-treatment. The probability from on- to off-treatment is independent of health state and unidirectional. This setup reflects the assumptions that treatment is discontinued at moderate dementia and that treatment is never provided in an institution care setting. Treatment discontinuation is operationalized as time-dependent probabilities of transitioning from on- to off-treatment. These are set over an initial period (e.g., due to side effects), a later period (e.g., due to health events interfering with receiving treatment) and a maximum duration.

Treatment effect relative to a control strategy is implemented as a relative risk multiplied to each of the transition probabilities from MCI to mild, moderate and severe dementia and from mild dementia to moderate and severe dementia. Specific relative risks can be set per transition between disease states and separately for on and off treatment. This latter feature facilitates consideration of a remaining treatment effect even after treatment is no longer provided.

Treatment effect waning is operationalized by a waning factor by which the treatment relative risk is raised (e.g., a treatment relative risk of 0.70 and 0.15 waning gives 0.70^((1-0.15)^cycle)). This can be specified separately for transitions on-treatment and, if applicable, transitions off-treatment.

Utilities (separate for patient and informal caregiver) and costs by health, social and informal care sector are specified per disease severity and care setting state (community or institution). Treatment costs are set to all on-treatment states. Caregiver utility was set to zero after patient death. No default setting is chosen and for this study aligns with the United States (US) setting for the cross-validation use cases.

A state trace (i.e., proportion of patients in each state at each timepoint) is calculated. A half-cycle correction is operationalized by taking the mean of each 2 adjacent timepoints for life years, QALYs and cost outcomes in each cycle. Cycle 1 is the period between time 0 and time 1, with starting age applied to cycle 1. The model allows for discounting life years, QALYs and costs. Inputs are provided per cycle to facilitate a different cycle length (detailed below). Multiplication between relative risks and transition probabilities are done on rate scale (27).

See **supplemental material Table S1** column 1 and 2 for a list of all input parameters of the new IPECAD open-source model framework and a short description.

### USE CASE 1: CROSS-VALIDATE EXISTING ICER MODEL

The first use case is the cross-validation of a model developed by the Institute for Clinical and Economic Review (ICER) in the US. ICER is an independent non-profit research organization that evaluates medical evidence and convenes public deliberative bodies to help stakeholders interpret and apply evidence to improve patient outcomes and control costs ([icer.org](http://icer.org)). They developed a cohort state-transition model with AD disease severity states to estimate the lifetime cost effectiveness of lecanemab in comparison with the standard of care (21, 28). Its development is linked to an earlier assessment of aducanumab arguing the model conceptualization (29, 30) and its basic model structure dates back to another AD state transition model developed earlier (31). We sought to replicate all features of the ICER model given the similarities with the IPECAD model structure.

### USE CASE 2: CROSS-VALIDATE EXISTING AD-ACE MODEL

The second use case is the cross-validation of a model published by Tahami Monfared et al. (22) which was funded by Eisai, the sponsor of the lecanemab phase 3 trial. They used the Alzheimer’s Disease ACE Simulator (AD-ACE) model (32) which uses a patient-level microsimulation approach capturing domains for AD pathology (e.g., beta-amyloid biomarkers), cognition, function, behavior and dependency. Its development is linked to earlier studies from Tahami Monfared et al. (33, 34), Kansal et al. (32) and Getsios et al. (35). We sought to mirror their input parameters for the cross-validation, given the different model type does not allow for replication.

### USE CASE 3: ADDITIONAL UNCERTAINTY SCENARIOS

To show the potential of the new IPECAD open-source model framework we performed univariate sensitivity analyses on choice of efficacy outcome from trial, natural disease progression, treatment effect extrapolation (i.e., waning) and stopping rules, and other methodological choices. These factors were chosen as they have been shown to have (or are anticipated to have) a large impact on health-economic outcomes (5, 16, 17), are sometimes complex to implement (as compared to parameter uncertainty) or to our knowledge have not been extensively tested in earlier studies. These sensitivity analyses were performed using the lecanemab scenario as implemented by ICER. See **Table 2** for details on these scenarios.

### USING THE MODEL

The new IPECAD open-source model framework is available in multiple formats (R code, spreadsheet and web-based). The R version uses base R combined with the dampack package to facilitate model outcome visualization and sensitivity analysis. We followed a coding guideline (36) commenting the R code, using object prefixes and following a similar structure as R dampack vignettes (37, 38). The spreadsheet version (in open document spreadsheet format) and web-based (R shiny) version does not contain probabilistic sensitivity analysis functionality. The model is hosted on GitHub ([https://github.com/ronhandels/IPECAD](https://github.com/ronhandels/IPECAD)) for its features of version control and collaboration.

Most model features are optional and can for example be turned off by setting them to 0 (e.g., transition probabilities, utilities or costs) or 1 (e.g., treatment relative risks). Experienced users may add or adjust model features to suit their research objectives.

## RESULTS

### USE CASE 1: CROSS-VALIDATE EXISTING ICER MODEL

Almost all features of the ICER model were implemented. However, starting in institution care setting and age-specific utilities and costs could not be implemented and some features were open for interpretation. See **supplemental material Table S1** and its table notes for a list of all input parameters and short description.

Compared to the ICER the IPECAD model mean per person outcomes showed higher life expectancy (+0.38 year), similar QALYs and lower costs (-$185,000) in the standard of care strategy. Incremental (intervention minus standard of care strategy) life years, QALY gains and cost savings were smaller (21-31% smaller) (see **Table 1**). The incremental cost-effectiveness ratio was somewhat larger ($272,000 instead of $236,000 per QALY gain).

View this table:
[Table 1:](http://medrxiv.org/content/early/2024/04/07/2024.04.05.24305373/T1)

Table 1: Cross-validation ICER and AD-ACE models; reported base case discounted model outcomes from ICER, AD-ACE and the IPECAD model outcomes from their cross-validation.

### USE CASE 2: CROSS-VALIDATE EXISTING AD-ACE MODEL

Where possible, features of the AD-ACE model were implemented except its structure and treatment effect waning due to its integration with structure. The reason was the fundamental difference in structure with AD-ACE a patient-level microsimulation on continuous disease progression domains cognition, function, behavior and biomarkers and IPECAD a cohort state transition on discrete disease progression composite domain of cognition and function. See **supplemental material Table S1** and its table notes for a list of all input parameters and short description.

Compared to AD-ACE the IPECAD model outcomes showed higher life expectancy (+0.71 year), higher QALYs (+0.40) and higher costs (+$49,000) in the standard of care strategy. Incremental life years, QALY gains and cost savings were smaller (36-56% smaller) (see **Table 1**).

### USE CASE 3: ADDITIONAL UNCERTAINTY SCENARIOS

Alternative scenarios were tested in univariate sensitivity analyses. First, the lecanemab trial primary efficacy endpoint of ‘relative difference in CDR-SB change from baseline’ and non-reported endpoint of ‘time shift in CDR-SB change from baseline’ was used as alternative to the ‘hazard ratio for progression to the next stage of dementia’. Second, an alternative source for natural progression from MCI to dementia was obtained from Vos et al. (39), and for natural progression between dementia states and death was obtained from Wimo et al. (23). Third, alternative extrapolating beyond the trial follow-up period were addressed in terms of ad-hoc combinations of treatment discontinuation (i.e., stopping rules) and treatment effect waning rates (see **supplemental Figure S1**). Fourth, an alternative method of a shorter cycle length of 1/24 month was employed.

Results of these additional uncertainty scenarios are presented in **Table 2**. As a result of extrapolation beyond evidence from the trial follow-up period more than half of the costs fell in the first 2 years while the majority of the benefits (QALY gain and care savings) were achieved after 2 years. Cost-effectiveness was lower (i.e., less net health benefit) in scenarios reflecting slower progression and treatment effect waning during treatment, and was higher (i.e., more net health benefit) in scenarios reflecting stopping treatment while assuming a treatment effect after stopping. We note the lack of evidence for stopping and waning assumptions related to the latter results.

View this table:
[Table 2:](http://medrxiv.org/content/early/2024/04/07/2024.04.05.24305373/T2)

Table 2: Difference (intervention minus standard of care strategy) in model outcomes of sensitivity analyses (person-years undiscounted; QALY, costs and net health benefit discounted in US dollar). See supplemental material Table Sx for details on the scenarios.

## DISCUSSION

We present a new IPECAD open-source model framework (version 2) for the health-economic evaluation of early AD treatment. We demonstrated its ability for cross-validation of other published analyses as well as additional uncertainty analyses. Health-economic outcomes seem related to model type and assumptions on treatment stopping rules and effect waning.

Differences with the reported ICER model outcomes could be explained by some features (e.g., start in institution care setting or age-specific utility and costs) not implemented in our IPECAD model. There may also have been ICER model features we interpreted or programmed differently. We note the SveDem model was closely replicated and post-hoc we relatively closely replicated another disease progression model by Herring et al. (14) (see **supplemental Table S3**). However, these two replications relied on support from the original developers. We think the limited replicability creates an opportunity for open-source modeling to improve transparency on model details.

Differences with the reported AD-ACE model outcomes could result from the assumption in AD-ACE that eventually patients would be in a similar state as if they had not been treated, which implies compression rather than postponing of the time spent in severe dementia. This would seemingly imply similar mortality between intervention and control, and thus fewer QALYs gained related to extending life. However, the AD-ACE model reported a larger QALY gain as compared to our IPECAD cross-validation. There may also have been AD-ACE model features we interpreted or programmed differently.

The additional uncertainty analyses showed that health-economic outcomes were sensitivity to assumptions on treatment stopping rules and treatment effect waning when extrapolating from the lecanemab trial 18-month follow-up period. We note calibrating the model to the time shift on the primary trial outcome required adjusting the model cycle length, which was also subject to uncertainty. In addition, the time shift scenario relied on the assumption that all aspects of the disease are shifted in time (i.e., a time shift in change from baseline on a continuous outcome translates to the same time shift in proportion in disease severity state).

The uncertainty scenarios confirm previous model comparison studies showing health-economic outcomes are sensitive to the choice of efficacy outcome from the trial and choice of natural disease history source (16, 17). Among recently reviewed studies (5) none addressed cycle time, and few addressed treatment discontinuation and treatment effect waning in scenario and sensitivity analyses. Whittington et al. (40) showed a lower incremental cost-effectiveness ratio with aducanumab treatment stopping at an earlier severity state and diminished outcomes with stronger treatment effect waning assumptions. AD-ACE model applications (22, 34, 41) showed higher lecanemab treatment value with higher discontinuation rates, with maintained reduced amyloid level after stopping treatment and with lower dosing frequency while assuming no treatment effect waning, and lower lecanemab treatment value with shorter maximum treatment duration. Kongpakwattana et al. (42) showed a higher cost-effectiveness ratio with earlier stopping donepezil at severe dementia. Ross et al. (15) showed a higher cost-effectiveness ratio with later discontinuation at severe instead of moderate dementia. An additional identified study (43) showed a lower ICER with a shorter maximum treatment duration, a lower ICER when assuming sustained effect after discontinuation due to amyloid clearance and a lower ICER when assuming treatment effects sustained longer. Another additional study (44) showed a higher ICER when assuming treatment effect waning. For the majority these results overlap to our finding of higher net benefit for higher discontinuation and optimistic treatment waning assumptions.

Recent cross-comparison studies in AD cross-validated models by comparing them after implementing a common benchmark scenario (16, 17). Although most previous modeling studies compared model outcomes to other studies (19), we identified only one example cross-validating a model by partly implementing another model’s scenario (14) in terms of starting age. We confirm the observation that differences between models are difficult to explain. Therefore, we advocate standardized reporting of undiscounted non-half-cycle-adjusted proportions in states over time to improve comparability of model outcomes to understand their differences (see **supplemental Table S2**) and sharing model outcomes using open science principles (for example on IPECAD repository [https://osf.io/jv85a](https://osf.io/jv85a)).

### IMPLICATIONS FOR REIMBURSEMENT AGENCIES AND MODELERS

We think the new IPECAD open-source model framework can support transparency and credibility of new cost-effectiveness assessments for new early AD treatments. First, the model can be copied, adjusted or further developed with little effort and (staff or time) resources. Second, the model can cross-validate a model submitted by industry to increase the scope and rigor. Third, the model can address additional (uncertainty or subgroup) analyses, for example addressing uncertainties that have received little attention in previous research. We note addressing parameter uncertainty fell outside our scope but can be relatively easily implemented. Fourth, the model can be used for other (educational) purposes without any risk of confidential information being compromised.

In addition, our study results showed uncertainty related to assumptions on treatment stopping rules and effect waning. Because a detailed elaboration of these aspects falls outside the scope of our study, we recommend addressing in the assessment of lecanemab, donanemab and future AD treatments.

### LIMITATIONS

Our study is subject to several limitations. We did not engage with patients and other stakeholders for the conceptualization of our model. However, another study has provided a rationale for the choice of a state-transition model type with similar disease states (30).

The model lacks reflecting diagnostic infrastructure to identify persons with abnormal amyloid eligible for treatment (45, 46), although this could be reflected by a number needed to test to identify a person eligible for treatment and corresponding test costs. Also, the model does not estimate the potential budget impact of new AD treatments, which likely is important to decision makers (6, 47). Also, the model does not reflect treatment effectiveness in specific subgroups such as APOE4, which could be associated to treatment effectiveness, adverse events and test costs.

The open-source nature of the model does not imply the validity of the model or any of its applications and does not imply it is error-free. Valid use implies adhering to scientific integrity standards for example in terms of transparency in selection of model inputs and assumptions (as compared to incorrect or ‘off-the-shelf’ application) (9). For example, careful consideration of implementing trial efficacy outcomes into the model as well as the choice for natural progression is important (17). Nevertheless, the open-source nature has the potential to reduce the presence of technical errors and facilitate incremental improvements (9), as well as to reduce the room for interpretation making it practically fully replicable.

Our model structure is of relatively simple nature, missing features for example to reflect treatment switching, domain-specific effects, alternative assumptions for mortality, efficiently address heterogeneity, treatment in institutional setting and time-dependent transitions between disease states. Also, we did not cross-validate the ICER state transition model with a microsimulation-type model. We note our previous IPECAD open-source model framework microsimulation version (version 1.2 available on [www.ipecad.org](http://www.ipecad.org)) allows some of these features (48). Alternatively, the open-source nature of our model allows adding new features such as time-specific transitions (26) by skilled programmers.

### CONCLUSION

A new IPECAD open-source model framework (version 2) was developed for the health-economic evaluation of early AD treatment. We demonstrated its ability for researchers and decision-makers to cross-validate other (HTA submission) models and perform additional uncertainty analyses, setting an example for open science in AD decision modeling and supporting important reimbursement decisions.

## AUTHOR CONTRIBUTIONS

Concept and design: RH, AW

Development of the model: RH

Applications of the model: RH, WLH, SG, LJ

Analysis and interpretation of data: RH, WLH, SG

Drafting the manuscript: RH

Critical revision: ALL

## FUNDING/SUPPORT

None

## Data Availability

All data produced are available online at https://github.com/ronhandels/IPECAD

## CONFLICT OF INTEREST

RH received outside this study research grants from JPND, ZonMW, IMI, H2020 (paid to institution); received outside this study consulting fees in the past 3 years from Lilly Nederland (2023), iMTA (2023), and Biogen (2021) (paid to institution); is member of IPECAD and member of ISPOR special interest group open-source models (un-paid).

WLH is a full-time employee of RTI Health Solutions, an independent nonprofit research organization. His compensation is unconnected to the studies on which he works. RTI Health Solutions did not receive funding for the current study. Outside of this study, RTI Health Solutions receives funding pursuant to research contracts with pharmaceutical and biotechnology companies. WLH is affiliated to research at the Karolinska Institutet and receives no compensation as part of this affiliation.

SG: has no conflict of interest to declare.

AW reports License holder of RUD-instrument (part) and Alzheimer Disease International MSAP scientific committee.

AS has no conflict of interest to declare.

LJ received outside of this study consulting fees from H. Lundbeck A/S, Novo Nordisk AS, Eli Lilly Inc and license fees for the Resource Utilization in Dementia (RUD) instrument.

BW received license fees for the Resource Utilization in Dementia (RUD) instrument.

## SUPPLEMENTAL MATERIAL

Supplemental material related to manuscript entitled “New IPECAD open-source model framework for the health technology assessment of early Alzheimer’s disease treatment: development and use cases”.

View this table:
[Table S1:](http://medrxiv.org/content/early/2024/04/07/2024.04.05.24305373/T3)

Table S1: Summary of the input parameters of the new IPECAD open-source model, the estimate to reflect the use case and related comments. Inputs are per cycle unless specified otherwise, with cycle length of 1 year. Page and table numbers refer to citation in column header.

View this table:
[Table S2:](http://medrxiv.org/content/early/2024/04/07/2024.04.05.24305373/T4)

Table S2: Proportion in states over a 10-year time period and cumulative person-years in (aggregated care setting) states of ICER and AD-ACE cross-validation in IPECAD (undiscounted, not half-cycle corrected).

View this table:
[Table S3:](http://medrxiv.org/content/early/2024/04/07/2024.04.05.24305373/T5)

Table S3: Cross-validation Herring et al. model; reported base case discounted model outcomes from Herring et al. and the IPECAD model outcomes from its cross-validation.

![Figure S1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2024/04/07/2024.04.05.24305373/F2.medium.gif)

[Figure S1:](http://medrxiv.org/content/early/2024/04/07/2024.04.05.24305373/F2)

Figure S1: Graphical representation of assumptions on treatment discontinuation and effectiveness (waning) after the trial 18-month follow-up period (i.e., treatment extrapolation).
A: Continue treatment & no treatment effect waning during treatment (base case)

B: Continue treatment & treatment effect waning during treatment

C: Stop treatment & treatment effect without effect waning after treatment stop

D: Stop treatment & treatment effect with effect waning after treatment stop

E: Stop treatment & no treatment effect after treatment stop

## ACKNOWLEDGMENT

We wish to acknowledge master students Linh Nguyen (BSc) and Daphne Silvertand (BSc) for their support in the development of the model.

*   Received April 5, 2024.
*   Revision received April 5, 2024.
*   Accepted April 7, 2024.


*   © 2024, Posted by Cold Spring Harbor Laboratory

This pre-print is available under a Creative Commons License (Attribution 4.0 International), CC BY 4.0, as described at [http://creativecommons.org/licenses/by/4.0/](http://creativecommons.org/licenses/by/4.0/)

## REFERENCES

1.  1.van Dyck CH, Swanson CJ, Aisen P, Bateman RJ, Chen C, Gee M, et al. Lecanemab in Early Alzheimer’s Disease. N Engl J Med. 2023;388(1):9–21.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJ-Moa2212948&link_type=DOI) 

2.  2.Sims JR, Zimmer JA, Evans CD, Lu M, Ardayfio P, Sparks J, et al. Donanemab in Early Symptomatic Alzheimer Disease: The TRAILBLAZER-ALZ 2 Randomized Clinical Trial. JAMA. 2023;330(6):512–27.
    
    

3.  3.EMA. Medicines for human use under evaluation. European Medicines Agency. 2024 [Available from: [https://www.ema.europa.eu/en/medicines/medicines-human-use-under-evaluation](https://www.ema.europa.eu/en/medicines/medicines-human-use-under-evaluation).
    
    

4.  4.NICE. Lecanemab for treating mild cognitive impairment or mild dementia caused by Alzheimer’s disease [ID4043]2023. Available from: [https://www.nice.org.uk/guidance/indevelopment/gid-ta11220](https://www.nice.org.uk/guidance/indevelopment/gid-ta11220).
    
    

5.  5.NICE. Potential issues and challenges in evaluation of disease-modifying dementia treatments. 2023. Available from: [https://www.nice.org.uk/Media/Default/About/what-we-do/HTA%20Lab/HTA-lab-dmdt.pdf](https://www.nice.org.uk/Media/Default/About/what-we-do/HTA%20Lab/HTA-lab-dmdt.pdf) and [https://www.nice.org.uk/about/what-we-do/our-research-work/hta-lab](https://www.nice.org.uk/about/what-we-do/our-research-work/hta-lab).
    
    

6.  6.Jonsson L, Wimo A, Handels R, Johansson G, Boada M, Engelborghs S, et al. The affordability of lecanemab, an amyloid-targeting therapy for Alzheimer’s disease: an EADC-EC viewpoint. Lancet Reg Health Eur. 2023;29:100657.
    
    

7.  7.Oliver K, Innvar S, Lorenc T, Woodman J, Thomas J. A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC Health Serv Res. 2014;14:2.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/1472-6963-14-2&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24383766&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F04%2F07%2F2024.04.05.24305373.atom) 

8.  8.Pouwels X, Sampson CJ, Arnold RJG, Open Source Models Special Interest G. Opportunities and Barriers to the Development and Use of Open Source Health Economic Models: A Survey. Value Health. 2022;25(4):473–9.
    
    

9.  9.Sampson CJ, Arnold R, Bryan S, Clarke P, Ekins S, Hatswell A, et al. Transparency in Decision Modelling: What, Why, Who and How? Pharmacoeconomics. 2019;37(11):1355–69.
    
    

10. 10.Eddy DM, Hollingworth W, Caro JJ, Tsevat J, McDonald KM, Wong JB, Force I-SMGRPT. Model transparency and validation: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force--7. Value Health. 2012;15(6):843–50.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jval.2012.04.012&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22999134&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F04%2F07%2F2024.04.05.24305373.atom) 

11. 11.Green C, Handels R, Gustavsson A, Wimo A, Winblad B, Skoldunger A, Jonsson L. Assessing cost-effectiveness of early intervention in Alzheimer’s disease: An open-source modeling framework. Alzheimers Dement. 2019;15(10):1309–21.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jalz.2019.05.004&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=31402324&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F04%2F07%2F2024.04.05.24305373.atom) 

12. 12.Jansen JP, Trikalinos TA, Phillips KA. Assessments of the Value of New Interventions Should Include Health Equity Impact. Pharmacoeconomics. 2022;40(5):489–95.
    
    

13. 13.Jun H, Cho SK, Aliyev ER, Mattke S, Suen SC. How Much Value Would a Treatment for Alzheimer’s Disease Offer? Cost-Effectiveness Thresholds for Pricing a Disease-Modifying Therapy. Current Alzheimer Research. 2020;17(9):819–22.
    
    

14. 14.Herring WL, Gould IG, Fillit H, Lindgren P, Forrestal F, Thompson R, Pemberton-Ross P. Predicted Lifetime Health Outcomes for Aducanumab in Patients with Early Alzheimer’s Disease. Neurology and Therapy. 2021;10(2):919–40.
    
    

15. 15.Ross EL, Weinberg MS, Arnold SE. Cost-effectiveness of Aducanumab and Donanemab for Early Alzheimer Disease in the US. JAMA Neurol. 2022;79(5):478–87.
    
    

16. 16.Handels RLH, Green C, Gustavsson A, Herring WL, Winblad B, Wimo A, et al. Cost-effectiveness models for Alzheimer’s disease and related dementias: IPECAD modeling workshop cross-comparison challenge. Alzheimers Dement. 2023;19(5):1800–20.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/alz.12811&link_type=DOI) 

17. 17.Handels R, Herring W, Kamgar F, Aye S, Tate A, Green C, et al. IPECAD Modeling Workshop 2023 Cross Comparison Challenge on Cost-Effectiveness Models in Alzheimer’s Disease. Under review 2024.
    
    

18. 18.Cohen JT, Neumann PJ. Decision analytic models for Alzheimer’s disease: state of the art and future directions. Alzheimers Dement. 2008;4(3):212–22.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jalz.2008.02.003&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=18631970&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F04%2F07%2F2024.04.05.24305373.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000255965700012&link_type=ISI) 

19. 19.Nguyen KH, Comans TA, Green C. Where are we at with model-based economic evaluations of interventions for dementia? a systematic review and quality assessment. Int Psychogeriatr. 2018;30(11):1593–605.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1017/S1041610218001291&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F04%2F07%2F2024.04.05.24305373.atom) 

20. 20.Landeiro F, Morton J, Gustavsson A, Potashman M, Lecomte P, Belger M, et al. Health economic modeling for Alzheimer’s disease: Expert perspectives. Alzheimers Dement (N Y). 2022;8(1):e12360.
    
    

21. 21.Lin G, Whittington M, Wright A, Agboola F, Herron-Smith S, Pearson S, Rind D. Lecanemab for Early Alzheimer’s Disease 2023. Available from: [https://icer.org/wp-content/uploads/2023/04/ICER\_Alzheimers-Disease\_Final-Report\_For-Publication\_04172023.pdf](https://icer.org/wp-content/uploads/2023/04/ICER\_Alzheimers-Disease_Final-Report_For-Publication_04172023.pdf).
    
    

22. 22.Tahami Monfared AA, Ye W, Sardesai A, Folse H, Chavan A, Kang K, Zhang Q. Estimated Societal Value of Lecanemab in Patients with Early Alzheimer’s Disease Using Simulation Modeling. Neurol Ther. 2023;12(3):795–814.
    
    

23. 23.Wimo A, Handels R, Winblad B, Black CM, Johansson G, Salomonsson S, et al. Quantifying and Describing the Natural History and Costs of Alzheimer’s Disease and Effects of Hypothetical Interventions. J Alzheimers Dis. 2020;75(3):891–902.
    
    

24. 24.Potashman M, Buessing M, Levitchi Benea M, Cummings J, Borson S, Pemberton-Ross P, Epstein AJ. Estimating Progression Rates Across the Spectrum of Alzheimer’s Disease for Amyloid-Positive Individuals Using National Alzheimer’s Coordinating Center Data. Neurol Ther. 2021;10(2):941–53.
    
    

25. 25.Davis M, T OC, Johnson S, Cline S, Merikle E, Martenyi F, Simpson K. Estimating Alzheimer’s Disease Progression Rates from Normal Cognition Through Mild Cognitive Impairment and Stages of Dementia. Curr Alzheimer Res. 2018;15(8):777–88.
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F04%2F07%2F2024.04.05.24305373.atom) 

26. 26.Tate AE, Bouteloup V, van Maurik IS, Jean D, Mank A, Speh A, et al. Predicting sojourn times across dementia disease stages, institutionalization, and mortality. Alzheimers Dement. 2023.
    
    

27. 27.Gidwani R, Russell LB. Estimating Transition Probabilities from Published Evidence: A Tutorial for Decision Modelers. Pharmacoeconomics. 2020;38(11):1153–64.
    
    

28. 28.Wright AC, Lin GA, Whittington MD, Agboola F, Herron-Smith S, Rind D, Pearson SD. The effectiveness and value of lecanemab for early Alzheimer disease: A summary from the Institute for Clinical and Economic Review’s California Technology Assessment Forum. J Manag Care Spec Pharm. 2023;29(9):1078–83.
    
    

29. 29.Lin G, Whittington M, Synnott P, McKenna A, Campbell J, Pearson S, Rind D. Aducanumab for Alzheimer’s Disease: Effectiveness and Value; Final Evidence Report and Meeting Summary. 2021. Available from: [https://icer.org/assessment/alzheimers-disease-2021/](https://icer.org/assessment/alzheimers-disease-2021/).
    
    

30. 30.Campbell JD, Whittington MD, Pearson SD. Performing Cost-Effectiveness Analyses to Support Policy Making: Key Lessons From the Assessment of Aducanumab. Neurology. 2022;98(9):360–5.
    
    

31. 31.Neumann PJ, Hermann RC, Kuntz KM, Araki SS, Duff SB, Leon J, et al. Cost-effectiveness of donepezil in the treatment of mild or moderate Alzheimer’s disease. Neurology. 1999;52(6):1138–45.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1212/WNL.52.6.1138&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F04%2F07%2F2024.04.05.24305373.atom) 

32. 32.Kansal AR, Tafazzoli A, Ishak KJ, Krotneva S. Alzheimer’s disease Archimedes condition-event simulator: Development and validation. Alzheimers Dement (N Y). 2018;4:76–88.
    
    

33. 33.Tahami Monfared AA, Tafazzoli A, Ye W, Chavan A, Zhang Q. Long-Term Health Outcomes of Lecanemab in Patients with Early Alzheimer’s Disease Using Simulation Modeling. Neurol Ther. 2022;11(2):863–80.
    
    

34. 34.Tahami Monfared AA, Tafazzoli A, Chavan A, Ye W, Zhang Q. The Potential Economic Value of Lecanemab in Patients with Early Alzheimer’s Disease Using Simulation Modeling. Neurol Ther. 2022;11(3):1285–307.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s40120-022-00373-5&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=35718854&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F04%2F07%2F2024.04.05.24305373.atom) 

35. 35.Getsios D, Blume S, Ishak KJ, Maclaine GD. Cost effectiveness of donepezil in the treatment of mild to moderate Alzheimer’s disease: a UK evaluation using discrete-event simulation. Pharmacoeconomics. 2010;28(5):411–27.
    
    

36. 36.Alarid-Escudero F, Krijkamp EM, Pechlivanoglou P, Jalal H, Kao SZ, Yang A, Enns EA. A Need for Change! A Coding Framework for Improving Transparency in Decision Modeling. Pharmacoeconomics. 2019;37(11):1329–39.
    
    

37. 37.Alarid-Escudero F, Knowlton G, Easterly C, Enns E. Decision analytic modeling package (dampack) 2021 [Available from: [https://cran.r-project.org/web/packages/dampack/](https://cran.r-project.org/web/packages/dampack/) and [https://github.com/DARTH-git/dampack](https://github.com/DARTH-git/dampack).
    
    

38. 38.Alarid-Escudero F, Krijkamp E, Enns EA, Yang A, Hunink MGM, Pechlivanoglou P, Jalal H. An Introductory Tutorial on Cohort State-Transition Models in R Using a Cost-Effectiveness Analysis Example. Med Decis Making. 2023;43(1):3–20.
    
    

39. 39.Vos SJ, Verhey F, Frolich L, Kornhuber J, Wiltfang J, Maier W, et al. Prevalence and prognosis of Alzheimer’s disease at the mild cognitive impairment stage. Brain. 2015;138(Pt 5):1327–38.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/brain/awv029&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25693589&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F04%2F07%2F2024.04.05.24305373.atom) 

40. 40.Whittington MD, Campbell JD, Rind D, Fluetsch N, Lin GA, Pearson SD. Cost-Effectiveness and Value-Based Pricing of Aducanumab for Patients With Early Alzheimer Disease. Neurology. 2022;98(9):e968–e77.
    
    

41. 41.Igarashi A, Azuma MK, Zhang Q, Ye W, Sardesai A, Folse H, et al. Predicting the Societal Value of Lecanemab in Early Alzheimer’s Disease in Japan: A Patient-Level Simulation. Neurol Ther. 2023;12(4):1133–57.
    
    

42. 42.Kongpakwattana K, Chaiyakunapruk N. Application of Discrete-Event Simulation in Health Technology Assessment: A Cost-Effectiveness Analysis of Alzheimer’s Disease Treatment Using Real-World Evidence in Thailand. Value Health. 2020;23(6):710–8.
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F04%2F07%2F2024.04.05.24305373.atom) 

43. 43.Boustani M, Doty EG, Garrison LP, Jr., Smolen LJ, Belger M, Klein TM, et al. Assessing the Cost-effectiveness of a Hypothetical Disease-modifying Therapy With Limited Duration for the Treatment of Early Symptomatic Alzheimer Disease. Clin Ther. 2022;44(11):1449–62.
    
    

44. 44.Nguyen HV, Mital S, Knopman DS, Alexander GC. Cost-Effectiveness of Lecanemab for Individuals With Early-Stage Alzheimer Disease. Neurology. 2024;102(7):e209218.
    
    

45. 45.Aye S, Handels R, Winblad B, Jönsson L. Optimising Alzheimer’s disease diagnosis and treatment: assessing cost-utility of integrating blood biomarkers in clinical practice for disease-modifying treatment. in preparation. 2024.
    
    

46. 46.Handels RL, Joore MA, Tran-Duy A, Wimo A, Wolfs CA, Verhey FR, Severens JL. Early cost-utility analysis of general and cerebrospinal fluid-specific Alzheimer’s disease biomarkers for hypothetical disease-modifying treatment decision in mild cognitive impairment. Alzheimers Dement. 2015;11(8):896–905.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jalz.2015.02.009&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=26071009&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F04%2F07%2F2024.04.05.24305373.atom) 

47. 47.Wahlberg K, Winblad B, Cole A, Herring WL, Ramsberg J, Torontali I, et al. People get ready! A new generation of Alzheimer’s therapies may require new ways to deliver and pay for healthcare. J Intern Med. 2023.
    
    

48. 48.Handels R, Grimm S, Blokland A, Possemis N, Ramakers I, Sambeth A, et al. The value of maintaining cognition in patients with mild cognitive impairment: The innovation headroom and potential cost-effectiveness of roflumilast. Alzheimers Dement. 2023;19(8):3458–71.