Abstract
Importance Inappropriate prescribing and prescribing omissions are major drivers of healthcare-related harm. Medication review may help improve pharmacotherapy.
Objective To study the effects of a primary care medication review intervention centered around an electronic clinical decision support system (eCDSS) on medication appropriateness and the number of prescribing omissions in older adults with multimorbidity and polypharmacy compared to usual care.
Design and Setting The “Optimising PharmacoTherapy In the multimorbid elderly in primary Care” (OPTICA) trial is a cluster randomized clinical trial conducted with general practitioners (GPs) and older multimorbid patients with polypharmacy in Swiss primary care settings, between January 2019 and February 2020. The 12-month follow-up was completed in February 2021.
Participants Eligible patients had to be ≥65 years of age with ≥3 chronic conditions and ≥5 long-term medications.
Intervention The intervention to optimize pharmacotherapy centered around an eCDSS compared to usual care.
Main Outcomes and Measures The two primary outcomes were the improvement in the Medication Appropriateness Index (MAI) and the Assessment of Underutilization (AOU) at 12 months. Secondary outcomes included the number of medications, number of falls and fractures and quality of life.
Results In 43 GP clusters, 323 patients were recruited (median age: 77 years (IQR: 73-83), 45% were female). 21 GPs with 160 patients were assigned to the intervention group and 22 GPs with 163 patients to the control group. On average, 1 recommendation to stop or start a medication were reported to be implemented per patient. At 12 months, there were no group differences in the improvement of medication appropriateness (Odds ratio (OR): 1.05; 95% confidence interval (CI): 0.59 to 1.87) nor the number of prescribing omissions (OR: 0.90; 95% CI: 0.41 to 1.96) in the intention-to-treat analysis. The per-protocol analysis showed no statistically significant group difference and there were no group differences in the secondary outcomes either.
Conclusions and Relevance In this randomized trial of GPs and older adults, medication reviews based on the eCDSS reduced inappropriate prescriptions but did not lead to higher appropriateness of patients’ medications. The intervention could be safely delivered to patients without causing any detriment to their health.
Funding Swiss National Science Foundation (407440_167465)
Question What is the effect of a GP administered medication review intervention supported by an electronic clinical decision support system on medication appropriateness in older patients with multimorbidity and polypharmacy?
Findings This cluster randomized controlled trial included 43 general practitioners and 323 patients. At the end of the 12-month follow-up period, medication appropriateness and the number of prescribing omissions did not differ between patients who received the intervention and those who received usual care.
Meaning The intervention to optimize pharmacotherapy was feasible and safe to implement in primary care but did not improve overall medication appropriateness nor reduce the number of prescribing omissions.
Introduction
Inappropriate polypharmacy is highly prevalent in older adults and a major driver of healthcare-related harm.1,2 It is associated with negative health outcomes, such as adverse drug events, falls and functional decline in activities of daily living.3-6 Patients with multiple chronic conditions (multimorbidity7) and polypharmacy, defined as the use of ≥5 medications,8 are at an increased risk of inappropriate polypharmacy, such as inappropriate prescribing9-11 and prescribing omissions.12 This highlights the need for reducing inappropriate polypharmacy. Primary care settings, characterized by long-term patient-provider relationships, lend itself as ideal settings for medication reviews. Performing medication reviews, however, is a complex and time-consuming task. And currently, the evidence for medication review interventions is mixed.13-15
Medication review interventions, such as those based on the ‘Screening Tool of Older Persons’ potentially inappropriate Prescription’ (STOPP) and ‘Screening Tool to Alert doctors to the Right Treatment’ (START) criteria – an evidence-based criteria to inform prescribing in older adults16,17– can support physicians. These criteria have been shown to be effective in improving prescribing quality and some patient outcomes.18,19 In the context of digitalization, it is a promising way forward to use electronic clinical decision support systems (eCDSS) based on the STOPP/START criteria, such as the ‘Systematic Tool to Reduce Inappropriate Prescribing’-Assistant (STRIPA).20-22 In recent years, different eCDSS for optimizing medication use have been tested.23-25 Systems based on the STOPP/START criteria were used in two randomized clinical trials conducted in the inpatient setting.19,26 However, evidence from primary care settings is lacking.
The OPTICA trial tested the hypothesis that in older adults with multimorbidity and polypharmacy the use of an eCDSS for optimizing pharmacotherapy by general practitioners (GPs) improves medication appropriateness and reduces prescribing omissions more than standard care.
Methods
Trial design
The protocol of the ‘Optimising PharmacoTherapy In the multimorbid elderly in primary CAre’ (OPTICA) trial was published previously.27 We conducted a cluster randomized controlled trial with 43 GPs as clusters. GPs recruited 8-10 of their older patients with multimorbidity and polypharmacy. The trial, conducted from 2018 to 2021, was approved by the responsible ethics committee before enrolment commenced (BASEC ID: 2018–00914). We obtained written informed consent from all participants or their legal representatives prior to study enrolment.
Participants
GPs had to be participating in the ‘Family medicine ICPC Research using Electronic medical records’ (FIRE) project.28 This allowed electronic health record (EHR) data exports from their GP practices to the trial database and the eCDSS.
Patients were ≥65 years of age, to take ≥5 long-term medications (≥90 days) and to have ≥3 chronic conditions based on ICPC-2 coding or GPs’ clinical judgement. In case eligible patients suffered from cognitive impairment, written informed consent was obtained from their legal representative.
Randomization
Randomization of clusters was done after patient enrolment for each cluster was completed. Randomization of participating GPs was done centrally in a web-based system (REDCap).29,30 We used a 1:1 ratio with unstratified block randomization and randomly varying block sizes of two and four.
Trial procedures
Intervention group: The intervention was performed by the GPs at the individual patient level and consisted of a structured medication review using STRIPA, a web-based electronic clinical decision support system based on the ‘Screening Tool of Older Person’s Prescriptions’ (STOPP) and ‘Screening Tool to Alert doctors to Right Treatment’ (START) criteria V.2.17,31 In addition to detecting potential drug overuse, underuse, and misuse, STRIPA generated recommendations to address drug-drug interactions and adapt the dosage of inappropriate prescriptions.
Control group: GPs were asked to discuss their patients’ medications in accordance with their usual practice.
Blinding
GPs were blinded during the screening and recruitment process of patients to limit biased selection of patients. GPs in the control group remained partially blinded, as they did not know the intervention procedure. Patients in the control group received a sham intervention (medication discussion). The data collectors and study assessors were fully blinded. Blinding of the trial statistician was not feasible because the data export contained information on the study groups in various forms.
Outcomes
Primary outcome measures
Medication appropriateness was the primary outcome. To account for the multi-dimensionality of this construct, we used two primary outcome measures: the Medication Appropriateness Index (MAI) and the Assessment of Underutilization (AOU) (both at 12 months). The MAI helps assess the appropriateness of prescriptions and the AOU is a tool to evaluate under-prescribing by measuring the number of prescribing omissions.32-34 We assessed the AOU for each non-acute condition of the patients and the MAI for each long-term medication. We used the 10-item version of the MAI. However, we excluded the cost-effectiveness item for feasibility reasons (Appendix 1). This resulted in a score from 0 to 17 for each medication (with a higher score representing greater inappropriateness). Improvement in the MAI was defined as a decrease of ≥1 score point. For the AOU, we assessed for every non-acute diagnosis whether there was i) no prescribing omission, ii) a marginal omission (e.g. use of non-pharmacological treatment), or iii) an omission of an indicated medication.35-37 Improvement in the AOU was defined as a reduction of ≥1 prescribing omission. Several interrater reliability assessments showed moderate agreement between the outcome assessors when doing the MAI and AOU assessments.
Secondary outcomes
Secondary outcomes included medication appropriateness (as measured by the ordinal MAI), the number of prescribing omissions, long-term medications, falls and fractures, quality of life as measured by the EQ-5D-5L questionnaire,38,39 informal care received (e.g. unpaid care work by relatives/friends), and survival. For health economic analyses (reported separately) additional secondary outcomes were QALYs,40 health services use (e.g., number of GP and specialist visits), and direct medical costs accrued in one year.
Data collection
Data was collected at baseline, 6 months, and 12 months. The data on medications, diagnoses, lab values, and vital data were imported from the EHR of patients through the FIRE database.28 Due to the substantial amount of missing data needed to assess the primary outcomes (∼35%), the study team collected missing information from participating GPs. The data on quality of life, health services use, falls and fractures were collected through phone calls with patients or legal representatives. GPs reported safety information on (serious) adverse events, including death.
Sample size calculation
We calculated the sample size to test for superiority of the two primary outcome measures and used the Bonferroni approach to account for multiple testing. We assumed that 35% and 60% of patients will have an improvement in the MAI and that 10% and 30% will have an improvement in the AOU in the control and intervention group, respectively. Based on a two-sample comparison of proportions, a pre-specified number of GP clusters of 40 (20 per arm), and an ICC of 0.05, 7 patients were required per cluster to detect a difference in the proportion of improvement in the MAI score of 25% between the two groups with a power of 90% at a two-sided alpha-level of 0.025. Using the same assumption for the AOU, 7 patients per cluster were also required to detect a difference of 20%. This results in a total sample size of 280 patients (140 per arm). This sample size provides 81% power to detect a significant improvement in both the MAI score and the AOU index. To account for attrition due to dropout or death (15% estimated), we enlarged the number of patients per cluster to 8-10, with a final sample size of 320 patients total (160 per group).
Statistical analysis
Sociodemographic characteristics of GPs were described. Patient characteristics were described and compared between groups using the Chi-squared test for categorical variables and the non-parametric Wilcoxon rank-sum test for continuous variables.41 The number of prescribing recommendations generated and implemented were descriptively analyzed.
In all model-based analyses (both intention-to-treat and per-protocol), multiple imputed data were used (Appendix 2). We used generalized estimating equation (GEE) models with robust standard errors to account for clustered data, which yields population-averaged effects.42-44 For binary outcomes, we computed odds ratios (OR) using a binomial distribution and a logit link. For count outcomes, we calculated incidence rate ratios (IRR) using a negative binomial distribution and a log link. For continuous outcomes, mean differences (MD) were computed using a Gaussian distribution and an identity link.
Several pre-specified subgroup comparisons were performed at GP and patient level through the models described above (Appendix 3), with additional interaction terms between randomization group and binary subgroup indicators. OR, IRR or MD for randomized comparisons are shown for each subgroup together with a p-value for interaction.
Due to differences in data exports from different EHR software programs, fewer medications and diagnoses were recorded for some patients. In secondary analyses, all models were re-run with the per-protocol set of patients. Here, we excluded all patients for whom <3 chronic conditions and <5 long-term medications were recorded, and all clusters that included <4 participants. In addition, we performed a post-hoc relaxed per-protocol analysis in which only patients with <1 chronic condition and <1 long-term medication recorded and clusters with <4 patients were excluded. In an additional sensitivity analysis, we adjusted models for potential confounders because cluster randomization may lead to imbalances in baseline characteristics between groups. Finally, we conducted an aggregated data analysis at the GP level.
All analyses were performed using Stata version 17.045. We report the results in line with the Consolidated Standards of Reporting Trials extension for cluster trials.46 Deviations from the Statistical Analysis Plan are reported in Appendix 4.
Patient and public involvement
GPs and patients aged ≥65 years with multimorbidity and polypharmacy were represented in the Safety and Data Monitoring Board (DSMB).
Results
43 GPs working in Swiss primary care practices participated in the OPTICA trial (eFigure 1).47 Between January 2019 and February 2020, 323 older adults with multimorbidity and polypharmacy (median age: 77, interquartile range (IQR): 73-83, 45% women) gave their informed consent. 22 GPs with 160 patients were randomized to the intervention group, 21 GPs with 163 patients to the control group (Figure 1). During the 12-month follow-up period, 12 patients (3.7%) died, 12 patients (3.7%) were lost to follow-up and could not be reached for the data collection by phone, 5 patients (1.5%) opted out from the data collection by phone but agreed to be followed-up via the FIRE database, and 1 patient withdrew from the study.
Participating GPs had a median age of 53 years (IQR: 44-58), median work experience of 14 years (IQR: 7-21), and 21% were female. At baseline, patients had a median number of long-term medications of 7 (IQR: 4-10) and a median number of chronic diagnoses of 7 (IQR: 4-10). The baseline characteristics of patients were similar in both groups, except for medication appropriateness, which was higher in the control group (Table 1).
Per patient, an average of 5.4 prescribing recommendations were generated, thereof, an average of 3.7 were STOPP or START recommendations, (Table 2). On average, 1.0 START or STOPP recommendations were implemented per patient in the intervention group, with 58.5% of patients having had at least one recommendation implemented. The ten most common prescribing recommendations made by STRIPA are shown in Table 3.
Primary outcome measures
82% of patients had information on the Medication Appropriateness Index (MAI) for both the baseline and the 12-month follow-up and 87% of patients had information on prescribing omissions as assessed using the AOU for both timepoints (eTable1). 42% of patients had an improvement in the MAI between baseline and the 12-month follow-up and 14% had an improvement in the number of prescribing omissions (eTable2). In the supporting material, the development of the MAI score and the number of prescribing omissions are shown by timepoint (eFigure3-5, eTable3).
The analyses compared the intervention to the control group. In the intention-to-treat analysis, the odds ratio (OR) for an improvement in the MAI score (decrease by ≥1 score point) between baseline and the 12-month follow-up was 1.05 (95% confidence interval (CI): 0.59 to 1.87) and the OR for an improvement in the AOU (at least 1 prescribing omission less) was 0.90 (95% CI: 0.41 to 1.96) (Table 4). The sensitivity analysis adjusting for baseline characteristics did not show any significant group differences either (eTable4). Moreover, the intervention effect on medication appropriateness and prescribing omissions did not differ in subgroup analyses (eFigure5) nor in the aggregated data analysis (eTable5). The results based on the available case data did not show a difference either (eTable6).
In the strict per-protocol analysis, the adjusted OR for an improvement in the MAI score between baseline and the 12-month follow-up was 1.03 (95% CI: 0.59 to 1.77) and the odds ratio for an improvement in the AOU was 1.25 (95% CI: 0.44 to 3.56) (eTable7-8). The relaxed per-protocol analysis showed similar results.
Secondary outcomes
There was no difference between groups with regards to the secondary outcomes, when analyzing the primary outcomes – medication appropriateness and prescribing omissions – at the 6-month follow-up (Table 4), in the per-protocol analyses (eTable9) nor in additional medication-related outcomes (eTable10).
Discussion
In this cluster randomized clinical trial evaluating the effect of a structured medication review intervention supported by an electronic decision support system in older adults with multimorbidity and polypharmacy, 58.5% of patients had at least one prescribing recommendation implemented. Despite the implementation of one STOPP or START recommendation per patient on average, there was no improvement in medication appropriateness nor a reduction in prescribing omissions after a 12-month follow-up period compared to usual care. While the intervention was not superior to the usual care, it could be safely delivered without causing any harm to patients.
Our null findings are in line with the literature on previous clinical trials testing the effect of medication review interventions on medication appropriateness in primary care settings. For instance, the PRIMUM trial, which randomized 72 primary care practices and 505 patients with multimorbidity and polypharmacy, did not find an improvement in the MAI after performing a medication review based on an eCDSS for GPs.48 This trial, however, did not assess under-prescribing and excluded patients with cognitive impairment. The results of the PRIMA-eDS trial with 359 primary care practices and 3,904 adults aged ≥75 years using multiple medications showed that the use of an eCDSS did not achieve a group difference in mortality or unplanned hospital admissions after a 24-month follow-up period.25 This study was strengthened by its longer observation period. However, it did not study medication underuse. In the OPTIMIZE trial, in which 3,012 patients with dementia or mild cognitive impairment from 19 primary care clinics were randomized, the number of (potentially inappropriate) medications were similar in both groups at the end of the 6-month follow-up period.49 These findings show that meaningful, sustainable improvements are difficult to achieve by the one-time use of eCDSS to support medication reviews in primary care settings.
Further, our findings are in line with the results of previous multicenter trials evaluating an eCDSS based on the STOPP/START criteria. For instance, the SENATOR trial, in which 1’536 inpatients were randomized, did not find any group difference concerning the recurrence of adverse drug events within 14 days of randomization.26 Similarly, in the OPERAM trial, in which 2’008 patients from 110 clusters were randomized and STRIPA was also used, the difference between the groups after a 12-month follow-up period was not statistically significant despite a trend towards a reduction of re-hospitalizations19. The intervention, however, came with potential cost-savings of CHF 3’588 per patient and a gain of 0.025 quality-adjusted life years (95% CI: -0.002 to 0.052) per patient.50 Despite the more user-friendly application of the STOPP/START criteria as an eCDSS, there are substantial issues related to implementing recommendations.
In the SENATOR trial, 15% of the overall recommendations were implemented.26 In the OPERAM trial, 62% of patients had ≥1 recommendation successfully implemented at 2 months.19 Our results from primary care settings are very similar to this. It would be unreasonable to expect every prescribing recommendation to be implementable, but the partial uptake of prescribing recommendations points to numerous issues that affect the overall effectiveness of medication review interventions. One reason for the partial uptake could be that not all the generated recommendations were relevant to the patients’ individual situations. For example, changes that had been tried in the past but did not work were recommended by the system. Poor integration of the decision-support system into the clinical workflow might have been another reason.51 Further, prescribing recommendations, particularly those related to stopping medications, have been shown to be difficult to implement due to numerous barriers faced by patients and prescribers.52,53
Future trials on medication optimization interventions would benefit from interventions focusing on overcoming implementation challenges. This not only requires preparatory qualitative studies to better understand the challenges, but also using implementation science approaches to better integrate interventions into clinical workflows, tailoring interventions to users’ needs, and piloting interventions. Further, future interventions may benefit from being designed as repeated interventions to accommodate the dynamic prescribing practices and frequent medication changes in older patients with multimorbidity and polypharmacy.
Strengths and Limitations
The OPTICA trial has several strengths. First, it had minimal exclusion criteria, which resulted in the recruitment of patients that were comparable to other older patients with multimorbidity and polypharmacy in Swiss primary care.47 Second, patient recruitment was based on screening lists with random samples of each GPs’ patient population. Third, the randomization of GP clusters once the recruitment per cluster was completed, helped to limit differential recruitment. Fourth, a low number of patients were lost to follow-up due to the pragmatic data collection design consisting of phone calls and EHR data imports. The pragmatic nature of the trial in primary care settings provides real-world insights. Finally, the collection of information related to the implementation of prescribing recommendations provides additional insights. However, despite several reminders, we were unable to collect this information from all GPs.
We noted several limitations. First, due to the Hawthorne effect, GPs in the control group may have been more attentive to their prescribing practices and it cannot be rule out that some of them were diverging from their usual care. The number of medications, however, did not differ between the two groups at any timepoint. Second, the quality of the data exports from the FIRE database was challenging because there were differences in how different EHR software programs exported data. Therefore, the study team had to manually collect missing information from GP practices. Third, since the intervention occurred at a single time point, its effectiveness may have been diluted over time. Fourth, the implementation of an average of 1 STOPP/START recommendation per patient did not seem to affect the MAI. Next, the different barriers faced by patients and providers related to the implementation of prescribing recommendations, which are numerous and well-documented in the literature (e.g., fears of negative health outcomes, alert fatigue, etc.), may have led to a low implementation of recommendations. Finally, STRIPA used clinical information but did not consider patient preferences. This may also have contributed to patients’ reluctance to implement recommendations.
Conclusion
In this primary care-based trial, 58.5% of patients had at least one prescribing recommendation implemented. Despite this, the medication review intervention centered around the use of an eCDSS did not lead to a significant improvement in medication appropriateness nor a reduction in prescribing omissions at 12 months compared to usual care. Nevertheless, the intervention could be safely delivered without causing any detriment to patient outcomes.
Declarations
Author Contributions
Dr. Katharina Jungo and Odile Stalder had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.
Concept and design: Prof. Nicolas Rodondi, Prof. Sven Streit, Prof. Matthias Schwenkglenks, PD Dr. Sven Trelle, Prof. Marco Spruit, Dr. Claudio Schneider, and Dr. Katharina Jungo designed the trial.
Acquisition, analysis, or interpretation of data: Dr. Katharina Jungo, Dr. Anna-Katharina Ansorg, Dr. Carmen Floriani, Dr. Zsofia Rozsnyai, Dr. Rahel Meier, Nathalie Schwab, Fabio Valeri, Dr. Michael Bagattini, PD Dr. Sven Trelle, Prof. Marco Spruit, Prof. Matthias Schwenkglenks, Prof. Nicolas Rodondi, and Prof. Sven Streit were involved in the data acquisition, analysis, and interpretation.
Drafting of the manuscript: Dr. Katharina Jungo and Odile Stalder wrote the first draft of the manuscript.
Critical revision of the manuscript for important intellectual content: All other authors provided feedback and approved the final version of the manuscript.
Statistical analysis: Odile Stalder, Dr. Andreas Limacher, and PD Dr. Sven Trelle provided statistical support and conducted the statistical analyses.
Obtained funding: Prof. Nicolas Rodondi, Prof. Matthias Schwenkglenks and Prof. Sven Streit obtained the funding for the OPTICA trial.
Administrative, technical, or material support: Nathalie Schwab and Fabio Valeri provided administrative and technical support.
Supervision: Prof. Nicolas Rodondi and Prof. Sven Streit supervised the conduct of the trial.
Data Availability
We will make the data for this study available to other researchers upon request after publication. The data will be made available for scientific research purposes, after the proposed analysis plan has been approved. Data and documentation will be made available through a secure file exchange platform after approval of the proposal. In addition, a data transfer agreement has to be signed (which defines obligations that the data requester must adhere to with regard to privacy and data handling). Deidentified participant data limited to the data used for the proposed project will be made available, along with a data dictionary and annotated case report forms. For data access, please contact the corresponding author.
Conflict of Interest Disclosures
Prof. Spruit reports a settlement agreement between Spru IT and Utrecht University, in which all IP related to the ‘Systematic Tool to Reduce Inappropriate Prescribing’ Assistant (STRIPA) is transferred to Utrecht University, in exchange for obtaining a free but non-exclusive right to provide STRIP Assistant consultancy or support services, both on a commercial basis, and to update the STRIP Assistant until June 2023. The other authors do not have any conflicts of interest to declare.
Funding/Support
The OPTICA trial was supported by the Swiss National Science Foundation, within the framework of the National Research Programme 74 “Smarter Health Care” (NRP74) under contract number 407440_167465 (to Prof. Streit, Prof. Rodondi, and Prof. Schwenkglenks).
Role of the Funder
The funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
Data Sharing Statement
We will make the data for this study available to other researchers upon request after publication. The data will be made available for scientific research purposes, after the proposed analysis plan has been approved. Data and documentation will be made available through a secure file exchange platform after approval of the proposal. In addition, a data transfer agreement has to be signed (which defines obligations that the data requester must adhere to with regard to privacy and data handling). Deidentified participant data limited to the data used for the proposed project will be made available, along with a data dictionary and annotated case report forms. For data access, please contact the corresponding author.
Ethical approval
The study protocol of the OPTICA trial and other documentation was approved by the competent ethics committee of the canton of Bern (KEK), Switzerland, and the Swiss regulatory authority (Swissmedic) (BASEC ID: 2018–00914). The KEK and Swissmedic received annually safety reports and were informed about the end of the study. All participants gave their written informed consent. The OPTICA trial was performed in accordance with relevant regulations and guidelines.
Acknowledgements
We would like to thank the GPs who participated in the OPTICA trial for their great contributions without which it would have been impossible to conduct this study. We also thank the participants for consenting to participate in our study. We would like to thank Shana Bertato, Rebekah Hoeks, Dominic Salvisberg, Yasmin Mohd Yatim, Melisa Harmanci, und Linda Chau for their support with the data entry. We would like to thank Dr. Kristie Weir for her editorial suggestions. Katharina Tabea Jungo is a member of the Junior Investigator Intensive Program of the US Deprescribing Research Network, which is funded by the National Institute on Aging.
Footnotes
Trial registration numbers Clinicaltrials.gov: NCT03724539
KOFAM (Swiss national portal): SNCTP000003060
Universal Trial Number: U1111-1226-8013