Abstract
Introduction Globally, resources for health spending, including HIV and tuberculosis (TB), are constrained, and a substantial gap exists between spending and estimated needs. Optima is an allocative efficiency modeling tool that has been used since 2010 in over 50 settings to generate evidence for country-level HIV and TB resource allocation decisions. This evaluation assessed the utilization of modeling to inform financing priorities from the perspective of country stakeholders and their international partners.
Methods In October-December 2021, the World Bank and Burnet Institute led 16 semi-structured small-group virtual interviews with 54 representatives from national governments and international health and funding organizations. Interviews probed participants’ roles and satisfaction with Optima analyses and how model findings have had been used and impacted resource allocation. Interviewed stakeholders represented nine countries and 11 different disease program-country contexts with prior Optima modeling analyses. Interview notes were thematically analyzed to assess factors influencing the utilization of modeling evidence in health policy and outcomes.
Results Common influences on utilization of Optima findings encompassed the perceived validity of findings, health system financing mechanisms, the extent of stakeholder participation in the modeling process, engagement of funding organization, socio-political context, and timeliness of the analysis. Utilizing workshops can facilitate effective stakeholder engagement and collaboration.
Model findings were often used conceptually to localize global evidence and facilitate discussion. Secondary outputs included informing strategic and financial planning, funding advocacy, grant proposals, and influencing investment shifts.
Conclusion Allocative efficiency modeling has supported evidence-informed decision making in numerous contexts and enhanced the conceptual and practical understanding of allocative efficiency. Most immediately, greater involvement of country stakeholders in modeling studies and timing studies to key strategic and financial planning decisions may increase the impact on decision making. Better consideration for integrated disease modeling, equity goals, and financing constraints may improve relevance and utilization of modeling findings.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
This work was funded by the World Bank, who contributed to study design, implementation, analysis, interpretation and manuscript review. The authors gratefully acknowledge the contribution to this work of the Victorian Operational Infrastructure Support Program received by the Burnet Institute.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
The original QA exercise was not subject to ethics review. The Alfred Hospital Ethics Review Committee approved the collation and analysis of the program QA data (project number:158/22).
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
Footnotes
Revised Methods to add further details on Optima models and qualitative analysis; Revised introduction and discussion to positions the analysis within existing literature and conceptual frameworks; Results section updated with additional quotes.
Data Availability
Data from this evaluation is not available for sharing as per ethics agreements. Data and reports for underlying country models are published and openly available in the World Bank Open Knowledge Repository and through Optima.
