RT Journal Article
SR Electronic
T1 A rubric for assessing conformance to the Ten Rules for credible practice of modeling and simulation in healthcare
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2024.10.31.24316520
DO 10.1101/2024.10.31.24316520
A1 Manchel, Alexandra
A1 Erdemir, Ahmet
A1 Mulugeta, Lealem
A1 Ku, Joy P.
A1 Rego, Bruno V.
A1 Horner, Marc
A1 Lytton, William W
A1 Myers, Jerry G.
A1 Vadigepalli, Rajanikanth
YR 2024
UL http://medrxiv.org/content/early/2024/11/02/2024.10.31.24316520.abstract
AB The power of computational modeling and simulation (M&S) is realized when the results are credible, and the workflow generates evidence that supports credibility for the context of use. The Committee on Credible Practice of Modeling & Simulation in Healthcare was established to help address the need for processes and procedures to support the credible use of M&S in healthcare and biomedical research. Our community efforts have led to the Ten Rules (TR) for Credible Practice of M&S in life sciences and healthcare. This framework is an outcome of a multidisciplinary investigation from a wide range of stakeholders beginning in 2012. Here, we present a pragmatic rubric for assessing the conformance of an M&S activity to the TR. This rubric considers the ability of the M&S to facilitate outreach of the results to a wide range of stakeholders from context-specific M&S practitioners to policymakers. It uses an ordinal scale ranging from Insufficient (zero) to Comprehensive (four) that is applicable to each rule, providing a uniform approach for comparing assessments across different reviewers and different models. We used the rubric to evaluate the conformance of two computational modeling activities: 1. six viral disease (COVID-19) propagation models, and 2. a model of hepatic glycogenolysis with neural innervation and calcium signaling. These examples were used to evaluate the applicability of the rubric and illustrate rubric usage in real-world M&S scenarios including those that bridge scientific M&S with policymaking. The COVID-19 M&S studies were of particular interest because they needed to be quickly operationalized by government and private decision-makers early in the COVID-19 pandemic and were accessible as open-source tools. Our findings demonstrate that the TR rubric represents a systematic tool for assessing the conformance of an M&S activity to codified good practices and enhances the value of the TR for supporting real-world decision-making.Competing Interest StatementI have read the journal's policy and the authors of this manuscript have the following competing interests: Ahmet Erdemir owns and operates innodof, LLC, a consulting company for modeling and simulation. Lealem Mulugeta owns and operates InSilico Labs LLC and Medalist Performance. InSilico Labs provides computational modeling and simulation products and services, and Medalist Performance applies computational and biomedical approaches to provide peak performance coaching services to tactical professionals, athletes, astronauts, and executives. Marc Horner is employed by ANSYS, Inc., a company that develops commercial off-the-shelf computational modeling software. The remaining authors have declared that no competing interests exist.Funding StatementYesAuthor DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.Not ApplicableThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:N/AI confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.Not ApplicableI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).Not ApplicableI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.Not ApplicableAll relevant data are within the manuscript and its Supporting Information files.