PT - JOURNAL ARTICLE AU - Lichtner, Gregor AU - Spies, Claudia AU - Jurth, Carlo AU - Bienert, Thomas AU - Müller, Anika AU - Kumpf, Oliver AU - Piechotta, Vanessa AU - Skoetz, Nicole AU - Nothacker, Monika AU - Boeker, Martin AU - Meerpohl, Joerg J AU - von Dincklage, Falk TI - Design and implementation of a system for automated monitoring of adherence to evidenced-based clinical guideline recommendations AID - 10.1101/2022.07.18.22277750 DP - 2023 Jan 01 TA - medRxiv PG - 2022.07.18.22277750 4099 - http://medrxiv.org/content/early/2023/03/21/2022.07.18.22277750.short 4100 - http://medrxiv.org/content/early/2023/03/21/2022.07.18.22277750.full AB - Background Clinical practice guidelines are systematically developed statements intended to optimize patient care. However, a gap-less implementation of guideline recommendations requires health care personnel not only to be aware of the recommendations and to support their content, but also to recognize every situation in which they are applicable. To not miss situations in which guideline recommendations should be applied, computerized clinical decision support could be given through a system that allows an automated monitoring of adherence to clinical guideline recommendation in individual patients.Objectives (1) To derive the requirements for a system that allows to monitor the adherence to evidence-based clinical guideline recommendations in individual patients, and based on these requirements, (2) to implement a software prototype that integrates clinical guideline recommendations with individual patient data and (3) to demonstrate the prototype’s utility on a COVID-19 intensive care treatment recommendation.Methods We performed a work process analysis with experienced intensive care clinicians to develop a conceptual model of how to support guideline adherence monitoring in clinical routine and identified which steps in the model could be supported electronically. We then identified the core requirements of a software system for supporting recommendation adherence monitoring in a consensus-based requirements analysis within loosely structured focus group work of key stakeholders (clinicians, guideline developers, health data engineers, software developers). Based on these requirements, we implemented a prototype and demonstrated its functionality by integrating clinical data with a treatment recommendation.Results Based on our conceptual flow chart model of recommendation adherence monitoring in clinical routine, we identified four main requirements of a software system for automated support of recommendation adherence monitoring of in-hospital patients: (i) Ability to interpret guideline recommendations’ semantics and logics, (ii) integration of clinical routine data from various underlying data structures, (iii) automatic adoption of new or updated guideline recommendations, and (iv) user interfaces optimized for distinct groups of users. Using a prototype implementation that fulfills these requirements, we demonstrate how such a system could be applied to monitor guideline recommendation adherence over time in clinical patients.Conclusions The four main requirements identified through our model-based analysis represent the most important aspects that need to be considered when developing a clinical decision support system for monitoring the adherence to evidence-based clinical guideline recommendations in individual patients. As each of the requirements corresponds to a different expertise (guideline development, health data engineering, software development, patient treatment), a modularized software architecture separated by area of required expertise seems favorable. Our prototype successfully demonstrates how such a modular architecture can be implemented to allow real-time monitoring of guideline recommendation adherence. This prototype, which we released as open source to invigorate collaboration, could serve as a basis for further development to integrate guideline recommendations with clinical information systems.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThe COVID-19 Evidence Ecosystem (CEOsys) project is funded under a scheme issued by the Network of University Medicine (Nationales Forschungsnetzwerk der Universitaetsmedizin (NUM)) by the Federal Ministry of Education and Research of Germany (Bundesministerium fuer Bildung und Forschung (BMBF)) grant number 01KX2021. The CODEX+ project is funded under a scheme issued by the Network of University Medicine (Nationales Forschungsnetzwerk der Universitaetsmedizin (NUM)) by the Federal Ministry of Education and Research of Germany (Bundesministerium fuer Bildung und Forschung (BMBF)) grant number 01KX2121.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Ethikausschuss 4 am Campus Benjamin Franklin of Charite - Universitaetsmedizin Berlin (Chairperson Prof. R. Stahlmann, Application Number EA4/008/19, approval date: 06 Feb 2019, amendment date: 14 May 2020) gave ethical approval for this work.I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesAll code produced is available online at https://github.com/CEOsys/grevaluator. https://github.com/CEOsys/grevaluator