Abstract
Introduction Surgical mortality is the third leading cause of death globally, with mortality rates in Africa double those of high-income countries despite patients being younger and undergoing lower-risk procedures. One of the contributors to poor outcomes in low- and middle-income countries (LMICs) is the lack of digital data, which is essential for quality improvement, audit and feedback systems, and early warning track-and-trigger systems. Due to limited financial resources, paper health records remain the standard in LMICs, making readily accessible digital data an urgent priority. This study builds on our previous work in computer vision-based digitization of smartphone-captured anesthesia records by developing a standardized, computer vision-ready anesthesia paper record. Designed for optimal digitization, this record will align with the Minimum Dataset for Surgical Patients in Africa guidelines.
Methods The standardized, computer vision-ready anesthesia paper chart was developed with input from anesthesia experts in LMICs and data scientists. Key adaptations designed to facilitate accurate computer vision digitization included replacing traditional free-text entries with predefined categorical checkboxes, pre-printing the name of commonly used medications, supplementing handwritten medication names with numeric codes, and structuring input fields to improve computer vision digitization accuracy. Prior computer vision software was further iterated to improve digitization accuracy for the new standardized chart. Performance of the updated software running on the new computer vision-ready paper chart was then evaluated by comparing the software output to the human-annotated ground-truth data measuring both detection and interpretation accuracy.
Results The training dataset consisted of thirty-three standardized, computer vision-ready anesthesia paper charts completed using synthetic data by a group of ten anesthesia providers. Five charts were reserved for validation, while the test dataset consisted of nine charts that were not used for any training or validation purposes. Updated computer vision software demonstrated high detection accuracy for vital signs: systolic blood pressure (93%), diastolic blood pressure (94%), and heart rate (93%), all physiological indicators (100%), and checkboxes (99%). The mean average error for inferring values from model detections were low: systolic (1.98mmHg), diastolic (1.13mmHg), heart rate (3.8/bpm), oxygen saturation (0.19%), end tidal carbon dioxide (0.65 mmHg), inspired oxygen concentration (2.48%). The accuracy for determining which checkboxes were marked vs. unmarked was 99%.
Conclusion This study confirms the feasibility and accuracy of a standardized, computer vision-ready anesthesia chart that can be deployed in LMICs to facilitate digital data access.
Competing Interest Statement
The authors have declared no competing interest.
Clinical Protocols
https://github.com/Paper-Chart-Extraction-Project/ChartExtractor
Funding Statement
This work is funded in part from a grant from the Center for Global Inquiry and Innovation, University of Virginia.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
The Chan Zuckerberg Initiative, Cold Spring Harbor Laboratory, the Sergey Brin Family Foundation, California Institute of Technology, Centre National de la Recherche Scientifique, Fred Hutchinson Cancer Center, Imperial College London, Massachusetts Institute of Technology, Stanford University, University of Washington, and Vrije Universiteit Amsterdam.