Abstract
Background Health service data from Health Management Information Systems is important for decision-making at all health system levels. Data quality issues in low-and-middle-income countries hamper data use however. Smart Paper Technology, a novel digital-hybrid technology, was designed to overcome quality challenges through automated digitization. Here we assessed the impact of the novel system on data quality dimensions, metrics and indicators as proposed by the World Health Organization’s Data Quality Review Toolkit.
Methods This cross-sectional study was conducted between November 2019 and October 2020 in 13 health facilities sampled from 33 facilities of one district in rural Tanzania, where we implemented Smart Paper Technology. We assessed the technology’s data quality for maternal health care against the standard District Health Information System-2 applied in Tanzania.
Results Smart Paper Technology performed slightly better than the District Health Information System-2 regarding consistency between related indicators and outliers. We found <10% difference between related indicators for 62% of the facilities for the new system versus 38% for the standard system in the reference year.
Smart Paper Technology was inferior to District Health Information System-2 data in terms of completeness. We observed that data on 1st antenatal care visits were complete ⍰ 90% in only 76% of facilities for the new system against 92% for the standard system. For the indicator internal consistency over time 73%, 59% and 45% of client numbers for antenatal, labour and postnatal care recorded in the standard system were documented in the new system. Smart Paper Technology forms were submitted in 83% of the months for all service areas.
Conclusion Our results suggest that not all client encounters were documented in Smart Paper Technology, affecting data completeness and partly consistency. The novel system was unable to leverage opportunities from automated processes because primary documentation was poor. Low buy-in of policymakers and lack of internal quality assurance may have affected data quality of the new system. We emphasize the importance of including policymakers in evaluation planning to co-design a data quality monitoring system and to agree on a realistic way to ensure reporting of routine health data to national level.
Competing Interest Statement
RN is co–founder and board member of SHIFO board and was involved in development and promotion of the smart paper technology described in this manuscript. MB is an employee of SHIFO. All other authors do not declare any conflict of interest.
Funding Statement
This work was supported by the Swedish Research Council (Vetenskapsrådet, VR) (Grant number 2017- 05572 to AH). The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
All methods were carried out in accordance with relevant guidelines and regulations. Ethical clearance was obtained for the overall SPT evaluation from the Institutional Ethical Committee of Ifakara Health Institute and National Institute of Medical Research in Tanzania and from the Ethics Review Board of the Commune of Stockholm, Sweden. Permission to use the two data bases for our study was granted with the Ministry of Health, Community Development, Gender, Elderly and Children, the President s Office, Regional Administration and Local Governments and the respective Regional Administrative Secretaries and Hospital Authorities during stakeholder consultation, need for individual consent was thus deemed unnecessary according to national regulations and this approach was approved by the IRB of Ifakara Health Institute and National Institute of Medical Research. No identifiable variables such as names of individuals were collected during this study. Names of health facilities involved in the study were not used for reporting. No administrative permissions apart from the above mentioned, were required to access the raw data used in our study.
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
List of Abbreviations
- ANC
- Antenatal Care
- DHIS2
- District Health Information System
- DQR
- Data Quality Review
- HCPs
- Health Care Providers
- IPT
- Intermittent Preventive Treatment
- HMIS
- Health Management Information System
- LC
- Labour Care
- PNC
- Postnatal Care
- SPT
- Smart Paper Technology
The Chan Zuckerberg Initiative, Cold Spring Harbor Laboratory, the Sergey Brin Family Foundation, California Institute of Technology, Centre National de la Recherche Scientifique, Fred Hutchinson Cancer Center, Imperial College London, Massachusetts Institute of Technology, Stanford University, University of Washington, and Vrije Universiteit Amsterdam.