Abstract
Background Health service data from Health Management Information Systems is important for decision-making at all health system levels. Data quality issues in low-and-middle-income countries hamper data use however. Smart Paper Technology, a novel digital-hybrid technology, was designed to overcome quality challenges through automated digitization. Here we assessed the impact of the novel system on data quality dimensions, metrics and indicators as proposed by the World Health Organization’s Data Quality Review Toolkit.
Methods This cross-sectional study was conducted between November 2019 and October 2020 in 13 health facilities sampled from 33 facilities of one district in rural Tanzania, where we implemented Smart Paper Technology. We assessed the technology’s data quality for maternal health care against the standard District Health Information System-2 applied in Tanzania.
Results Smart Paper Technology performed slightly better than the District Health Information System-2 regarding consistency between related indicators and outliers. We found <10% difference between related indicators for 62% of the facilities for the new system versus 38% for the standard system in the reference year.
Smart Paper Technology was inferior to District Health Information System-2 data in terms of completeness. We observed that data on 1st antenatal care visits were complete ⍰ 90% in only 76% of facilities for the new system against 92% for the standard system. For the indicator internal consistency over time 73%, 59% and 45% of client numbers for antenatal, labour and postnatal care recorded in the standard system were documented in the new system. Smart Paper Technology forms were submitted in 83% of the months for all service areas.
Conclusion Our results suggest that not all client encounters were documented in Smart Paper Technology, affecting data completeness and partly consistency. The novel system was unable to leverage opportunities from automated processes because primary documentation was poor. Low buy-in of policymakers and lack of internal quality assurance may have affected data quality of the new system. We emphasize the importance of including policymakers in evaluation planning to co-design a data quality monitoring system and to agree on a realistic way to ensure reporting of routine health data to national level.
Competing Interest Statement
RN is co–founder and board member of SHIFO board and was involved in development and promotion of the smart paper technology described in this manuscript. MB is an employee of SHIFO. All other authors do not declare any conflict of interest.
Funding Statement
This work was supported by the Swedish Research Council (Vetenskapsrådet, VR) (Grant number 2017- 05572 to AH). The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
All methods were carried out in accordance with relevant guidelines and regulations. Ethical clearance was obtained for the overall SPT evaluation from the Institutional Ethical Committee of Ifakara Health Institute and National Institute of Medical Research in Tanzania and from the Ethics Review Board of the Commune of Stockholm, Sweden. Permission to use the two data bases for our study was granted with the Ministry of Health, Community Development, Gender, Elderly and Children, the President s Office, Regional Administration and Local Governments and the respective Regional Administrative Secretaries and Hospital Authorities during stakeholder consultation, need for individual consent was thus deemed unnecessary according to national regulations and this approach was approved by the IRB of Ifakara Health Institute and National Institute of Medical Research. No identifiable variables such as names of individuals were collected during this study. Names of health facilities involved in the study were not used for reporting. No administrative permissions apart from the above mentioned, were required to access the raw data used in our study.
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
Data Availability
All relevant data is within the manuscript and the accompanying Supplementary files. The full SPT data set is stored on the institutional server of Ifakara Health Institute. In line with restrictions set by the Tanzanian ethics committees, access to the full data is only available to involved researchers on reasonable request. They will be asked to complete a data sharing agreement with the National Institute for Medical Research Ethics Committee and Ifakara Health Institute’s Institutional Review Board as per policy in Tanzania. Data requests may be sent to the secretary of the independent Institutional Ethics Review Board associated to Ifakara Health Institute, Dr. Mwifadhi Mrisho via email to mmrisho{at}ihi.or.tz.
List of Abbreviations
- ANC
- Antenatal Care
- DHIS2
- District Health Information System
- DQR
- Data Quality Review
- HCPs
- Health Care Providers
- IPT
- Intermittent Preventive Treatment
- HMIS
- Health Management Information System
- LC
- Labour Care
- PNC
- Postnatal Care
- SPT
- Smart Paper Technology
