Determinants of COVID-19 data quality in the District Health Information Management System version 2 in Ahafo Region, Ghana

Introduction

Assessing the progress toward the Sustainable Development Goals (SDGs), World Health Organization (WHO) Triple Billion targets, and national or subnational health priorities requires a well-functional and proactive health information management system (HIMS) with high-quality data, especially in developing countries (1,2). Therefore, in ensuring public health efforts in combating pandemics, transparent data reporting that is of high quality and easily accessible is crucial for addressing outbreaks like coronavirus disease 2019 (COVID-19) (2–4). The WHO recommends four data quality dimensions including completeness, accuracy, consistency, and timeliness that need to be ensured at all levels of reporting (5). The repercussions of poor data quality in the health sector are significant, as they undermine efficient resource allocation and jeopardize national and international investments (2,6). Inaccurate data minimizes the effective monitoring of pandemics, global immunization initiatives and also increases the risk of vaccine-preventable disease outbreaks by failing to identify areas with low vaccination coverage (7,8). In the United States of America (USA), poor data quality is the third leading cause of death (9).

Globally, as data quality presents a significant concern, approximately 40% of countries lack evident adherence to quality data assurance processes which are mainly collected by national HIMS (2,5). For example, as of July 6, 2020, France had incomplete COVID-19 data on ages, while Armenia, Luxembourg, North Macedonia, Turkey, Serbia, and Bosnia-Herzegovina had no age data available. Similarly, as of May 1, 2020, the United States of America lacked a standardized system for COVID-19 data reporting, leading to significant discrepancies in data quality among different states and counties (8,10). Although there is no perfect health data due to missing values, bias, measurement, transcription, and human entry errors, most of these data problems chiefly occur in developing countries (11–14). Poor data quality in the health sector can be attributed to various factors, including inadequate training of data managers and healthcare staff, limited access to resources such as technology and reporting tools, and data fragmentation due to disparate systems (2,11,15,16). Data entry errors and lack of supervision and quality control also contribute to inaccuracies, alongside overwhelming workloads and time constraints that lead to rushed data entry (8,9,15). Furthermore, the absence of a dedicated data validation team, inconsistent reporting practices, and the lack of data governance and standardization further compromise data quality (7,17).

COVID-19 disease, caused by severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2) was declared a pandemic and non-Public Health Emergency of International Concern in March 2020 and May 2023 respectively by WHO (3). The COVID-19 pandemic required continuous reporting formats via the Surveillance Outbreak Response Management and Analysis System (SORMAS) and/or HIMS across the globe (3,8). The Ghana Health Service under the Ministry of Health implemented the District Health Information Management System (DHIMS-2) software in 2008 to assist all districts, regions, and national managers in the analysis of routine health service data, planning, policy implementation, and also for enhancing health information reliability (6,18). In 2020, SORMAS, another web-based tool was also integrated into DHIMS-2 for reporting COVID-19 data. The DHIMS-2 utilizes three data dimensions (completeness, accuracy, and timeliness) in assessing data quality (18) which is employed in this study. Endriyas and colleagues re-echoed that completeness, accuracy, and timeliness are the most crucial indicators of data quality measurements (15). When these indicators are corrected, the other possible dimensions of data quality will automatically be addressed (15,19).

Ahafo Regional Health Directorate is one of the recently created directorates in Ghana which is confronted with resource constraints and inadequate technical human resources (20). The directorate was automatically hooked onto the DHIMS-2 and started recording high COVID-19 cases after the first case was registered in March 2020, the same month the country recorded its first incident (21). Data documentation and reporting of COVID-19 diseases then took center stage, although numerous studies have shown that data from Ghanaian health facilities are of poor quality in terms of accuracy and timeliness (18,22,23). This highlights the need to assess COVID-19 data quality using the three dimensions of data quality at different levels of the healthcare system. Such a study will not only furnish health managers in the Ahafo Region and across the 16 regions in Ghana with concrete ideas and knowledge on COVID-19 data quality challenges in the DHIMS-2 but will also recommend strategies to strengthen data quality for routine healthcare reporting and unforeseen disease outbreaks. Additionally, since the creation of the directorate in May 2019 (20), and the adoption of DHIMS-2 as a standard tool for reporting health data (21), no studies have been conducted in the Ahafo Region and Ghana at large to evaluate the quality of data on DHIMS-2, especially in the era of the COVID-19. In this regard, this study seeks to assess the determinants of COVID-19 data quality in the DHIMS-2 of the Ahafo Region in the middle belt of Ghana.

Methods and materials

Results

Descriptive analysis of COVID-19 monthly data quality from 2020 to 2022

All the 782 COVID-19 monthly reports comprising 34 months from 23 health facilities were collected and reviewed. The overall rates of data completeness, accuracy, and timeliness of the monthly COVID-19 report were 50.6% (95%CI=47.1%, 54.2%), 50.2% (95%CI=46.7%, 53.8%), and 72.4% (95%CI=69.1%, 75.5%) respectively. Meanwhile, the overall data quality was estimated at 35.9% (95%CI=32.6%, 39.4%) (Table 2).

Furthermore, the trend analysis of data completeness, accuracy, and timeliness in the region is illustrated in Figure 1. Data completeness of the COVID-19 report was from 30% in March 2020 which gradually increased to 70% in May and June 2022, before declining steadily to 57% in December 2022. Furthermore, the rate of data accuracy across the 34 months was generally low, starting from 18% in March 2020, with several rises and falls in between, before reaching 50% in December 2022. The records review at the various facilities revealed that COVID-19 reporting was introduced into the DHIMS-2 in July 2020 which accounted for the zero-timeliness rate from March to June 2020. Compared with data completeness and accuracy, the rate of data timeliness was generally high. The trend of data timeliness started at 73% reaching its lowest rate (43%) in December 2020 and its highest rate of 100% in August and September 2022, before declining to 83% in December 2022.

• Download figure
• Open in new tab

Figure 1: Trend of COVID-19 data quality from facilities in Ahafo Region of Ghana (2020 - 2022)

Discussion

The provision of safe and dependable healthcare relies on the availability of high-quality data (4). In addition, the monitoring of health performance is heavily dependent on quality data obtained from health facilities (2). This study aimed to assess the estimates and determinants of COVID-19 data quality in DHIMS-2 in the Ahafo Region of Ghana, by reviewing all COVID-19 monthly reports from March 2020 to December 2022.

Most of the COVID-19 reports (87%) were submitted by government-owned health facilities with few reports from mission and private facilities. This was expected as the majority of mission and private facilities in the region could not conduct COVID-19 tests during the early stages of the COVID-19 pandemic, therefore all suspected cases were sent to government-owned facilities for testing and possible management. Although there are several studies about COVID-19 in general (8,11), no or very scanty published studies on COVID-19 data quality are available which renders this study unique. Therefore most of these data quality estimates in this study were compared with other health indicators like maternal and child health as well as expanded program on immunization.

We found the completeness, accuracy, and timeliness of COVID-19 data reports in the region to be 50.6%, 50.2%, and 72.4% respectively with an overall data quality of 35.9%. Ouedraogo and colleagues reported data completeness and timeliness of 34% and 32% on selected MCH indicators respectively in Kersa City, Ethiopia which is less than our study results (26). Additionally, another study in sub-Saharan Africa reported the data accuracy rate of confirmed malaria as 46.4%, and that of antenatal care fourth visit as 46.6% (15) which are all lesser as compared to the results of the current study. The plausible reason for these indifferences could be attributed to greater political commitment to COVID-19 as compared to the MCH indicators which are regarded as routine data in healthcare delivery. Notwithstanding, the overall data quality of MCH indicators in Central Ghana was estimated at 93% (23) which is higher than our study estimate of 35.9%. Despite the political commitment to COVID-19 management, the disparity may be due to the higher number of monthly data reports and the novelty nature of COVID-19. More COVID-19 data was assessed and reported over a period of three years which could contribute to reducing COVID-19 data quality compared to MCH data reports assessed over 12 months to determine its quality in the previous studies.

Health facilities having functional data validation teams were more likely to report quality COVID-19 data (complete, accurate, and timely data) onto DHIMS-2. Coherent to studies in Tanzania, health facilities with data validation teams remain a significant determinant of data quality (27). Among the Ghanaian health facilities, data validation teams are mandated to meet within the first week of every month to review and validate the monthly report of the previous month before it is submitted onto the web-based DHIMS-2 platform. The activities of the data validation team do not only reduce data errors but also enhance the quality of data produced in the health facilities for planning and decision-making (6).

Training on COVID-19 data management was a significant factor for data quality in the Ahafo region which is parallel with the findings of other studies (7,17,28). Data managers should have adequate knowledge about data standards, best practices, and validation techniques to maintain data completeness, accuracy, and timeliness. Understanding data governance, compliance requirements, and ethical considerations is crucial for data privacy and security (2,6). Therefore, trained data managers are more likely to implement quality assurance and control measures to generate quality data at all levels and at all times (5,11). In this study, more than half of the facility data managers (65.2%) received training on COVID-19 data management which requires additional effort to build the capacity of the untrained ones in the Ahafo region. We therefore recommend on-the-job training for all facility staff responsible for data management as capacity development is key to quality data outcomes (2,28).

Data managers possessing a certificate background in the profession were about four times more likely to report quality data into the DHIMS-2. Though this is an unexpected finding, however, the COVID-19 data in most lower-level health facilities such as health centres and CHPS compounds in the Ahafo region were managed and formally reported by enrolled nurses and community health nurses (20). These nurses are mostly certificate holders with two years of school training. Furthermore, these nurses doubling as data managers are well-trained in COVID-19 data management and frequently receive supportive supervision from their senior colleagues and other data managers which makes them more superior in reporting quality data into the DHIMS-2 database.

Limitations of the study

The study encountered some limitations. Our study assessed limited data quality dimensions. Thus, the study assessed three data dimensions (completeness, accuracy, and timeliness) out of the four and six data quality dimensions recommended by WHO (5) and the Data Management Association (DAMA – UK) International (25) respectively. Although COVID-19 was a pandemic that lasted for some time, this omission might result in overlooking other crucial dimensions that could impact the overall data quality.

We assessed 20% (23/120) of health facilities in the region which might affect the generalizability of the findings. The results might not be fully representative of all health facilities in the Ahafo Region of Ghana, which could limit its applicability to other contexts.

Lastly, despite adequate training of data collectors, there could be human or review errors (reporting bias) that might have occurred during the data collection process, which could introduce some inaccuracies in the study results.

Conclusion

The overall COVID-19 data quality from 2020 to 2022 in the Ahafo region was quite poor. While the rate of data timeliness was high, that of data completeness, and accuracy were relatively low. The quality of COVID-19 data for the period was determined by the availability of a functional data validation team at the health facilities, training of data managers in COVID-19 data management, and data managers with two-year professional training (certificate background). The rate and interaction of these independent correlates of COVID-19 data quality require the healthcare system to identify stringent measures to focus on HIMS for planning and decision-making, especially during disease outbreaks and/or pandemics. Continuous training programs, workshops, and capacity-building initiatives for data managers with the necessary expertise in data collection, validation techniques, data entry protocols, and familiarity with reporting systems such as DHIMS-2 should be promoted. By investing in their professional growth, the GHS can empower data managers to adhere to data quality standards and ensure accurate and reliable data. Essential data tools such as reporting forms and registers should also be readily available at all times across health facilities. A dedicated data validation team should be established across all health facilities, and districts health directorates to systematically review and validate data before it is entered into the reporting database system. Providing specialized training to team members on data validation techniques and quality assurance procedures is crucial to ensure high-quality data during epidemics.

Abbreviations

COVID-19

Coronavirus disease 2019

DHIMS-2

District Health Information Management System version 2

HIMS

Health information management system

SARS-CoV-2

Severe acute respiratory syndrome coronavirus-2

SDGs

Sustainable Development Goals

SORMAS

Surveillance outbreak response management and analysis system

WHO

World Health Organization

Consent For Publication

Not applicable

Availability of data and materials

The datasets collected, generated, or analyzed during this study have been attached as supplementary information.

Competing interests

The authors have declared that no competing interests exist.

Funding

This study was funded by The Project for Human Resource Development Scholarship, Japan International Cooperation Agency (JICA), and Nagasaki University School of Tropical Medicine and Global Health, Japan.

Authors’ contributions

FGA, SAG, TA, and HA designed and conceptualized the study. FGA, SAG, SKBB, and HA supervised the data collection exercise which was carried out and supported by CA, SMB, and BBK. FGA, SAG, CA, SMB, BBK, SKBB, and HA performed the data analysis and interpretation. FGA, SAG, TA, and HA initially drafted the manuscript. All authors reviewed and approved the final manuscript.

Authors’ acronyms

Felix Gumaayiri Aabebe (FGA); Silas Adjei-Gyamfi (SAG); Clotilda Asobuno (CA); Samuel Malogae Badieko (SMB); Blaise Bagyliku Kuubabongnaa (BBK); Samuel Kwabena Boakye-Boateng (SKBB); Tsunoneri Aoki (TA); Hirotsugu Aiga (HA)

Supporting information

S1 Figure 1. Trend of COVID-19 data quality from facilities in Ahafo Region of Ghana (2020–2022)

S2 Table 1. Measurement and description of variables

S3 Table 2. Estimates of COVID-19 data quality from facilities in Ahafo Region of Ghana (2020–2022)

S4 Table 3. Frequency distribution and determinants of COVID-19 data quality from facilities in Ahafo Region of Ghana (2020–2022)