Abstract
Background Children who receive pre-referral rectal artesunate (RAS) require urgent referral to a health facility where appropriate treatment for severe malaria can be provided. However, the rapid improvement of a child’s condition after RAS administration may influence a caregiver’s decision to follow this recommendation. Currently, the evidence on the effect of RAS on referral completion is limited. In this study, we investigated the relationship between RAS implementation and administration and referral completion.
Methods and Findings An observational study accompanied the roll-out of RAS in three malaria endemic settings in the Democratic Republic of the Congo (DRC), Nigeria and Uganda. Community health workers and primary health centres enrolled children under five years with suspected severe malaria before and after the roll-out of RAS. All children were followed up 28 days after enrolment to assess their treatment seeking pathways, treatments received, and their health outcome. In total, 8,365 children were enrolled, 77% of whom fulfilled all inclusion criteria and had a known referral completion status. Referral completion was 67% (1,408/2,104) in DRC, 48% (287/600) in Nigeria and 58% (2,170/3,745) in Uganda. In DRC and Uganda, RAS users were less likely to complete referral than RAS non-users in the pre-roll-out phase (adjusted odds ratio [aOR] = 0.48, 95% CI 0.30–0.77 and aOR = 0.72, 95% CI 0.58–0.88, respectively). Among children seeking care from a primary health centre in Nigeria, RAS users were less likely to complete referral compared to RAS non-users in the post-roll-out phase (aOR = 0.18, 95% CI 0.05–0.71). In Uganda, among children who completed referral, RAS users were significantly more likely to complete referral on time than RAS non-users enrolled in the pre-roll-out phase (aOR = 1.81, 95% CI 1.17–2.79).
Conclusions The findings of this study raise legitimate concerns that the roll-out of RAS may lead to lower referral completion in children who were administered pre-referral RAS. To ensure that community-based programmes are effectively implemented, barriers to referral completion need to be addressed at all levels. Alternative effective treatment options should be provided to children unable to complete referral.
Introduction
Rectal artesunate (RAS) is a potentially life-saving pre-referral treatment for children presenting at the primary health care level with suspected severe malaria [1]. Current guidelines require that children who received RAS be referred immediately to a health facility where comprehensive management of severe malaria can be provided [2]. However, the rapid improvement of a child’s condition after the administration of RAS [3] may result in children not being taken to a referral health facility (RHF) where appropriate treatment is available [4].
According to World Health Organization (WHO) guidelines, appropriate post-referral treatment of severe malaria consists of an intramuscular or intravenous antimalarial for at least 24 hours followed by a full course of an oral artemisinin-based combination therapy (ACT) and accompanied by the management of clinical complications [5]. Previous studies on RAS and referral defined referral completion as going to the nearest health facility, irrespective of the facility’s capacity to treat severe malaria [4, 6-10]. In the case of children first treated with RAS by a community health worker (CHW), this may be a primary health centre (PHC) that lacks the capacity to manage a severe malaria episode. In view of improving the case management of such children, more evidence is needed to understand the pathways by which children with suspected severe malaria reach a competent and capacitated health care provider and whether referral completion is impacted by the administration of RAS.
There is evidence that children who received pre-referral treatment were less likely to complete referral than children without treatment prior to referral [11, 12]. However, this kind of evidence for RAS as a pre-referral treatment is scarce. Most previous quantitative studies on RAS and referral completion did not compare RAS users versus non-RAS users [8-11, 13], and thus did not estimate the potential effect of RAS administration on referral completion. Only one observational study tested for non-inferiority of referral completion among children receiving RAS compared to children not receiving RAS [6]. The authors concluded non-inferiority because the pre-defined margin of 15% was not reached; however, referral completion in RAS users (84%) was lower than in non-RAS users (94%). In addition, the analysis did not control for other factors influencing referral completion. Factors that have previously been shown to influence referral completion are household dynamics and priorities, illness severity, the type of referring provider, the performance and result of diagnostic tests prior to referral, health workers’ communication skills, distance to the RHF, referral and treatment costs, and the perceived quality of the RHF [4, 6-8, 11-16].
The Community Access to Rectal Artesunate for Malaria (CARAMAL) project included an observational study accompanying the implementation of RAS in the Democratic Republic of the Congo (DRC), Nigeria and Uganda and is described in detail in a companion paper [17]. The training provided to CHW and staff of PHCs during the roll-out of RAS emphasised the need to refer severely sick children to an appropriate and recognised RHF capable of managing the child’s severe condition, rather than to the nearest or next-higher level provider. This manuscript aimed to assess referral completion of children with suspected severe malaria and its relationship with RAS implementation and administration, taking into consideration other factors influencing referral completion. The key study results are described elsewhere [18] and the treatment patterns in the RHF are described in [19].
Method
Study design
This observational study followed the implementation of pre-referral RAS in three study areas in DRC, Nigeria and Uganda. Local health authorities in collaboration with UNICEF trained community-based providers on the use and administration of rectal artesunate. Community-based providers enrolled children under five years of age with fever and danger signs according to the national integrated community case management (iCCM, in the case of CHW) or integrated management of childhood illness (IMCI, in the case of PHC) guidelines. All eligible children were followed up one month after enrolment by dedicated research staff.
The study period covered approximately ten months before the implementation of RAS (pre-roll-out: May 2018 – February 2019) and 17 months thereafter (post-roll-out: March 2019 – August 2020).
Study setting
The study was conducted in three districts in Uganda (Kole, Oyam, Kwania), three Local Government Areas (LGA) in Adamawa State in Nigeria (Fufore, Song, Mayo-Belwa) and three health zones in the Democratic Republic of the Congo (Kenge, Kingandu, Ipamu). The overall study population was 2.5 million of which 476,000 (19%) were children under 5 years. Further details are provided elsewhere [17].
The public health system in the study areas consisted of several levels of community-based providers and at least one level of RHFs (Table 1). Community-based providers implementing pre-referral RAS included CHWs and PHCs. In the study health zones in DRC, CHWs were located in communities with no formal provider within a distance of 5km. In the study LGAs in Nigeria, CHWs were located in communities that were more than 5km away from a public health facility, or the community was hard to reach due to bad road conditions or natural barriers like rivers or mountains. In the study districts in Uganda, there were two CHWs per village irrespective of the presence of other formal health care providers.
According to national policies, community-based providers should refer severely ill children to the nearest higher-level health care provider. In the case of CHWs, these are often PHCs (e.g. in Uganda, a Village Health Team may refer a child to a Health Centre II). During RAS roll-out, community-based providers who were trained in the administration of pre-referral RAS were instructed to refer children immediately to a designated RHF. The importance of speedy referral was emphasized in the training. Simultaneously, UNICEF implemented behaviour change communication campaigns that informed caregivers about the benefits of RAS and the importance of referral completion. In Uganda and DRC, there were no interventions in place to support referral to a RHF. In Nigeria, an Emergency Transport System for severely ill children was introduced in July 2019, shortly after the implementation of RAS.
Data collection
Local research partners established a patient surveillance system for the enrolment and follow-up of children with suspected severe malaria presenting to CHWs or PHCs in DRC and Nigeria, and to CHWs in Uganda. Children were enrolled if they were under five years, had a history of fever and at least one danger sign for which RAS is indicated as per national iCCM and IMCI guidelines. Upon enrolment, community-based providers conducted a malaria rapid diagnostic test (mRDT) for study purposes. After referring the child to a higher-level provider, the enrolling provider reported the case to the local study office where eligible children were recorded in a central case register. In Nigeria and Uganda, this contact happened via telephone. In DRC, community-based providers were regularly visited by CARAMAL research staff to record provisionally enrolled children in the central case register. Dedicated CARAMAL staff were stationed in RHFs in the study area to record the post-referral management of referred children who were admitted for treatment. CARAMAL research staff scheduled an interview 28 days after enrolment. Deceased children were followed up two months after enrolment to respect the mourning period. At the follow-up visit, caregivers or other knowledgeable family members provided information on signs and symptoms, treatment seeking history, diagnosis and treatment during the child’s illness episode. The interviewer also recorded the geo-coordinates of the home location of the child. Additional information on the child’s condition and administered treatment upon enrolment was obtained from the enrolling provider.
Data was collected electronically on tablets with ODK Collect (https://opendatakit.org/). During admission, CARAMAL research staff at RHFs recorded information on case management on paper forms before entering it into ODK Collect. The password protected ODK Aggregate server was hosted at the Swiss Tropical and Public Health Institute in Switzerland.
Outcomes and explanatory variables
The primary outcome of this analysis was referral completion, defined as a child being brought to one of the designated RHFs at any stage during the treatment seeking process, after seeing a community-based provider, as reported by the caregiver or by CARAMAL staff stationed at the RHF. Secondary outcomes included going to any other public provider after seeing a community-based provider and going to a provider outside of the public health system after seeing a community-based provider. A further secondary outcome was timely referral completion defined as reaching a RHF on the same or next day after enrolment. The number of days between enrolment and reaching a RHF was either calculated as the difference between the enrolment date and the date of admission at a RHF, or obtained from the treatment seeking narrative as reported by the caregiver during follow-up.
The main exposures of interest were the RAS implementation phases (pre-roll-out vs. post-roll-out) and pre-referral RAS administration in the post-roll-out phase. To assess these effects, we grouped children into three study groups: 1) pre-RAS, 2) RAS non-users in the post-RAS phase and 3) RAS users in the post-RAS phase. We accounted for age and sex of the child and the interviewed caregiver, and the child’s place of residence (health zone/LGA/district). The severity as perceived by the caregiver and the presence of a danger sign involving the central nervous system (CNS; convulsions, unusually sleepy, or unconscious) were proxies for disease severity. Additional factors considered included the mRDT result at enrolment, the type of community-based provider (CHW vs. PHC), the season, day of enrolment (workday vs. weekend), enrolment during the Covid-19 pandemic (April 1st, 2020 or later), treatment seeking delay between the onset of illness and going to the enrolling provider, the means of transport to enrolling provider, travel time between home and nearest RHF and the administration of home treatment before presentation to enrolling provider.
To calculate the travel time between the home of the child and the nearest RHF, we used the Malaria Atlas Project friction surface 2015 [20] with a 100 m × 100 m resolution. The calculation was done in RStudio [21] using the method described by Bertozzi-Villa [22]. Geolocations of RHFs were obtained from the CARAMAL Health Care Provider Surveys for RHFs within the study area and from Maina et al. [23] for RHFs surrounding the study area. All geolocations were verified using Google Maps [24] and official government sources, where applicable [25, 26].
Statistical analysis
For each country, we used a logistic regression model to estimate the association of the implementation of RAS and RAS administration with referral completion. For children completing referral, we used logistic regression models to estimate the association between RAS implementation and administration and referral timeliness. All models included the enrolling PHC or CHW as random effects to account for clustering at that level. Exposure variables were selected based on rational grounds prior to analysis and included in the final model irrespective of their level of significance. Variables to test for interactions were chosen a priori. The interactions included in the final model were significant at the 5% level. Observations with missing values for referral completion were excluded from the regression analysis. Statistical analyses were performed in Stata SE 16.1 [27].
Ethics
The community-based providers informed caregivers about the CARAMAL study prior to enrolment and caregivers gave oral pre-consent to be contacted for a follow-up interview. We obtained written consent from all caregivers of provisionally enrolled children either at the RHF or before the follow-up interview 28 days after enrolment.
The CARAMAL study protocol was approved by the Research Ethics Review Committee of the World Health Organization (WHO ERC, No. ERC.0003008), the Ethics Committee of the University of Kinshasa School of Public Health (No. 012/2018), the Health Research Ethics Committee of the Adamawa State Ministry of Health (S/MoH/1131/I), the National Health Research Ethics Committee of Nigeria (NHREC/01/01/2007-05/05/2018), the Higher Degrees, Research and Ethics Committee of the Makerere University School of Public Health (No. 548), the Uganda National Council for Science and Technology (UNCST, No. SS 4534), and the Scientific and Ethical Review Committee of CHAI (No. 112, 21 Nov 2017). The study is registered on ClinicalTrials.gov (NCT03568344).
Results
Study population
Between May 2018 and August 2020, community-based providers provisionally enrolled 8,365 children (Supplement 1). The study team successfully followed up 7,593 (91%) children and obtained informed consent. Of those, 6,505 (78%) children fulfilled all inclusion criteria of which 6,449 had a known referral status (77%). The majority of included children were enrolled after the implementation of RAS (n=4,396, 68%). Particularly in DRC, the sample receiving RAS in the post-RAS phase was substantially larger (N = 1,548) compared to the other two study groups (pre-RAS: N = 368; post-RAS non-users: N = 188) (Table 2). In Nigeria, the sample sizes across study groups were balanced. In Uganda, the number of children enrolled in the pre-RAS phase (N = 1,479) was comparable to the number of children receiving RAS in the post-RAS phase (N = 1,631); however, the number of children not receiving RAS in the post-RAS phase was substantially smaller (N = 635).
Within each country, the age and sex distribution were similar among children enrolled in the pre-RAS phase, RAS users and non-users in the post-RAS phase. In Nigeria, there were fewer children under one year than in the other countries. Danger signs involving the CNS were most common in Uganda followed by Nigeria and DRC. In all countries, more than 90% of eligible children tested positive for malaria at enrolment. In DRC, eligible children were almost exclusively enrolled by PHCs (95%), while in Uganda all children were enrolled by CHWs. In Nigeria, a higher proportion of children were enrolled by CHWs in the pre-RAS phase (72%) compared to the post-RAS phase (42%). In the post-RAS phase, between 19% (Uganda) and 30% (Nigeria) of the children were enrolled during the Covid-19 pandemic. In all countries, the proportion of children receiving RAS was higher during the Covid-19 pandemic.
Referral completion
In DRC, overall 1,408 (67%) children completed referral to a designated RHF. Few children went to another public provider (6%) or to any other provider (3%). In Nigeria, 287 (48%) children completed referral to a designated RHF. An additional 21% of the children went to another public provider and only 4% of the children went to a non-public provider. In Uganda, 2,170 (58%) of the children completed referral to the designated RHFs. Going to another public provider was infrequent (9%), but 29% of the children in Uganda were brought to providers outside of the public health system.
In all countries, referral completion to a RHF was slightly lower among RAS users compared to RAS non-users in the post-RAS phase (Figure 1, Table 3 and Table 4). In DRC and Uganda, referral completion in the post-RAS phase was comparable to referral completion in the pre-RAS phase. Meanwhile in Nigeria, referral completion increased from the pre-RAS to the post-RAS phase. The difference between the pre-RAS and post-RAS phase was mainly driven by PHC enrolments being substantially more likely to complete referral to a RHF than CHW enrolments, in combination with an increase in the number of PHC enrolments in the post-RAS phase (Figure 2).
In both DRC and Nigeria, going to any other provider than a RHF was uncommon for PHC enrolments (Figure 2); but seemed more common for CHW enrolments who frequently went to a public provider other than a designated RHF. In Uganda, children rarely went to another public provider but tended instead to go to a private provider, compensating the lower referral completion to a RHF in the two post-RAS study groups (Figure 1).
In DRC and Uganda, referral completion was lower in the post-RAS phase compared to the pre-RAS phase after adjusting for other factors, irrespective of whether children had received RAS (Table 3). The opposite occurred in Nigeria, where referral completion in the post-RAS phase irrespective of RAS use was higher compared to the pre-RAS phase (Table 4).
When taking RAS non-users in the post-RAS phase as a reference, the odds of completing referral did not significantly differ between children not receiving RAS and children receiving RAS in DRC (adjusted odds ratio (aOR) = 1.39, 95% confidence interval (CI) 0.82–2.35) and Uganda (aOR = 0.90, 95% CI 0.70–1.16). In Nigeria, the same was true for children enrolled by a CHW (aOR = 2.51, 95% CI 0.76–8.24); however, among children enrolled by a PHC, those who had received RAS were significantly less likely to complete referral than those not receiving RAS in the post-RAS phase (aOR = 0.18, 95% CI 0.05–0.71).
Besides RAS implementation and RAS administration, we found other factors significantly associated with referral completion. In all countries, increasing travel time to the RHF had a negative effect on referral completion. In DRC and Nigeria, children were more likely to complete referral if they were referred by a PHC compared to a CHW (not applicable in Uganda). Other factors that had a positive effect on referral completion included being perceived fatally ill by the caregiver (DRC), having received home treatment (DRC) or being enrolled on a workday (Uganda). Factors with a negative effect on referral completion included having a CNS danger sign (DRC) or being enrolled during the Covid-19 pandemic (Nigeria).
The adjusted odds ratios did not differ substantially from the unadjusted estimates except for the effect of the malaria test result in DRC and being enrolled by a PHC in Nigeria. Unadjusted estimates are provided in Supplement 2.
Referral timeliness
Of the 3,865 children that completed referral to a RHF, data on the timeliness of referral completion was available for 3,598 children (93%) (Supplement 1). Timely referral completion to a RHF on the same or next day after seeing a community-based provider was 76% in DRC, 86% in Nigeria and 92% in Uganda. In all countries, timely referral was highest among children receiving RAS in the post-RAS phase; however, the differences between study groups were rather small (Figure 3). After adjusting for other factors, children in Uganda receiving RAS in the post-RAS phase were significantly more likely to complete referral on time than children in the pre-RAS phase (OR = 1.81, 95% CI 1.17–2.79). Other comparisons between study groups were not significant in any of the countries. Complete tables with denominators and regression results are presented in Supplement 3.
Discussion
After the administration of pre-referral RAS, current guidelines recommend referral completion to a health facility where intramuscular or intravenous treatment is available [5]. Findings from previous studies on RAS and referral completion were mostly reassuring; however, the effect of RAS on referral completion was either not adjusted for other factors [6] or did not compare RAS users to non-users [8-11, 13]. Additionally, none of the studies took into consideration that the nearest health facility might not have the capacity of administering parenteral antimalarial treatment. The CARAMAL Project for the first time provides adjusted estimates of the effect of RAS on referral completion to a RHF at which, according to national policy, appropriate post-referral treatment is available. Post-referral treatment with an injectable antimalarial followed by a full course of ACT ensures that children are effectively treated for severe malaria, and RAS (and parenteral artemisinin) is not applied as a monotherapy, thereby reducing the risk of the development and selection of artemisinin-resistant parasites [5].
This study provides evidence that the large-scale introduction and use of RAS can affect referral completion. In DRC and Uganda, referral completion was lower in the post-roll-out phase compared to the pre-roll-out phase. In Nigeria, the opposite was the case. However, in Nigeria, children who were administered RAS in a PHC were less likely to complete referral to a RHF than children who did not receive RAS. Referral completion by children attending a PHC in Nigeria and DRC was consistently higher when compared to the referral completion of children attending a CHW (not applicable in Uganda). In all countries, children living a greater distance from a RHF (measured in the time it would take to travel to the facility) were significantly less likely to complete referral than those living in the vicinity of the facility. In all countries, the majority of children that completed referral to a RHF did so on the same or next day after being referred.
The findings of this study raise legitimate concerns that the roll-out of RAS may lead to lower referral completion in children who were administered pre-referral RAS. The comparison of RAS users and RAS non-users in the post-roll-outs phase in Nigeria strongly suggests that RAS administration negatively affected referral completion of children enrolled in a PHC. In DRC, a comparison of RAS users versus non-users in the post-roll-out phase was limited by the comparatively small number of non-users. Therefore, the significantly lower referral completion of RAS users compared to the referral completion of children enrolled in the pre-roll-out phase may indicate that referral completion was negatively affected by RAS administration; even though other causal links cannot be excluded. The reason for a decrease in referral completion after RAS use is most likely the rapid improvement of children after RAS administration, a result of the fast reduction of the parasite to blood concentration and the drug’s antipyretic effect [28-31]. Considering that treatment seeking is often delayed due to lack of transport and money [32-34], the child’s condition may have improved in the meantime. In such a situation, a caregiver is likely to balance between the referral recommendation and priorities at home, in addition to expenses for transport and those that would be incurred at the RHF [4]. Obviously, such a practice raises the concern that children may not receive the appropriate post-referral treatment with potentially fatal consequences.
Measures to improve referral completion must take into consideration the actual capacity of RHFs to provide appropriate case management for severe malaria. As opposed to previous studies, this study considered referral to be completed only if the patient arrived at a RHF with the capacity to manage severe malaria cases. However, an analyses of the quality of care at RHFs in the CARAMAL study areas found that the treatment of children with severe malaria was often inadequate [19]. Meanwhile, some children sought post-referral treatment from a lower-level public or from a non-public provider. Considering that referral completion did not improve the health outcome of children enrolled in the CARAMAL study in DRC and Uganda [18] sufficient treatment may have been provided by non-RHF providers [35]. It is also possible that less severely sick children recover faster and are hence less likely to be brought to a RHF after pre-referral RAS treatment. Therefore, children with suspected severe malaria first attending a community-based provider may not always require treatment at the level of RHFs. However, recognizing such children with a more moderate form of severe malaria remains a challenge.
The finding that a substantial proportion of children (33–52%) did not complete referral emphasizes the need to address referral-related barriers at all levels: sensitizing caregivers, properly training community-based health care providers, facilitating access to and increasing trust in RHFs. Such a package of supportive interventions accompanying the roll-out of RAS in Zambia has previously been shown to reduce the mortality of children with severe malaria [36]. In a trial conducted by Gomes et al. [1], RAS had a protective effect in the context of high completion of referral (though not necessarily to a RHF in the African sites). In the CARAMAL study in Nigeria, the implementation of an Emergency Transport System most likely increased referral completion, and referral completion significantly improved the health outcomes of children with suspected severe malaria in this country. The available evidence strongly indicates that community-based programmes should always be accompanied by measures strengthening referral.
Irrespective of the effort to strengthen referral, it is important to acknowledge that some caregivers to children may delay or not complete referral. Therefore, the training materials and referral guidelines for community-based providers need to emphasize the importance of a close follow-up of severely sick children, if necessary at their home. If referral cannot be completed or is refused by the caregiver, the treatment with pre-referral drugs should be continued. Such a recommendation already exists for RAS until oral treatment with an ACT is tolerated [2]. Similarly, the WHO recommends that CHWs continue administering amoxicillin to children with pneumonia with chest in-drawing if referral is not feasible [37]. Sufficient stocks of pre-referral drugs are therefore essential for providing adequate care to children unable to complete referral.
Referral completion to a RHF was a problem particularly among CHW enrolments in DRC and Nigeria. Unlike in Uganda, CHWs in these two countries are placed in especially hard-to-reach areas. In our analyses, we accounted for difficulties in geographical access to a RHF (availability of transport and travel time to RHF), but we may have missed additional barriers to accessing a RHF. Another explanation could be that children attending a PHC are more severely ill than children attending a CHW [38]. Caregivers may be more likely to make increased efforts to reach the first provider as well as to complete referral if the child is more severely ill. Meanwhile, irrespective of the reasons, an active follow up of children at home seems to be particularly important in the most hard-to-reach places where referral completion is the least likely. As community programmes continue to be the preferred approach to extend health services to remote communities, the challenges associated with these hard-to-reach places need to be acknowledged in referral and treatment guidelines and the promotion of best practices.
Even though treatment seeking practices including referral are highly contextual, some recommendations based on the results of this study can be generalised to other settings. That is, programmes implementing RAS need to consider the potential effects on referral completion. More generally, community-based programmes should be supported by measures facilitating referral completion, and provide a back-up option for those children who fail to complete referral. Alternative treatment options are particularly important in hard-to-reach places.
This study has several strengths. First, it covered three different contexts with varying intensities of malaria transmission, access to health care, and differences in the implementation of iCCM/IMCI policies [17]. Secondly, the study was community-based and enrolled a large number of children with severe febrile illness from remote communities. Large community-based studies in far-to-reach places are mostly cross-sectional surveys that rarely capture severe illness episodes because of their low incidence, and always exclude children that are deceased, resulting in a lack of understanding of severe illnesses at community level [39]. Thirdly, the study achieved a high follow-up rate, thereby reducing the risk of selection bias.
This study comes with several limitations. First, the low enrolment numbers of children not receiving RAS in the post-roll-out phase did not allow a clear conclusion about the effects of RAS administration on referral completion after the roll-out of RAS in DRC. Secondly, the enrolment strategy in Nigeria and Uganda may have introduced selection bias. The notification of enrolments from the enrolling provider to the local study office depended on a contact via mobile phone. Thus, the study may have excluded systematically children in the most remote places because of unstable network coverage. It is likely that these children would have also been the least likely to complete referral leading to an overestimation of referral completion in our study. Thirdly, the observational design and the retrospective data collection 28 days after enrolment did not allow for direct causal inferences.
Conclusion
Providing prompt and appropriate health care to severely sick children in remote communities remains a challenge. Children in hard-to-reach places are the least likely to complete referral after seeing a community-based provider. In addition, referral completion may further be negatively affected by the administration of RAS. To ensure that community-based programmes are effectively implemented, barriers to referral completion need to be addressed at all levels. Alternative effective treatment options should be provided to children unable to complete referral.
Data Availability
Individual de-identified participant data that underlie the results reported in this article are available at zenodo.org upon reasonable request (DOI: 10.5281/zenodo.5570278).
Funding
This study was funded by Unitaid.
Conflict of Interest Statement
All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf and declare: all authors had financial support from Unitaid for the submitted work; no financial relationships with any organizations that might have an interest in the submitted work in the previous three years; no other relationships or activities that could appear to have influenced the submitted work.
Data availability
Individual de-identified participant data that underlie the results reported in this article are available at zenodo.org upon reasonable request (DOI: 10.5281/zenodo.5570278).
Supporting information captions
Supplement 1. Inclusion flow-charts
Supplement 2. Table S2.1. Estimated associations between child characteristics and referral completion, DRC.
Supplement 2. Table S2.2. Estimated associations between child characteristics and referral completion, Nigeria.
Supplement 2. Table S2.3. Estimated associations between child characteristics and referral completion, Uganda.
Supplement 3. Table S3 1. Estimated associations between child characteristics and referral timeliness, DRC.
Supplement 3. Table S3 2. Estimated associations between child characteristics and referral timeliness, Nigeria.
Supplement 3. Table S3 3. Estimated associations between child characteristics and referral timeliness, Uganda.
Acknowledgements
The authors would like to express their sincere thanks to the children and their caregivers who agreed to participate in this study; the health workers and local and national health authorities who provided their support; the study teams of the School of Public Health in Kinshasa (DRC), Akena Associates (Nigeria), and Makerere University School of Public Health (Uganda); and the colleagues of the local CHAI and UNICEF offices. We greatly appreciate Aurelio DiPasquale’s support with the ODK software and Robert Canavan’s editorial support.