Abstract
Two billion pyrethroid long-lasting insecticidal nets (LLINs) have been distributed since 2010 for malaria prevention in Sub-Saharan Africa. Current malaria control strategies rely on an assumed effective 3-year lifespan for LLINs. PBO synergist LLINs are a newly recommended class but there is limited information on their life span and long-term protective efficacy in communities. To assess their operational survival, a cohort of 390 PBO LLINs (Olyset Plus) and 367 standard pyrethroid LLIN (Olyset net) from 396 households were followed for 36 months in Western Tanzania. To assess the association between the condition of the LLIN and malaria infection, nets from at least 480 randomly selected households were assessed during malaria prevalence cross-sectional surveys at 4, 9, 16, 21, 28, and 33 months post-distribution. Information on the presence and condition of nets, and demographic information from the household, were collected to evaluate factors influencing net durability. After 3 years less than 17% of nets distributed were available for sleeping. The fabric condition was not associated with malaria infection in either type of net. The difference between the net types was highest when nets were between 1-2 years old, when PBO nets appeared to be similarly protective as nets less than a year old, whereas standard nets were considerably less protective as they aged, regardless of fabric condition. There was no statistical difference in the estimated median functional survival time between net types with 1.6 years (95% CI 1.38-1.87) for PBO LLIN and 1.9 years (95% CI 1.67-2.06) for standard LLINs. After 3 years, there was a loss of 55% of permethrin content for both nets, and 97% of PBO content was lost in PBO LLIN. These results highlight that functional survival is less than the recommended 3 years for both net types. However, even as the nets age, the PBO nets remained more protective than standard nets, regardless of their condition.
Background
Long-lasting insecticidal nets (LLINs) remain a cornerstone approach for malaria prevention (1) and 2 billion have been distributed between 2010 and 2021 in Sub Saharan Africa(2, 3). The functional survival of LLINs is recommended to be at least 3 years under field conditions(4, 5). Functional survival is characterised by the LLIN remaining in the household, in an acceptable physical condition, and retaining biological activity (giving protection against mosquitoes). Early accumulation of holes and loss of adequate insecticide is listed among the factors hindering LLINs’ functional survival and protective effects(6, 7). For decades, LLINs have been treated with pyrethroid insecticides, due to their high insecticidal activity and low mammalian toxicity(8). However, recent evidence suggests that insecticide resistance in mosquito vectors may have reduced the level of protection provided by pyrethroid-only LLINs(9, 10).
One alternative to pyrethroid-only LLINs is to treat nets with a combination of pyrethroid insecticides and a synergist, piperonyl butoxide (PBO) (11). Piperonyl butoxide (PBO) is not designed to kill insects directly, but when mixed and applied with pyrethroids enhances their potency by inhibiting enzymes that normally act to detoxify insecticides in the insect (12), essentially rendering pyrethroids effective, even in pyrethroid-resistant insects(13). PBO is designed to be effective against mosquitoes whose resistance is based on oxidative metabolism (10). There are currently two brands of LLIN which incorporate PBO that have been assessed in epidemiological trials: Permanet 3.0 (14) and Olyset Plus (10, 15). In these trials, the PBO nets showed better efficacy than standard pyrethroid nets for at least 12 months of monitoring(10, 14, 15). However, there are mounting concerns that the efficacy of PBO LLINs may wane before 3 years because the PBO has been shown to degrade at a fast pace(16). A recent study conducted in Uganda showed that in nets that had been in use in the community, mosquito mortality measured using three-minute WHO cone bioassay decreased quickly however, still remained higher for PBO LLIN compared to standard LLIN over two years (17).
Net durability is a key factor in the effectiveness of nets. As nets deteriorate there is likely to be more vector-human contact; and, in addition, owners are more likely to stop using, discard, or repurpose holed LLINs as they perceive them to be no longer useful (18, 19). To investigate the durability of PBO-nets, we performed a study to investigate the attrition (net loss), physical integrity (number of holes present), chemical content (amount of active ingredient remaining), and the association between holed and aged LLINs and malaria infection in children under 15 years, over three years of use in field conditions. The study took place within a 4 arm factorial cluster randomised control trial (RCT) to evaluate the efficacy of PBO LLIN compared to standard LLINs(20).
Methodology
Study area
The study was conducted in Muleba district (10 45’ S 310 40’ E), in Kagera, in the North-West region of Tanzania on the Western shore of Lake Victoria. Muleba covers an area of approximately 3500km2 at an altitude ranging from 1,100m-1,600m above sea level. The district comprises 43 wards and 160 villages and a population of 540,310 (21). Rainfall occurs in two seasons: the short rains in October–December (average monthly rainfall 160 mm) and the long rains in March-May (average monthly rainfall 300 mm). Malaria transmission in the district occurs throughout the year with two distinct peaks, in June to July and November to January following the long and short rains, respectively. The study area is described in detail elsewhere(10). Briefly, it comprised 48 clusters from 40 villages within 13 wards. A total of 30,000 households were included. The 48 clusters were randomly assigned to one of four arms: (1) conventional standard LLIN (pyrethroid only), (2) PBO LLIN (pyrethroid and PBO), (3) conventional standard LLIN + Indoor Residual Spraying (IRS, with pirimiphos-methyl CS at the dosage of 1–2 g AI/m2 (22)), and (4) PBO LLIN + IRS (Fig 1). Indoor residual spraying (IRS) took place once in February/March 2015.
Net treatment and distribution
As part of the trial, approximately 90,000 LLINs (45,000 PBO LLIN and 45,000 standard LLINs) were distributed to study clusters between 6th-8th February 2015. The nets appeared similar and were blue, rectangular LLINs made from 150 denier polyethylene material. PBO LLIN (Sumitomo Chemicals, Japan) contain the pyrethroid permethrin (20 g/kg) as the active ingredient (AI) and the synergist Piperonyl Butoxide (PBO) (10 g/kg) (23). The standard LLIN (Sumitomo Chemicals, Japan) contains permethrin (20 g/kg) incorporated in the yarn but no synergist (24).
Study Design
Longitudinal LLIN study
The durability of the nets was assessed first in a longitudinal survey, which followed a cohort of nets every year for 36 months. For this study, 100 households per cluster were randomly selected from two clusters receiving PBO LLIN (one with and one without IRS) and two receiving standard LLINs (one with and one without IRS). Net durability was also assessed in 480 households (10 households per cluster) during successive cross-sectional surveys done at 4, 9, 16, 22, 28, and 33 months post-distribution (Table 1).
At enrolment, all nets in selected households hung and in use received a unique ID number, to be easily identified at subsequent visits. At each 12, 24, and 36 months visit, the physical presence of the net was recorded (to assess survivorship) and nets were inspected for holes to estimate functional survival of the LLIN (4). In addition, 10 PBO LLIN and 10 standard LLINs still in use were randomly sampled from the households for insecticide content analysis. All sampled nets were replaced with new nets of the same brand but were not subsequently followed up, and if the selected nets were missing, additional nets were sampled and replaced.
Cross-sectional LLIN study
At each time point, a random sample of 10 households per cluster was selected for LLIN physical durability assessment. If the selected household had no study net, households were not replaced by another. In each household, field assistants randomly selected three study LLINs. In the same selected household, up to three children aged 6 months to 14 years were randomly selected to be tested for malaria infection using a rapid diagnostic test (CareStart Malaria HRP2/pLDH(pf/PAN) Combo, DiaSys, UK). Children diagnosed as malaria positive by the rapid diagnostic test were treated with artemether-lumefantrine according to national guidelines. At the 21-month cross-sectional survey, 10 PBO LLIN and 10 standard LLINs were randomly selected to be used for insecticide content analysis.
LLIN fabric integrity assessment
To assess fabric integrity, nets were mounted onto a 170cm x 180cm x160cm collapsible frame to facilitate the visual assessment of the net (25). The number of holes, location on the net, type of holes, and hole size were recorded. Size was classified into four categories as per WHO guidelines (4, 5): size 1 =0.5–1.99 cm, size 2 =2–9.99 cm, size 3 =10–25 cm and size 4 > 25 cm. Size of holes was measured by superimposing transparent plastic with illustrations of hole sizes.
LLIN insecticidal content
For each net collected for chemical content, one 30 cm x 30 cm net piece was cut from each side of the net following standard WHO procedure (5). These pieces were then uniquely labelled, packed in aluminium foil, and stored at 4°C; and sent to the Liverpool School of Tropical Medicine (United Kingdom) for chemical content analysis using High-Performance Liquid Chromatography (HPLC) (26).
Data analysis
Data collection was done on Personal Digital Assistants (PDAs) using Pendragon Software. The primary outcome was LLIN functional survival (LLIN present and in serviceable condition). Secondary outcomes included (1) malaria infection in children sleeping under LLINs of different physical conditions, and (2) chemical content. All statistical analyses were conducted using STATA release 15 (StataCorp, College Station, TX, USA). Household social and economic wealth indices were constructed and analysed by Principal component analysis (PCA), and households were sub-divided into wealth tertiles. The svy command using cluster as sampling unit was used to account for the clustered design of the study. Comparisons between the two types of nets were tested for significance using the Chi-square (χ2) test allowing for the clustered design.
A sum of the holes identified in the nets were weighted (27) to calculate a hole surface area (HS) = (1.23 x no. of size1 holes) + (28.28 x no. of size2 holes) + (240.56 x no. of size3 holes) + (706.95 x no. size4 holes)(27). Linear regression allowing for survey design was used to compare hole surface area between net products, using log-transformed data to normalise the distribution. Based on the hole surface area, LLINs were assigned to different categories (good <80cm2; damaged=80-789 cm2, and extremely torn ≥ 790 cm2) to determine risk factors associated with the physical state of each LLIN product.
Survivorship, attrition and functional survival were estimated using the longitudinal data and compared between net types and over the three visits using Chi-square (χ2), accounting for the clustered design. Functional survival over time were calculated using cox regression. To aid in functional survival calculations, a questionnaire was used to capture information on net condition and usage, as well as “how many months ago the net was lost/discarded” if the net was no longer in the household at each follow-up point. Then, the number of months was subtracted from the current date to determine the actual month the net was lost. For the longitudinal data, where nets were sampled at multiple timepoints, generalized estimation equations (GEE) using a logit model were used to determine factors associated with the poor physical condition of the 2 net brands accounting for the repeated measures on individual nets and correlations within clusters. In addition, we assessed the factors which were associated with bad net condition using multivariate logistic regression with the cross-sectional data. Factors investigated included net type, net age, socio-economic status (SES) of household, hanging habits of nets, type of beds, type of mattress, net ever washed, indoor residual spraying (IRS), and use of open flames in the household. The association between net physical condition and malaria infection was assessed using multivariate logistic regression analysis, controlling for SES, child age, indoor residual spraying (IRS), and presence of eaves in the house (these variables showed evidence for a possible association with malaria infection, p<0.05).
Ethics
The trial was approved by the ethics review committees of the Kilimanjaro Christian Medical University College, the London School of Hygiene & Tropical Medicine, and the Tanzanian Medical Research Coordinating Committee (NIMR/HQ/R.8a/VolIX/1803). A trial steering committee reviewed progress. Written informed consent from parents or guardians was obtained for each survey.
Results
Nets included in the study
In total, 757 nets (397 PBO LLIN, 360 standard LLIN) from 396 households from four clusters were included in the longitudinal study and followed up for 3 years at 12 months intervals. The proportion of households that were lost to follow-up was 21% (3%-refused, 14%-dwelling vacant for survey duration, and 4% dwelling not found) over the 3 years of the trial. Cross-sectional surveys were conducted every year in June-July and November-December from 2015 to 2017. In total, 2104 LLINs (987 PBO LLIN, and 1117 standard LLINs) from 1,383 households were assessed during cross-sectional surveys. During cross-sectional surveys, the proportion of households with at least one study net for every two people decreased from 50% after 4 months to 7% after 33 months. The proportion of participants reporting using study nets the night before decreased from 71% at 4 months to 21% at 33 months post-intervention.
The demographics of households over surveys and study arms were relatively similar in terms of the average number of sleeping rooms, number of sleeping spaces, education status, main housing materials (Table 2). There was an increase in the number of households with electricity over the study period, from 5% to 19% (Table 2). This was due to the government’s mission to facilitate access to modern energy services in rural Mainland Tanzania through Rural Energy Agency (REA).
LLIN survivorship and attrition
Three years following distribution, survivorship (defined as nets present in surveyed households and available for sleeping under) was 28.8% (95% CI 11.8-54.9) for PBO LLIN and 25.6% (95% CI 22.2-29.3) for standard LLIN. A small proportion of nets were given away, stolen, sold, or used in other locations at each time point and these also did not differ significantly per arm (Table 3). Attrition due to wear and tear (poor net condition) increased from 3% (95% CI 0.3-23.6) at 12 months to 56% (95% CI 37.6-72.4) at 36 months in PBO LLIN and from 4% (95% CI 3.5-4.5) to 63% (95% CI 57.1-68.7) in standard LLINs (Table 3). There were no significant differences in attrition between PBO LLIN and standard LLINs over the study period (p= 0.6816). Comparing survivorship between arms that received IRS and those that did not, there was a significant difference in survivorship at 24 months (p=0.044) and 36 months (p=0.050); where arms without IRS recorded higher survivorship of nets (S2 Table). There was no significant difference in functional survival (defined as the presence of serviceable LLIN) of the 2 net products; 15.4% (95% CI 4.8-39.7) for PBO LLIN and 17.9% (95% CI 14.7-21.5) for standard LLIN (p=0.6929).Estimated median functional survival was relatively similar in both net types (1.9 years (95% CI 1.67-2.06) for standard LLIN and 1.6 years (95% CI 1.38-1.87)) for the PBO LLIN (S1 Table).
Net physical integrity
After 3 years of use, on average, 93% of standard LLIN and 94% PBO LLIN had at least one hole of any size in the longitudinal survey; while on average 63% of standard LLIN and 57% of PBO LLIN had at least on hole in the cross-sectional data (Table 4). Error! Reference source not found.The damage to PBO LLIN was more severe than to standard LLINs across the study period in the longitudinal survey but only significant at 36 month; while this tendency was opposite in the cross-sectional survey. Based on WHO categories, 55% of PBO LLIN and 37% standard LLINs were considered extremely torn after 3 years of field use in the longitudinal survey; whereas in the cross-sectional survey data it was 24% of PBO LLIN and 33% standard LLINs at 33 months post-distribution. Of the nets present in the households but no longer in use as they were perceived unprotective by users after 3 years, 32% (7%-intact, 5%-good, and 20%-damaged) were in good or damaged condition. In both surveys, fabrics of the lower half of both net types were more vulnerable to tear than other parts of the net (S3 Table).
Factors associated with net integrity
Factors that were though to influence net fabric integrity were assessed. These included, net type, net age, SES, type of bed, type of mattress, folding/unfolding the net in the morning, and washing of the net (. The influence of these factors to fabric integrity deferred by survey (longitudinal and cross-sectional survey). In cross-sectional data, factors that were significantly associated with net damage included net age, lowest SES, unfolding the net in the morning, and sleeping under grass or reed mats and washing of the net. however, in longitudinal data, net age, unfolding the net in the morning, and sleeping under no bed frame were significantly associated with net damage.
Table 5). The influence of these factors to fabric integrity deferred by survey (longitudinal and cross-sectional survey). In cross-sectional data, factors that were significantly associated with net damage included net age, lowest SES, unfolding the net in the morning, and sleeping under grass or reed mats and washing of the net. however, in longitudinal data, net age, unfolding the net in the morning, and sleeping under no bed frame were significantly associated with net damage.
Chemical content
At baseline (0 months), all 10 PBO LLIN and 10 standard LLIN samples complied with their target doses of pyrethroid (20 ± 5 g AI/kg) and PBO concentration (10 ± 2.5 g PBO/kg) for PBO LLIN nets (Fig 2). At 12 months, 24 months, and 36 months mean permethrin content in PBO LLIN decreased to 15 g/kg, 6 g/kg, and 9 g/kg, corresponding to a loss of 29.8%, 73.4%, and 56.9% of the original dose, respectively. The mean permethrin content of standard LLINs was 21 g/kg at 12 months, 16 g/kg (23.8% loss of the original dose) at 24 months, and 10 g/kg (53.3% loss) at 36 months. Mean PBO content decreased to 3 g/kg (69.5%) at 12 months and less than 1g/kg (96% loss) after 36 months. Pyrethroid content of nets collected at 21 months during the cross-sectional survey was 12.2 g/kg for PBO LLIN and 16.7 g/kg for standard LLIN and PBO concentration in PBO LLIN was 1.4 g/kg.
Malaria infection and physical condition of LLIN
Malaria infection was measured in cross-sectional surveys only. Between year two and three, there was a significant increase in malaria infection in all arms. When controlling for other factors, the fabric condition was not associated with malaria infection in either type of net. However superior protection afforded by PBO nets depended on the age of nets: Olyset Plus (PBO LLIN) providing particularly strong protection versus standard nets when both net types were aged between 1 and 2 years (Table 6). For nets that are still relatively new (<1 year), there was only weak evidence that PBO nets were better in protecting against infection; after 2 years there was also little evidence that PBO nets provided enhanced protection compared to standard nets.
Discussion
This study presents the durability of two types of nets with and without the synergist PBO over 3 years of field use and examines whether this was associated with malaria infection in an area of pyrethroid resistance. As has been seen with other studies (refs), the nets are not lasting for the three years which is assumed for ‘long-lasting’ nets, both in terms of fabric integrity and chemical content.
The majority of nets followed in the longitudinal study had at least one hole by 12 months, with a similar proportion of extremely torn nets, for the two net types and poor fabric integrity was the main reason nets were discarded. Nets collected via the cross-sectional surveys were generally less damaged-this is likely to be due to the fact that participants in the longitudinal study were asked to keep hold of their nets regardless, whilst it appears that if this was not the case, users are more likely to get rid of the torn nets quickly. In addition, we do not have data on when the nets sampled cross-sectionally were first used, and some may have been stored for several months before being put into use, as has been seen elsewhere (28, 29). This highlights the differential information the two methods (longitudinal and cross-sectional) obtain with regards to damage to fabric integrity over time, compared to the point when users realistically discard their nets. Indeed, a third of the nets that were considered unprotective by users which were examined by the field workers were actually still in serviceable condition. Community attitudes towards damaged nets may vary from place to place and may feed into differences in durability seen across countries(30).
Overall, PBO nets were more likely to be torn, although this was only evident in longitudinal survey nets and not in the cross-sectional nets. PBO nets had less functional survival by 12 months, suggesting that users had held onto them even if they were in bad condition. This could be due to the higher protective efficacy of the PBO nets, regardless of fabric condition(31).
Both net types lasted for less than 2 years, which is a shorter timespan than has been see in other studies’ for similar nets (16, 18, 32). Moreover, in this study, less than a third of the distributed nets remained in households after 3 years of community use, which is slightly lower than has been observed in other studies conducted in Tanzania (45%)(18), Mozambique (40%)(33), and Kenya (82%)(34). Notably, a recent study in Kenya examining the durability of the same make of PBO LLIN showed extremely high survivorship of 91% after 3 years of use(16). Differences in living conditions but also in net care behaviour could explain these variations(35). Remarkably, net survivorship in the arms that did not receive indoor residual spraying (IRS) was significantly higher than in arms that received IRS, suggesting that people are more likely to care for their nets if there is no other preventive intervention in place. This is not a chance finding since communities were randomly allocated to receiving IRS, and may therefore have implications for any future strategy that combines different interventions.
Several risk factors were identified for increased risk of damage to the net. Washing of the net and aging of the net increased the likelihood of net damage whereas folding the net every morning was observed to protect the nets against damage, as has been seen in other studies (33, 36, 37). Other factors that could protect the net against damage included sleeping under bed frames and the use of foam mattresses. Targeted behavioural change communication (BCC) campaigns could eventually increase awareness on the net care, repair and net durability determinants thereby preventing LLINs from becoming extremely torn (36-39).
In this study, fabric condition was not associated with malaria infection in either type of net. However, older nets were associated with higher risk of infection, with differential effects by net type depending on age of net. Notably, the difference between the net types was highest when nets were between 1-2 years old, when PBO nets appeared to be similarly protective as nets less than a year old, whereas standard nets were considerably less protective as they aged, regardless of fabric condition (Table 6). This suggests that a major benefit of PBO nets may be in mitigating the detrimental effect of aging of nets, but that this advantage relative to standard nets wanes after two years. Therefore, to maximise the gain that PBO nets offer in combating malaria, programmes and funding agencies should consider a two-year cycle for net replacement strategies.
The results also suggest that much of the protection given by the nets is related to the insecticide (which declined in both nets over the three years), rather than the condition of the fabric(40). Other studies have also found that malaria infection is not necessarily associated with the condition of the nets (7, 41), however, we would caution against interpreting this too strongly as study net usage considerably declined over the three years of this study and low community-level coverage of nets could be confounding the impact of fabric quality on malaria infection.
Both net types had chemical content within the manufacturers’ specifications at the start of the study. However, PBO content was low at 12 month and almost gone by 24 months. The active ingredient (permethrin) was considerably reduced in both nets, but reduced more quickly in PBO nets. Despite insecticide loss and aging of nets, PBO nets were more protective against malaria infection in the second year than standard LLINs, suggesting that people should continue using PBO LLINs even if they are aged and damaged(10). This may also explain why there was a high proportion of extremely torn PBO LLIN compared to standard LLINs in use at the end of the study; as users may still find that they are effective, despite the physical condition and aging. These findings concur with the earlier findings on torn PBO LLIN, that they will continue protecting against blood-feeding Anopheles irrespective of physical condition(31).
Access and usage of study net decreased sharply over the study period. This is likely due to the high attrition rate leading to too few study nets remaining in the households at the end of the study. However, access and usage of any nets was relatively higher, highlighting that residents are keen to keep using nets if they are considered in good condition. In general, the nets which replaced study nets were obtained from periodic governmental net distributions in the study area. It is of key importance that manufacturers produce more durable nets, which could potentially be achieved with a small increase in unit price (18, 42) by reinforcing seam and net lower mid-zone or bottom part which is vulnerable to abrasion (S3 Table).
The study had some limitations. The low study net usage by the third year may have confounded some of the results-though, in the main, they highlight the speed at which these nets are discarded in the community. In addition, the insecticide content was tested on smaller number of nets than what is recommended by WHO. However, small number of nets has been tested for other net types than PBO nets (43); thus, for PBO nets this need to be repeated to confirm these results. Although, a study that assessed insecticide content of PBO nets on a number of nets 4 times higher than of this study, found a relatively similar reduction in chemical content(16). Importantly, this study does not report on entomological bio-efficacy meaning that we do not know whether the reduced chemical content on the nets over time would have also resulted in reduced mosquito mortality. Finally, due to higher attrition than expected, textile integrity could only could be assessed on a small sample of nets after 3 years. However, the high rate of attrition in this community is clear and highlights that the usable life of these two nets is well under the recommended lifespan of 3 years.
Conclusion
The findings of this study demonstrate that the nets’ lifespan in this setting was below 2 years. Aged PBO LLINs still provided better protection against malaria infection than standard LLINs up to about 2 years. Behavioural change communication encouraging users to retain aged and holed PBO LLIN could extend their effective lifespan. Importantly, either manufacturers need to make nets that last for the recommended 3 years, in terms of fabric and chemical content, or distribution methods need to be increased in regularity to ensure that the population is able to sleep under effective bed nets
Data Availability
Deidentified data will be made available upon reasonable request to the corresponding author. There is no legal or ethical restrictions to the data.
Supporting information
S1 Table. Percentage net functional survival (defined as the presence of the net in the house and serviceable condition) by net product and time point
S2 Table. Survivorship and attrition of cohort nets by age and arms with and without Indoor Residual Spraying (IRS) (data from longitudinal survey)
S3 Table. Geometric mean of holes by zone and by size
Author Contributions
Authors’ contributions EL, NP, JC conceptualized the study. EL, JM, AW, NP participated in data collection and curation. EL analysed data and wrote the first draft manuscript, NP, JC, IK reviewed the first draft manuscript. EL, NP, LM, JC, IK, MR finalized and edited the original manuscript and revised it according reviewers’ comments. All authors read and approved the revised manuscript.
Acknowledgments
We thank colleagues and staff at the Kilimanjaro Christian Medical University College in Muleba and Moshi, and those at the National Institute of Medical Research in Mwanza who were involved in the project. We acknowledge the assistance provided by staff at the Muleba District Medical Office, at both the ward, village and hamlet level. Additionally, we thank USAID/President’s Malaria Initiative and RTI International for funding and implementing the indoor residual spraying operation in the study area, and the Tanzania Communication and Development Center for communications and implementation of the distribution campaign of the long-lasting insecticidal nets. We thank Hanafy Ismail (Liverpool School of Tropical Medicine, Liverpool, UK) for chemical analysis of the long-lasting insecticidal net. Finally, we thank all the participating households.