Effect of Behaviourally Informed Text Messages to Promote Retention in HIV Care: A Randomized Trial in Ekurhuleni District, South Africa ======================================================================================================================================== * Caroline Govathson * Sophie Pascoe * Candice Chetty-Makkan * Laura Schmucker * Preethi Mistri * Harsha Thirumurthy * Tonderai Mabuto ## Abstract **Introduction** Sustained engagement in care among people living with HIV is vital for realising the individual and public health benefits of antiretroviral therapy (ART). We examined whether mobile phone-based text messages that leveraged behavioural science principles promoted timely clinic attendance among ART recipients. **Methods** We conducted a randomized controlled trial in three primary health clinics in Gauteng Province, South Africa between July 2021 and December 2021. ART recipients with an upcoming clinic appointment were randomised to standard of care appointment reminders or three enhanced reminders that leveraged behavioural science principles of loss aversion, social norms, and altruism. The primary outcome was a timely clinic visit, on or before the scheduled appointment day. Poisson regression with clinic fixed effects and controls for age, sex, and ART duration was used to examine the effect of the enhanced reminders on the primary outcome. **Results** Among 1539 participants, 690 (44.8%) were male and median time on ART was 11 months (IQR, 3.7-51.9). The primary outcome of timely clinic visit was 50.3% in the standard of care arm, and similar in the loss aversion arm (53.5%; adjusted risk ratio, ARR 1.1; 95% CI: 0.9-1.2), social norms arm (48.0%; ARR 1.1; 95% CI: 0.8-1.1), and altruism arm (50.9% ARR 1.0; 95% CI: 0.9-1.5). In subgroup analyses, messages framed with loss aversion increased the timely clinic visits among participants with ART duration <90 days (ARR=1.37; 95% CI: 1.08-1.74). **Conclusions** The use of behavioural science principles to frame reminder messages did not increase timely clinic visits among HIV care recipients. Among those who recently initiated ART, however, loss aversion framing increased timely clinic visits. Future research should explore alternative behavioural science principles to revise health communication with HIV care recipients. **Clinical Trials Number** NCT05010291 Keywords * Retention in care * HIV * text message * behavioural science * South Africa ## Introduction In recent years, an increasing number of studies have shown how shifts in the needs, values and preferences of many people on antiretroviral therapy (ART) often translates to cyclical patterns of clinical care, characterised by varying periods of disengagement, temporary lapses in ART, and reengagement (1,2). These cyclical patterns are often associated with suboptimal viral suppression and increased risk of onward transmission of HIV (1,3,4). With many countries implementing same-day ART initiation, the challenges with interruption in care and retention are more pronounced in the first six months after ART initiation (5,6). Clinic appointment attendance has emerged as a strong predictor for longer term retention of ART clients since missed appointments can lead to a reluctance to return to care and ultimately result in disengagement from HIV treatment (7–9). Beyond the risk of disengagement from ART, when care recipients are late for, or miss their scheduled appointments, this may place additional pressure on already constrained clinic staff to trace and bring clients back to care, negatively affecting the quality-of-service delivery (9–11). Healthcare systems need be highly agile in developing new strategies or enhancing existing ones to promote continued engagement in HIV care and adherence to ART among recipients of care. For many years, text message appointment reminders have been used to promote timely and continuous engagement of clients receiving chronic care (12–14). In the early years of scaling up text message appointment reminders, these strategies were mostly targeted at addressing clients’ forgetfulness and confusion over appointment dates (15,16). However, more recently, studies have begun to explore how text message appointment reminders may minimise lapses in ART by influencing other key decision-making points that influence and individual’s pattern of clinical care engagement. Notably, many of these studies build on emerging evidence from behavioural science research that shows how individual-level decision making can be influenced by minor changes in how information is presented – commonly referred to as the framing effect. Although there is mixed evidence on how well text message appointment reminders improve client outcomes across different stages of the HIV care continuum (17), their low-cost, high acceptability, and high reach to recipients of care, justifies the need to explore whether the content of text messages appointment reminders can contribute to better client outcomes. This is particularly important for South Africa, a low-middle income country that provides ART to about 5.7 million people (18), many of whom exhibit cyclical patterns of care engagement (1,19). One study assessing testing and restarts reported 71% of individuals retesting had previously started ART (1). In a randomised control trial in South Africa, we sought to evaluate whether framing effects on text message appointment reminders, informed by behavioural science, would effectively promote adherence to scheduled clinic appointment among ART recipients. ## Methods ### Study Design and Setting This study was an individually randomized controlled trial conducted in three public sector clinics in Ekurhuleni District, Gauteng Province, South Africa. The three clinics were purposively selected based on their large number of ART recipients, routine use of text message appointment reminders and a high burden of missed appointments among care recipients (18). Ekurhuleni District has the second-highest district-level HIV prevalence in South Africa (14.3%), and high levels of unemployment and poverty, increase the occurrence of cyclical care engagement patterns among ART recipients. ### Participants Individuals living with HIV who were ≥18 years old, receiving ART or about to initiate ART were eligible for the study. Care recipients without cell phone contact details, those who had self-transferred out of the study clinic, or were known to be deceased were excluded. A waiver of participant consent was obtained from the University of Witwatersrand Human Research Ethics Committee, the Ekurhuleni Research Ethics Committee, and the University of Pennsylvania Institutional Review Board, as the study did not alter routine care delivery, did not involve more than minimal risk to recipients of care, and could not have been practicably carried out without a waiver of client consent. Block randomisation sequences (block size 8) were generated by an independent biostatistician, separate from the study implementation team at the study clinics. Participants were randomly assigned in a 1:1:1:1 ratio to either the standard of care text message arm or three text message appointment reminders enhanced with framing effects (described in the next section). Separate randomisation sequences were created for each study clinic. While the study arm allocations were unmasked for randomisation assignment by routine healthcare providers who were involved in the study at each clinic, all study staff performing outcome assessments were masked to the study assignments until all outcome data were collected. ### Intervention Design The study had four arms, with three behavioural science-informed text message arms and one standard-of-care (SOC) text message arm. The content and framing of the text message appointment reminders in the intervention arms were developed by a panel of behavioural science experts and reviewed by routine healthcare providers designated to assist with care navigation and sending appointment reminders (hereafter referred to as case officers) at the study sites to ensure accuracy and ease of understanding. All messages were developed in English and translated into two local languages (Sesotho and isiZulu) commonly used in the study setting. The SOC message contained the name of the clinic sending the message, information about clinic operating hours, reminded them of their appointment, and prompted them to attend the visit. The text messages in the three intervention arms used framing effects to modify the SOC message regarding how care recipients were reminded of their appointment and how they were prompted to attend the visit. The text message in the first intervention arm was framed around the concept of loss aversion which is grounded in the human tendency to prefer avoiding losses over receiving an equivalent gain. The loss aversion message sought to nudge care recipients that an appointment day was “reserved for them” and encouraged them to not lose the opportunity to see a provider during the reserved day. The text message in the second intervention arm was framed around the concept of social norms, which relates to how people engage in social comparison and are strongly influenced by others’ behaviours. The social norms message sought to nudge care recipients that on-time clinic attendance was the norm for most individuals who were staying on track and maintaining good health. The text message in the third intervention arm was framed around the concept of altruism, which focuses on sacrifices made to benefit others. The altruism framing message highlighted the importance of going to the clinic visit on time to protect one’s health and the health of people they love. Participants received only one text message appointment reminder during the study period. ### Data Collection Case officers used a web-based text messaging service to send one-way text message appointment reminders to each participant one week (seven days) before the participant’s scheduled appointment. The web-based service also indicated whether each message was successfully delivered to the participant. Case officers abstracted outcome information from care recipient clinic paper folders and electronic health records. ### Data analysis The primary outcome was a timely clinic visit, defined as having occurred if the participant went to the clinic on or before the scheduled date of their clinic appointment. Participant baseline characteristics were described using proportions for categorical variables and either medians and interquartile ranges (IQRs) or means and standard deviations for continuous variables. Poisson regression models was used to estimate the effect of each intervention. In adjusted analyses, we controlled for participant age, gender, ART duration at the time of the scheduled clinic appointment, and whether successful message delivery occurred (based on text message system reports).We conducted an intention to treat analysis, including participants whose messages were not delivered. The same analyses were performed for four different participant subgroups based on antiretroviral therapy duration (<90, 90-180, 180-365, >365 days). This subgroup analysis was not pre-specified, but the intervention effect was examined in each subgroup given the variation in antiretroviral therapy adherence and appointment attendance patterns among people living with HIV who have been on antiretroviral therapy for different durations. The study was approved by the research ethics committees at the University of the Witwatersrand # 210308 and University of Pennsylvania # 849826. ## Results Between July 2021 and October 2021, 1635 ART recipients had a scheduled clinic appointment at the three study specific clinics. We excluded 10 individuals who were aged <18 years, 31 individuals who did not have available phone numbers, 53 who had duplicate participant identification numbers, and 2 individuals for whom the purpose of their clinic visit was unknown **(Figure 1)**. ![Figure 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2023/11/01/2023.10.29.23297725/F1.medium.gif) [Figure 1.](http://medrxiv.org/content/early/2023/11/01/2023.10.29.23297725/F1) Figure 1. Flow of procedures describing assignment of the groups receiving the text messages between July-October 2021 from three clinics in Ekurhuleni, South Africa For the 1539 care recipients enrolled in the study, 55.2% were female and the median age was 37 years (IQR, 31-43). Median time on ART was 11.6 months (IQR 3.8-52.1 months) and the purpose of the clinic visit for most (80.7%) participants was ART refill. Baseline characteristics including age and sex were similar among the four intervention groups and no significant differences were found (**Table 1)**. Around 60% of participants did not receive the text messages that were sent to them. Delivery rates did not vary by study arm. View this table: [Table 1:](http://medrxiv.org/content/early/2023/11/01/2023.10.29.23297725/T1) Table 1: Baseline characteristics of study participants The primary outcome of timely clinic visits was similar across study arms, with no significant difference due to the text messages in either unadjusted models or adjusted model. In the SOC arm, 50.3% of participants had a timely clinic visit. Compared to the SOC arms, timely clinic visits were similar in the loss aversion arm (53.5%; adjusted risk ratio, ARR 1.06; 95% CI: 0.93-1.22), social norms arm (48.0%; ARR 0.94: 95% CI: 0.83-1.08), and altruism arm (50.9%; ARR 1.01; 95% CI: 0.89-1.15). Participants receiving ART for <90 days were more likely to have timely clinic visits (ARR 1.25; CI: 1.08-1.43) (**Table 2)**. View this table: [Table 2.](http://medrxiv.org/content/early/2023/11/01/2023.10.29.23297725/T2) Table 2. Effect of different text messages reminders on timely clinic visits In the subgroup analysis, loss aversion framed messages increased the likelihood for timely clinic visits among participants who were on ART for <90 days (ARR 1.37; 95% CI: 1.08-1.74). Social norms messages and altruism-framed messages did not appear to be effective in any of the sub-groups that were examined. ## Discussion Using behavioural science principles to frame text message reminders did not increase the likelihood of timely attendance of scheduled clinic visits among ART recipients in South Africa. Since appointment reminders are often sent in the form of text messages, we tested messages that drew upon loss aversion, social norms, and altruism to encourage care recipients to come to clinic for their appointment. In addition, the study also found that nearly 50% of care recipients, in all study arms, did not have timely clinic visits. This result underscores the continued need for alternative interventions that can promote clinic visits and retention in care more generally. There are several reasons why the enhanced text messages may have been ineffective in promoting timely clinic attendance. First, nearly 40% of all text messages were not delivered to participants since many individuals routinely change their phone numbers, share numbers with others, or provide incorrect information to clinics (14,20,21). Verifying care recipients’ contact information at regular intervals is likely to be necessary for effective use of enhanced text messaging systems. Second, it could be that reasons for not having timely clinic attendance have been due to structural and economic barriers such as high transportation costs, opportunity costs of time, or long clinic wait times. These barriers have been shown to significantly impact clinic attendance, particularly for marginalized and underserved populations (22,23), and they are less likely to be addressed by text messages. Third, the lack of timely clinic attendance may be due to the perception of a scheduled clinic visit date as merely being a suggested date to come to the clinic rather than an exact appointment date. In some cases, there may be a mismatch between scheduled clinic visits and dispensation of medicines, particularly for those on treatment for longer periods. Our subgroup analyses showed that among care recipients who had been on treatment for <90 days, loss aversion messages were effective in promoting timely clinic attendance. This is notable since research shows that care recipients who miss visits within the first six months on treatment have increased likelihood of poor outcomes (22,24). Care recipients who have been on treatment for >90 days may have become accustomed to clinic messages or may feel it is less important to come to the clinic on or before the scheduled appointment date especially if they still have medication in hand. Other studies have also shown a diminishing effect of messages over time or at various stages of treatment journey (17,25). It may be necessary to tailor messaging interventions to the specific stage of treatment to maximise their effectiveness. ### Study limitations Our study has some limitations. The primary outcome was attending a scheduled visit on or before the appointment date, but we were unable to obtain information on whether participants came to the clinic after the scheduled appointment date. This may result in an underestimate of whether participants come to the clinic within a few days around the time of their appointment (before or after). However, it is less plausible that this affects the estimated effect sizes of the enhanced text messages. Second, we did not assess the impact of the interventions on long-term outcomes such as retention in care or viral suppression since our goal was to rapidly assess whether the messages changed behavior. Third, a large proportion of participants were scheduled to attend medication refill visits. This restricted us to understanding only one aspect of HIV service delivery and the effect of enhanced text messages. Lastly, we did not have a pure control that did not receive any text message, which may have prevented us from seeing an effect of any message compared to no message. ## Conclusions Our study has implications on programmatic use of SMS reminders to improve clinic attendance. Behavioural science framed messages may be an effective, low-cost tool for increasing timely visit attendance among ART care recipients. However, the effectiveness of differently framed messages may depend on one’s stage of the treatment journey, and care recipients may be more responsive during the earlier stages. More work is needed to address the systematic and technological deficiencies that may reduce the impact of these interventions and to explore approaches to tailor these messages and apply them to the subgroups that would benefit the most. ## Data Availability All data produced in the present study are available upon reasonable request to the authors ## Competing interests The authors declare that they have no competing interests. ## Authors’ contributions CG, CC, HT, SP, and TM designed the study. CG and TM had primary oversight of the study implementation. CG and TM conducted the analyses. CG prepared the first draft with input from HT. All authors reviewed and edited the draft. ## Funding This analysis was funded by the Bill and Melinda Gates Foundation (INV-008318). The contents are the responsibility of the authors and do not necessarily reflect the views of the sponsor. The funders had no role in the study design, collection, analysis and interpretation of the data, in manuscript preparation or the decision to publish. ## Acknowledgements We would like to thank the all the participants and staff including but not limited to case officers, data capturers and nurses at the facilities we conducted the research for their support and contribution to the success of the study. ## Footnotes * Corrected author name * Received October 29, 2023. * Revision received November 1, 2023. * Accepted November 1, 2023. * © 2023, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution 4.0 International), CC BY 4.0, as described at [http://creativecommons.org/licenses/by/4.0/](http://creativecommons.org/licenses/by/4.0/) ## References 1. 1.Ehrenkranz P, Rosen S, Boulle A, Eaton JW, Ford N, Fox MP, et al. The revolving door of HIV care: Revising the service delivery cascade to achieve the UNAIDS 95-95-95 goals [Internet]. Vol. 18, PLOS Medicine. Public Library of Science; 2021 [cited 2022 Apr 25]. e1003651 p. Available from: [https://journals.plos.org/plosmedicine/article?id=10.1371/journal.pmed.1003651](https://journals.plos.org/plosmedicine/article?id=10.1371/journal.pmed.1003651) 2. 2.Beeman A, Bengtson AM, Swartz A, Colvin CJ, Lurie MN. Cyclical engagement in HIV Care: A qualitative study of clinic transfers to re-enter HIV care in Cape Town, South Africa HHS Public Access. AIDS Behav [Internet]. 2022 [cited 2023 Sep 18];26(7):2387–96. Available from: [https://www.springernature.com/gp/open-research/policies/accepted-manuscript-terms](https://www.springernature.com/gp/open-research/policies/accepted-manuscript-terms) 3. 3.Kaplan SR, Oosthuizen C, Stinson K, Little F, Euvrard J, Schomaker M, et al. Contemporary disengagement from antiretroviral therapy in Khayelitsha, South Africa: A cohort study. PLoS Med [Internet]. 2017 Nov 1 [cited 2023 Sep 18];14(11):e1002407. Available from: [https://journals.plos.org/plosmedicine/article?id=10.1371/journal.pmed.1002407](https://journals.plos.org/plosmedicine/article?id=10.1371/journal.pmed.1002407) 4. 4.Amstutz A, Brown JA, Ringera I, Muhairwe J, Lejone TI, Klimkait T, et al. Engagement in Care, Viral Suppression, Drug Resistance, and Reasons for Nonengagement After Home-Based Same-Day Antiretroviral Therapy Initiation in Lesotho: A Two-Year Follow-up of the CASCADE Trial. Clinical Infectious Diseases [Internet]. 2020 Dec 17 [cited 2023 Sep 18];71(10):2608–14. Available from: doi:10.1093/cid/ciz1126 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/cid/ciz1126&link_type=DOI) 5. 5.Govere SM, Kalinda C, Chimbari MJ. The impact of same-day antiretroviral therapy initiation on retention in care and clinical outcomes at four eThekwini clinics, KwaZulu-Natal, South Africa. BMC Health Serv Res [Internet]. 2023;23(1):838. Available from: doi:10.1186/s12913-023-09801-0 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/s12913-023-09801-0&link_type=DOI) 6. 6.Maskew M, Brennan AT, Venter WDF, Fox MP, Vezi L, Rosen S. Retention in care and viral suppression after same-day ART initiation: One-year outcomes of the SLATE I and II individually randomized clinical trials in South Africa. J Int AIDS Soc [Internet]. 2021 [cited 2023 Sep 18];24. Available from: [http://onlinelibrary.wiley.com/doi/10.1002/jia2.25825/full](http://onlinelibrary.wiley.com/doi/10.1002/jia2.25825/full)|doi:10.1002/jia2.25825 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/jia2.25825&link_type=DOI) 7. 7.Maskew M, Sharpey-Schafer K, De Voux L, Crompton T, Bor J, Rennick M, et al. Applying machine learning and predictive modeling to retention and viral suppression in South African HIV treatment cohorts. Scientific Reports | [Internet]. 123AD [cited 2023 Mar 25];12:12715. Available from: doi:10.1038/s41598-022-16062-0 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41598-022-16062-0&link_type=DOI) 8. 8.Esra R, Carstens J, Le Roux S, Mabuto T, Eisenstein M, Keiser O, et al. Validation and Improvement of a Machine Learning Model to Predict Interruptions in Antiretroviral Treatment in South Africa. J Acquir Immune Defic Syndr (1988) [Internet]. 2023 Jan 1 [cited 2023 Mar 25];92(1):42–9. Available from: [https://journals.lww.com/jaids/Fulltext/2023/01010/Validation\_and\_Improvement\_of\_a\_Machine\_Learning.6.aspx](https://journals.lww.com/jaids/Fulltext/2023/01010/Validation\_and\_Improvement\_of_a_Machine_Learning.6.aspx) 9. 9.Ware NC, Wyatt MA, Geng EH, Kaaya SF, Agbaji OO, Muyindike WR, et al. Toward an Understanding of Disengagement from HIV Treatment and Care in Sub-Saharan Africa: A Qualitative Study. [cited 2023 Mar 25]; Available from: [https://www.plosmedicine.org](https://www.plosmedicine.org) 10. 10.Bisnauth MA, Davies N, Monareng S, Struthers H, Mcintyre JA, Rees K. Exploring healthcare workers’ experiences of managing patients returning to HIV care in Johannesburg, South Africa. Glob Health Action [Internet]. 2022 [cited 2023 Mar 25];15. Available from: doi:10.1080/16549716.2021.2012019 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1080/16549716.2021.2012019&link_type=DOI) 11. 11.Nhemachena T, Späth C, Arendse KD, Lebelo K, Zokufa N, Cassidy T, et al. Between empathy and anger: healthcare workers’ perspectives on patient disengagement from antiretroviral treatment in Khayelitsha, South Africa - a qualitative study. BMC Primary Care [Internet]. 2023 Jan 26 [cited 2023 Mar 25];24(1). Available from: /pmc/articles/PMC9878968/ 12. 12.Davey DJ, Nhavoto JA, Augusto O, Ponce W, Traca D, Nguimfack A, et al. SMSaúde: Evaluating mobile phone text reminders to improve retention in HIV care for patients on antiretroviral therapy in Mozambique HHS Public Access. J Acquir Immune Defic Syndr. 2016;73(2):23–30. 13. 13.Gurol-Urganci I, de Jongh T, Vodopivec-Jamsek V, Atun R, Car J. Mobile phone messaging reminders for attendance at healthcare appointments. Cochrane Database Syst Rev [Internet]. 2013 Dec 5 [cited 2023 Mar 25];2013(12). Available from: /pmc/articles/PMC6485985/ 14. 14.Farmer T, Brook G, McSorley J, Murphy S, Mohamed A. Using short message service text reminders to reduce “did not attend” rates in sexual health and HIV appointment clinics. Int J STD AIDS [Internet]. 2014 [cited 2023 Mar 25];25(4):289–93. Available from: [https://pubmed.ncbi.nlm.nih.gov/23999939/](https://pubmed.ncbi.nlm.nih.gov/23999939/) 15. 15.Demena BA, Artavia-Mora L, Ouedraogo D, Thiombiano BA, Wagner N. A Systematic Review of Mobile Phone Interventions (SMS/IVR/Calls) to Improve Adherence and Retention to Antiretroviral Treatment in Low-and Middle-Income Countries. AIDS Patient Care STDS. 2020;34(2):59–71. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1089/apc.2019.0181&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F11%2F01%2F2023.10.29.23297725.atom) 16. 16.Anthony N, Molokwu J, Alozie O, Magallanes D. Implementation of a Text Message to Improve Adherence to Clinic and Social Service Appointments. J Int Assoc Provid AIDS Care. 2019;18:1–5. 17. 17.Hall AK, Cole-Lewis H, Bernhardt JM. Mobile Text Messaging for Health: A Systematic Review of Reviews. Annu Rev Public Health [Internet]. 2015 [cited 2023 Sep 18];36:393–415. Available from: [www.annualreviews.org](http://www.annualreviews.org) 18. 18.UNAIDS data 2020 | UNAIDS [Internet]. [cited 2022 Apr 25]. Available from: [https://www.unaids.org/en/resources/documents/2020/unaids-data](https://www.unaids.org/en/resources/documents/2020/unaids-data) 19. 19.Maskew M, Benade M, Huber A, Pascoe S, Sande L, Rosen S. Patterns of retention in care during clients’ first 12 months after HIV treatment initiation in South Africa: a retrospective cohort analysis using routinely collected data. medRxiv [Internet]. 2023 Jun 16 [cited 2023 Sep 18];2023.06.13.23291348. Available from: [https://www.medrxiv.org/content/10.1101/2023.06.13.23291348v1](https://www.medrxiv.org/content/10.1101/2023.06.13.23291348v1) 20. 20.Norton BL, Person AK, Castillo C, Pastrana C, Subramanian M, Stout JE. Barriers to Using Text Message Appointment Reminders in an HIV Clinic. 21. 21.Demsash AW, Derese Tegegne M, Damtew Walle A, Wubante SM. Understanding barriers of receiving short message service appointment reminders across African regions: a systematic review. BMJ Health Care Inform [Internet]. 2022 [cited 2023 Mar 27];29:100671. Available from: [http://informatics.bmj.com/](http://informatics.bmj.com/) 22. 22.Dear N, Esber A, Iroezindu M, Bahemana E, Kibuuka H, Maswai J, et al. Routine HIV clinic visit adherence in the African Cohort Study. AIDS Res Ther [Internet]. 2022 [cited 2023 Mar 27];19:1. Available from: doi:10.1186/s12981-021-00425-0 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/s12981-021-00425-0&link_type=DOI) 23. 23.Lowane MP, Lebese RT. Why adult patients on antiretroviral therapy miss clinical appointments in rural villages of Limpopo Province, South Africa: An exploratory study. Health SA Gesondheid. 2022 Oct 1;27. 24. 24.Brennan AT, Maskew M, Sanne I, Fox MP. The importance of clinic attendance in the first six months on antiretroviral treatment: a retrospective analysis at a large public sector HIV clinic in South Africa. J Int AIDS Soc [Internet]. 2010 [cited 2023 Mar 27];13(1):49. Available from: /pmc/articles/PMC3012655/ 25. 25.Wagstaff A, Van Doorslaer E, Burger R, Burger R. SMS nudges as a tool to reduce tuberculosis treatment delay and pretreatment loss to follow-up. A randomized controlled trial. 2019 [cited 2023 Mar 27]; Available from: doi:10.1371/journal.pone.0218527 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0218527&link_type=DOI)