Making use of an App (Tawakkalna) to track and reduce COVID transmission in KSA =============================================================================== * Donal Bisanzio * Richard Reithinger * Sami Almudarra * Reem F. Alsukait * Di Dong * Yi Zhang * Sameh El-Saharty * Hala Almossawi * Christopher H. Herbst * Ada Alqunaibet ## Abstract Since March 2020, the Kingdom of Saudi Arabia (KSA) has launched several digital applications to support the intervention response to reduce the spread of SARS-CoV-2. At the beginning of 2021, the KSA Government introduced a mandatory immunity passport to regulate access to public venues. The passport was part of the strategy of resuming public activities before reaching high vaccination coverage. The passport was implemented as a new service in the Tawakkalna mobile phone application (App). The immunity passport allowed access to public locations only for the users who recovered from COVID-19 or those who were double vaccinated. Our study aimed to evaluate the effectiveness of the immunity passport, implemented through the Tawakkalna App, on SARS-CoV-2 spread. We built a spatial-explicit individual-based model to represent the whole KSA population (IBM-KSA) and its dynamic on a national scale. The IBM-KSA was parameterized using country demographic, remote sensing, and epidemiological data. The model included non-pharmaceutical interventions and vaccination coverage. A social network was created to represent contact heterogeneity and interaction among age groups of the population. The IBM-KSA also simulated the movement of people across the country based on a gravity model. We used the IBM-KSA to evaluate the effect of the immunity passport on the COVID-19 epidemic’s outcomes. The IBM-KSA results showed that implementing the immunity passport through the Tawakkalna App mitigated the SARS-CoV2 spread. In a scenario without the immunity passport, the KSA could have reported 1,515,468 (95% confidence interval [CI]: 965,725-1,986,966) cases, and 30,309 (95% CI: 19,314-39,739) deaths from March 2021 to November 2021. The comparison of IBM-KSA results with COVID-19 official reporting estimated that the passport effectively reduced the number of cases, hospitalizations, and deaths by 8.7 times, 13.5 times, and 11.9 times, respectively. These results showed that the introduction of the immunity passport through the Tawakkalna App was able to control the spread of the SARS-COV-2 until vaccination reached high coverage. By introducing the immunity passport, The KSA was able to allow to resume most of public activities safely. ## Background The response to the COVID-19 pandemic has been characterized by the use of several information, communication, and technology application s (ICT apps). Leveraging the widespread population coverage of smart phones and access to the internet, the pandemic has stimulated the development and launch of many digital e-health applications to support governments by mitigating COVID-19 outcomes [1]. In March 2020, Singapore; the Republic of Korea (Korea); Hong Kong SAR, China; and Japan deployed contact tracing ICT apps to support the contact tracing of SARS-CoV-2 cases [2]. Following the success of reducing the spread of the disease in countries where the contact tracing apps were employed, many other countries decided to deploy these apps to support interventions aiming to reduce the SARS-CoV-2 spread. These new e-health solutions used innovative technologies based on Bluetooth, Global Positioning System (GPS), artificial intelligence, and machine learning [3]. The aim of these ICT solutions was to improve health care system delivery and reduce virus circulation. Apps were created to provide information about COVID-19 both nationally and internationally, help to track virus exposure and confirmed cases, improve access to health services using remote-health solutions, regulate movement during lockdown and curfew periods, support vaccination campaigns, and regulate international travel and access to public spaces [3]. Most of the launched ICT apps were able to perform contact tracing, carry out self-assessments, book testing appointments, report on testing results, and allow for remote access to health services [4]. When COVID-19 vaccinations become available early 2021, countries decided to develop and launch ICT solutions to support the rollout of available vaccines that included an *immunity passport* (also called a *risk-free certificate*) feature. Apps—often linked to a country’s ministry of health or health providers’ data platforms—were created to book vaccination appointments and record the immunization status of people. Many countries adopted immunity passport systems to identify vaccinated people, allowing them to move more freely, both nationally and internationally, than non-vaccinated individuals [5]; adoption of these immunity passport apps was also used to increase vaccination coverage among the population. The immunity passport is not a new concept: this approach has been used for decades to reduce the risk of yellow fever infection in many countries with high transmission risk [6]. However, the effectiveness of these solutions has not been fully assessed, given the difficulty of untangling the role of each digital application on SARS-CoV-2 circulation and COVID-19 outcomes. After the first case of COVID-19 was recorded in Saudi Arabia on March 3, 2020, the government rapidly adopted NPIs to mitigate the spread of the virus among its population. The rolled out NPIs included closing national borders, lockdowns, curfews, school closings, and enforcing mask-wearing and physical distancing in public spaces. By imposing strict NPIs, KSA recorded fewer than approximately 500 daily reported cases from September 2020 to the end of March 2021 [7]. Indeed, a recent study estimated that between June 2020 and June 2021, the adoption of these NPIs averted roughly 4 million cases, 600,000 hospitalizations, and 70,000 deaths due to COVID-19 [8]. Like other countries, KSA has implemented multiple ICT solutions to support the national health system in the response to COVID-19—a step that also built on and was aligned with KSA’s health system modernization set forth in the country’s Vision 2030 National Transformation Program [9]. The aim of the program was to increase access to health care by improving remote services (screening, prescription, scheduling visit appointments) for the population [9]. KSA was not new to using ICTs to handle emerging infection diseases. The country had already adopted ICT for handling the spread of Middle East respiratory syndrome coronavirus virus (MERS-CoV) in 2015 [10-11]. Increasing the e-health capacity of the health system resulted in an improved access to services with a high cost-benefit for the KSA health system [12]. Furthermore, as of January 2020, approximately 89 percent of the KSA population had access to the internet and 96 percent of the adult population owned smart phones [13]. Given the country’s experience with ICT to respond to health emergencies, its new public health strategy—based on remote solutions and the high penetration of information technology—helped KSA to rapidly deploy e-health solutions by adding new features to already-launched apps and developing new ones. Although many applications were launched from government and private sector [14], the pillars of the KSA e-health response to COVID-19 were five mobile phone applications: Mawid, Tabaud, Sehha, Tetamman, and Tawakkalna (Tables S1 and Table S2). Among all these applications, only the use of the Tawakkalna App was made mandatory for the KSA population. The Tawakkalna app was launched in the KSA in April 2020. This app was designed to regulate people’s movements during lockdowns and curfews. The app records the health status of users and allows them to request movement permits during curfews and lockdowns. A color system also shows whether the user is able to travel freely in the country: green means that the user can travel; yellow means that the person has been exposed, could become positive, and needs to quarantine; and red means that the person is infected and has to remain in self-isolation. The number of app users rapidly increased during the month following its release, reaching about 20 million users by March 2021. The functions of Tawakkalna app were updated when vaccination was rolled out in December 2020 [15]. In January 2021, the MOH launched the Immunity Passport service as a new functionality of the app [16], which recorded the user’s COVID-19 vaccine doses received, the vaccine brand they received, and the date of vaccination. People who received two COVID-19 vaccine doses were then provided with access to public spaces and events. Furthermore, the app allowed KSA to fully resume national travel, reopen public venues, and resume public events starting in March 2021; it also allows for the resumption of in-person teaching for children above 11 years of age in August 2021 [17]. The use of the Tawakkalna app as an immunity passport, in conjunction with mandatory enforcement of NPIs, has been the country’s main strategy for re-opening shops, restaurants, and other public venues, and for allowing public events. The use of the app also aimed to mitigate the spread of the virus while, at the same time, reopening public activities before the country reached a high vaccination coverage rate. Furthermore, the app was the only ICT made mandatory for the KSA population. Estimating the impact of using the Tawakkalna app as an immunity passport is crucial to better understanding the role of implementing such a policy to minimize future outbreaks of COVID-19 or other highly transmissible infections. The aim of this study was to use a novel epidemiological individual based modeling framework (IBM-KSA) representing KSA’s population to assess the effect of Tawakkalna app as an immunity passport, using the estimated number of cases, hospitalizations, and deaths from March 2021 to November 2021 as its metric. The epidemiological model had already been used to estimate the health benefit of NPIs adopted by KSA before the introduction of the vaccines [8]. ## Method ### IBM-KSA model structure description The impact of using the Tawakkalna app as a COVID-19 immunity passport for tracking SARS-CoV-2 circulation in the Kingdom of Saudi Arabia (KSA) was modeled by simulating interaction at the person level using an individual-based model. The individual-based model used to represent the KSA population was named IBM-KSA. The model had already been used to estimate the effect of non-pharmaceutical interventions (NPIs) adopted during the first phase of the pandemic, between March 2, 2020, and July 31, 2021 [8]. The IBM-KSA model utilizes a contact network structure to simulate interactions among the entire KSA population—that is, among approximately 34 million people. The network structure was preferred to an agent model because it allows for contact heterogeneity among people while reducing computational load. The model was built using demographic data to reproduce a population with characteristics of the actual KSA population. The IBM-KSA also accounts for differences in contact interactions among age groups [18-21] as well as accounts for movement flux among cities—a main driver of SARS-CoV-2 spread in a country [22]. ### COVID-19 Measures between March and November 2021 The model included NPIs and the vaccination campaign, as their implementation dates as of November 2021. The model also included the introduction of the immunity passport through the Tawakkalna app to calibrate the model with real data. After calibration, the IBM-KSA simulated projections of COVID-19 cases, hospitalizations, and deaths, with or without the introduction of the immunity passport. The modeled scenarios simulated the epidemic from March 1, 2021, to November 30, 2021. This time window was chosen to capture the effect of the use of Tawakkalna app immunity passport before the introduction of the SARS-CoV-2 Omicron variant in the country. ### Epidemiological Model The transmission dynamic of COVID-19 was represented in the model by the classical transition status seen in SEIR compartmental models: ![Formula][1] COVID-19 national data were used to estimate the hospitalization and fatality rates for KSA [7] to determine the number of infected individuals who would also be at risk of being hospitalized or dying. The transition from one status to another is a function of pathogen characteristics (for example, virulence, incubation period, infectious period, hospitalization, and fatality rate); interaction among individuals (only for S through I); and immunization status [22-27]. The IBM-KSA model also accounts for the fraction of asymptomatic cases, set as equal to 80 percent [27]. A detailed description of the IBM-KSA model framework and transmission parameters can be found in Bisanzio et al. [13]. Here follows a list of new and updated parameters used to modify the KSA-IBM published in Bisanzio et al. [13]. Transmission parameters: * ▪ Transmission probability per hour: 0.06 and 0.12 for Alpha and Delta variants, respectively [8, 28] * ▪ First case of Delta variant reported in August 2021 [29] * ▪ Naturally acquired immunity: >12months (assumption) but with reduced protection over time [30] * ▪ Hospitalization rate equal to 10 percent and death rate equal to 2 percent of infected individuals [7] NPIs included in the IBM-KSA: * ▪ Mask wearing for 70 percent of the population and social distancing for 80 percent of the population Full isolation for 80 percent of the population [8] * ▪ Resumed in-person education only for students 11 years of age with the following restrictions: * ▪ Mask wearing and social distancing set to 90 percent * ▪ Class isolation in case of detected cases among students * ▪ Children can attend class only if double-vaccinated Vaccination status of KSA population: * ▪ 70 percent of the population was fully vaccinated by November 2021 * ▪ 90 percent of 11–17 age group was fully vaccinated by November 2021 Vaccination campaign: * ▪ ∼350,000 vaccinations per day [31] * ▪ 3-week lag between the two doses * ▪ Vaccination offered to people > 17 years old * ▪ Vaccination for people 11–17 years of age began June 2021 * ▪ Maximum coverage of the population set to 95 percent * ▪ Delay of second dose for different age groups from April to July 2021 ## Results The KSA-IBM results showed that using the Tawakkalna app as an immunity passport was able to substantially mitigate the spread of COVID-19 in the country. If the immunity passport had not been in place, the number of cases would have drastically increased after the easing of NPIs at the beginning of March 2021. Additionally, the number of cases would have peaked in June 2021, with more than 600,000 (95% CI: ∼400,000–∼900,000) cases per week (Figure 1). The estimated number of cases fell after June as a result of the expanded rollout of vaccination that also targeted children ages 11–17. The number of reported cases showed a slight increase until February 2021, but then it remained stable, with roughly 8,400 cases per week from the beginning of May 2021 to the end of August 2021 (Figure 1). The massive reduction of cases after August could be linked to the high proportion of population having received their second vaccine. The number of cases stabilized until the end of November 2021, with approximately 300 cases per week (Figure 1). ![Figure 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2022/10/17/2022.10.16.22281142/F1.medium.gif) [Figure 1.](http://medrxiv.org/content/early/2022/10/17/2022.10.16.22281142/F1) Figure 1. Epidemic Curves of the COVID-19 Epidemic in KSA with an Immune Passport (panel A) and Scenarios without an Immune Passport (panel B), March 1, 2020, to December 1, 2021. The yellow bars are the mean values of the simulation, and the green and red bars are the 95 percent confidence interval (95% CI). The orange bars and line represent the reported number of cases until December 1, 2021 [12]. CI = confidence interval. The results of the model showed that the app was able to reduce the spread of the virus while vaccination coverage was increasing, reaching a threshold after which the spread of the virus was reduced. Using the IBM-KSA model, we estimate that the use of the app was able to avert 1,343,099 cases, 112,322 hospitalizations, and 27,967 deaths from March to November 2021 (Table 1). The comparison of IBM-KSA results with COVID-19 official reporting estimated that the passport effectively reduced the number of cases, hospitalizations, and deaths by 8.7 times, 13.5 times, and 11.9 times, respectively (Table1). After August 2021, when most of the population was fully vaccinated against SARS-CoV-2, the app’s effectiveness was reduced because an important fraction of the population was—due to their vaccination status—no longer affected by the limitations imposed by the app (Tables 1 and 2). We estimated that dropping the use of Tawakkalna after reaching high fraction of fully vaccinated people in the population could have increase the number of cases, hospitalizations, and deaths by by 1.8 times, 1.7 times, and 1.3 times, respectively (Table2). View this table: [Table 1.](http://medrxiv.org/content/early/2022/10/17/2022.10.16.22281142/T1) Table 1. The Impact of Using the Tawakkalna App as an Immunity Passport on Cases, Hospitalizations, and Deaths, March 2021 to November 2021 View this table: [Table 2.](http://medrxiv.org/content/early/2022/10/17/2022.10.16.22281142/T2) Table 2. The Impact of Using the Tawakkalna App as an Immunity Passport on Cases, Hospitalizations, and Deaths, August 2021 to November 2021 ## Discussion The IBM-KSA model’s results showed that introducing the Tawakkalna app immunity passport was able to reduce the circulation of SARS-CoV-2, resulting in a low number of reported cases, hospitalizations, and deaths. Re-opening without the passport would have resulted in over a million more reported cases, over 100,000 more hospitalizations, and around 30,000 more deaths from March 2021 to November 2021 than with the passport. Furthermore, the introduction of the immunity passport allowed the country to maintain lower circulation of the virus while vaccination coverage was increasing. These findings are consistent with studies performed in other countries introducing a national immunity passport. The introduction of the immunity passport (called the *green pass*) in Italy was linked to a reduction of reported COVID-19 cases, hospitalizations, and deaths, and reduced the virus’s transmission in the early stage of the vaccination campaign [32]. Making the app mandatory probably improved the impact of the app on COVID-19 transmission. Studies evaluating ICT solutions that allow for contact tracing have found that when use is non-mandatory, their effect on disease transmission is limited. First studies investigating contact tracing apps have shown that such apps successfully reduced the incidence of COVID-19 in England, Switzerland, and Hong Kong SAR, China [33-35], with the apps’ success linked to the percentage of the population using them. In contrast, in Australia, a study showed that a contact tracing system through an app had a small and lower-than-expected effect on COVID-19 incidence [36], which was likely the result of the low number of app users (only approximately 22 percent of the population) [36]. These results are consistent with a recent systematic review showing only weak evidence of the impact of contact tracing on COVID-19 cases [37]. A systematic review highlighted the way modeling studies had estimated high effectiveness of contact tracing apps only with a high level of population uptake (higher than 50 percent) [38]. The non-mandatory policy of contact tracing apps could be at the base of low population uptake in many countries, resulting in a dimmed efficacy of this tool. The use of an immunity passport that reduces the movement of the non-immunized fraction of the population could also result in a rapid increase of vaccination coverage. Enforcing the need to prove their immunization status to access workplaces, shops, schools, public venues, and events would make people keener to be vaccinated. A recent study showed that introducing an immunity passport could speed up the vaccination campaign and provide high vaccination coverage in less time than countries without a mandatory passport [39]. Thus, the adoption of an immunity passport could benefit vaccination campaigns by minimizing the circulation of the virus during the period when vaccination coverage is still increasing, and boost vaccination adherence. Although the introduction of an immunity passport has been criticized for its ethical implications [40], as of October 2021, 144 countries have implemented different forms of immunity passports reporting people’s immunization status to regulate access to public space and people movement or to international travel [5]. Depending upon country regulations, the passport could show vaccination status, proof of a negative COVID-19 test, proof of recovery from the virus, or a combination of such information. Because updating digital immunity passport apps through mobile phones is so easy, immunity passports have also been used to reduce the spread of the new SARAS-CoV-2 Omicron variant, first reported in South Africa in November 2021 [41]. After Omicron was detected in KSA, the number of reported COVID-19 cases rapidly increased and the country re-established mandatory mask-wearing and social distancing. The country’s Ministry of Health (MOH) also decided to update the rules to allow access to public spaces only for those people who have received a third dose of the vaccine (the booster dose) [42]. These rules were able to swiftly decrease the number of cases, avoiding major disruption to the health system and mitigating the outcome of Omicron spread [7]. In conclusion, the study showed that introducing an immunity passport through the Tawakkalna app could result in high public health benefits by reducing the burden of COVID-19. Such immunity passports are a tool that can easily be modified to face new public health emergency threats—such as the emergence of new SARS-CoV-2 variants or future pandemics—and to implement changes in the public health response. Adopting a digital immunity passport, such as the Tawakkalna app, can reduce the need for curfews and lockdowns; the result is a positive health impact that also protects the country’s economy by allowing people to safely resume economic activity and international traveling and protecting human capital. ## Supporting information Tables S1 and Table S2 [[supplements/281142_file02.pdf]](pending:yes) ## Data Availability All data produced in the present study are available upon reasonable request to the authors ## Funding Financing was provided by the Saudi Public Health Authority and the Saudi Ministry of Finance under the Health, Nutrition and Population Reimbursable Advisory Services Program (P172148) between the World Bank and the Saudi Public Health Authority. ## Aknowledges The study was developed by the Saudi Public Health Authority, with technical support from individuals from RTI International, and the World Bank. The authors are grateful for the support provided by Rekha Menon (Practice Manager, Health Nutrition and Population, Middle East and North Africa region, World Bank) and Issam Abousleiman (Country Director, GCC countries, World Bank). The findings, interpretations, and conclusions expressed in this work are those of the authors and do not necessarily reflect the views of the authors’ employers or organizations that funded the work. * Received October 16, 2022. * Revision received October 16, 2022. * Accepted October 17, 2022. * © 2022, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/) ## References 1. 1.Bokolo, A. Jnr. 2021. “Implications of Telehealth and Digital Care Solutions during COVID- 19 Pandemic: A Qualitative Literature Review.” Informatics for Health and Social Care 46 (1): 68–83. 2. 2.Utzerath, J., R. Bird, G. Cheng, and J. Ohara. 2020. “Contact Tracing Apps in China, Hong Kong, Singapore, Japan, and South Korea.” Freshfields Bruckhaus Deringer Blog Post, April 24, 2020. 3. 3.Alanzi, T. 2021. “A Review of Mobile Applications Available in the App and Google Play Stores Used during the COVID-19 Outbreak.” Journal of Multidisciplinary Healthcare 14: 45. 4. 4.Golinelli, D., E. Boetto, G. Carullo, A. G. Nuzzolese, M. P. Landini, and M. P. Fantini. 2020. “Adoption of Digital Technologies in Health Care during the COVID-19 Pandemic: Systematic Review of Early Scientific Literature.” Journal of Medical Internet Research 22 (11): e22280. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.2196/22280&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F10%2F17%2F2022.10.16.22281142.atom) 5. 5.Ada Lovelace Institute. 2021. International Monitor: Vaccine Passports and COVID Status Apps. Page current as of October 15, 2021. [https://www.adalovelaceinstitute.org/project/international-monitor-vaccine-passports-covid-status-apps/](https://www.adalovelaceinstitute.org/project/international-monitor-vaccine-passports-covid-status-apps/), accessed March 13, 2022. 6. 6.UK NHS (United Kingdom National Health Service). 2020. Vaccination: Yellow Fever. Page last reviewed May 22, 2020. [https://www.nhs.uk/conditions/yellow-fever/vaccination/](https://www.nhs.uk/conditions/yellow-fever/vaccination/). 7. 7.MOH (Ministry of Health). 2020. COVID 19 Dashboard: Saudi Arabia (created 2020). [https://covid19.moh.gov.sa/](https://covid19.moh.gov.sa/), accessed March 13, 2022. 8. 8.Bisanzio, D., R. Reithinger, A. Alqunaibet, S. Almudarra, R. F. Alsukait, D. Dong, Y. Zhang, S. El-Saharty, and C. H. Herbst. 2022. “Estimating the Effect of Non-Pharmaceutical Interventions to Mitigate COVID-19 Spread in Saudi Arabia.” BMC Medicine 20 (1): 1–4. 9. 9.MOH (Ministry of Health). 2019. Health Sector Transformation Strategy V.3. Riyadh: MOH. [https://www.moh.gov.sa/en/Ministry/vro/Documents/Healthcare-Transformation-Strategy.pdf](https://www.moh.gov.sa/en/Ministry/vro/Documents/Healthcare-Transformation-Strategy.pdf), accessed March 13, 2022. 10. 10.Saeed, A. A., G. R. Abedi, A. G. Alzahrani, I. Salameh, F. Abdirizak, R. Alhakeem, H. Algarni, O. A. El Nil, M. Mohammed, A. M. Assiri, and H. M. Alabdely, J. T. Watson, and S. Gerber. 2017. “Surveillance and Testing for Middle East Respiratory Syndrome Coronavirus, Saudi Arabia, April 2015–February 2016.’ Emerging Infectious Diseases 23 (4): 682. 11. 11.Sandhu, R., S. K. Sood, and G. Kaur. 2016. “An Intelligent System for Predicting and Preventing MERS-CoV Infection Outbreak.” The Journal of Supercomputing 72 (8): 3033–56. 12. 12.Otaibi, M. 2019. “Internet of Things (IoT) Saudi Arabia Healthcare Systems: State-of-the-Art, Future Opportunities and Open Challenges.” Journal of Health Informatics in Developing Countries 13 (1). 13. 13.Hootsuite. 2020. Digital 2020: Saudi Arabia. DataReportal. [https://datareportal.com/reports/digital-2020-saudi-arabia](https://datareportal.com/reports/digital-2020-saudi-arabia), accessed March 13, 2022. 14. 14.Khan, A., A. Alahmari, Y. Almuzaini, N. Alturki, A. Aburas, F. A. Alamri, M. Albagami, M. Alzaid, T. Alharbi, R. Alomar, and M. A. Tayli. 2021. “The Role of Digital Technology in Responding to COVID-19 Pandemic: Saudi Arabia’s Experience.” Risk Management and Healthcare Policy 14: 3923. 15. 15.Assiri, A., J. A. Al-Tawfiq, M. Alkhalifa, H. Al Duhailan, S. Al Qahtani, R. A. Dawas, A. A. El Seoudi, N. Alomran, O. A. Omar, N. Alotaibi, and S. S. Almudarra, K. Alabdulkarim, S. Alqahtani, and H. Jokhdar. 2021. “Launching COVID-19 Vaccination in Saudi Arabia: Lessons Learned, and the Way Forward.” Travel Medicine and Infectious Disease 43: 102119. 16. 16.MOH (Ministry of Health). 2021. “MOH and SDAIA Release ‘COVID-19 Immunity Passport’ Through ‘Tawakkalna’ Application.” MOH News, January 7, 2021. [https://www.moh.gov.sa/en/Ministry/MediaCenter/News/Pages/News-2021-01-07-004.aspx](https://www.moh.gov.sa/en/Ministry/MediaCenter/News/Pages/News-2021-01-07-004.aspx), accessed March 13, 2022. 17. 17.The New York Times. 2021. “With the Virus Relatively Contained, Saudi Arabia Lifts Most Pandemic Restrictions.” New York Times, March 7, 2021. [https://www.nytimes.com/2021/03/07/world/saudi-arabia-covid.html](https://www.nytimes.com/2021/03/07/world/saudi-arabia-covid.html), accessed March 13, 2022. 18. 18.OECD (Organisation for Economic Co-operation and Development). 2021. Education at a Glance 2021: OECD Indicators. Paris: OECD Publishing. [https://www.oecd.org/education/education-at-a-glance/](https://www.oecd.org/education/education-at-a-glance/), accessed November 27, 2020. 19. 19.Prem, K., A. R. Cook, and M. Jit. 2017. “Projecting Social Contact Matrices in 152 Countries Using Contact Surveys and Demographic Data.” PLoS Computational Biology 13 (9): e1005697. 20. 20.Rabaah, A., D. Doaa, and A. Asma. 2016. “Early Childhood Education in Saudi Arabia: Report.” World Journal of Education 6 (5): 1–8. [https://files.eric.ed.gov/fulltext/EJ1158243.pdf](https://files.eric.ed.gov/fulltext/EJ1158243.pdf), accessed March 13, 2022. 21. 21.World Bank. No date. World Bank Open Data. [https://data.worldbank.org/](https://data.worldbank.org/). accessed November 27, 2020. 22. 22.Bisanzio D, Kraemer MU, Bogoch II, Brewer T, Brownstein JS, Reithinger R. 2020. Use of Twitter social media activity as a proxy for human mobility to predict the spatiotemporal spread of COVID-19 at global scale. Geospatial health.15;15(1). 23. 23.Al-Tawfiq, J.A., Sattar, A., Al-Khadra, H., Al-Qahtani, S., Al-Mulhim, M., Al-Omoush, O. and Kheir, H.O., 2020. Incidence of COVID-19 among returning travelers in quarantine facilities: a longitudinal study and lessons learned. Travel medicine and infectious disease, 38, p. 101901. 24. 24.McAloon C, Collins Á, Hunt K, Barber A, Byrne AW, Butler F, Casey M, Griffin J, Lane E, McEvoy D, Wall P. 2020. Incubation period of COVID-19: a rapid systematic review and meta-analysis of observational research. BMJ Open 10:e039652. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYm1qb3BlbiI7czo1OiJyZXNpZCI7czoxMjoiMTAvOC9lMDM5NjUyIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjIvMTAvMTcvMjAyMi4xMC4xNi4yMjI4MTE0Mi5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 25. 25.Khan AA, AlRuthia Y, Balkhi B, Alghadeer SM, Temsah MH, Althunayyan SM, Alsofayan YM. 2020. Survival and estimation of direct medical costs of hospitalized COVID-19 patients in the Kingdom of Saudi Arabia. Int. Journal of Environm. Res. and Public Health 17:7458. 26. 26.Barber A, Butler F, Griffin J, Lane EA, McAloon C, O’Brien K. 2020. Inferred duration of infectious period of SARS-CoV-2: rapid scoping review and analysis of available evidence for asymptomatic and symptomatic COVID-19 cases. BMJ Open 10:e039856. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYm1qb3BlbiI7czo1OiJyZXNpZCI7czoxMjoiMTAvOC9lMDM5ODU2IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjIvMTAvMTcvMjAyMi4xMC4xNi4yMjI4MTE0Mi5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 27. 27.Russell TW, Golding N, Hellewell J, Abbott S, Wright L, Pearson CA, van Zandvoort K, Jarvis CI, Gibbs H, Liu Y, Eggo RM. 2020. Reconstructing the early global dynamics of under-ascertained COVID-19 cases and infections. BMC Medicine 18:1–9. 28. 28.WHO (World Health Organization). 2020a. “Coronavirus Disease (COVID-19): Similarities and Differences with Influenza.” Updated September 30, 2021. [https://www.who.int/emergencies/diseases/novel-coronavirus-2019/question-and-answers-hub/q-a-detail/coronavirus-disease-covid-19-similarities-and-differences-with-influenza](https://www.who.int/emergencies/diseases/novel-coronavirus-2019/question-and-answers-hub/q-a-detail/coronavirus-disease-covid-19-similarities-and-differences-with-influenza), accessed March 13, 2022. 29. 29.Allen, H., A. Vusirikala, J. Flannagan, K. A. Twohig, A. Zaidi, D. Chudasama, T. Lamagni, N. Groves, C. Turner, C. Rawlinson, J. Lopez-Bernal, R. Harris, A. Charlett, G. Dabrera, M. Kall, and COVID-19 Genomics UK (COG-UK Consortium). 2022. “Household Transmission of COVID-19 Cases Associated with SARS-CoV-2 Delta Variant (B. 1.617. 2): National Case-Control Study.” The Lancet Regional Health-Europe 12: 100252. 30. 30. Arab News. 2021. “Delta Variant Reported among Saudi Arabia’s New Virus Cases.” August 15, 2021; updated December 20, 2021. Arab News [https://www.arabnews.com/node/1911526/saudi-arabia](https://www.arabnews.com/node/1911526/saudi-arabia), accessed March 13, 2022. 31. 31.Hall, V., S. Foulkes, F. Insalata, P. Kirwan, A. Saei, A. Atti, E. Wellington, J. Khawam, K. Munro, M. Cole, and C. Tranquillini. 2022. “Protection against SARS-CoV-2 after Covid-19 Vaccination and Previous Infection.” New England Journal of Medicine 386 (13): 1207–20. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa2118691&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F10%2F17%2F2022.10.16.22281142.atom) 32. 32.Ritchie, H. E. Mathieu, L. Rodés-Guirao, C. Appel, C. Giattino, E. Ortiz-Ospina, J. Hasell, B. Macdonald, D. Beltekian, and M. Roser. 2020. “Coronavirus Pandemic (COVID-19)”. Published online at OurWorldInData.org. [https://ourworldindata.org/coronavirus](https://ourworldindata.org/coronavirus), accessed March 14, 2022. 33. 33.Reno, C., F. Sanmarchi, M. A. Stoto, M. P. Fantini, J. Lenzi, and D. Golinelli. 2022. “The Impact of Health Policies and Vaccine Rollout on the COVID-19 Pandemic Waves in Italy.” Health Policy and Technology, 100604. 34. 34.Salathé, M., C. L. Althaus, N. Anderegg, D. Antonioli, T. Ballouz, E. Bugnion, S. Capkun, D. Jackson, S. I. Kim, J. R. Larus, and N. Low. 2020. “Early Evidence of Effectiveness of Digital Contact Tracing for SARS-CoV-2 in Switzerland.” Swiss Medical Weekly 150: w20457. 35. 35.Wymant, C., L. Ferretti, D. Tsallis, M. Charalambides, L. Abeler-Dörner, D. Bonsall, R. Hinch, M/ Kendall, L. Milsom, M. Ayres, and C. Holmes. 2021. “The Epidemiological Impact of the NHS COVID-19 App.” Nature 594 (7863): 408–12. 36. 36.Yuan, H. Y. and C. Blakemore. 2022. “The Impact of Contact Tracing and Testing on Controlling COVID-19 Outbreak without Lockdown in Hong Kong: An Observational Study.” The Lancet Regional Health-Western Pacific 20: 100374. 37. 37.Vogt, F., B. Haire, L. Selvey, A. L. Katelaris, and J. Kaldor. 2022. “Effectiveness Evaluation of Digital Contact Tracing for COVID-19 in New South Wales, Australia.” The Lancet Public Health 7 (3): e250–8. 38. 38.Mendez-Brito, A., C. El Bcheraoui, and F. Pozo-Martin. 2021. “Systematic Review of Empirical Studies Comparing the Effectiveness of Non-Pharmaceutical Interventions against COVID-19.” Journal of Infection 83 (3): 281–93. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jinf.2021.06.018&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=34161818&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F10%2F17%2F2022.10.16.22281142.atom) 39. 39.Braithwaite, I., T. Callender, M. Bullock, and R. W. Aldridge. 2020. “Automated and Partly Automated Contact Tracing: A Systematic Review to Inform the Control of COVID-19.” The Lancet Digital Health 2 (11): e607–21. 40. 40.Mills, M. C. and T. Rüttenauer. 2022. “The Effect of Mandatory COVID-19 Certificates on Vaccine Uptake: Synthetic-Control Modelling of Six Countries.” The Lancet Public Health 7 (1): e15–22. 41. 41.Brown, R. C., D. Kelly, D. Wilkinson, and J. Savulescu. 2021. “The Scientific and Ethical Feasibility of Immunity Passports.” The Lancet Infectious Diseases 21 (3): e58–63. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F10%2F17%2F2022.10.16.22281142.atom) 42. 42.WHO (World Health Organization). 2021. “Update on Omicron.” WHO News, November 28, 2021. [https://www.who.int/news/item/28-11-2021-update-on-omicron](https://www.who.int/news/item/28-11-2021-update-on-omicron), accessed March 13, 2022. 43. 43. Saudi Gazette. 2022. “Immunaztion Status to be Updated in February on Tawakkalna, 8 months after the Second Dose.” Saudi Gazette, January 18, 2022. [https://saudigazette.com.sa/article/615997/SAUDI-ARABIA/Immunaztion-status-to-be-updated-in-February-on-Tawakkalna-8-months-after-the-second-dose](https://saudigazette.com.sa/article/615997/SAUDI-ARABIA/Immunaztion-status-to-be-updated-in-February-on-Tawakkalna-8-months-after-the-second-dose), accessed March 13, 2022. 44. 44.AlBahrani S, AlAhmadi N, Hamdan S, Elsheikh N, Osman A, Almuthen S, Almajed GN, Alkhuraim AH, Jebakumar AZ, Al-Tawfiq JA. Clinical presentation and outcome of hospitalized patients with COVID-19 in the first and second waves in Saudi Arabia. International Journal of Infectious Diseases. 2022 May 1;118:104-8. [1]: /embed/graphic-1.gif