Improved screening of COVID-19 cases through a Bayesian network symptoms model and psychophysical olfactory test ================================================================================================================ * Susana Eyheramendy * Pedro A. Saa * Eduardo A. Undurraga * Carlos Valencia * Carolina López * Luis Méndez * Javier Pizarro-Berdichevsky * Andrés Finkelstein-Kulka * Sandra Solari * Nicolás Salas * Pedro Bahamondes * Martín Ugarte * Pablo Barceló * Marcelo Arenas * Eduardo Agosin ## Abstract The infectiousness and presymptomatic transmission of SARS-CoV-2 hinder pandemic control efforts worldwide. Therefore, the frequency of testing, accessibility, and immediate results are critical for reopening societies until an effective vaccine becomes available for a substantial proportion of the population. The loss of sense of smell is among the earliest, most discriminant, and prevalent symptoms of COVID-19, with 75-98% prevalence when clinical olfactory tests are used. Frequent screening for olfactory dysfunction could substantially reduce viral spread. However, olfactory dysfunction is generally self-reported, which is problematic as partial ol-factory impairment is broadly unrecognized. To address this limitation, we developed a rapid psychophysical olfactory test (KOR) deployed on a web platform for automated reporting and traceability based on a low-cost (about USD 0.50/test), six-odor olfactory identification kit. Based on test results, we defined an anosmia score –a classifier for olfactory impairment–, and a Bayesian Network (BN) model that incorporates other symptoms for detecting COVID-19. We trained and validated the BN model on two samples: suspected COVID-19 cases in five healthcare centers (*n* = 926; 32% COVID-19 prevalence) and healthy (asymptomatic) mining workers (*n* = 1, 365; 1.1% COVID-19 prevalence). All participants had COVID-19 assessment by RT-PCR assay. Using the BN model, we predicted COVID-19 status with 76% accuracy (AUC=0.79 [0.75 − 0.82]) in the healthcare sample and 84% accuracy (AUC=0.71 [0.63 − 0.79]) among miners. The KOR test and BN model enabled the detection of COVID-19 cases that otherwise appeared asymptomatic. Our results confirmed that olfactory dysfunction is the most discriminant symptom to predict COVID-19 status when based on olfactory function measurements. Overall, this work highlights the potential for low-cost, frequent, accessible, routine testing for COVID-19 surveillance to aid society’s reopening. Keywords * screening * COVID-19 symptoms * anosmia * asymptomatic * Bayesian network model The COVID-19 pandemic has imposed an enormous toll, with more than 85 million cases and 1.9 million deaths globally as of January 2021 [1]. Despite recent effective COVID-19 vaccine approvals [2, 3, 4], epidemic containment will critically depend on non-pharmaceutical interventions (e.g., lockdowns, gathering restrictions) until a substantial proportion of the population is vaccinated [5, 6, 7]. These society-wide non-pharmaceutical strategies are socially and economically costly [8, 9]. As countries reopen and lift restrictions, there is a high risk of a resurgence of the epidemic [10, 11, 12]. More focused interventions are becoming essential to control viral transmission while reducing social and economic impact [13, 14, 15]. Controlling these transmission hotspots and effectively breaking the chain of viral transmission requires complementing non-pharmaceutical interventions with robust surveillance [16, 17]. Two characteristics of SARS-CoV-2, the virus that causes COVID-19, makes frequent screening, rapid diagnosis, and early isolation of infected individuals critical. First, the virus spreads efficiently, with an average number of secondary cases caused by an infected individual of about 2.5 [18, 19]. Second, a substantial proportion of onward transmission occurs before symptoms are apparent [20, 21, 22]. The viral load is the major spreading factor. It remains low during incubation time and reaches a peak slightly before symptoms onset [20]. This peak in infectiousness is followed by a rapid decline within about a week [20]. These two characteristics hinder epidemic control efforts because detection and isolation of infectious individuals are challenging. So far, COVID-19 surveillance has been mainly based on reverse transcription-polymerase chain reaction (RT-PCR) assays, considered the gold standard for diagnosis [23, 24]. Yet, RT-PCR assays are expensive and turnaround time, about 24 48 hours or longer, make them impractical as a surveillance tool to curb community transmission. Modeling studies have shown that effective COVID-19 surveillance should prioritize the frequency of testing, accessibility, and immediate results [16, 25, 26]. Infectious individuals might then be able to isolate and stop onward transmission promptly.This could be achieved, for example, using antigen tests which can have a turnaround time as low as 15 minutes and may cost about USD5-50 per test, or using mass screening for specific high-prevalence symptoms of SARS-CoV-2 infection, such as olfactory dysfunction [27]. Another critical aspect of a robust surveillance is having a clear characterization of the clinical presentation of COVID-19. Clinical signs and symptoms related to COVID-19 are mostly nonspecific and include cough, fever, shortness of breath, dyspnea, myalgia, and fatigue [28, 29, 30, 31]. Initially overlooked, the sudden loss of smell has emerged as one of the earliest and most prevalent symptoms of COVID-19 [32, 33, 34, 35, 36, 37, 38, 39]. The mechanisms that explain the loss of smell probably relate to an inflammatory response of support and vascular cells that could affect odor conduction by obstructing the olfactory clefts [40]or modifying olfactory sensory or olfactory bulb neurons’ function [41]. The function of olfactory sensory or olfactory bulb neurons could also be altered by damage to support cells[42] or vascular damage [43]. Recent studies have identified molecular factors involved in the sudden loss of smell [44]. SARS-CoV-2 uses the angiotensin-converting enzyme 2 (ACE2) and protease TMPRSS2 receptors to invade host cells [41]. Both proteins are expressed in various cell types and are particularly abundant in the nose, throat, upper bronchial airways, and alveolar epithelial type II cells. Protein expression in the nose has only been determined in supporting cells and stem cells in the olfactory epithelium, but not in olfactory neuronal receptors directly responsible for smell [40, 45]. These results suggest inflammation of cells in the olfactory epithelium leads to early loss and disturbance of the sense of smell in COVID-19 patients. Long-term symptoms could also be related to more extensive neural injury or virus persistence in the olfactory bulb [46, 47, 48]. However, olfactory dysfunction is seldom self-recognized and reported except by patients with the most severe smell disorders [49, 50, 51]. Therefore, self-reported partial (hyposmia) and total (anosmia) olfactory impairment associated with COVID-19 infection may be unreliable and shows substantial variation [38, 52, 53, 54, 55, 56]. In contrast, the prevalence of olfactory impairment in COVID-19 patients is high (75-98%) based on clinical psychophysical tests [57, 58, 59, 60, 61,]. We have developed a model-based COVID-19 screening framework using a Bayes network symptom model and a low-cost olfactory function test (KOR, Kit Olfativo Ráapido) for frequent and immediate prediction of COVID-19 status. To support mass testing, we have deployed a secure web platform to store and track participants’ health state with automated reports. We present validation results of the Bayesian network model incorporating KOR test measurements on a sample of suspect COVID-19 patients (*n* = 926, 32% prevalence of SARS-CoV-2 infection) and asymptomatic healthy mining workers (*n* = 1365, 1.1% prevalence of infection). All participants had SARS-CoV-2 infection confirmation by RT-PCR assays. The KOR test and the results gathered in the platform can provide critical support for routine mass screening of COVID-19 symptoms for a safer and gradual reopening of society. ## Results ### KOR test and data The KOR test is a standardized six-odor, forced multiple-choice identification test. Briefly, each participant is presented with six familiar odors, such as orange or vanilla, in a random sequence, one at a time. After the recognition of an odor, the individual is asked to select the term that best describes it from four options in a tablet or mobile phone (Figure 1A). Details of the KOR test design as well as the application protocol can be found in the corresponding *Methods* sections. After each identification, the selected choice is stored and used for model training using RT-PCR results as indicators of COVID-19 status. Figure 1B shows the proportion of individuals who recognized aromas, by RT-PCR status. 79−93% of participants with a negative RT-PCR recognized all aromas and 56 − 74% of participants with a positive RT-PCR recognized all aromas. ![Figure 1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/04/16/2021.01.18.21249821/F1.medium.gif) [Figure 1:](http://medrxiv.org/content/early/2021/04/16/2021.01.18.21249821/F1) Figure 1: Implementation of the KOR test. (A) The KOR test consists of presenting individuals with six familiar odors, such as orange or vanilla, in a disposable piece of paper. Odors are presented in a random sequence. For each trial, we asked individuals to select in a tablet or mobile phone the term that best describes the odor from four options presented. If the individual does not recognize the odor, he/she selects “I do not recognize the odor”. The test implementation takes less than three minutes per participant. (B) Proportion of individuals from the UC-Christus Sample (*n* = 936) with a positive or negative result from the RT-PCR assay who perceived each aroma: Banana, Caramel, Mint, Orange, Pineapple and Vanilla. We used two samples for the analysis. First, we gathered data from 926 patients with suspected COVID-19 infection or close contact with a laboratory-confirmed case in five medical centers in Santiago, Chile (UC-Christus). Our second sample consisted of 1, 365 healthy asymptomatic participants from a large mining operation in Chile, all of which underwent an exhaustive epidemio-logical and clinical screening before the KOR test. Participants in this sample were excluded from the study if they had any COVID-19 related symptom (cough, fever, shortness of breath, dyspnea, myalgia, and fatigue) or had been in contact with a lab-confirmed COVID-19 case in the past week. All participants in the “UC-Christus” and “miners” sample underwent an RT-PCR test following the KOR test. We considered all RT-PCR positive results as lab-confirmed COVID-19 [23, 24]. Descriptive statistics of the training sample, COVID-19 symptoms prevalence and RT-PCR status can be found in Supplementary Table S1. ### Anosmia score and classifier training We developed an anosmia score based on the odors each participant was able to identify (see *Methods*). A higher score means a better sense of smell. Figure 2 compares anosmia score by RT-PCR status (Fig. 2A) and by self-reported anosmia (Fig. 2B), for all participants in the UC-Christus sample. Healthy individuals (RT-PCR negative) had a higher anosmia score than COVID-19 cases (Fig. 2A), and also showed higher anosmia scores than participants who reported normal sense of smell (Fig. 2B). The latter result suggests that some anosmic participants were not aware of their olfactory dysfunction, consistent with previous studies [56]. Participants with COVID-19 (RT-PCR positive) also showed a higher anosmia score than self-reported anosmic participants, suggesting there are normosmic participants among COVID-19 cases as reported elsewhere [39, 38]. ![Figure 2:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/04/16/2021.01.18.21249821/F2.medium.gif) [Figure 2:](http://medrxiv.org/content/early/2021/04/16/2021.01.18.21249821/F2) Figure 2: Anosmia score among participants. (A) Anosmia score distribution by RT-PCR status, and (B) by self-reported anosmia. Results include all UC-Christus participants (*n* = 926). (C) Results from applying a Gaussian mixture classifier to identify individuals with olfactory dysfunction. Based on the anosmia scores we developed a Gaussian mixture classifier to identify individuals with olfactory impairment. This classifier is composed of two Gaussian distributions: one describes the anosmia scores of individuals with olfactory impairment, and the other represents the anosmia scores of individuals with a normal sense of smell. A large proportion of COVID-19 cases develop some olfactory dysfunction [57, 58, 59, 62, 60, 61]. We estimated the distribution of the anosmia scores for the truly anosmic participants based on the scores obtained from self-reported anosmic participants (*mean* = −1.81; *std* = 2.1). Similarly, we estimated the distribution of the anosmia scores for the non-anosmic participants based on the score of the participants with negative RT-PCR ignoring outliers from the left tail (*mean* = 1.22; *std* = 0.97). We used these two distributions to build a Gaussian mixture classifier to identify individuals with olfactory dysfunction (refer to *Methods*). The results from the anosmia classifier are summarized in Figure 2C. ### Olfactory function measurement improves COVID-19 prediction by Bayesian network model in symptomatic population We constructed a Bayesian network model (Figure 3A illustrates the model structure) to estimate whether a participant had COVID-19 (P). The model included self-reported cold (F) as a confounder, seven COVID-19 symptoms (cough, fever, muscular pain, breathing difficulty, self-reported anosmia, ageusia, and anosmia score), five indicator variables (sI1 recognized more than four odors; sI4 reported more than one symptom among cough, fever, breathing difficulty and muscular pain and sI1; sDays had 2-3 days with symptoms; sI7 had headache, diarrhea, or chest pain and recognized four or less odors; sI8 had ageusia, stomach pain, or fatigue, and sI1), and gender. The contribution of each variable to the probability of having COVID-19 can be found in Supplementary Figs. S1-S2. For more details about the construction of the Bayesian network, the reader is referred to the corresponding subsection in *Methods*. ![Figure 3:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/04/16/2021.01.18.21249821/F3.medium.gif) [Figure 3:](http://medrxiv.org/content/early/2021/04/16/2021.01.18.21249821/F3) Figure 3: Training of the Bayesian network model for COVID-19 prediction. (A) Structure of the model. P represents the result of the RT-PCR assay, and F represents self-reported cold. The six different odors are represented with the variables: oB (Banana), oC (Caramel), oM (Mint), oO (Orange), oPi (Pineapple), oV (Vanilla). The six different symptoms are represented by: sCo (cough), sFe (fever), sMusPain (muscular pain), sBreDif (breathing difficulty), sAn (self-reported anosmia) and sAg (self-reported ageusia). Five indicator variables are represented by: sI1, sI4, sI7, sI8, sDays. dGender represents the gender of the individual. All variables are dichotomous. (B) Average Receiver Operating Characteristic (ROC) curve, as estimated through cross-validation (K=10), for predicting a COVID-19 case using the full model (black line), only the KOR test (red line), and single self-reported symptoms. (C) Mean and 95% confidence intervals for the AUC of the ROC curves shown in (B). These analysis were performed using the UC-Christus sample (N=926) We evaluated the performance of our model based on the UC-Christus dataset (*n* = 926, 32% positive RT-PCR). A 10-fold cross-validation was performed in order to have a robust estimator of the errors in the identification of positive and negative COVID-19 individuals. Figure 3B displays the average receiver operating characteristic (ROC) curve of the full model in black. To assess the contribution to the model of the objective measurements of olfactory impairment, we estimated the model with all variables except the ones that include information from the KOR test. Figure 3B shows the ROC curve of this model in red. The complete model displayed an area under the curve (AUC) of 0.785 with 95% confidence interval [0.754;0.816] and 76% accuracy, whereas the partially complete model yielded an AUC of 0.733 with 95% confidence interval [0.696;0.768] and 72% accuracy. The difference in the AUC is significant at an 87% level. We further looked at the subset of individuals from the UC-Christus sample with no reported symptoms (*n* = 288) to assess model performance based solely on the anosmia score and measurements obtained from the KOR test. From this subset, 39 individuals had an RT-PCR positive, of which 9 had a predicted probability above 0.5 for being infected. All recognized three or less odors among a total of six, except for one that recognized four odors. The two odors not recognized were mint and orange. The remaining 30 individuals with a positive RT-PCR recognized at least four odors, and were not captured by the model at the infection probability threshold of 0.5. From the 249 individuals with a negative RT-PCR, 13 obtained a probability of being infected above 0.5, 11 of them recognized three or fewer odors and 2 recognized four, with mint among the non-recognized. ### Anosmia score predicts COVID-19 status with higher fidelity than self-report in asymptomatic cases We further applied the KOR test to 1, 365 workers from a mining company that had not been previously infected and did not present any symptoms, such as fever, cough, and muscular pain. These workers were also tested with RT-PCR. Among all the workers, only 15 had a positive RT-PCR, of which the BN model identified 6. These six individuals identified less than four odors from the KOR test. The remaining nine individuals identified five out of the six odors (*n* = 4) or identified the six odors (*n* = 5). Overall, the model had 84% accuracy and an AUC of 0.712 with a 95% confidence interval [0.6302;0.7942]. As the main predictor of COVID-19 status in asymptomatic individuals is their olfactory function, we compared the anosmia score of this sample and the probability of having olfactory dys-function using the anosmia classifier trained with the UC-Christus dataset. The latter showed great agreement between the anosmia negative individuals and the miners cohort as observed by the overlapping between both densities (Figure 4A), confirming its suitability for describing the olfactory function of the general population. Finally, we compared the anosmia classifier results against the anosmia self-report of a sub-sample from the miners cohort (*n* = 825). There are 52 individuals likely of having olfactory dysfunction as determined by their anosmia score and the corresponding infection probability (> 0.5). This corresponds to 6.3% of the total sample. Of those, only 8 (approx. 1%) individuals self-reported an olfactory dysfunction. Roughly, 85% of individuals with olfactory impairment were not aware of their loss of the sense of smell (Figure 4B). This result confirms that olfactory impairment is typically underestimated or not perceived by healthy individuals [56], rendering the self-report of a “healthy olfactory function” unreliable. ![Figure 4:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/04/16/2021.01.18.21249821/F4.medium.gif) [Figure 4:](http://medrxiv.org/content/early/2021/04/16/2021.01.18.21249821/F4) Figure 4: Anosmia prevalence in the healthy workers cohort. (A) Anosmia score density in the asymptomatic sample from the mining company (black line). The red and green lines correspond to the distribution for anosmic and non-anosmic individuals, respectively, as estimated in the UC-Christus data. (B) Comparison of self-reported anosmia and measured anosmia in the asymptomatic miners cohort. An individual was predicted to have olfactory dysfunction (anosmia) if the infection probability given its anosmia score was greater than 0.5. ## Discussion We report a novel model for predicting the COVID-19 status of individuals based on self-reported symptoms (subjective measures) and the degree of olfactory dysfunction (anosmia score) as determined from psychophysical odor recognition trials from a rapid smelling test (Fig. 1). This anosmia score overcomes the known limitations of olfactory dysfunction self-report, i.e., usually underestimation of olfactory dysfunction severity (Fig. 2B), and furthermore, it substantially increases the predictive power of the model (Fig. 3B-C). We found that the full model incorporating this index yielded COVID-19 status predictions with high fidelity (AUC 0.785), which worsened when this index was left out (AUC 0.733). In the case of asymptomatic individuals (miners data), where the only measurement is obtained from the KOR test, the model was able to identify 100% of the individuals with olfactory impairment. Among the 15 individuals that were RT-PCR positive, six of them recognized less than four odors, the remaining 9 recognized at least five out of the six different odors. We obtained a similar performance on the asymptomatic participants from the UC-Christus sample. The model recognized all individuals with RT-PCR positive who identified less than four odors and one individual who identified four odors. For the model to recognize an individual infected that identified four odors, mint has to be among the unrecognized odors. As opposed to conventional olfactory function tests, the KOR test does not place the same weight on all the odors for the determination of the olfactory function state. A clear example is mint. Mint has two features that are especially attractive in a smell test. First, mint has a very distinctive smell and is rarely confused with other odors. Second, mint is a familiar smell to most people. In the KOR test, mint was correctly recognized by a majority of participants with a negative RT-PCR (93%). Hence, mint has a larger contribution to the model. If mint is not recognized there is a higher probability that the participant is infected (Fig. 1B). It is possible that some of the proposed odors may not be readily recognized across different sociocultural settings, despite being used and validated in international medical studies [63]. Cross-cultural validity would be, nevertheless, straightforward to address by piloting the test and by choosing odors which satisfy the two features mentioned above before implementation. The fact that the KOR test is rapid, painless, low-cost (about USD 0.50/test), and simple enables mass screening of COVID-19 in the population. There is substantial evidence that a great portion of infected individuals are asymptomatic [29, 64]. For example, the notorious Diamond Princess cruise ship had an asymptomatic COVID-19 infection prevalence of 30.8% in an adult population, and The American Academy of Pediatrics currently reports that about 4% of children are asymptomatic and 51% have only mild symptoms [65]. Rational allocation of scarce diagnostic resources to test asymptomatic individuals is crucial, particularly in low- and middle-income countries. It can substantially mitigate disease transmission as patients with no apparent symptoms are less likely to follow public health guidelines than symptomatic patients [65]. Several studies have stressed the importance of frequent, mass testing, with a short sample-to-answer reporting time to limit viral transmission in this epidemic [16, 17, 25, 26]. Furthermore, modeling suggests that frequent screening for olfactory dysfunction could substantially reduce viral spread at a comparatively low cost [27]. However, despite the expectation that an olfactory test would be cost-effective [27], some settings with limited resources may not necessarily afford it financially. Until a substantial proportion of the population is vaccinated, frequent, accessible, routine screening for COVID-19 is critical to isolate infectious individuals and effectively break the chain of viral transmission. The KOR test, or any other psychophysical test to assess olfactory dysfunction would allow developing better sampling strategies that maximize the identification of high-probability COVID-19 cases with more sensitive tests (e.g., RT-PCR), among individuals with no apparent symptoms. Our analyses are based on a sample of individuals from medical centers with probable COVID-19 and a sample of asymptomatic workers in a large mining operation. Neither sample is representative of the broader population. Nevertheless, the over-representation of positive cases in the UC-Christus data enabled us to estimate the relationship between symptoms and disease using a moderate sample size. The under-representation of positive cases in the miners data, challenged the model to capture infected individuals with just KOR test measurements. The Bayesian network model has moderate accuracy and relatively low sensitivity. Diagnosis for symptomatic patients in a clinical setting usually requires high accuracy and sensitivity, as it defines a patient’s treatment. In contrast, given the transmission dynamics of SARS-CoV-2, rapid results and frequency of testing are much more critical for effective surveillance with the potential of controlling viral transmission [16, 17, 25, 26]. However, it is possible that false positives would be put under quarantine unnecessarily, at least until they can access a more sensitive test such as an RT-PCR. From an epidemiological standpoint, this outcome is preferable to having community transmission, especially for a gradual reopening of society. Perhaps more worryingly, using a psychophysical smell test for mass screening would probably result in several false negatives and result in the onward transmission of SARS-CoV-2. However, in a counterfactual scenario without mass screening, those individuals would not be tested and still transmit the virus. The test may potentially lead to higher spreading if individuals without olfactory dysfunction but active infection felt falsely reassured. Therefore, the potential use of this test requires adequate risk communication and is not intended to replace other non-pharmaceutical strategies for the control and prevention of viral transmission, such as social distancing, frequent hand-washing, and wearing face masks. Last, it is also possible that our test would fail to recognize some patients with olfactory dysfunction. While they do not serve the same purpose, we also compared our test with standard RT-PCR results. Despite limited evidence, several studies have raised concerns about possible false-negative RT-PCR tests in patients with COVID-19 [66, 67, 68]. The evidence suggests that negative results, even with a relatively low probability of exposure, cannot rule out SARS-COV-2 infection [69]. Some of the cases we classified as false-positives due to negative RT-PCR results could have been true COVID-19 cases. This also underscores the importance of frequent testing for COVID-19 [16, 17, 27]. Research among COVID-19 patients suggests that olfactory dysfunction, self-reported and based on a psychophysical test, was significantly more prevalent in mild compared to moderate-to-critical disease [46, 58]. The mechanisms that explain this observed difference are still unclear, but they could potentially be related to differences in patients’ immunological response by disease severity [46]. Olfactory loss may appear before other symptoms [70, 59]and seems to be more prevalent in mild compared to moderate-to-critical disease [47], which reinforces the potential of psychophysical smell test for early detection of COVID-19. An important extension of our study would be testing whether olfactory dysfunction allows distinguishing SARS-CoV-2 infections in patients with a negative RT-PCR test, which may be particularly problematic, for example, among healthcare and other essential workers (e.g., police). This could be addressed using serology, for example, testing individuals before the olfactory test and three weeks later. Our model incorporated self-reported cold to capture the fact that several symptoms are shared between COVID-19 and cold. Nevertheless, several other diseases and conditions share symptoms with COVID-19, including smoking, allergies, and rhinitis, which we could have been considered in the model. However, capturing more complexity in the Bayesian network model requires an exponentially larger dataset, which rapidly becomes prohibitively expensive. We limited model complexity to make parameter estimation reliable. The model assumes that symptoms are independent given the status of cold and COVID-19 (infected/not infected). This independence assumption may not be satisfied, but we prioritized a simpler model that can capture the general tendency, given sample size constraints. Until an effective vaccine for COVID-19 becomes available for a large proportion of the population, strategies to control the epidemic are mostly limited to non-pharmaceutical interventions. These interventions are socially and economically costly, and therefore, more focused interventions are increasingly important. Frequent screening, rapid diagnosis, and effective isolation of SARS-CoV-2 infections are critical. However, costs and time make currently available options impractical as a surveillance tool, particularly for low- and middle-income countries. We have presented a standardized, model-based, low-cost olfactory psychophysical test for the rapid screening of COVID-19. The test is painless and easy to implement and has a web-based secure platform for managing patient data. To this date, over 190,000 tests have been performed in the platform (refer to *KOR web platform*), which highlights the potential for systematic assessment of olfactory impairment in the general population. In a sample of participants with no apparent symptoms, the model captures individuals with loss of smell and a positive RT-PCR. Our results highlight the potential of using olfactory function assessments as a low-cost, frequent, accessible, painless, routine testing for COVID-19 surveillance for a safer reopening of society, including industry, universities, and other organizations. ## Methods ### COVID-19 RT-PCR test Individuals were tested following the World Health Organization guidelines for real-time reverse-transcriptase PCR testing using validated diagnostics reported elsewhere [71]. ### KOR test design The KOR test is a rapid, six-odor, forced multiple-choice identification test. While previous rapid tests have shown to be reasonably effective for detecting total loss of olfactory function (i.e., anosmia) through the identification of only three odors [72], they are ineffective for the identification of partial olfactory function loss. As there is good evidence of COVID-19 cases suffering from partial olfactory impairment [58], we increased the number of odors in the test (6) to improve its sensitivity for detecting olfactory function loss. The proposed six odors were based on previous odor recognition reports [72] and clinical olfactory studies for infants in several countries including Chile [63]. To minimize recognition bias, candidate odors were evaluated and validated in a pilot trial. Only odors with a high recognition level of at least 85% (Supplementary Fig. S3) were selected. The sample of the pilot study consisted of 79% and 21% healthy men and women, respectively, with ages between 18 and 65 years of age in a sample of 2289 volunteers. Selected odors showed no significant differences in their recognition between men and women at 5% significance level (two-sided *t*-test, critical *p*-value = 0.21), displayed a high recognition level in all cases (*>* 85% one-sided *t*-test, minimum critical *p*-value = 0.41), and showed no significant differences in the average recognition level for individuals between 18 and 60 years at 5% significance level (ANOVA, critical *p*-value = 0.10). Details of the pilot study sample can be found in Supplementary Table S2. ### KOR test application protocol The KOR test is a standardized, six-odor, forced multiple-choice identification test, which is managed through an online platform, hosted in [www.testkor.com](http://www.testkor.com). The test is carried out as follows: a paper strip is impregnated with a drop (0.03 mL) one of the aromatic solutions, as indicated by the platform, and presented to the participant to be smelled. The individual must identify the corresponding odour among 4 options, shown in the platform. Before evaluating the next odour, the subject is asked to neutralize eventual remaining fragrance in the nasal cavity by smelling his own body odor (wrist or forearm). All 6 aromas, i.e. banana, caramel, mint, orange, pineapple and vanilla, were evaluated in a random sequence, as determined by the platform, one at a time, with an inter stimulus interval of 15 seconds. The aromas were supplied by Alfa Group ([https://alfagroup.cl/](https://alfagroup.cl/)), a Chilean company specialized in providing food ingredients. The company,s safety procedures are certified for HACCP and FSSC22000. All raw materials were FEMA / GRAS. Each aroma is contained in a 30 ml amber, glass dropper. Supplementary Table S3 indicates the composition and concentration of main odorants of the six solutions. The reader is referred to the Supplementary Text S1 for more details on the application protocol. ### Model training dataset: COVID-19 suspects cohort from healthcare system The first sample of participants was obtained from five medical centers that are part of the UC-Christus healthcare network in Santiago. The sample consisted of 926 individuals, 48% women and 52% men, with an average of 37 ± 13 years of age. These individuals had either symptoms compatible with SARS-CoV-2 infection, and/or were in close contact with confirmed cases. The individuals undergone both the olfactory KOR test and the SARS-CoV-2 real-time RT-PCR tests. COVID-19 prevalence was 32% in this sample. Individuals who reported base olfactory dysfunction as a consequence of previous trauma and/or acute/chronic health issues (e.g., chronic sinusitis, allergic rhinitis, among others) were not considered in this study. Before the application of the test, participants declared their COVID-19-related symptoms (fever, cough, muscular pain, breathing difficulty), demography (age, gender), prevailing diseases (allergy, cold, diabetes, hypertension, Parkinson, rhinitis and Alzheimer), and whether they were smokers. Other self-reported symptoms or conditions such as anosmia/hyposmia, ageusia, headache, diarrhea, fatigue, chest pain, and stomach pain, were also registered (refer to previous subsection). ### Model validation dataset: Workers cohort from mining company For model validation under more realistic conditions, a sample of 1365 individuals was collected from a mining company in Antofagasta, Chile. Individuals that satisfy criteria i) and ii) (below) were simultaneously tested for their olfactory function status and SARS-CoV-2 real-time RT-PCR at a sanitary checkpoint. Inclusion criteria were: i) the person had not have a positive RT-PCR for COVID-19, and ii) at the moment of the test, the person did not have fever or any other apparent COVID-19 symptom. Only asymptomatic individuals were included in the sample. The prevalence of COVID-19 was 1.1% in this sample. Participants (825) also reported at the time of the screening if they recently suffered from olfactory impairment. ### Bayes network model To predict an individual’s COVID-19 status, we built a model that considers an RT-PCR positive result as a COVID-19 case (*Y*1), and incorporates *cold* (*Y*2) as a possible confounder variable, seven symptoms (cough (*X*7), fever (*X*8), muscular pain (*X*9), breathing difficulty (*X*10), self-reported anosmia (*X*14), ageusia (*X*15) and the anosmia score), five indicator variables (*X*11, *X*12, *X*13, *X*16, *X*17) and gender (*X*18). To compute the anosmia score, we tested the identification of six odours: banana (*X*1), caramel (*X*2), mint (*X*3), orange (*X*4), pineapple (*X*5) and vanilla (*X*6). The five indicator variables were defined in the following way: *X*11 measures whether the individual recognized more than four odours or not (this score yielded the best COVID-19 prediction performance when the odors have equal weight, see Supplementary Fig. S5); *X*12 indicates whether the individual suffers from more than one symptom among cough, fever, muscular pain, breathing difficulty, headache, diarrhea and fatigue, and satisfies *X*11 = 1; *X*13 measures whether the individuals had 2-3 days with symptoms (this variable represents the days where the RT-PCR is most effective); *X*16 measures whether the individuals had *X*11 = 0 and one or more symptoms among headache, diarrhea and chest pain; and *X*17 measures whether the individual satisfies *X*11 = 1 and one or more symptoms among ageusia, stomach pain and fatigue. These indicator variables aim to identify group of symptoms that by occurring together increase the effect on the model. The structure of the model is depicted in Figure 3A. Note that the structure of the model assumes that all the X variables are conditionally independent given *Y*1 and *Y*2 and all X variables are colliders. The joint probability distribution of all variables is given by: ![Formula][1] and we are interested in calculating the probability of positive RT-PCR given the other variables, i.e. ![Formula][2] where all variables are dichotomous Bernoulli distributed. We assume a Binomial distribution for the joint probability of RT-PCR and self-reported cold. ![Formula][3] ![Formula][4] Here *k* denotes the four different outcomes that the joint variables *Y*1, *Y*2 can take. Note that there are a total of 75 parameters that need to be estimated. *θ**k* represents the probability of belonging to group *k* for the variables *Y*1, *Y*2. *θ**i,k* represents the probability that an individual is positive for the condition/disease/variable *i* given that she/he is in group *k* for the variables *Y*1, *Y*2. We trained this model using a dataset of 926 individuals. In order to gain some degrees of freedom, and because we observed a clear tendency between the symptoms and the outcome of the variables *Y*1 and *Y*2 as shown in Supplementary Fig. S2, we set the following linear constrain on the parameters, ![Formula][5] reducing the number of parameters to be estimated to 36. We either plug-in equations (3) and (4), or (3) and (5) into (1) to obtain via maximum likelihood the estimators of the parameters. The variables *R**ik* are known and set to fit the tendency of the parameters as shown in Supplementary Fig. S4. Finally, for a new individual with variables *X*1 = *x*1, …, *X*18 = *x*18 we compute: ![Formula][6] From these three equations we can obtain the probabilities *s*, *s*1, *s*2, *s*3. If *Y*2 = 1 then ![Formula][7] when *Y*2 = 0 then ![Formula][8] ### Anosmia score and classifier For an individual with outcomes from the KOR test given by (*x*1, *x*2, *x*3, *x*4, *x*5, *x*6) where *x**i* can take the value 1 if the individual identify odour *i* or 0 if the individual did not identify the odour *i*, its anosmia score is calculated in the following way. * For individuals with the cold: ![Formula][9] * For individuals without the cold: ![Formula][10] The distribution of the anosmia score, say *y*, is assumed to be a Gaussian mixture of two distribution: ![Formula][11] where *f* (*y*; *µ, σ*2) denotes a Gaussian distribution with mean *µ* and variance *σ*2, the parameters *µ*1, ![Graphic][12] represent the parameters of the distribution for the anosmia score for individuals suffering from olfactory dysfunction, and the parameters *µ*2, ![Graphic][13] represent the parameters of the distribution for the anosmia score for individuals that do not suffer from olfactory dysfunction. The estimators for these parameters were obtained from the UC-Christus data: ![Graphic][14] and ![Graphic][15] ## KOR web platform The KOR test web platform was designed to enable a rapid administration of the test. We developed a data model to store test information efficiently, paying attention to how often data about organizations, members, and screening tests are updated. The platform’s data access layer (back-end) was developed in Django (open-source framework), while its user interface (front-end) was developed in the JavaScript library ReactJS (open-source). High scalability and security concerns are handled by the deployment of the platform in Amazon Elastic Compute Cloud. General statistics on platform use, such as total tests, tests per day, and average time per test, can be found at [http://metabase.imfd.cl/public/dashboard/2801acac-8414-43be-871d-dad441026d3a](http://metabase.imfd.cl/public/dashboard/2801acac-8414-43be-871d-dad441026d3a) ## Supporting information Supplementary Information [[supplements/249821_file02.pdf]](pending:yes) ## Data Availability The required data to reproduce the results of this study have been deposited in Mendeley Data and can be freely downloaded from the link provided. [http://dx.doi.org/10.17632/z4ktvcwfp6.1](http://dx.doi.org/10.17632/z4ktvcwfp6.1) ## Data availability The required data to reproduce the results of this study have been deposited in Mendeley Data and can be freely downloaded at [http://dx.doi.org/10.17632/z4ktvcwfp6.2](http://dx.doi.org/10.17632/z4ktvcwfp6.2) ## Funding This work was funded by the Technological Adoption Fund SiEmpre from SOFOFA Hub (CORFO), and partially funded by ANID through the Millennium Science Initiative Program ICN17 002 to S.E., P.B. and M.A.; ANID Millennium Science Initiative Program NCN17 081 and ANID/FONDAP CIGIDEN 15110017 to EU; Fondecyt 1200146 to S.E; and Fondecyt de Iniciación 11190871 to PS. ## Contributions S.E., P.A.S., E.A.U., L.M., J.P., A.F., s.s., P.B., M.A., and E.A. designed the study; P.A.S., C.V., C.L., and E.A. designed the olfactory test; C.V., C.L., and S.S. collected the data; S.E. performed modelling; M.U., N.S., and P.B. developed the web platform; S.E., P.A.S., E.A.U., and M.A. analyzed data; and S.E., P.A.S., E.A.U., M.A., and E.A. wrote the paper. ## Competing interests DICTUC SA. has interest in commercial application of the olfactory test. E.A. is an advisor for DICTUC SA. C.V. and C.L. are employed by DICTUC SA. ## Footnotes * We have made some modifications to the article based on suggestions from scientific reviewers. The main results of the paper have not changed, but only some specific parts that required more details (e.g., test specification). Some of these details are available in a revised version of the Supplementary Material. * Received January 18, 2021. * Revision received April 16, 2021. * Accepted April 16, 2021. * © 2021, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/) ## References 1. [1]. E. Dong, H. Du, and L. Gardner, “An interactive web-based dashboard to track covid-19 in real time,” The Lancet Infectious Diseases, vol. 20, no. 5, pp. 533–534, 2020. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S1473-3099(20)30120-1&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 2. [2]. E. Mahase, “Covid-19: Uk approves oxford vaccine as cases of new variant surge,” BMJ, vol. 371, p. m4968, 2020. [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE3OiIzNzEvZGVjMzBfNi9tNDk2OCI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIxLzA0LzE2LzIwMjEuMDEuMTguMjEyNDk4MjEuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 3. [3]. J. Tanne, “Covid-19: Fda panel votes to authorise pfizer biontech vaccine,” BMJ, vol. 371, p. m4799, 2020. [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE3OiIzNzEvZGVjMTFfNS9tNDc5OSI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIxLzA0LzE2LzIwMjEuMDEuMTguMjEyNDk4MjEuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 4. [4]. C. Zimmer, J. Corum, and S.-L. Wee, “Coronavirus vaccine tracker,” New York Times, 2021. 5. [5]. S. M. Kissler, C. Tedijanto, E. Goldstein, Y. H. Grad, and M. Lipsitch, “Projecting the transmission dynamics of sars-cov-2 through the postpandemic period,” Science, vol. 368, no. 6493, pp. 860–868, 2020. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6Mzoic2NpIjtzOjU6InJlc2lkIjtzOjEyOiIzNjgvNjQ5My84NjAiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMS8wNC8xNi8yMDIxLjAxLjE4LjIxMjQ5ODIxLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 6. [6]. T. E. I. Unit, “Rich countries will get access to coronavirus vaccines earlier than others,” The Economist, 2020. 7. [7]. R. Anderson, C. Vegvari, J. Truscott, and B. Collyer, “Challenges in creating herd immunity to sars-cov-2 infection by mass vaccination,” The Lancet, vol. 396, no. 10263, pp. 1614–1616, 2020. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S0140-6736(20)32318-7&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=33159850&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 8. [8]. K. Asahi, E. A. Undurraga, R. Valdes, and R. Wagner, “The effect of covid-19 on the economy: evidence from an early adopter of localized lockdowns,” J Glob Health, vol. 11, p. 05002, 2021. 9. [9]. C. Baek, P. McCrory, T. Messer, and P. Mui, “Unemployment effects of stay-at-home orders: Evidence from high frequency claims data,” The Review of Economics and Statistics, vol. online Oct 30, pp. 1–72, 2020. 10. [10]. K. Shimizu, G. Wharton, H. Sakamoto, and E. Mossialos, “Resurgence of covid-19 in japan,” BMJ 370:m3221, 2020. [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE3OiIzNzAvYXVnMThfNy9tMzIyMSI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIxLzA0LzE2LzIwMjEuMDEuMTguMjEyNDk4MjEuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 11. [11]. N. W. Ruktanonchai, J. Floyd, S. Lai, C. W. Ruktanonchai, A. Sadilek, P. Rente-Lourenco, X. Ben, A. Carioli, J. Gwinn, J. Steele, et al., “Assessing the impact of coordinated covid-19 exit strategies across europe,” Science, vol. 369, no. 6510, pp. 1465–1470, 2020. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6Mzoic2NpIjtzOjU6InJlc2lkIjtzOjEzOiIzNjkvNjUxMC8xNDY1IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDQvMTYvMjAyMS4wMS4xOC4yMTI0OTgyMS5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 12. [12]. J. Wise, “Covid-19: Risk of second wave is very real, say researchers,” BMJ: British Medical Journal (Online), vol. 369, 2020. 13. [13]. E. Lavezzo, E. Franchin, C. Ciavarella, G. Cuomo-Dannenburg, L. Barzon, C. Del Vecchio, L. Rossi, R. Manganelli, A. Loregian, N. Navarin, et al., “Suppression of a sars-cov-2 outbreak in the italian municipality of vo’,” Nature, vol. 584, no. 7821, pp. 425–429, 2020. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 14. [14]. V. A. Karatayev, M. Anand, and C. T. Bauch, “Local lockdowns outperform global lockdown on the far side of the covid-19 epidemic curve,” Proceedings of the National Academy of Sciences, vol. 117, no. 39, pp. 24575–24580, 2020. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoicG5hcyI7czo1OiJyZXNpZCI7czoxMjoiMTE3LzM5LzI0NTc1IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDQvMTYvMjAyMS4wMS4xOC4yMTI0OTgyMS5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 15. [15]. X. Hao, S. Cheng, D. Wu, T. Wu, X. Lin, and C. Wang, “Reconstruction of the full transmission dynamics of covid-19 in wuhan,” Nature, vol. 584, no. 7821, pp. 420–424, 2020. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 16. [16]. D. B. Larremore, B. Wilder, E. Lester, S. Shehata, J. M. Burke, J. A. Hay, M. Tambe, M. J. Mina, and R. Parker, “Test sensitivity is secondary to frequency and turnaround time for covid-19 surveillance,” Science Advances, vol. 7, no. 1, 2020. 17. [17]. A. D. Paltiel, A. Zheng, and R. P. Walensky, “Assessment of sars-cov-2 screening strategies to permit the safe reopening of college campuses in the united states,” JAMA Network Open, vol. 3, no. 7, p. e2016818, 2020. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jamanetworkopen.2020.16818&link_type=DOI) 18. [18]. Q. Li, X. Guan, P. Wu, X. Wang, L. Zhou, Y. Tong, R. Ren, K. S. Leung, E. H. Lau, J. Y. Wong, et al., “Early transmission dynamics in wuhan, china, of novel coronavirus–infected pneumonia,” New England Journal of Medicine, vol. 382, no. 13, pp. 1199–1207, 2020. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa2001316&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 19. [19]. J. T. Wu, K. Leung, and G. M. Leung, “Nowcasting and forecasting the potential domestic and international spread of the 2019-ncov outbreak originating in wuhan, china: a modelling study,” The Lancet, vol. 395, no. 10225, pp. 689–697, 2020. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/s01406736(20)30260-9&link_type=DOI) 20. [20]. X. He, E. H. Lau, P. Wu, X. Deng, J. Wang, X. Hao, Y. C. Lau, J. Y. Wong, Y. Guan, X. Tan, et al., “Temporal dynamics in viral shedding and transmissibility of covid-19,” Nature Medicine, vol. 26, no. 5, pp. 672–675, 2020. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.7326/M20-3012&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 21. [21]. Y. Liu, S. Funk, S. Flasche, et al., “The contribution of pre-symptomatic infection to the transmission dynamics of covid-2019 [version 1; peer review: 3 approved],” Wellcome Open Research, vol. 5, no. 58, 2020. 22. [22]. T. Ganyani, C. Kremer, D. Chen, A. Torneri, C. Faes, J. Wallinga, and N. Hens, “Estimating the generation interval for coronavirus disease (covid-19) based on symptom onset data, march 2020,” Eurosurveillance, vol. 25, no. 17, p. 2000257, 2020. 23. [23]. W. J. Wiersinga, A. Rhodes, A. C. Cheng, S. J. Peacock, and H. C. Prescott, “Pathophysiology, transmission, diagnosis, and treatment of coronavirus disease 2019 (covid-19): a review,” Jama, vol. 324, no. 8, pp. 782–793, 2020. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jama.2020.12839.e4&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 24. [24]. N. Sethuraman, S. S. Jeremiah, and A. Ryo, “Interpreting diagnostic tests for sars-cov-2,” Jama, vol. 323, no. 22, pp. 2249–2251, 2020. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jama.2020.8259&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 25. [25]. P. Bosetti, C. T. Kiem, Y. Yazdanpanah, A. Fontanet, B. Lina, V. Colizza, and S. Cauchemez, “Impact of mass testing during an epidemic rebound of sars-cov-2: a modelling study using the example of france,” Eurosurveillance, vol. 26, p. 2001978, 2021. 26. [26]. M. Pavelka, K. van Zandvoort, S. Abbott, K. Sherratt, M. Majdan, P. Jarcuska, M. Krajci, S. Flasche, S. Funk, and C. C.-. working group, “The effectiveness of population-wide, rapid antigen test based screening in reducing sars-cov-2 infection prevalence in slovakia,” medRxiv, p. 2020.12.02.20240648, 2020. 27. [27]. D. Larremore, D. Toomre, and R. Parker, “Modeling the effectiveness of olfactory testing to limit sars-2-cov transmission,” MedRxiv, 2020. 28. [28]. W.-j. Guan, Z.-y. Ni, Y. Hu, W.-h. Liang, C.-q. Ou, J.-x. He, L. Liu, H. Shan, C.-l. Lei, D. S. Hui, et al., “Clinical characteristics of coronavirus disease 2019 in china,” New England Journal of Medicine, vol. 382, no. 18, pp. 1708–1720, 2020. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa2002032&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 29. [29]. Q.-X. Long, X.-J. Tang, Q.-L. Shi, Q. Li, H.-J. Deng, J. Yuan, J.-L. Hu, W. Xu, Y. Zhang, F.-J. Lv, et al., “Clinical and immunological assessment of asymptomatic sars-cov-2 infections,” Nature Medicine, vol. 26, no. 8, pp. 1200–1204, 2020. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41591020-0965-6&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 30. [30]. D. Wang, B. Hu, C. Hu, F. Zhu, X. Liu, J. Zhang, B. Wang, H. Xiang, Z. Cheng, Y. Xiong, et al., “Clinical characteristics of 138 hospitalized patients with 2019 novel coronavirus–infected pneumonia in wuhan, china,” JAMA, vol. 323, no. 11, pp. 1061–1069, 2020. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jama.2020.1585&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 31. [31]. W. de Souza, L. Buss, and D. e. a. Candido, “Epidemiological and clinical characteristics of the covid-19 epidemic in brazil,” Nature Human Behavior, vol. 4, pp. 856––865, 2020. 32. [32]. D. Borsetto, C. Hopkins, V. Philips, R. Obholzer, G. Tirelli, J. Polesel, and P. Boscolo-Rizzo, “Self-reported alteration of sense of smell or taste in patients with covid-19: a systematic review and meta-analysis on 3563 patients,” Rhinology, vol. 10, 2020. 33. [33]. C. Menni, A. Valdes, and M. e. a. Freidin, “Real-time tracking of self-reported symptoms to predict potential covid-19,” Nature Medicine, vol. 26, pp. 1037–1040, 2020. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41591-020-0916-2&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 34. [34]. G. Ottaviano, M. Carecchio, B. Scarpa, and R. Marchese-Ragona, “Olfactory and rhinological evaluations in sars-cov-2 patients complaining of olfactory loss,” Rhinology, vol. 58, no. 4, pp. 400–401, 2020. 35. [35]. M. M. Speth, T. Singer-Cornelius, M. Oberle, I. Gengler, S. J. Brockmeier, and A. R. Sedaghat, “Time scale for resolution of olfactory dysfunction in covid-19,” Rhinology, vol. 58, no. 4, pp. 404–405, 2020. 36. [36]. M. Eliezer, C. Hautefort, A.-L. Hamel, B. Verillaud, P. Herman, E. Houdart, and C. Eloit, “Sudden and complete olfactory loss function as a possible symptom of covid-19,” JAMA Otolaryngology–Head & Neck Surgery, vol. 146, no. 7, pp. 674–675, 2020. 37. [37]. V. Parma, K. Ohla, M. G. Veldhuizen, M. Y. Niv, C. E. Kelly, A. J. Bakke, K. W. Cooper, C. Bouysset, N. Pirastu, M. Dibattista, et al., “More than smell–covid-19 is associated with severe impairment of smell, taste, and chemesthesis,” Chemical Senses, vol. 45, no. 7, pp. 609– 622, 2020. 38. [38]. A. A. Agyeman, K. L. Chin, C. B. Landersdorfer, D. Liew, and R. Ofori-Asenso, “Smell and taste dysfunction in patients with covid-19: A systematic review and meta-analysis,” in Mayo Clinic Proceedings, vol. 146, pp. 674–675, Elsevier, 2020. 39. [39]. M. Renaud, A. Leon, G. Trau, L. Fath, S. Ciftci, Y. Bensimon, A. Venkatasamy, and C. Debry, “Acute smell and taste loss in outpatients: all infected with sars-cov-2?,” Rhinology, vol. 58, no. 4, pp. 406–409, 2020. 40. [40]. W. Sungnak, N. Huang, C. Báecavin, M. Berg, R. Queen, M. Litvinukova, C. Talavera-López, H. Maatz, D. Reichart, F. Sampaziotis, et al., “Sars-cov-2 entry factors are highly expressed in nasal epithelial cells together with innate immune genes,” Nature Medicine, vol. 26, no. 5, pp. 681–687, 2020. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41591-020-0868-6&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 41. [41]. D. H. Brann, T. Tsukahara, C. Weinreb, M. Lipovsek, K. Van den Berge, B. Gong, R. Chance, C. Macaulay, H.-J. Chou, R. B. Fletcher, D. Das, K. Street, H. R. de Bezieux, Y.-G. Choi, D. Risso, S. Dudoit, E. Purdom, J. Mill, R. A. Hachem, H. Matsunami, D. W. Logan, B. J. Goldstein, M. S. Grubb, J. Ngai, and S. R. Datta, “Non-neuronal expression of sars-cov-2 entry genes in the olfactory system suggests mechanisms underlying covid-19-associated anosmia,” Science Advances, vol. 6, no. 31, p. eabc5801, 2020. [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6MzoiUERGIjtzOjExOiJqb3VybmFsQ29kZSI7czo4OiJhZHZhbmNlcyI7czo1OiJyZXNpZCI7czoxMzoiNi8zMS9lYWJjNTgwMSI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIxLzA0LzE2LzIwMjEuMDEuMTguMjEyNDk4MjEuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 42. [42]. L. W. Plasschaert, R. Žilionis, R. Choo-Wing, V. Savova, G. Knehr, J.and Roma, A. M. Klein, and A. B. Jaffe, “A single-cell atlas of the airway epithelium reveals the cftr-rich pulmonary ionocyte,” Nature, vol. 560, pp. 377–381, 2018. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41586-018-0394-6&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=30069046&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 43. [43]. M. Chen, R. R. Reed, and A. P. Lane, “Chronic inflammation directs an olfactory stem cell functional switch from neuroregeneration to immune defense.,” Cell Stem Cell, vol. 25, pp. 501– 513, 2019. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.stem.2019.08.011&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=31523027&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 44. [44]. M. Chen, W. Shen, N. R. Rowan, H. Kulaga, A. Hillel, M. Ramanathan Jr., and A. P. Lane, “Elevated ace2 expression in the olfactory neuroepithelium: implications for anosmia and upper respiratory sars-cov-2 entry and replication,” European Respiratory Journal, 2020. 45. [45]. K. Bilinska, P. Jakubowska, C. S. Von Bartheld, and R. Butowt, “Expression of the sars-cov-2 entry proteins, ace2 and tmprss2, in cells of the olfactory epithelium: Identification of cell types and trends with age,” ACS Chemical Neuroscience, 2020. 46. [46]. C.-E. C. M. Lechien, J.R. and, E. Beckers, V. Mustin, M. Ducarme, F. Journe, A. Marchant, L. Jouffe, M. R. Barillari, G. Cammaroto, M. P. Circiu, S. Hans, and S. Saussez, “Prevalence and 6-month recovery of olfactory dysfunction: a multicentre study of 1363 covid-19 patients,” Journal of Internal Medicine, vol. early view, 2021. 47. [47]. J. R. Lechien, C. M. Chiesa-Estomba, D. R. De Siati, M. Horoi, S. D. Le Bon, A. Rodriguez, D. Dequanter, S. Blecic, F. El Afia, L. Distinguin, Y. Chekkoury-Idrissi, S. Hans, I. L. Delgado, C. Calvo-Henriquez, P. Lavigne, C. Falanga, M. R. Barillari, G. Cammaroto, M. Khalife, P. Leich, C. Souchay, C. Rossi, F. Journe, J. Hsieh, M. Edjlali, R. Carlier, L. Ris, A. Lovato, C. De Filippis, F. Coppee, N. Fakhry, T. Ayad, and S. Saussez, “Olfactory and gustatory dysfunctions as a clinical presentation of mild-to-moderate forms of the coronavirus disease (covid-19): a multicenter european study,” European Archives of Oto-Rhino-Laryngology, vol. 277, pp. 2251–2261, 2020. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s00405-020-05965-1&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32253535&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 48. [48]. A. Paderno, D. Mattavelli, and C. Piazza, “Long-term olfactory and gustatory dysfunction may be related to neural damage,” Otolaryngology–Head and Neck Surgery, p. 0194599821994845, 2021. 49. [49]. M. S. Xydakis and L. Belluscio, “Detection of neurodegenerative disease using olfaction,” The Lancet Neurology, vol. 16, no. 6, p. 415, 2017. 50. [50]. A. Welge-Luessen, T. Hummel, T. Stojan, and M. Wolfensberger, “What is the correlation between ratings and measures of olfactory function in patients with olfactory loss?,” American Journal of Rhinology, vol. 19, no. 6, pp. 567–571, 2005. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=16402642&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000234312800006&link_type=ISI) 51. [51]. J. Lötsch and T. Hummel, “Clinical usefulness of self-rated olfactory performance—a data science-based assessment of 6000 patients,” Chemical Senses, vol. 44, no. 6, pp. 357–364, 2019. 52. [52]. S. B. Gane, C. Kelly, and C. Hopkins, “Isolated sudden onset anosmia in covid-19 infection. a novel syndrome?,” Rhinology, vol. 58, no. 3, pp. 299–301, 2020. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.4193/Rhin20.114]&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32240279&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 53. [53]. A. Giacomelli, L. Pezzati, F. Conti, D. Bernacchia, M. Siano, L. Oreni, S. Rusconi, C. Gervasoni, A. L. Ridolfo, G. Rizzardini, et al., “Self-reported olfactory and taste disorders in patients with severe acute respiratory coronavirus 2 infection: a cross-sectional study,” Clinical Infectious Diseases, vol. 71, no. 15, pp. 889–890, 2020. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 54. [54]. C. Hopkins, P. Surda, and N. Kumar, “Presentation of new onset anosmia during the covid-19 pandemic,” Rhinology, vol. 10, 2020. 55. [55]. L. Mao, H. Jin, M. Wang, Y. Hu, S. Chen, Q. He, J. Chang, C. Hong, Y. Zhou, D. Wang, et al., “Neurologic manifestations of hospitalized patients with coronavirus disease 2019 in wuhan, china,” JAMA Neurology, vol. 77, no. 6, pp. 683–690, 2020. 56. [56]. E. Wehling, A. J. Lundervold, T. Espeset, I. Reinvang, A. Bramerson, and S. Nordin, “Even cognitively well-functioning adults are unaware of their olfactory dysfunction: Implications for ent clinicians and researchers,” Rhinology, vol. 53, no. 1, pp. 89–94, 2015. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25756084&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 57. [57]. J. R. Lechien, P. Cabaraux, C. Chiesa-Estomba, M. Khalife, J. Plzak, S. Hans, et al., “Objective olfactory testing in patients presenting with sudden onset olfactory dysfunction as the first manifestation of confirmed covid-19 infection,” Medrxiv, 2020. 58. [58]. S. T. Moein, S. M. Hashemian, B. Mansourafshar, A. Khorram-Tousi, P. Tabarsi, and R. L. Doty, “Smell dysfunction: a biomarker for covid-19,” International Forum of Allergy & Rhinology, vol. 10, no. 8, pp. 944–950, 2020. 59. [59]. L. A. Vaira, G. Deiana, A. G. Fois, P. Pirina, G. Madeddu, A. De Vito, S. Babudieri, M. Petrocelli, A. Serra, F. Bussu, et al., “Objective evaluation of anosmia and ageusia in covid-19 patients: Single-center experience on 72 cases,” Head & Neck, vol. 42, no. 6, pp. 1252–1258, 2020. 60. [60]. J. R. Lechien, P. Cabaraux, S. Hans, M. Khalife, D. Martiny, C. Chiesa, et al., “Psychophysical olfactory findings of mild-to-moderate covid-19 patients: Preliminary report,” medRxiv, 2020. 61. [61]. L. A. Vaira, G. Salzano, M. Petrocelli, G. Deiana, F. A. Salzano, and G. De Riu, “Validation of a self-administered olfactory and gustatory test for the remotely evaluation of covid-19 patients in home quarantine,” Head & Neck, vol. 42, no. 7, pp. 1570–1576, 2020. 62. [62]. D. Hornuss, B. Lange, N. Schröter, S. Rieg, W. V. Kern, and D. Wagner, “Anosmia in covid-19 patients,” Clinical Microbiology and Infection, vol. 26, pp. 1426–1427, 2020. 63. [63]. V. A. Schriever, E. Agosin, A. Altundag, H. Avni, H. Cao Van, C. Cornejo, G. de los Santos, G. Fishman, C. Fragola, M. Guarneros, N. Gupta, R. Hudson, R. Kamel, A. Knaapila Konstantinidis, B. N. Landis, M. Larsson, J. N. Lundström, A. Macchi, F. Marinõ-Sáanchez, L. Martinec Nováakováa, E. Mori, J. Mullol, M. Nord, V. Parma, C. Philpott, E. J. Propst Rawan, M. Sandell, A. Sorokowska, P. Sorokowski, L.-M. Sparing-Paschke, C. Stetzler Valder, J. Vodicka, and T. Hummel, “Development of an international odor identification test for children: The universal sniff test,” The Journal of Pediatrics, vol. 198, pp. 265–272.e3, 2018. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 64. [64]. M. A. Johansson, T. M. Quandelacy, S. Kada, P. V. Prasad, M. Steele, J. T. Brooks, R. B. Slayton, M. Biggerstaff, and J. C. Butler, “Sars-cov-2 transmission from people without covid-19 symptoms,” JAMA Network Open, vol. 4, no. 1, p. e2035057, 2021. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jamanetworkopen.2020.35057&link_type=DOI) 65. [65]. W. V. Padula, “Why only test symptomatic patients? consider random screening for covid-19,” Applied Health Economics and Health Policy, vol. 18, no. 3, pp. 333–334, 2020. 66. [66]. Y. Yang, M. Yang, C. Shen, F. Wang, J. Yuan, J. Li, M. Zhang, Z. Wang, L. Xing, and J. Wei, “Laboratory diagnosis and monitoring the viral shedding of 2019-ncov infections,” MedRxiv, 2020. 67. [67]. J. Zhao, Q. Yuan, H. Wang, W. Liu, X. Liao, Y. Su, X. Wang, J. Yuan, T. Li, and J. Li, “Antibody responses to sars-cov-2 in patients of novel coronavirus disease 2019,” Clinical Infectious Diseases, vol. 71, no. 16, pp. 2027–2034, 2020. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 68. [68]. I. Arevalo-Rodriguez, D. Buitrago-Garcia, D. Simancas-Racines, P. Zambrano-Achig, R. del Campo, A. Ciapponi, O. Sued, L. Martínez-García, A. Rutjes, and N. Low, “False-negative results of initial rt-pcr assays for covid-19: a systematic review,” PLoS ONE, vol. 15, no. 12,p. e0242958, 2020. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0242958&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 69. [69]. S. Woloshin, N. Patel, and A. Kesselheim, “False negative tests for sars-cov-2 infection—challenges and implications,” New England Journal of Medicine, vol. 383, no. 6, p. e38, 2020. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 70. [70]. F. Heidari, E. Karimi, M. Firouzifar, P. Khamushian, R. Ansari, M. M. Ardehali, and F. Heidari, “Anosmia as a prominent symptom of covid-19 infection,” Rhinology, vol. 58, pp. 302–303, 2020. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.4193/Rhin20.140&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32319971&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) 71. [71]. V. M. Corman, O. Landt, M. Kaiser, R. Molenkamp, A. Meijer, D. K. Chu, T. Bleicker, S. Brünink, J. Schneider, M. L. Schmidt, D. G. Mulders, B. L. Haagmans, B. van der Veer, S. van den Brink, L. Wijsman, G. Goderski, J.-L. Romette, J. Ellis, M. Zambon, M. Peiris, H. Goossens, C. Reusken, M. P. Koopmans, and C. Drosten, “Detection of 2019 novel coron-avirus (2019-ncov) by real-time rt-pcr,” Euro surveillance: bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin, vol. 25, no. 3, p. 2000045, 2020. 72. [72]. T. Hummel, K. Rosenheim, C.-G. Konnerth, and G. Kobal, “Screening of olfactory function with a four-minute odor identification test: Reliability, normative data, and investigations in patients with olfactory loss,” Annals of Otology, Rhinology & Laryngology, vol. 110, no. 10, pp. 976–981, 2001. PMID: 11642433. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/000348940111001015&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=11642433&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F04%2F16%2F2021.01.18.21249821.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000171574400015&link_type=ISI) [1]: /embed/graphic-5.gif [2]: /embed/graphic-6.gif [3]: /embed/graphic-7.gif [4]: /embed/graphic-8.gif [5]: /embed/graphic-9.gif [6]: /embed/graphic-10.gif [7]: /embed/graphic-11.gif [8]: /embed/graphic-12.gif [9]: /embed/graphic-13.gif [10]: /embed/graphic-14.gif [11]: /embed/graphic-15.gif [12]: /embed/inline-graphic-1.gif [13]: /embed/inline-graphic-2.gif [14]: /embed/inline-graphic-3.gif [15]: /embed/inline-graphic-4.gif