Utility and limitations of Google searches on sensory loss as markers for new COVID-19 cases

Introduction

COVID-19 pandemic has by now hit almost all countries worldwide. Monitoring disease occurrence is a key prerequisite for combating the disease spread. Laboratory testing availability differs per country, with most of the countries unable to test the general and even the symptomatic population broadly. Furthermore, the symptoms elicited by SARS-CoV-2 are still being discovered, with the list of official symptoms being updated on a rolling basis.

Specifically, in addition to fever, cough, shortness of breath or difficulty breathing, chill, muscle pain, headache and sore throat, recent additions to CDC symptoms include “new taste and smell loss”, and World Health Organization has listed “loss of taste or smell” among “less common symptoms” of COVID-19. Smell loss, and to a lesser degree taste loss accompanying COVID-19 infection have appeared in reports of COVID-19 patients testimonies (Hopkins and Kumar, 2020), preprints of scientific papers (Bagheri et al., 2020; Menni et al., 2020; Pellegrino et al., 2020; Williams et al., 2020), peer-reviewed publications (i.e. (Bénézit et al., 2020; Eliezer et al., 2020; Moein et al., 2020; Spinato et al., 2020; Yan et al., 2020)), and are rather widely discussed by journalists.

The details of taste and smell change in relation to COVID-19 remain unclear, and scientists (including the authors of this contribution), clinicians and patients advocates have created the GCCR consortium which studies the relation between taste and smell loss and COVID-19.

Here we set out to explore the hypothesis, proposed by several groups (Brunori and Resce, 2020; Lampos et al., 2020; Walker et al., 2020) as well as discussed in the New York Times (Stephens-Davidowitz, 2020) and CNBC (Frank, 2020) that Google Trends searches on smell loss are indicative of COVID-19 cases.

We focused on two countries, Italy and US, and have looked not only for searches on smell loss, but also for searches of taste loss. Media reports on these phenomena were analyzed using Media Cloud, a database collecting media articles and reporting the attention over time on a query topic.

Furthermore, we used sight loss and hearing loss as controls, since these are senses not currently known to be associated with COVID-19. Because smell and taste loss are gradually becoming recognized as COVID-19 symptoms, we also looked at searches for COVID-19 symptoms.

Results

We analyzed Google searches and the numbers of new COVID-19 cases in Italy and the US, taking into account the states (US) and the regions (Italy) that compose them. For each region or state we calculated the following parameters: Google Trends popularity index per region/state for generic (COVID-19 symptoms) and specific (taste loss, smell loss) symptoms of COVID-19, as well as specific symptoms not known to affect patients (hearing loss, sight loss); the number of their mentions in digital media; the number of new COVID-19 cases normalized by population size per region or state inhabitants. The data were collected for 8 consecutive weeks, spanning March 4th to April 28th. Next, for each week and for each of the searches, the correlation with the normalized number of new cases was calculated for each country.

Results for weeks with a good correlation for taste loss and smell loss searches are shown in Figure 1. The volume of searches for these two keywords was high, among the other regions, in Lombardy, Emilia Romagna and Veneto, as well as New York, New Jersey and Louisiana, which are geographical sub-areas with high rates of new COVID-19 patients/inhabitants in their respective country.

• Download figure
• Open in new tab

Figure 1:

Data from which correlation was derived. Here shown for Italy (11-17 March) and the US (1-7 April), weeks with highest correlation for taste loss. Graphs show the taste loss (in orange) and smell loss (in green) search queries. Each point represents a different region/state. Normalized number of new cases related to the corresponding week on the x axis, popularity of the search terms on the y axis. For both graphs, not all the regions or states are shown because of the lack of popularity index for some regions/states.

Does this picture hold over time? In figure 2, we followed week by week, the correlation between the number of searches with the number of new cases, calculated for the 51 states in the US, and the 20 regions in Italy (as was exemplified for a particular week in Figure 1).

• Download figure
• Open in new tab

Figure 2:

Correlation between number, normalized by population size, of new COVID-19 cases in each region in Italy (top graph) and in each state in the US (bottom graph) and search queries popularity index, for each week. Confidence intervals are shown.

Overall, Figure 2 illustrates that both in Italy and in the US, there are some weeks with high correlation between searches for taste and smell loss, and the normalized number of new cases. This can be due to people affected by the taste loss and/or smell loss searching for their experienced specific symptoms. But this correlation changes over time: during the first analyzed week in Italy (4-10 March) and the first two in the US (4-10 and 11-17 March), taste loss and smell loss queries show a negative and low correlation with new COVID-19 cases. In the following weeks, the peaks with the highest correlation values are reached for Italy on 11-17 March week (0.91 for taste loss and 0.97 for smell loss) and for the US on the 2531 March and 1-7 April weeks (0.81 for both smell loss and taste loss).

Weeks following the peaks are characterized by a decrease in correlation for the two specific symptoms keywords, where the lowest values are reached during the last analyzed week (22-28 April) (see Supplementary Figure 1 for detailed representation of data for this week).

In Italy, in the 11-17 March and 15-21 April weeks, the average number of new cases per 1,000,000 inhabitants was almost identical, 354 and 357 respectively, while the correlation decreases from 0.91 for taste loss and 0.97 for smell loss to 0.04 and 0.31, respectively (Figure 2). Similarly, from 1-7 April week to the 22-28 April week, the average number of new cases in the US remains confined in the range of 644-663, but correlation decreases from 0.81 for taste loss and 0.73 for smell loss to -0.04 and 0.14 respectively.

Hearing loss and sight loss terms, that were used as controls, show lack of correlation in the US in all of the 8 weeks under analysis, as expected (Figure 2). The corresponding searches for the Italian translation of the queries (“perdita udito” and “perdita vista”) did not produce enough results to show data relative to different regions and, consequently, display no correlation. Only a low correlation in some of the 8 weeks studied here was observed for “COVID-19 symptoms” search. This can be attributed to a general interest in the disease and its symptoms, with some contribution of searches due to people suspecting they might be sick with the disease.

Since we hypothesized that media coverage of COVID-19 related taste and smell symptoms may impact the number of searches, we next analyzed, on a daily basis and for each country as a whole, the number of new cases, as well as Google searches and the volume of media coverage of taste and smell loss.

Using the Explorer tool on the Media Cloud platform, we monitored the number of times taste and smell keywords were mentioned daily by digital news media (hence, not including radio, television or printed matter).

The news about these two specific symptoms, in both Italy and the US, was reported for the first time during the 11-17 March week according to our search on Media Cloud (media coverage at the end of the 4-10 March week in both Italy and the US, actually reported the taste loss or smell loss in a different context, not related to COVID-19 symptoms) (Figure 3). The maximum media coverage in Italy is reached between the 22nd and 23rd of March, with a second higher peak for smell loss on April 12th. There is a small media peak during the 11-17 March week, which coincides with a high number of new cases. The correlation peak for Italy, reported in Figures 1 and 2, is reached during this week. An increase in popularity of searches was observed before the first media reports of March 14th (Figure 3 and Supplementary Figure 2). Indeed, the total number of cases on March 13th in Italy was 8.2 times higher than in the US (17660 for Italy vs 2147 for the US) and, consequently, the volume of searches observed until this day is also higher (Supplementary Figure 3).

• Download figure
• Open in new tab

Figure 3:

Comparison between Google searches volume for taste loss and smell loss queries, Media Cloud popularity of the same keywords and number of new COVID-19 cases calculated from March 4th to April 28th for Italy and the US. The Media Cloud data were normalized as for the Google search results, assigning the value of 100 to the day with the highest popularity, with the other days assigned values relative to that day. The number of new cases is relative to a population of 1,000,000 in each country.

In the US we observed a different situation. The Media Cloud data and the Google Trends searches are perfectly superimposed in proximity of the maximum peak. The rise of cases in the US is later than in Italy, and there is no time window in which the number of cases is surging while the taste and smell symptoms are still unknown. Therefore, in the US, it is difficult to know which part of taste and smell loss searches are driven by patients worried about their own symptoms, and which part is due to interest elicited by the media.

The correlation between the number of new cases and the volume of searches is better correlated in Italy than in the US, while the volume of searches in the US is more affected by the media trend than in Italy (Table 1). Smell and taste loss trends are more closely related to each other than to the respective media coverage of each effect, suggesting that the two symptoms are experienced together. This is of interest, as it may indirectly suggest a potential common or joint mechanism that allows SARS-CoV-2 to affect both senses together.

Overall, the decrease in correlation between taste and smell loss searches and the number of new cases overtime is apparent both in Italy and the US (Figure 2). We believe that, with media coverage and inclusion of taste and smell loss as official symptoms of COVID-19, there are less searches for these symptoms alone, but rather a convergence with COVID-19 symptoms searches due to the broad knowledge of the symptoms.

Discussion

In this study, we show the presence of a correlation in Italy and the US between Google searches for specific and new symptoms of COVID-19 (taste loss and smell loss) and the number of people affected by the SARS-CoV-2 virus. On average, regions with a high percentage of patients among the total number of inhabitants tend to search for specific symptoms more often than in regions with low rates when the number of new cases reach for the first time a relatively high volume (21357 for Italy on 11-17 March and 47553 for the US 18-24 March). Nevertheless, relying solely on Google trends for taste loss and smell loss searches is not a reliable strategy, even though suggested by Goldman and Sachs (Frank, 2020) to monitor the spread of the SARS-CoV-2. Indeed, this correlation varies among the weeks analyzed here, even when the number of new cases in a country is high, and decreases in the recent weeks, potentially because the specific symptoms are becoming well established by now.

Media had a strong impact on the volume of searches for taste loss and smell loss in the US, and today taste and smell loss in COVID-19 patients is rather widely known. On the other hand, in Italy the media effect on searches was slightly milder due to the advanced state of the pandemic when the news started to appear on digital media. The Italian data likely suggests genuine interest based on self-symptoms even before they became broadly established.

Interestingly, we also found a strong correlation between searches for taste loss and searches for smell loss. This is in line with recent findings that the degree of Covid-19-related anosmia (loss of smell) and ageusia (loss of taste) correlate closely in affected individuals (Yan et al., 2020). Hence, both senses seem to be affected simultaneously in COVID-19 patients, a finding that may provide clues for mechanisms of action of the virus.

Strategies for geographic monitoring of COVID-19 hotspots are being developed (Giordano et al., 2020), self-reporting apps becoming increasingly common (Mayor, 2020; Rossman et al., 2020), and epidemiological tools, such as sewage monitoring (Medema et al., 2020) are being introduced. We believe that social media monitoring of taste and smell loss searches is unlikely to remain a useful marker for COVID-19 cases, as these symptoms become widely known, and will likely give way to other tools. More generally, as additional new symptoms may be discovered and future pandemics may be expected, usage of digital media searches on pandemic symptoms for disease should take into account the potential “surprise rise and knowledge saturation” curve.

Methods