Internet search patterns reveal clinical course of COVID-19 disease progression and pandemic spread across 32 countries

Tina Lu, Ben Y. Reis
doi: https://doi.org/10.1101/2020.05.01.20087858

Abstract

Effective public health response to novel pandemics relies on accurate and timely surveillance of pandemic spread, as well as characterization of the clinical course of the disease in affected individuals. We sought to determine whether Internet search patterns can be useful for tracking COVID-19 spread, and whether these data could also be useful in understanding the clinical progression of the disease in 32 countries across six continents. Temporal correlation analyses were conducted to characterize the relationships between a range of COVID-19 symptom-specific search terms and reported COVID-19 cases and deaths for each country during the period of January 1 through April 20, 2020. Increases in COVID-19 symptom-related searches preceded increases in reported COVID-19 cases and deaths by an average of 18.53 days (95% confidence interval 15.98 to 21.08) and 22.16 days (20.33 to 23.99), respectively. Cross-country ensemble averaging was used to derive average temporal profiles for each search term, which were combined to create a search-data-based view of the clinical course of disease progression. Internet search patterns revealed a clear temporal pattern of disease progression for COVID-19: Initial symptoms of fever, dry cough, sore throat and chills were followed by shortness of breath an average of 5.22 days (95% confidence interval 3.30 to 7.14) after initial symptom onset, matching the clinical course reported in the medical literature. This is the first study to show that Internet search data can be useful for characterizing the detailed clinical course of a disease. These data are available in real-time and at population scale, providing important benefits as a complementary resource for tracking the spread of pandemics, especially during the early stages before widespread laboratory testing is available.

Accurate real-time surveillance of local disease spread is essential for effective pandemic response, informing key public health measures such as social distancing and closures, as well as the allocation of scarce healthcare resources such as ventilators and hospital beds.1,2 During the current COVID-19 pandemic, surveillance has relied primarily on direct testing of individuals using a variety of de novo laboratory testing methods developed specifically for the emergent pandemic.3

While laboratory testing serves as an important primary gauge of epidemic spread, it is subject to a number of important limitations: 1. During the early stages of a novel pandemic, laboratory tests specific to the novel pathogen do not yet exist and therefore must be developed de novo, leading to significant delays before test-based surveillance can begin. 2. Once a test has been developed, scaling the manufacturing, distribution and test processing capacity takes a significant amount of time, resulting in limited testing capacity in many countries.4 It is therefore difficult to achieve population-scale surveillance with laboratory testing in the crucial early stages of an emergent pandemic. 3. Even after tests are widely available, operational delays in test administration and processing make laboratory testing a lagging indicator relative to disease onset.5 4. Laboratory testing often requires individuals to leave home and congregate at testing centers, increasing exposure both for those being tested and for the health workers administering the tests. 5. Laboratory tests are typically invasive, involving blood draws or deep nasal swabs, which are uncomfortable for patients and increase the risk of infection to healthcare workers.6 6. Laboratory testing can be expensive, especially when testing large numbers of people.5 7. Certain types of laboratory tests may need to be repeated due to issues of reliability.7, 8

These limitations present an opportunity for exploring additional surveillance approaches9 that could be used as complementary information sources alongside laboratory testing, especially during the critical early stages of a pandemic. Aggregated de-identified Internet search patterns have been used to track a wide range of health phenomena, including influenza10, MERS11, measles12, abortion13 and immunization compliance,14 and are a potential complementary source of information for surveilling pandemic spread. Previous uses of these data have yielded valuable lessons in their appropriate use, including avoiding non-specific search terms, keeping models straightforward and transparent, and avoiding complex models that increase the risks of overfitting. When harnessed appropriately, Internet search patterns possess a number of strengths relative to laboratory testing: 1. Search data are collected continuously, and are ready to be used as soon as a new pandemic emerges. 2. Data are available at population-scale in areas with sufficient Internet access and usage levels.15 3. Internet search data are available in near-real time, typically the same day. 4. There is no need for individuals to travel to testing locations; people can stay at home, avoiding increased exposure to themselves and to healthcare workers. 5. No physical intervention is required. 6. Internet search data are available for free.

Characterizing Disease Progression

In addition to pandemic tracking, during the early stages of an emergent pandemic it is also important to characterize the clinical course of symptoms in affected individuals. At the individual patient level, knowing the expected clinical course of a disease allows doctors to understand where an individual patient is in their expected disease course, and what can be expected for that patient in the future. For example, in the case of COVID-19, it is important to know when dyspnea (shortness of breath) is expected to occur for patients, so that appropriate planning of clinical care and resources can take place.

A number of clinical case studies have analyzed the day-by-day clinical course for COVID-19 patients: A study of 138 patients in Wuhan, China found that common initial symptoms include fever and dry cough, followed by dyspnea a median of 5.0 days later.16 A meta-review found that the average length from illness onset to dyspnea was 4.99 days, based on evidence from 179 COVID-19 patients.17 A study in the US found that dyspnea typically set in between the fourth and eighth day following initial symptoms.18 A study of 41 patients in Wuhan, China found that the median duration from illness onset to dyspnoea was 8.0 days.19 The CDC’s Interim Clinical Guidance for Management of Patients with Confirmed Coronavirus Disease (COVID-19) states “Among patients who developed severe disease, the medium time to dyspnea ranged from 5 to 8 days”.20 These studies relied on a limited number of patients in hospital settings, and were published weeks and months after the initial spread of the pandemic.

Unlike the above hospital-based studies, Internet search data have the potential to provide information on disease progression across a much larger population of patients, not only those seen in hospital settings. Understanding the expected sequence of symptoms at a population level could also help public health officials track the different stages of the onset of the pandemic as it takes hold in a new location. It would therefore be beneficial for pandemic tracking and clinical planning if disease progression of novel pandemics could be studied in a timely manner and at population scales.

In this study, we conducted a systematic study across 32 countries on six continents to determine whether Internet search patterns can be used as a complementary data source for tracking COVID-19 spread, and whether these data could also be useful in understanding the clinical progression of the disease.

Methods

Data Acquisition

We selected a diverse set of 32 countries from six continents (Table 1), in which sufficient search data volumes were available for the search terms of interest. We obtained data on reported COVID-19 cases and deaths for each of these countries from a publicly available dataset maintained by the Center for Systems Science and Engineering at Johns Hopkins University. 21

View this table:
Table 1.

Countries included in the study, categorized by continent.

We collected daily relative search volume (RSV) data on a per-country basis for the period of January 1, 2020 through April 20, 2020, from Google Trends22 using the pytrends API23. Since Google has limited availability in China, we also accessed search trend data from the search engine Weibo.24 We accessed data for the following common symptoms of COVID-19: “fever”, “cough”, “dry cough”, “chills”, “sore throat”, “runny nose” and “shortness of breath”, as well as the more general terms “coronavirus”, “coronavirus symptoms” and “coronavirus test”. Each search term was searched as an “exact phrase”. We also considered other less common symptoms such as loss of smell and loss of taste, but the search volumes on those terms were too sparse for many countries. As daily search data are inherently noisy, all search data were smoothed with a 7-day moving average.25

For translations of the English search terms into local languages, we recruited native speakers to translate each term into the following languages: Arabic, Mandarin Chinese, Dutch, French, German, Italian, Persian, Polish, Portuguese and Spanish. These languages covered almost all of the countries included in the study. For languages in which we were unable to recruit native speakers for translations, we used Google Translate26 and confirmed that sufficient data were available for these translated search terms on Google Trends.22 A complete table of search terms and translations for each country is provided in Supplementary Table S-1.

Data Analysis: Pandemic spread

We conducted temporal correlation studies to study the relationships between Internet search data and reported COVID-19 cases and deaths. For each country and search term, we calculated the Pearson correlation coefficient between the time series of search volumes for that search term and the time series of COVID-19 cases. We then shifted the search term data by a variable lag, and identified the lag that yielded the highest correlation. We computed the mean of these optimal lags for each search term across all countries. We then repeated these analyses substituting reported COVID-19 deaths for reported COVID-19 cases.

Data Analysis: Clinical Course of Illness

We investigated whether Internet search data could be used to characterize the clinical course of COVID-19 symptoms over time. “Coronavirus symptoms” was selected as the index search term since it peaked first relative to the other search terms in 22 out of 32 countries. For each country, the date of peak search volume for the index search term was defined as the index date, and the dates for all other search data for that country were defined in relation to that date (Day 0, Day 1, Day 2, etc.). With the data from all countries aligned by the index date, cross-country ensemble average curves were calculated for each search term. (e.g. Day 1 values for “fever” searches in each of the 32 countries were averaged together to calculate the Day 1 value of the ensemble average “fever” curve. The same for Day 2, etc.) The ensemble average curves for all search terms were then overlaid on one plot, providing a search-data-based view of the clinical course of illness.

Since studies in the medical literature report the number of days between initial symptom onset and shortness of breath (dyspnea) 16,17,18,19,20, we examined a range of possible search-term-based definitions for initial symptom onset, based on various combinations of the earliest-peaking search terms “fever”, “cough”, “coronavirus symptoms” and “coronavirus test” (Table 3).

Results

Internet search volume and COVID-19 cases and deaths

We begin by examining a few example countries in which the pandemic peaked at different times. Figure 1 shows search volumes for the terms “fever” and “dry cough”, alongside reported COVID-19 cases and deaths for China, Iran, Italy, United States and India. Even though outbreaks occurred at different times in each country, the temporal relationships between the search terms and reported COVID-19 cases and deaths remained similar across countries.

Figure 1.
Figure 1.

Search volumes (purple) for the terms “fever” (left) and “dry cough” (right), alongside reported COVID-19 cases (cyan) and deaths (orange) for China, Iran, Italy, US and India. Even though outbreaks occur at different times in different countries, the relationships between the search terms and reported COVID-19 cases and deaths remain similar across countries. To highlight the temporal relationships between the curves, the magnitude of each curve was independently normalized to fit the vertical dimensions of the plot.

Expanding this analysis to all 32 countries, Figure 2a shows the lags between search volumes for the term “fever” and COVID-19-related deaths for each of the 32 countries, along with a histogram showing the distribution of these lags. Figure 2b shows the lags between search volumes for the term “dry cough” and COVID-19-related deaths, along with the distribution of the lags.

Figure 2.
Figure 2.
Figure 2.

(a) Lags between searches for “fever” and reported COVID-19 deaths across 32 countries, with a histogram showing the distribution of these lags. Each country is labeled with its ISO Alpha-2 country code. (b) The same plots shown for searches for “dry cough”.

Table 2 shows summary statistics over all 32 countries for the lags between each of the ten search terms and COVID-19 cases and deaths, including mean and 95% confidence intervals. Searches for “fever” preceded increases in reported COVID-19 cases and deaths by an average of 18.53 days [95% CI 15.98-21.08] and 22.16 days [95% CI 20.33-23.99], respectively. For “cough” these times were 18.34 days [95% CI 16.05-20.64] and 21.88 days [95% CI 20.19-23.56], respectively. The complete list of lags between each search term and COVID-19 deaths for each individual country is provided in Supplementary Table S-2.

View this table:
Table 2.

Mean lags between search volumes for specific search terms and reported COVID-19 cases and deaths across 32 countries. Mean lags are reported in days, along with 95% confidence intervals. Search terms are sorted chronologically, with those that peaked earliest appearing at the top of the table.

The average lags between searches and reported cases were shorter than those between searches and reported deaths, as cases are typically diagnosed and reported before deaths. We found that the inter-country variability of the average lags between searches and reported cases was greater (larger confidence intervals) than that for reported deaths, likely because case reporting is more dependent on local testing capacity and rates. We also found that the general term “coronavirus” has the greatest variability in its lags to reported cases and deaths (largest confidence intervals), compared to other symptom-specific terms, as would be expected for a more general search term.

Internet Search Volume and COVID-19 Clinical Course of Illness

We begin by examining examples from individual countries, this time looking at the progression of symptom-related search terms over time. Figure 3 shows search volumes for a range of symptom-related search terms plotted over time for France (Figure 3a) and Mexico (Figure 3b). For each country, searches for “shortness of breath” appear a few days after searches for other symptoms such as “fever”, “cough” and “dry cough”.

Figure 3.
Figure 3.
Figure 3.

Clinical Course of COVID-19 symptoms in (a) France and (b) Mexico. Search volumes for the terms “coronavirus symptoms”, “fever”, “cough”, “dry cough” and “shortness of breath” (black) are shown alongside COVID-19 cases (dashed cyan line) and deaths (dashed orange line). Initial symptoms appear clustered together in time, with searches for shortness of breath appearing a few days later. To highlight the temporal relationships between curves, the magnitude of each curve was independently normalized to fit the vertical dimensions of the plot.

Expanding this analysis to all 32 countries, we calculated ensemble average curves for each search term across all 32 countries. Figure 4a shows the ensemble average search volumes for “fever”, “cough”, “dry cough” and “shortness of breath”, indexed by searches for “coronavirus symptoms”, alongside reported COVID-19 cases and deaths. Figure 4b shows this same analysis for additional search terms “sore throat”, “runny nose”, “chills”, and “coronavirus test”, also indexed by searches for “coronavirus symptoms”.

Figure 4.
Figure 4.
Figure 4.

Ensemble average clinical course of COVID-19 symptoms across 32 countries, as seen through Internet search volumes of search terms related to COVID-19 symptoms. (a) Search volumes for the terms “fever”, “cough”, “dry cough”, “shortness of breath” (black), indexed by searches for “coronavirus symptoms”, shown alongside COVID-19 cases (dashed line cyan) and deaths (dashed line orange). (b) Search volumes for the terms “sore throat”, “runny nose”, “chills”, and “coronavirus test”, algonside “shortness of breath” (black), indexed by searches for “coronavirus symptoms”, shown alongside COVID-19 cases (dashed line cyan) and deaths (dashed line orange).

The clinical progression that emerges from these data presents the following picture: As the pandemic begins to take hold in a country, people search for “coronavirus symptoms” and “coronavirus test”, followed by initial symptoms “fever”, “cough”, “runny nose”, “sore throat” and “chills”, followed by searches for “shortness of breath” approximately 5 days after the search for initial symptoms.

Table 3 shows the lags between different definitions for initial symptom onset and searches for “shortness of breath”. The average lag between the searches for “fever” and “shortness of breath” was 5.22 days [95% CI 3.30-7.14]. For “cough” it was 5.16 days [95% CI 3.13-7.18]. These lags, as well as the lags deriving from other symptom onset definitions, are all around 5 days, matching the clinical course of the disease reported in the literature.16,17,18,19,20

View this table:
Table 3.

Different search-term-based definitions for symptom onset were examined by looking at different combinations of early-peaking search terms. The table shows average lag in days from various search-based definitions of symptom onset to searches for “Shortness of Breath” across 32 countries.

The clinical progressions above are based on a 32-country ensemble average. While there is greater variability at the individual country level, the general temporal order of COVID-19 symptom progression remains fairly consistent across individual countries, with few exceptions. For example, only two of the 32 countries had searches for “coronavirus symptoms” peak after searches for “shortness of breath”, only 3 out of 32 countries had searches for “cough” peak after searches for “shortness of breath”, and only 4 out of 32 countries had searches for “fever” peak after searches for “shortness of breath” (Supplementary Table 2).

Discussion

In this study, a systematic analysis of Internet search data from 32 countries across six continents found that increases in symptom-related Internet searches precede increases in reported COVID-19 cases and deaths by approximately 2-3 weeks. The present study also found that by analyzing data from all 32 countries, the overall temporal relationships between the different symptom-related search terms reflect the clinical progression of the symptoms of COVID-19.

To the best of the authors’ knowledge, the present study is the first to conduct a detailed investigation of multiple COVID-19 symptom-related search terms across such a large number of countries and languages. It is also the first to conduct a detailed analysis of the temporal relationships between different symptom-related searches in order to determine whether these data could be useful in understanding the clinical course of illness for a disease. During emergent pandemics, this detailed level of information can support health officials in tracking pandemic spread and planning clinical care and resources.

A number of recent studies have analyzed Internet search data related to the COVID-19 pandemic. Most of these studies examined data from a single country or from a small number of countries: Some studies examined only the search term “coronavirus” 27, 28, 29,30. In the present study we found that general non-symptom-specific search terms such as “coronavirus” have a greater variability in their relation to reported cases and deaths, likely due to the fact that individuals seeking general information on the pandemic may search for “coronavirus” even if they are not experiencing specific symptoms themselves at that time. Other studies looked at additional search terms such as “handwashing”, “face masks”,31,32 “quarantine”, “hand disinfection”,33 “SARS”, “MERS”, 34 “antiseptic”, and “sanitizer”35, but did not include specific symptom-related search terms.

Another group of studies did examine symptom-related search terms, including: “COVID pneumonia” and “COVID heart” in the US 36; “COVID” and “pneumonia” in China 37; “worry”, “hysteria” and other mental health symptoms in the US 38; “diarrhea”, “nausea”, “vomiting”, “abdominal pain”, “fever” and “cough” in the US39; “can’t smell” “ear pain”, “sinus pain”, “voice pain”, “ears ringing”. Among other terms in the US 40; “ageusia”, “abdominal pain”, “loss of appetite”, “anorexia”, “diarrhea”, and “vomiting” in the US41; “chest pain,” “myocardial infarction,” “cough,” and “fever” in four countries42; “Loss of sense of smell”,”Sense of smell”, “Loss of sense of taste”, and “Sense of taste” across multiple regions in five countries25; and “smell”, “loss of smell”, “anosmia”, “hyposmia”, “olfaction”, “taste”, “loss of taste”, and “dysgeusia” in eight countries 43. While these studies investigated a range of important questions, including the effects of COVID-19 on mental health38, gastrointestinal health 39,41, otolaryngological health40, and coronary-related conditions42, they did not study whether the temporal relationships between these search terms could be useful in understanding the clinical progression of the disease.

Some previous studies have tried to study temporal information from online data sources. For example, Liu et al. analyzed Twitter data to resolve different stages of behaviour relating to alcohol consumption (alcohol seeking, alcohol consuming, post-consumption reflection)44. Wu et al. studied seasonality in global public interest in psoriasis by analyzing seasonality in Internet search trends45. To the best of the authors’ knowledge, no previous studies have attempted to reconstruct the clinical progression of a disease based on Internet search data.

The use of Internet search data is subject to a number of important limitations.46,10,47 Internet infrastructure and digital access levels differ across countries and communities. Even though digital access rates are generally increasing worldwide, many developing countries currently lack sufficient search volumes to support search-based tracking. Search data may be subject to demographic, socio-economic, geographic, or other biases inherent in the local digital divide.15,48,49 In each country, the population of individuals who perform Internet searches may have different characteristics than those who do not, and the results inferred from Internet searching behaviors may not generalize to other populations.

Changes in search volumes for symptom-related terms such as “fever” could result not only from increases in COVID-19 cases, but also from general curiosity about the pandemic, the occurrence of other diseases (e.g. influenza, Lassa fever50), news coverage, or other factors. In this study, we used specific symptom-related search terms and examined data from a geographically diverse set of 32 counties across six continents and multiple languages. In recognition of the inherent variability of the data at the individual country level, we performed a global analysis combining data from all 32 countries. Despite the inherent variability of country-specific search data, our results show that the temporal relationships between the symptom-specific Internet search terms and COVID-19-related cases and deaths remained generally consistent between countries.

Future work includes applying these approaches to other diseases, and combining Internet search data with additional data sources such as local testing rates, public health measures, news reports, climatological and air quality variables, among others.

The ability of search data to not only help track pandemic spread, but also to reveal the clinical course of symptoms in emergent pandemics is significant. Given the limitations of laboratory testing, search data can be a valuable complementary source for population-scale tracking of pandemics in real time, particularly during the early stages of a pandemic when local testing is not yet available at scale, and can help to guide public health response.

Data Availability

All data used in this study are publicly available through the sources referenced in the Methods section.

Data Availability

All data used in this study are publicly available through the sources referenced in the Methods section.

Author Contributions

B.Y.R. and T.L conceived of the study, supervised its conduct, and oversaw data collection. B.Y.R. and T.L. designed the study, conducted statistical analysis, drafted the manuscript and formulated the implications of the results. All authors contributed substantially to the revision of the manuscript and approved the final manuscript as submitted.

Competing Interest Statement

The authors declare no competing interests.

Supplementary Materials

View this table:
Table S-1.

Translations used for each search term in each country.

View this table:
Table S-2.

Comprehensive list of lags between each of the search terms and COVID-19 deaths, for each of the 32 countries.

Footnotes

  • Supplementary tables added with further details of analysis.

References

  1. 1.↵
    Fineberg, H. V. Pandemic preparedness and response--lessons from the H1N1 influenza of 2009. N. Engl. J. Med. 370, 1335–1342 (2014).
    OpenUrlCrossRefPubMedWeb of Science
  2. 2.↵
    Balter, S. et al. Pandemic (H1N1) 2009 surveillance for severe illness and response, New York, New York, USA, April-July 2009. Emerg. Infect. Dis. 16, 1259–1264 (2010).
    OpenUrlPubMed
  3. 3.↵
    Peto, J. Covid-19 mass testing facilities could end the epidemic rapidly. BMJ 368, (2020).
  4. 4.↵
    Godlee, F. The burning building. BMJ 368, (2020).
  5. 5.↵
    Sheridan, C. Fast, portable tests come online to curb coronavirus pandemic. Nat. Biotechnol. (2020) doi:10.1038/d41587-020-00010-2.
    OpenUrlCrossRefPubMed
  6. 6.↵
    Xu, M. et al. COVID-19 diagnostic testing: Technology perspective. Clin. Transl. Med. 10, e158 (2020).
    OpenUrl
  7. 7.↵
    Li, Z. et al. Development and clinical application of a rapid IgM-IgG combined antibody test for SARS-CoV-2 infection diagnosis. J. Med. Virol. (2020) doi:10.1002/jmv.25727.
    OpenUrlCrossRefPubMed
  8. 8.↵
    Beeching, N. J., Fletcher, T. E. & Beadsworth, M. B. J. Covid-19: testing times. BMJ 369, (2020).
  9. 9.↵
    Fagherazzi, G., Goetzinger, C., Rashid, M. A., Aguayo, G. A. & Huiart, L. Digital Health Strategies to Fight COVID-19 Worldwide: Challenges, Recommendations, and a Call for Papers. J. Med. Internet Res. 22, e19284 (2020).
    OpenUrlCrossRefPubMed
  10. 10.↵
    Kandula, S. & Shaman, J. Reappraising the utility of Google Flu Trends. PLoS Comput. Biol. 15, e1007258 (2019).
    OpenUrl
  11. 11.↵
    Shin, S.-Y. et al. High correlation of Middle East respiratory syndrome spread with Google search and Twitter trends in Korea. Sci. Rep. 6, 32920 (2016).
    OpenUrl
  12. 12.↵
    Santangelo, O. E. et al. Digital epidemiology: assessment of measles infection through Google Trends mechanism in Italy. Ann. Ig. 31, 385–391 (2019).
    OpenUrl
  13. 13.↵
    Reis, B. Y. & Brownstein, J. S. Measuring the impact of health policies using Internet search patterns: the case of abortion. BMC Public Health 10, 514 (2010).
    OpenUrlCrossRefPubMed
  14. 14.↵
    Barak-Corren, Y. & Reis, B. Y. Internet activity as a proxy for vaccination compliance. Vaccine vol. 33 2395–2398 (2015).
    OpenUrl
  15. 15.↵
    Alicino, C. et al. Assessing Ebola-related web search behaviour: insights and implications from an analytical study of Google Trends-based query volumes. Infect Dis Poverty 4, 54 (2015).
    OpenUrl
  16. 16.↵
    Wang, D. et al. Clinical Characteristics of 138 Hospitalized Patients With 2019 Novel Coronavirus–Infected Pneumonia in Wuhan, China. JAMA vol. 323 1061 (2020).
    OpenUrlCrossRefPubMed
  17. 17.↵
    Tan, S. C. Clinical and epidemiological characteristics of Coronavirus Disease 2019 (COVID-19) patients. doi:10.1101/2020.04.02.20050989.
    OpenUrlAbstract/FREE Full Text
  18. 18.↵
    Cohen, P. A., Hall, L. E., John, J. N. & Rapoport, A. B. The Early Natural History of SARS-CoV-2 Infection: Clinical Observations From an Urban, Ambulatory COVID-19 Clinic. Mayo Clin. Proc. 95, 1124–1126 (2020).
    OpenUrl
  19. 19.↵
    Huang, C. et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet 395, 497–506 (2020).
    OpenUrlCrossRefPubMed
  20. 20.↵
    Interim Clinical Guidance for Management of Patients with Confirmed Coronavirus Disease (COVID-19). https://www.cdc.gov/coronavirus/2019-ncov/hcp/clinical-guidance-management-patients.html.
  21. 21.↵
    CSSEGISandData. CSSEGISandData/COVID-19. GitHub https://github.com/CSSEGISandData/COVID-19.
  22. 22.↵
  23. 23.↵
    GeneralMills. GeneralMills/pytrends. GitHub https://github.com/GeneralMills/pytrends.
  24. 24.↵
    Weibo Search rends. https://data.weibo.com/index.
  25. 25.↵
    Cherry, G. et al. Loss of smell and taste: a new marker of COVID-19? Tracking reduced sense of smell during the coronavirus pandemic using search trends. Expert Rev. Anti. Infect. Ther. 1–6 (2020).
  26. 26.↵
  27. 27.↵
    Strzelecki, A. The second worldwide wave of interest in coronavirus since the COVID-19 outbreaks in South Korea, Italy and Iran: A Google Trends study. Brain Behav. Immun. (2020) doi:10.1016/j.bbi.2020.04.042.
    OpenUrlCrossRef
  28. 28.↵
    Mavragani, A. Tracking COVID-19 in Europe: Infodemiology Approach. JMIR Public Health Surveill 6, e18941 (2020).
    OpenUrl
  29. 29.↵
    Effenberger, M. et al. Association of the COVID-19 pandemic with Internet Search Volumes: A Google TrendsTM Analysis. International Journal of Infectious Diseases (2020) doi:10.1016/j.ijid.2020.04.033.
    OpenUrlCrossRefPubMed
  30. 30.↵
    Benjamin Lucas Brendan Elliot. Online Information Search During COVID-19. arXiv:arxiv:2004.07i83V2 https://arxiv.org/pdf/2004.07183.pdf (2020).
  31. 31.↵
    Husnayain, A., Fuad, A. & Su, E. C.-Y. Applications of google search trends for risk communication in infectious disease management: A case study of COVID-19 outbreak in Taiwan. Int. J. Infect. Dis. (2020) doi:10.1016/j.ijid.2020.03.021.
    OpenUrlCrossRefPubMed
  32. 32.↵
    Lin, Y.-H., Liu, C.-H. & Chiu, Y.-C. Google searches for the keywords of ‘wash hands’ predict the speed of national spread of COVID-19 outbreak among 21 countries. Brain, Behavior, and Immunity (2020) doi:10.1016/j.bbi.2020.04.020.
    OpenUrlCrossRef
  33. 33.↵
    Jarynowski, A., Wojta-Kempa, M. & Belik, V. Perception of emergent epidemic of COVID-2019 / SARS CoV-2 on the Polish Internet. doi:10.1101/2020.03.29.20046789.
    OpenUrlAbstract/FREE Full Text
  34. 34.↵
    Strzelecki, A. & Rizun, M. Infodemiological Study Using Google Trends on Coronavirus Epidemic in Wuhan, China. International Journal of Online and Biomedical Engineering (iJOE) vol. 16 139 (2020).
    OpenUrl
  35. 35.↵
    Ayyoubzadeh, S. M., Ayyoubzadeh, S. M., Zahedi, H., Ahmadi, M. & R Niakan Kalhori, S. Predicting COVID-19 Incidence Through Analysis of Google Trends Data in Iran: Data Mining and Deep Learning Pilot Study. JMIR Public Health Surveill 6, e18828 (2020).
    OpenUrl
  36. 36.↵
    Yuan, X. et al. Trends and prediction in daily incidence and deaths of COVID-19 in the United States: a search-interest based model. doi:10.1101/2020.04.15.20064485.
    OpenUrlAbstract/FREE Full Text
  37. 37.↵
    Li, C. et al. Retrospective analysis of the possibility of predicting the COVID-19 outbreak from Internet searches and social media data, China, 2020. Euro Surveill. 25, (2020).
  38. 38.↵
    Hoerger, M. et al. Impact of the COVID-19 pandemic on mental health: Real-time surveillance using Google Trends. Psychol. Trauma 12, 567–568 (2020).
    OpenUrl
  39. 39.↵
    Rajan, A. et al. Association of Search Query Interest in Gastrointestinal Symptoms With COVID-19 Diagnosis in the United States: Infodemiology Study. JMIR Public Health Surveill 6, e19354 (2020).
    OpenUrl
  40. 40.↵
    Pier, M. M., Pasick, L. J., Benito, D. A., Alnouri, G. & Sataloff, R. T. Otolaryngology-related Google Search trends during the COVID-19 pandemic. Am. J. Otolaryngol. 41, 102615 (2020).
    OpenUrl
  41. 41.↵
    Ahmad, I., Flanagan, R. & Staller, K. Increased Internet Search Interest for GI Symptoms May Predict COVID-19 Cases in U.S. Hotspots. Clin. Gastroenterol. Hepatol. (2020) doi:10.1016/j.cgh.2020.06.058.
    OpenUrlCrossRef
  42. 42.↵
    Senecal, C., Gulati, R. & Lerman, A. Google Trends Insights Into Reduced Acute Coronary Syndrome Admissions During the COVID-19 Pandemic: Infodemiology Study. JMIR Cardio 4, e20426 (2020).
    OpenUrl
  43. 43.↵
    Walker, A., Hopkins, C. & Surda, P. The use of google trends to investigate the loss of smell related searches during COVID-19 outbreak. Int. Forum Allergy Rhinol. (2020) doi:10.1002/alr.22580.
    OpenUrlCrossRef
  44. 44.↵
    Liu, J., Weitzman, E. R. & Chunara, R. Assessing behavior stage progression from social media data. of the 2017 ACM Conference on … (2017).
  45. 45.↵
    Wu, Q. et al. Seasonality and global public interest in psoriasis: an infodemiology study. Postgrad. Med. J. 96, 139–143 (2020).
    OpenUrlAbstract/FREE Full Text
  46. 46.↵
    Arora, V. S., McKee, M. & Stuckler, D. Google Trends: Opportunities and limitations in health and health policy research. Health Policy 123, 338–341 (2019).
    OpenUrl
  47. 47.↵
    Lazer, D., Kennedy, R., King, G. & Vespignani, A. Big data. The parable of Google Flu: traps in big data analysis. Science 343, 1203–1205 (2014).
    OpenUrlAbstract/FREE Full Text
  48. 48.↵
    Din, H. N., McDaniels-Davidson, C., Nodora, J. & Madanat, H. Profiles of a Health Information-Seeking Population and the Current Digital Divide: Cross-Sectional Analysis of the 2015–2016 California Health Interview Survey. J. Med. Internet Res. 21, e11931 (2019).
    OpenUrl
  49. 49.↵
    McCloud, R. F., Okechukwu, C. A., Sorensen, G. & Viswanath, K. Beyond access: barriers to internet health information seeking among the urban poor. J. Am. Med. Inform. Assoc. 23, 1053–1059 (2016).
    OpenUrlCrossRefPubMed
  50. 50.↵
    Wogu, J. O. et al. Mass media reportage of Lassa fever in Nigeria: a viewpoint. J. Int. Med. Res. 48, 300060518821552 (2020).
    OpenUrl
Back to top
Posted September 16, 2020.
Download PDF
Data/Code
Email
Internet search patterns reveal clinical course of COVID-19 disease progression and pandemic spread across 32 countries
Tina Lu, Ben Y. Reis
medRxiv 2020.05.01.20087858; doi: https://doi.org/10.1101/2020.05.01.20087858
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools

Subject Area