This paper is in the following e-collection/theme issue:

Health and Risk Communication (45) Infoveillance, Infodemiology, Digital Disease Surveillance, Infodemic Management (1041) JMIR Theme Issue: COVID-19 Special Issue (2450) Theme Issue: Novel Coronavirus (COVID-19) Outbreak Rapid Reports (1517) Outbreak and Pandemic Preparedness and Management (1724) Infectious Diseases (non-STD/STI) (1570) Infodemiology and Infoveillance (1349) Hygiene and Infection Prevention (314)

Published on in Vol 2, No 1 (2022): Jan-Jun

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/31732, first published .
Sustained Reductions in Online Search Interest for Communicable Eye and Other Conditions During the COVID-19 Pandemic: Infodemiology Study

Sustained Reductions in Online Search Interest for Communicable Eye and Other Conditions During the COVID-19 Pandemic: Infodemiology Study

Sustained Reductions in Online Search Interest for Communicable Eye and Other Conditions During the COVID-19 Pandemic: Infodemiology Study

Authors of this article:

Michael S Deiner1, 2 Author Orcid Image ;   Gerami D Seitzman1, 2 Author Orcid Image ;   Gurbani Kaur3 Author Orcid Image ;   Stephen D McLeod1, 2 Author Orcid Image ;   James Chodosh4 Author Orcid Image ;   Thomas M Lietman1, 2, 5 Author Orcid Image ;   Travis C Porco1, 2, 5 Author Orcid Image
Article Authors Cited by (1) Tweetations (4) Metrics

    Original Paper

    1Francis I Proctor Foundation, University of California San Francisco, San Francisco, CA, United States

    2Department of Ophthalmology, University of California San Francisco, San Francisco, CA, United States

    3School of Medicine, University of California San Francisco, San Francisco, CA, United States

    4Department of Ophthalmology, Massachusetts Eye and Ear, Harvard Medical School, Boston, MA, United States

    5Department of Epidemiology and Biostatistics, Global Health Sciences, University of California San Francisco, San Francisco, CA, United States

    Corresponding Author:

    Travis C Porco, MPH, PhD

    Francis I Proctor Foundation

    University of California San Francisco

    Floor 2 Box 0944

    490 Illinois St

    San Francisco, CA, 94143

    United States

    Phone: 1 4154764101

    Email: travis.porco@ucsf.edu


    Background: In a prior study at the start of the pandemic, we reported reduced numbers of Google searches for the term “conjunctivitis” in the United States in March and April 2020 compared with prior years. As one explanation, we conjectured that reduced information-seeking may have resulted from social distancing reducing contagious conjunctivitis cases. Here, after 1 year of continued implementation of social distancing, we asked if there have been persistent reductions in searches for “conjunctivitis,” and similarly for other communicable disease terms, compared to control terms.

    Objective: The aim of this study was to determine if reduction in searches in the United States for terms related to conjunctivitis and other common communicable diseases occurred in the spring-winter season of the COVID-19 pandemic, and to compare this outcome to searches for terms representing noncommunicable conditions, COVID-19, and to seasonality.

    Methods: Weekly relative search frequency volume data from Google Trends for 68 search terms in English for the United States were obtained for the weeks of March 2011 through February 2021. Terms were classified a priori as 16 terms related to COVID-19, 29 terms representing communicable conditions, and 23 terms representing control noncommunicable conditions. To reduce bias, all analyses were performed while masked to term names, classifications, and locations. To test for the significance of changes during the pandemic, we detrended and compared postpandemic values to those expected based on prepandemic trends, per season, computing one- and two-sided P values. We then compared these P values between term groups using Wilcoxon rank-sum and Fisher exact tests to assess if non-COVID-19 terms representing communicable diseases were more likely to show significant reductions in searches in 2020-2021 than terms not representing such diseases. We also assessed any relationship between a term’s seasonality and a reduced search trend for the term in 2020-2021 seasons. P values were subjected to false discovery rate correction prior to reporting. Data were then unmasked.

    Results: Terms representing conjunctivitis and other communicable conditions showed a sustained reduced search trend in the first 4 seasons of the 2020-2021 COVID-19 pandemic compared to prior years. In comparison, the search for noncommunicable condition terms was significantly less reduced (Wilcoxon and Fisher exact tests, P<.001; summer, autumn, winter). A significant correlation was also found between reduced search for a term in 2020-2021 and seasonality of that term (Theil-Sen, P<.001; summer, autumn, winter). Searches for COVID-19–related conditions were significantly elevated compared to those in prior years, and searches for influenza-related terms were significantly lower than those for prior years in winter 2020-2021 (P<.001).

    Conclusions: We demonstrate the low-cost and unbiased use of online search data to study how a wide range of conditions may be affected by large-scale interventions or events such as social distancing during the COVID-19 pandemic. Our findings support emerging clinical evidence implicating social distancing and the COVID-19 pandemic in the reduction of communicable disease and on ocular conditions.

    JMIR Infodemiology 2022;2(1):e31732

    doi:10.2196/31732

    Keywords

    COVID-19; pandemic; communicable disease; social distancing; infodemiology; Google Trends; influenza; conjunctivitis; ocular symptoms; seasonality; trend; online health information; information-seeking 


    Infodemiology, an emerging field of study within health informatics, applies the science of distribution and determinants of information in an electronic medium such as the internet or within a population toward informing public health and policy [1-4]. The COVID-19 pandemic highlights the utility of infodemiology from the ability to predict outbreaks of coronavirus infection based on internet search engine queries, social media post–based syndrome surveillance, and search engine data mining to cluster query and click data as an estimate of the prevalence of symptoms patients sought to address outside of clinical appointments or business hours [1,2,5-7]. Although no standard methodologic approach has been established in the past decade, recently new standardized infodemiologic study methods have been proposed to strengthen the validity and utility of its application in health [8].

    Google Trends has emerged as a predictive tool for disease occurrence and outbreaks. For example, one study demonstrated a strong correlation between keyword-triggered link click counts on Google and influenza cases 1 week later as the 2004-2005 Canadian influenza season unfolded (Pearson correlation coefficient r=0.91) [9]. Infodemiologic approaches such as use of Google Trends unlocks access to real-time predictive analysis of health-related behaviors. This was previously unfathomable, when much of public health analytics was predicated on collecting and sifting through large data sets [2,10]. For example, social media–based surveillance of foodborne diseases have been shown to be 66% effective, more rapid, and cheaper than these data-based surveillance methods [11].

    Clinical studies of the COVID-19 pandemic have suggested potential links between the pandemic with changes in health conditions [12-21]. This includes studies and reports on ocular symptoms and health [22-36]. Online searches and social media reflect the clinical seasonality and epidemics of conjunctivitis [37-40]. Previously, we found evidence that during the start of the COVID-19 pandemic (through April 2020), some ocular-related terms (in multiple languages on a worldwide level) showed an increased search trend. These terms included “burning,” “sore,” and “red” eyes [5]. Subsequently, other studies of search data through June 2020 found a strong correlation between some ocular search terms and cases of COVID-19 on a country level in Europe [41]. In our prior study, searches for English-language conjunctivitis- and pink eye–related terms in March and April 2020 were lower compared with those in prior years. We had conjectured that one cause of these search trend results could be that implementation of school closures and social distancing starting in March 2020 had reduced the incidence of contagious conjunctivitis cases, resulting in reduced information-seeking about conjunctivitis [5]. However, our findings were limited as our study data time series ended quite early into the pandemic in April 2020.

    In this study, using masked analyses of searches geolocated to the United States for 1 full year after the pandemic began, we assessed whether a reduction in searching occurred for conjunctivitis in the United States compared to the prior 9 years. We then assessed whether this was sustained for multiple seasons throughout the COVID-19 pandemic in 2020-2021. We also assessed whether the search volume decreased for other common school- and workplace-based communicable diseases, including strep throat, chicken pox, the common cold, as well as other conditions of acute exposure such as sexually transmitted diseases (STDs) and bug bites. We compared the results for that class of terms (referred to as “communicable”) to searches for control “noncommunicable” conditions, including some ocular terms for which we and others had previously found had increased search activity at the start of the pandemic [5,41]. We also assessed whether terms with stronger seasonal variation were more likely to have a decreased search trend during the COVID-19 pandemic. In addition, we assessed whether there was sustained change across multiple seasons, compared to the prior 9 years, for the group of terms we had classified as COVID-19 pandemic–related (related to a search about distinguishing or identifying COVID-19 symptoms).


    Google Search Data

    Weekly relative search frequency volume data for search terms in English for the United States were obtained on March 9, 2021, for the weeks of March 1, 2011, through February 28, 2021, as previously described using the Google Health application programming interface (API) [40,42-44]. This provided a long baseline of prepandemic data as a basis for comparisons (described below). Queries of this API allow specification of the following: a set of search terms (eg, “coronavirus symptoms,” “shingles treatment”), time range (start date and end date), interval (day, week, month), and geolocation (eg, “United States”). For any given query, for each search term, a search activity value is provided at each time interval, which represents the relative share of search for that term in proportion to all Google searches that were made within the specified time range and geolocation [45]. Search terms were chosen based on our prior studies [5], COVID-19, and on common terms used in the United States for communicable and noncommunicable conditions. Some terms served as a surrogate for ambiguously named conditions to improve the health-specificity of search data (eg, we used “cold medicine” for the common cold and “shingles treatment” for shingles). Classifications were assigned a priori. We classified 16 terms as COVID-19 pandemic–related conditions, including respiratory, allergic, or flu-like terms (as we assumed they may represent a symptomatic search for those affected by, or initially concerned about, COVID-19). We also included 29 terms that were classified as communicable (communicable conditions unrelated to the COVID-19 pandemic) and 23 terms that were classified as noncommunicable (control noncommunicable conditions, less likely related to the COVID-19 pandemic).

    Masking of Terms, Classifications, and Location

    To reduce bias, actual search terms were masked using numeric codes before the data were analyzed. To further mask, data for the same terms for two other masked countries were also included and names of our assigned classification groups were also encoded. In this way, individuals assessing statistical outcomes were naïve to the actual terms and to their assigned classifications, as well as to the country of search term origin.

    Statistical Analysis

    Overview

    The masked statistical analysis, described in detail below, included identifying seasonal search features for each term. It also included fitting models for spring (March to May 2020), summer (June to August 2020), autumn (September to November 2020), and winter (December to February 2020-2021). This was done to contrast search interest during each season of the first year of the pandemic with that of the same season from the prior 9 years, by identifying seasons for each term that differed (as well as those that were specifically reduced) during the pandemic compared to the prior 9 years. We then compared those results for terms representing different classes of conditions, as well as to the seasonality of terms, as described in detail below.

    Analysis of Changes in Search Trends in 2020-2021 Seasons Compared to Prior Years

    To test for the significance of changes in the period following March 2020, the following algorithm was used. Time series were first subject to the Hampel filter for outlier removal (R package pracma). For more complete series (time series with fewer than 20% missing data), we detrended the time series using the residuals from Theil-Sen regression with respect to the calendar time for the pre-COVID-19 epoch (March 2011 to February 2020). The 9 years of pre-COVID-19 time-series data were intended to provide sufficiently precise estimations of prepandemic seasonal and secular trends for our planned comparison of these features during the pandemic period. Theil-Sen regression is a nonparametric fixed-effects regression model designed to minimize the influence of outliers [46,47]. Thus, when sufficient data were available, we compared postpandemic values to what would have been expected based on prepandemic trends, as has been done in other studies (eg, [48,49]). We then compared the levels of search for spring 2020 (and the other seasons) to the pre-COVID-19 trend line as follows. We applied a robust linear mixed-effects regression model to compare the residuals of observations for each season, thus comparing the levels for spring 2020, summer 2020, autumn 2020, and winter 2021 to the corresponding times of previous years. Using this model, we computed both one- and two-sided P values. Significant two-sided P values represented a P value for a search change (increase or decrease) in 2020-2021 compared to prior years. Significant one-sided P values represented a P value for search reduction in 2020-2021 compared to prior years. For time series containing more than 20% missing (or zero) data, we performed robust mixed-effects regression using indicators for spring, summer, autumn, and winter of 2020 as predictors (clustering on year); one- and two-sided P values were computed using the standard normal distribution. This analysis only compared values for each season after the pandemic began to those before. We interpreted all significant two-sided P values as indicating an increase if significance was not also seen using the one-sided tests specific to identifying decreases. All computations were performed using R for MacIntosh v.4.0 (R Foundation for Statistical Computing, Vienna, Austria); the R packages pracma, mblm, and robustlmm were used for Hampel filter, Theil-Sen, and robust linear mixed models, respectively [50-52].

    Comparing Changes in Searches in 2020-2021 Seasons for Communicable Versus Noncommunicable and Non-COVID-19 Classification Groups

    We then performed an analysis of the previously calculated P values for search reduction by term groups to ask if non-COVID-19 terms representing communicable disease were more likely to show significant reductions in searches in 2020-2021 than noncommunicable terms. We compared the P values for search reduction between these two groups using the Wilcoxon rank-sum test. Similarly, we assessed the binary classification of significance at the .05 level using the Fisher exact test (where a significant P value indicates a difference in the proportion of P values less than .05 found between the two groups).

    Determining Seasonal Characteristics and Their Relationships to Search Reductions in 2020-2021

    Standard circular statistical methods were used for seasonal analysis, computing the circular mean, a measure of central tendency for the occurrence time of searches within the yearly cycle [53]. We also report the amplitude-to-mean (AtM) ratio (ie, the ratio of the difference between the peak and the mean to the mean itself) as an estimate of the degree of seasonality. Large AtM values correspond to large swings or oscillations, while small values correspond to minor fluctuations on a yearly cycle. Statistical significance of seasonality per term was assessed using Morlet wavelets, reporting the largest daily P value for the power at the annual cycle over the course of the time series (excluding the first and last years) [44,54]. This provided a conservative requirement for consistency of the annual cycle for all years. Calculations were performed using the R package WaveletComp [55]. Using the P values reflecting seasonality for a term, for each season, we then also assessed if there was a relationship between the P value for search reduction in 2020-2021 and the seasonal P value for that term. This was assessed using Theil-Sen regression.

    Unmasking, Describing, and Visualizing Results

    After all statistical analyses were completed, search terms, country, and classifications were then unencoded (unmasked). The weekly (x axis) and resulting mean search interest values (y axis) for terms were plotted. Weekly data were plotted as log-transformed Hampel-smoothed raw mean values+1 for improved scaling and visualizations. Seasons are indicated with vertical dashed line separators. The 2020 weekly mean search values are plotted as a red solid line, 2021 values are plotted as a red dashed line, 2017-2019 plots are gold, 2014-2016 data are green, and 2011-2013 data are blue. P values at the top of each panel for any season indicate if searches in 2020-2021 were significantly different overall (red, P values for search change) or specifically lower (blue, P values for search reduction), compared to those in the same quarters in 2011-2019 (differences significant at P>.05 are presented in tables). In addition, the overall seasonality is presented for each term (black text on the lower left of each panel in figures), indicating if a term is significantly seasonal. If significantly seasonal (defined as P<.05), the AtM (as an indicator of relative seasonal strength) and a circular mean week (as an indicator of the peak high season) are provided. All of the statistical values described above are included in figures and all P values are also presented in tables. We subjected P values to false discovery rate correction prior to reporting.

    Ethics Considerations

    This study received approval from the University of California San Francisco institutional review board (14-14743) and adhered to the Declaration of Helsinki.


    Overview of Changes in Search Trends in 2020-2021 Seasons Compared to Prior Years

    Overall, we found that at the start of the pandemic (spring 2020), many terms of all three classifications appeared to have search patterns that differed from those in prior years. Some changes persisted for subsequent seasons. Further details and statistical analysis results are described below first for COVID-19–related terms and then for non-COVID-19–related terms (including comparison of search term groups classified as representing communicable conditions vs noncommunicable conditions).

    COVID-19–Related Search During the Pandemic

    Of the terms we had a priori classified as COVID-19 pandemic–related, resulting quarterly P values for the search change and for search reduction, as well as plotted data, indicated significant search increases compared to prior years. Of note, this group of terms includes those we classified as potentially related, due to the public’s concern about conditions with symptoms similar to those of COVID-19 (such as flu and allergy). Increases were observed for spring and summer 2020-2021 and often in additional seasons. A common exception was that several potentially flu-related terms switched to a significant decrease in winter 2020 (P<.001) (see Figure 1 and Table 1).

    ‎
    Figure 1. Search interest for COVID-19–related terms in 2020-2021 seasons compared to the same seasons in 2011-2019. In each panel, the x axis indicates week of the year and the y axis indicates weekly mean search interest values (Hampel-filtered and log-transformed for presentation purposes) for that term. Solid red, 2020 values; dashed red, 2021 values; gold, 2017-2019; green, 2014-2016; blue, 2011-2013. The 4 seasons are separated with vertical dashed lines. P values at the top of each panel for each season indicate if searches in that season of 2020-2021 were significantly (P<0.05) different overall (red, 2-sided test) than the same quarters in 2011-2019. Significant reductions are indicated by blue P values. Nonsignificant (P>.05) values are not shown. Seasonal characteristics for each term are shown as black text on the lower left of each panel. For terms with seasonality (P<.05), amplitude to mean ratios (AtM) are provided as an indicator of relative seasonal strength, as are circular mean week (Wk.) as an indicator of peak high season (assuming annual seasons); standard deviations are in parentheses.
    View this figure
    Table 1. Search interest for COVID-19–related terms in 2020-2021 seasons compared to the same seasons in 2011-2019 (related to Figure 1).
    TermsSeasonalityaP valueb for test of different search from prior years for each termP valuec for test of lower search from prior years for each term

    		P valueAtMd, mean (SD)Weeke, circular mean (SD)SpringSummerAutumnWinterSpringSummerAutumnWinter
    allergies<.0010.14 (0.05)19 (4.4)<.001<.001<.001<.001>.99>.99>.99>.99
    anosmia.040.08 (0.06)7 (16.6)<.001<.001<.001<.001>.99>.99>.99>.99
    asthma<.0010.04 (0.04)5 (18.8)<.001<.001.13.25>.99>.99.11.17
    coronavirus symptoms>.99—f—<.001<.001<.001<.001>.99>.99>.99>.99
    coronavirus test locations>.99——<.001<.001<.001<.001>.99>.99>.99>.99
    dry cough<.0010.17 (0.06)3 (21.5)<.001.009.33<.001>.99>.99.27<.001
    fever<.0010.14 (0.05)19 (4.4)<.001<.001<.001<.001>.99>.99>.99>.99
    flu<.0010.36 (0.05)52 (24.2)<.001<.001<.001<.001>.99>.99>.99<.001
    flu season<.0010.29 (0.08)0 (24.4)<.001<.001.04<.001>.99>.99>.99>.99
    headache.22——<.001.04.43.02>.99>.99>.99>.99
    influenza<.0010.38 (0.04)4 (1.2)<.001<.001.10<.001>.99>.99>.99<.001
    my fever.13——.05.13.86<.001>.99>.99.66<.001
    problems breathing>.99——<.001<.001<.001<.001>.99>.99>.99>.99
    shortness of breath.43——<.001<.001<.001<.001>.99>.99>.99>.99
    why cant I smell>.99——<.001<.001<.001<.001>.99>.99>.99>.99
    why cant I taste.61——<.001<.001<.001<.001>.99>.99>.99>.99

    aIndicates if the search for the years 2011-2019 shows a significant (P<.05) seasonal trend.

    bTwo-sided P values regarding any change in search from prior years for each season.

    cOne-sided P values regarding a decrease in search from prior years for each season.

    dAtM: amplitude to mean ratio, indicating relative seasonal strength.

    eIndicates peak high season.

    fNot applicable; AtM and circular mean values are provided only for search terms where statistical evidence of that term being seasonal was found.

    Changes in Searches in 2020-2021 Seasons for Communicable Versus Noncommunicable and Non-COVID-19 Classification Groups

    The two ocular terms we had classified a priori as communicable, “conjunctivitis” and “pink eye,” both had significant reductions for all 4 seasons of 2020-2021 (P<.001) compared to prior years. Overall, in 2020-2021, these and other communicable condition search terms appeared to have more reductions in search compared with the reductions in control noncommunicable terms. To test this hypothesis further, we compared the P values for search changes and reductions between the communicable and noncommunicable class of terms (excluding COVID-19–related terms).

    We first assessed if P values for the search change in the non-COVID-19 communicable term group differed significantly from P values for the search change in the noncommunicable group (Figure 2, red P values; Table 2 "different search from prior years"). In spring 2020, we found no evidence for a significant difference between these groups for the P values (Wilcoxon rank-sum test, P=.99) or in the proportion of search terms with significant P values (Fisher exact test, P=.83). In contrast, for the subsequent 3 seasons in 2020-2021, the levels of searches were significantly different in 2020-2021 (compared to past years) for the communicable versus control noncommunicable groups of terms. This was observed when comparing the P values per group (Wilcoxon rank-sum test: summer P=.05, autumn P=.02, winter P=.006). Similarly, the proportion of search terms with significant search changes in 2020-2021 was significantly higher for the communicable group compared with the noncommunicable group (Fisher exact test: summer P=.01, autumn P=.01, winter P=.003).

    We also assessed specifically if significant reductions in search differed for the communicable and noncommunicable classifications of non-COVID-19 term groups. To do so, we compared the P values for search reduction (see Table 2, “lower search from prior years”) between groups, by season. We found little evidence for a significant difference in overall reductions in search between these groups in spring 2020 (Wilcoxon rank-sum test: P=.04, Fisher exact test: P=.09). For each of the subsequent 3 seasons in 2020-2021, the levels of search were much more significantly reduced in 2020-2021 (compared to past years) for the communicable class of terms than for the noncommunicable term group (Wilcoxon rank-sum test: summer P<.001, autumn P<.001, winter P<.001; Fisher exact test: summer P<.001, autumn P<.001, winter P<.001).

    The Wilcoxon rank-sum test and Fisher exact test P values for the overall differences in search postpandemic between the two classification groups (communicable and noncommunicable conditions) per season, described above, are shown in Table 3.

    ‎
    Figure 2. Search interest for non-COVID-19, communicable, and noncommunicable terms in 2020-2021 seasons compared to the same seasons in 2011-2019. Time-series annual mean weekly search interest; P values indicating changes in 2020-2021 and seasonal values are all as described for Figure 1. Panel labels indicate communicable (shown first) and noncommunicable (shown second) classes that were compared group-wise using the Wilcoxon rank-sum test and Fisher exact test (described in the text and in Tables 2 and 3).
    View this figure
    Table 2. Search interest for non-COVID-19 communicable versus noncommunicable term groups in 2020-2021 seasons compared to those seasons in 2011-2019.
    TermSeasonalityaP valuesb for test of different search from prior years for each termP valuesc for test of lower search from prior years for each term

    		P valueAtMd, mean (SD)Weeke, circular mean (SD)SpringSummerAutumnWinterSpringSummerAutumnWinter
    Communicable and/or acute exposure conditions (non-COVID)

    		bug bite<.0010.38 (0.05)29 (1.2).54.43.06<.001.41>.99.05<.001

    		chicken pox.06—f—<.001<.001<.001<.001<.001.009<.001<.001

    		chlamydia.83——<.001<.001<.001<.001<.001<.001<.001<.001

    		cold medicine<.0010.25 (0.04)51 (21.6)<.001.003<.001<.001<.001.004<.001<.001

    		conjunctivitis<.0010.06 (0.04)13 (11)<.001<.001<.001<.001<.001<.001<.001<.001

    		ear infection<.0010.07 (0.05)4 (18.6)<.001.05.001<.001<.001.05<.001<.001

    		fifth disease<.0010.14 (0.06)11 (2.5)<.001.03.02<.001<.001.03.02<.001

    		german measles.38——.71.91.81.21.97.90.63.14

    		gonorrhea.48——<.001.01<.001.02<.001.01<.001.01

    		HIV.050.02 (0.03)13 (14.8)<.001<.001<.001<.001<.001<.001<.001<.001

    		hpv.62——<.001.15.09<.001<.001.14.07<.001

    		impetigo.030.07 (0.06)35 (11)<.001<.001<.001<.001<.001<.001<.001<.001

    		lice<.0010.06 (0.05)35 (9.8)<.001<.001<.001<.001<.001<.001<.001<.001

    		measles.010.23 (0.07)12 (3.6).10.01.06<.001.08.01.05<.001

    		meningitis.62——<.001.008<.001<.001<.001.008<.001<.001

    		mononucleosis.25——<.001.77.55<.001<.001.75.44<.001

    		mumps.62——.01.004.002<.001.01.004.002<.001

    		pertussis.64——<.001.84.36.003<.001>.99.28.002

    		pink eye<.0010.09 (0.06)9 (17.4)<.001<.001<.001<.001<.001<.001<.001<.001

    		ringworm<.0010.03 (0.04)27 (10.6).04<.001<.001<.001.03<.001<.001<.001

    		rubella.010.05 (0.05)12 (14.5).15.69.79.01.12.65.62.008

    		salmonella.62——.25.45.43<.001.20>.99.35<.001

    		scabies.11——<.001.02<.001<.001<.001.02<.001<.001

    		shingles treatment.19——.15.47.33.93>.99>.99>.99.62

    		std.020.01 (0.03)20 (15.9)<.001<.001.005<.001<.001<.001.004<.001

    		stomach flu<.0010.33 (0.06)3 (1.2)<.001<.001<.001<.001<.001<.001<.001<.001

    		strep throat<.0010.12 (0.07)5 (19.9)<.001<.001<.001<.001<.001<.001<.001<.001

    		syphilis.88——.22.81.36.93.17.78.29.70

    		tuberculosis.05——.53.04.74.02.40>.99.60.02
    Noncommunicable, control conditions (non-COVID)

    		arthritis.26——<.001.33.65.07<.001>.99>.99.05

    		broken bone.23——<.001.03.53.004<.001.03.43.003

    		burning eyes>.99——<.001.002.04<.001>.99>.99>.99>.99

    		cancer.26——<.001<.001.007<.001<.001<.001.006<.001

    		cataracts.97——<.001.33.50.12<.001.30.41.08

    		claritin<.0010.16 (0.06)18 (3.2).50.63.59.002.39>.99.46.002

    		corneal ulcer.26——.10.04.74.86.08.03.60.56

    		diabetes.010.02 (0.05)6 (18.9)<.001.84.20.93<.001>.99.16.70

    		diabetic retinopathy.88——.15.70.43.40.12>.99>.99.26

    		dry eyes.13——.02.93.04<.001.02>.99>.99>.99

    		eczema<.0010.04 (0.05)9 (17.2).30.19.04.003.24.18.03.002

    		glaucoma.41——<.001.42.36.03<.001.38.29.02

    		heart attack.010.04 (0.06)12 (10).15.41.34.03.12.37.28.02

    		high blood pressure<.0010.05 (0.04)5 (13.2)<.001.91.66.29<001.89>.99.20

    		itchy eyes<.0010.1 (0.05)18 (5.3)<.001.003.10.22>.99>.99>.99>.99

    		macular degeneration.78——<.001.42.36.08<.001>.99>.99.05

    		memory loss.92——<.001.81.79.93<.001>.99.62.71

    		pollen<.0010.29 (0.07)17 (1.7)<.001<.001<.001.28>.99>.99>.99>.99

    		pregnant.05——.38.43.79.80.30.38.62.53

    		red eyes.19——.004.72.86.59>.99>.99.66.39

    		sore eyes.83——.51.22.04.12.39>.99>.99>.99

    		stroke symptoms<.0010.09 (0.04)26 (8).25.91.36.06>.99>.99>.99>.99

    		toothache.62——.06.41.13.34>.99.37.11.23

    aIndicates if the search for the years 2011-2019 shows a significant (P<.05) seasonal trend.

    bTwo-sided P values regarding any change in search from prior years for each season.

    cOne-sided P values regarding a decrease in search from prior years for each season.

    dAtM: amplitude to mean ratio, indicating relative seasonal strength.

    eIndicates peak high season.

    fNot applicable; AtM and circular mean values are provided only for search terms where statistical evidence of that term being seasonal was found.

    Table 3. Comparison of the differences and reductions in search postpandemic (P values in Table 2), for communicable vs noncommunicable condition search terms groups, by season.
    SeasonDifference from prior yearsaSearch lower than prior yearsb

    		Wilcoxon rank-sum testFisher exact testWilcoxon rank-sum testFisher exact test
    Spring.99.83.04.09
    Summer.05.01<.001<.001
    Autumn.02.01<.001<.001
    Winter<.001.003<.001<.001

    aP values when testing if significant changes in search after the start of the pandemic differed for the communicable and noncommunicable classifications of non-COVID-19 term groups.

    bP values when testing if significant reductions in search after the start of the pandemic differed for the communicable and noncommunicable classifications of non-COVID-19 term groups.

    Seasonal Characteristics and Their Relationship to Reductions in 2020-2021

    Although we found searches for a number of terms from all 3 classifications that appeared to be seasonal, it appeared that seasonal terms were more likely to have a reduced search frequency in 2020-2021 seasons (see panels in Figure 2, including the black text on the lower left of all panels and Table 2 “Seasonality” P values). We hypothesized that seasonal conditions might be reduced by social distancing measures during the pandemic more than for those that are less seasonal. To test this hypothesis, for each season of each non-COVID-19 term, we compared the P values for search reduction against the seasonality P values for that term using Theil-Sen regression. For spring, we found no significant correlation between a term having reductions in search in 2020-2021 and with the seasonality of a term (P=.95). However, for summer, autumn, and winter, we found a significant correlation between a term having reductions in search in 2020-2021 with the seasonality of that term (Theil-Sen: summer P<.001, autumn P<.001, winter P<.001).


    Principal Results

    Decreased Searches for Communicable and Seasonal Disease Search Terms During 2020-2021

    Overall, in our masked analysis, searches for many of the 29 non-COVID-19 communicable terms (including those related to conjunctivitis) were significantly decreased during the first 4 seasons of the 2020-2021 pandemic compared with the prior 9 years. For example, 18 of the terms (“chicken pox,” “chlamydia,” “cold medicine,” “conjunctivitis,” “ear infection,” “fifth disease,” “gonorrhea,” “HIV,” “impetigo,” “lice,” “meningitis,” “mumps,” “pink eye,” “ringworm,” “scabies,” “std,” “stomach flu,” “strep throat”) showed reductions for all 4 seasons of the pandemic (see Table 2). For 3 consecutive seasons in 2020-2021 (summer, autumn, winter), the levels of search were much more significantly reduced in 2020-2021 for the non-COVID-19 communicable terms group than for the noncommunicable terms group. The conjunctivitis-related findings of sustained reduction in search continue to lend support to our hypothesis described in our prior study from the start of the pandemic, based on reduced searches for conjunctivitis terms, that social distancing from the pandemic may lead to reductions in infectious conjunctivitis [5]. Recently, Lavista Ferres et al [56] provided support of this hypothesis, demonstrating that a 37% decrease in emergency department encounters for infectious conjunctivitis was associated with implementation of social distancing, reduced smartphone mobility, and reduced online search. Our results also support a broader hypothesis that non-COVID-19 communicable disease in general may be reduced in comparison to control noncommunicable conditions due to implementation of social distancing. In a separate assessment independent of our search term classifications, we also found a significant correlation between reductions in search for a term in 2020-2021 and seasonality of search for that term. This is not surprising, as it appears that many terms of communicable conditions were seasonal and with apparent higher seasonality overall compared to noncommunicable conditions.

    Increase of Searches With Non-COVID-19 Ocular Terms During the Pandemic

    Of the terms we had initially classified as not clearly COVID-19 pandemic–related and as noncommunicable, the only terms that showed significant increases in 2020-2021 for one or more seasons included “pollen” and several ocular terms (“burning eyes,” “dry eyes,” “itchy eyes,” “red eyes,” “sore eyes”). Despite this, no other control ocular conditions (“cataracts,” “corneal ulcer,” “diabetic retinopathy,” “glaucoma,” “macular degeneration”) were significantly increased. This suggests that unlike communicable ocular conditions, which had a lower search during the pandemic (conjunctivitis), or noncommunicable chronic ocular conditions (without a sustained change in search), these other ocular conditions may have indeed increased during the pandemic. This appears most likely for “burning eyes” as well as “dry eyes” and “itchy eyes.” These findings lend support to some clinical studies (although not all of them draw the same conclusions) suggesting that some of these elevated ocular symptoms may be linked to COVID-19 or to other impacts of the pandemic, such as mask-wearing and increased screen time [5,28-36,41]. For example Nasiri et al [28] found common ocular manifestations in patients with COVID-19, including dry eye, redness, tearing, itching, eye pain, and discharge, and Moshirfar et al [33] reported that facemask wearing may cause ocular irritation and dryness in regular mask wearers.

    Sustained Decrease in Searching Non-COVID-19 Noncommunicable Terms During the Pandemic

    A few noncommunicable terms had sustained search reductions in 2020-2021. Search for “cancer” was reduced for all 4 seasons compared to prior years. Chen et al [18] reported declines in colorectal, prostate, and breast cancer screening rates with the start of the COVID-19 pandemic through mid-summer. It is possible that fewer positive results from screening of healthy adults could potentially have led to fewer people searching for “cancer.” For some terms in our communicable condition group representing conditions covered by routine annual clinical screening (such as “std”), the decreased search may therefore also reflect less screening services or test results rather than a reduced prevalence. Johnson et al [20] reported large declines in STD testing and in STD programmatic operations during the first 6 months of the pandemic. Our observed sustained reduction in search for bone fracture (“broken bone”) reflects what has also been observed clinically during the pandemic. For example, one systematic review reported a 43% decline in the number of fractures presenting to hospitals during the pandemic compared to prepandemic levels that they attributed to less driving, sports, and other outdoor activities during the pandemic [19].

    Impact of the Pandemic on Searching for COVID-19 and Influenza Terms

    Unlike the non-COVID-19 groups, in several seasons of 2020-2021, most search terms in the group we had classified as related to COVID-19 had significant search increases. An exception was that earlier increases in search for influenza-related terms reversed in winter to become significant decreases. This could indicate that early on in the pandemic, COVID-19 symptoms may have been misconstrued as being related to flu [57] or that searches to distinguish COVID-19 from flu were common. By winter 2020, these reasons may have waned, while, in parallel, an actual drop in flu cases (and therefore less flu searches) may have occurred due to social distancing during the peak flu season. This has been suggested from clinical data as well. For example, a systematic review performed by Fricke et al [57] showed that defined influenza cases and influenza positivity rate were lower during the pandemic than in former seasons.

    Limitations

    As with many infodemiology studies, it is possible that multiple other causes can affect search trends besides the occurrence rate of a disease. We may expect this for some terms such as those related to conditions reported in the news during the pandemic. However, the fact that our general finding of more reduced search for communicable than noncommunicable terms suggests that this is not the case globally. Furthermore, a search reduction due to news stories is much less likely than an increase. Reduced search for a term related to news about that term also would not likely be sustained for several seasons. Many of our health terms exhibited a general overall search reduction in spring 2020 (other than those potentially related to COVID-19). Those in the noncommunicable group tended to return to normal levels by summer 2020. This may indicate that seeking medical care for these other conditions was reduced due to public concern of going to clinics as well as closed clinics. Some terms had no significant changes noted during the pandemic compared to prior years. This could reflect unchanged clinical conditions. Alternatively, the search volume for some terms may be too low overall, preventing determining statistical significance using our methods.

    For a small number of terms, although searches in 2020-2021 visually appeared to be lower than in prior years, they were not shown to be significantly different than those in prior years. This could be due to our analysis accounting for secular trends already moving in that direction (eg, see the red line in the “pregnant” panel of Figure 2). Indeed, other epidemiological studies have seen a decrease during the pandemic that was also partially obscured by a prior secular trend [58,59].

    Comparison With Prior Work and Significance

    This study lends support to our prior study hypotheses, and confirms theoretical public health and epidemiological assumptions about the value of social distancing to reduce the impact of conjunctivitis epidemics [5,56,60]. It also builds upon and complements a growing body of evidence from clinical and other epidemiologic studies suggesting that social distancing and public health interventions such as school closures during the pandemic can potentially reduce the prevalence of numerous other communicable diseases, including pediatric respiratory tract infection, non-COVID-19 acute pediatric infections, varicella, measles, rubella, head lice, influenza, and STDs, as well as other condition [12-17,19-21,56].

    Use of online information-seeking behavior data to infer changes in disease can be simultaneously applied to entire countries, states, and smaller regions, and to numerous conditions, potentially worldwide. Being able to leverage such low-cost early monitoring can help detect or predict clinical or epidemiological status or outcomes early on during an event to potentially allow for improved modeling and planning by public health programs. Such approaches could be considered to complement findings from clinical studies and to reveal findings prior to availability of clinical data, such as what occurred during the COVID-19 pandemic. Indeed, an early study of reduced disease term search data, at a time when clinical data were unavailable, suggested that one cause was due to a potential decline in clinical cases, which, many months later, was confirmed from clinical data [5,56].

    Conclusions

    Compared to studies based on more costly and less publicly available individual-level clinical data, we demonstrate the use of online search data to study the impacts of interventions such as social distancing at very low cost. Results from the study of online search data lend support to emerging clinical evidence implicating social distancing and the COVID-19 pandemic in the reduction of communicable disease and in the impact on ocular conditions.

    Acknowledgments

    This work was supported in part by grant 1R01EY024608-01A1 (principal investigator, TL) from the National Institutes of Health National Eye Institute (NIH-NEI), grant EY002162 (Core Grant for Vision Research; principal investigator, Ullian) from the NIH-NEI, and an Unrestricted Grant from Research to Prevent Blindness (principal investigator, SM). The sponsor or funding organization had no role in the design or conduct of this research.

    Authors' Contributions

    Each author of this manuscript contributed to multiple of the following roles: data ascertainment and collection, study design, analysis, visualizations, manuscript writing and revision.

    Conflicts of Interest

    TML, TCP, MSD, and SDM received National Institutes of Health-National Eye Institute (NIH-NEI) grant support through the University of California San Francisco (UCSF), and JC did as well through a subcontract from UCSF. The other authors declare no conflicts of interest.

    1. Eysenbach G. Infodemiology and infoveillance: framework for an emerging set of public health informatics methods to analyze search, communication and publication behavior on the Internet. J Med Internet Res 2009 Mar 27;11(1):e11 [FREE Full text] [CrossRef] [Medline]
    2. Mavragani A. Infodemiology and infoveillance: scoping review. J Med Internet Res 2020 Apr 28;22(4):e16206 [FREE Full text] [CrossRef] [Medline]
    3. E-collection 'Infodemiology and Infoveillance'. Journal of Medical Internet Research.   URL: https://www.jmir.org/collection/view/69 [accessed 2021-08-10]
    4. E-collection 'Infoveillance, Infodemiology, Digital Disease Surveillance, Infodemic Management'. JMIR Public Health and Surveillance.   URL: https://publichealth.jmir.org/collection/view/304 [accessed 2021-08-10]
    5. Deiner MS, Seitzman GD, McLeod SD, Chodosh J, Hwang DH, Lietman TM, et al. Ocular signs of COVID-19 suggested by internet search term patterns worldwide. Ophthalmology 2021 Jan;128(1):167-169 [FREE Full text] [CrossRef] [Medline]
    6. Ben S, Xin J, Chen S, Jiang Y, Yuan Q, Su L, et al. Global internet search trends related to gastrointestinal symptoms predict regional COVID-19 outbreaks. J Infect 2022 Jan;84(1):56-63 [FREE Full text] [CrossRef] [Medline]
    7. Tran HTT, Lu S, Tran HTT, Nguyen BV. Social media insights during the COVID-19 pandemic: infodemiology study using big data. JMIR Med Inform 2021 Jul 16;9(7):e27116 [FREE Full text] [CrossRef] [Medline]
    8. Mavragani A, Ochoa G. Google trends in infodemiology and infoveillance: methodology framework. JMIR Public Health Surveill 2019 May 29;5(2):e13439 [FREE Full text] [CrossRef] [Medline]
    9. Eysenbach G. Infodemiology: tracking flu-related searches on the web for syndromic surveillance. 2006 Presented at: AMIA Annual Symposium Proceedings; November 11-15, 2006; Washington, DC p. 244-248.
    10. Eysenbach G. Infodemiology and infoveillance tracking online health information and cyberbehavior for public health. Am J Prev Med 2011 May;40(5 Suppl 2):S154-S158. [CrossRef] [Medline]
    11. Bernardo TM, Rajic A, Young I, Robiadek K, Pham MT, Funk JA. Scoping review on search queries and social media for disease surveillance: a chronology of innovation. J Med Internet Res 2013 Jul 18;15(7):e147 [FREE Full text] [CrossRef] [Medline]
    12. Lin C, Huang Y, Cheng C, Wu K, Tang K, Chiu I. Public health interventions for the COVID-19 pandemic reduce respiratory tract infection-related visits at pediatric emergency departments in Taiwan. Front Public Health 2020 Dec 16;8:604089. [CrossRef] [Medline]
    13. Kishimoto K, Bun S, Shin J, Takada D, Morishita T, Kunisawa S, et al. Early impact of school closure and social distancing for COVID-19 on the number of inpatients with childhood non-COVID-19 acute infections in Japan. Eur J Pediatr 2021 Sep 31;180(9):2871-2878 [FREE Full text] [CrossRef] [Medline]
    14. Hatoun J, Correa E, Donahue S, Vernacchio L. Social distancing for COVID-19 and diagnoses of other infectious diseases in children. Pediatrics 2020 Oct;146(4):e2020006460. [CrossRef] [Medline]
    15. van de Pol AC, Boeijen JA, Venekamp RP, Platteel T, Damoiseaux RAMJ, Kortekaas MF, et al. Impact of the COVID-19 pandemic on antibiotic prescribing for common infections in the Netherlands: a primary care-based observational cohort study. Antibiotics (Basel) 2021 Feb 18;10(2):196 [FREE Full text] [CrossRef] [Medline]
    16. Wu D, Liu Q, Wu T, Wang D, Lu J. The impact of COVID-19 control measures on the morbidity of varicella, herpes zoster, rubella and measles in Guangzhou, China. Immun Inflamm Dis 2020 Dec 07;8(4):844-846. [CrossRef] [Medline]
    17. Galassi F, Ortega-Insaurralde I, Adjemian V, Gonzalez-Audino P, Picollo MI, Toloza AC. Head lice were also affected by COVID-19: a decrease on Pediculosis infestation during lockdown in Buenos Aires. Parasitol Res 2021 Feb 06;120(2):443-450 [FREE Full text] [CrossRef] [Medline]
    18. Chen RC, Haynes K, Du S, Barron J, Katz AJ. Association of cancer screening deficit in the United States with the COVID-19 pandemic. JAMA Oncol 2021 Jun 01;7(6):878-884. [CrossRef] [Medline]
    19. Lim MA, Mulyadi Ridia KG, Pranata R. Epidemiological pattern of orthopaedic fracture during the COVID-19 pandemic: a systematic review and meta-analysis. J Clin Orthop Trauma 2021 May;16:16-23 [FREE Full text] [CrossRef] [Medline]
    20. Johnson KA, Burghardt NO, Tang EC, Long P, Plotzker R, Gilson D, et al. Measuring the impact of the COVID-19 pandemic on sexually transmitted diseases public health surveillance and program operations in the state of California. Sexual Trans Dis 2021 Apr 20;48(8):606-613. [CrossRef]
    21. Rodríguez I, Hernández Y. Sexually transmitted diseases during the COVID-19 pandemic: A focus on syphilis and gonorrhoea in Cuba. Public Health Pract 2021 Nov;2:100072. [CrossRef]
    22. Wu P, Duan F, Luo C, Liu Q, Qu X, Liang L, et al. Characteristics of ocular findings of patients with coronavirus disease 2019 (COVID-19) in Hubei Province, China. JAMA Ophthalmol 2020 May 01;138(5):575-578 [FREE Full text] [CrossRef] [Medline]
    23. Hong N, Yu W, Xia J, Shen Y, Yap M, Han W. Evaluation of ocular symptoms and tropism of SARS-CoV-2 in patients confirmed with COVID-19. Acta Ophthalmol 2020 Apr 26;98(5):online ahead of print. [CrossRef] [Medline]
    24. Daruich A, Martin D, Bremond-Gignac D. Ocular manifestation as first sign of Coronavirus Disease 2019 (COVID-19): interest of telemedicine during the pandemic context. J Fr Ophtalmol 2020 May;43(5):389-391 [FREE Full text] [CrossRef] [Medline]
    25. Verri D. Coronavirus in Italy: Alessandro Favalli describes 'fever, headache, eyes burning'. BBC. 2020 Mar 19.   URL: https://www.bbc.com/sport/football/51961429 [accessed 2020-03-19]
    26. Colavita F, Lapa D, Carletti F, Lalle E, Bordi L, Marsella P, et al. SARS-CoV-2 isolation from ocular secretions of a patient with COVID-19 in Italy with prolonged viral RNA detection. Ann Intern Med 2020 Aug 04;173(3):242-243 [FREE Full text] [CrossRef] [Medline]
    27. Zhou Y, Duan C, Zeng Y, Tong Y, Nie Y, Yang Y, et al. Ocular findings and proportion with conjunctival SARS-COV-2 in COVID-19 patients. Ophthalmology 2020 Jul;127(7):982-983 [FREE Full text] [CrossRef] [Medline]
    28. Nasiri N, Sharifi H, Bazrafshan A, Noori A, Karamouzian M, Sharifi A. Ocular manifestations of COVID-19: a systematic review and meta-analysis. J Ophthalmic Vis Res 2021 Jan 20;16(1):103-112 [FREE Full text] [CrossRef] [Medline]
    29. Feng Y, Park J, Zhou Y, Armenti ST, Musch DC, Mian SI. Ocular manifestations of hospitalized COVID-19 patients in a tertiary care academic medical center in the United States: a cross-sectional study. Clin Ophthalmol 2021;15:1551-1556. [CrossRef] [Medline]
    30. Agrawal D, Parchand S, Agrawal D, Chatterjee S, Gangwe A, Mishra M, et al. Impact of COVID-19 pandemic and national lockdown on ocular trauma at a tertiary eye care institute. Indian J Ophthalmol 2021;69(3):709. [CrossRef]
    31. Al-Dairi W, Al Saeed AA, Al Sowayigh OM. Impact of quarantine during COVID-19 pandemic on the quality of life of patients with allergic conjunctivitis. Cureus 2020 Dec 23;12(12):e12240 [FREE Full text] [CrossRef] [Medline]
    32. Sözener Z, Öztürk B, Aydın Ö, Demirel YS, Pınar NM, Bavbek S, et al. Coincidence of pollen season and coronavirus disease 2019 pandemic: less time outdoors - lesser allergy symptoms in 2020. Asia Pac Allergy 2021 Apr;11(2):e16 [FREE Full text] [CrossRef] [Medline]
    33. Moshirfar M, West WB, Marx DP. Face mask-associated ocular irritation and dryness. Ophthalmol Ther 2020 Sep 15;9(3):397-400 [FREE Full text] [CrossRef] [Medline]
    34. Mastropasqua L, Lanzini M, Brescia L, D'Aloisio R, Nubile M, Ciancaglini M, et al. Face mask-related ocular surface modifications during COVID-19 pandemic: a clinical, in vivo confocal microscopy, and immune-cytology study. Transl Vis Sci Technol 2021 Mar 01;10(3):22 [FREE Full text] [CrossRef] [Medline]
    35. Koh S, Rhee M. COVID-19 and dry eye. Eye Contact Lens 2021 Jun 01;47(6):317-322. [CrossRef] [Medline]
    36. Boccardo L. Self-reported symptoms of mask-associated dry eye: a survey study of 3,605 people. Cont Lens Anterior Eye 2021 Jan 20:101408 [FREE Full text] [CrossRef] [Medline]
    37. Leffler C, Davenport B, Chan D. Frequency and seasonal variation of ophthalmology-related internet searches. Can J Ophthalmol 2010 Jun;45(3):274-279. [CrossRef] [Medline]
    38. Deiner M, Lietman T, McLeod S, Chodosh J, Porco T. Surveillance tools emerging from search engines and social media data for determining eye disease patterns. JAMA Ophthalmol 2016 Sep 01;134(9):1024-1030 [FREE Full text] [CrossRef] [Medline]
    39. Deiner MS, McLeod SD, Chodosh J, Oldenburg CE, Fathy CA, Lietman TM, et al. Clinical age-specific seasonal conjunctivitis patterns and their online detection in Twitter, blog, forum, and comment social media posts. Invest Ophthalmol Vis Sci 2018 Feb 01;59(2):910-920 [FREE Full text] [CrossRef] [Medline]
    40. Deiner MS, McLeod SD, Wong J, Chodosh J, Lietman TM, Porco TC. Google searches and detection of conjunctivitis epidemics worldwide. Ophthalmology 2019 Sep;126(9):1219-1229 [FREE Full text] [CrossRef] [Medline]
    41. Mirza E, Mirza GD, Belviranli S, Oltulu R, Okka M. Ocular-symptoms-related Google Search Trends during the COVID-19 pandemic in Europe. Int Ophthalmol 2021 Jun 16;41(6):2213-2223 [FREE Full text] [CrossRef] [Medline]
    42. Stocking G, Matsa KE. Using google trends data for research? Here are 6 questions to ask. Pew Research Center. 2017 Apr 27.   URL: https:/​/medium.​com/​@pewresearch/​using-google-trends-data-for-research-here-are-6-questions-to-ask-a7097f5fb526 [accessed 2017-11-25]
    43. Matsa KE, Mitchell A, Stocking G. Methodology. Pew Research Center. 2017 Apr 27.   URL: https://www.pewresearch.org/journalism/2017/04/27/google-flint-methodology/ [accessed 2017-04-27]
    44. Berlinberg EJ, Deiner MS, Porco TC, Acharya NR. Monitoring interest in herpes zoster vaccination: analysis of Google Search data. JMIR Public Health Surveill 2018 May 02;4(2):e10180 [FREE Full text] [CrossRef] [Medline]
    45. Matsa KE, Mitchell A, Stocking G. Terminology. Pew Research Center. 2017 Apr 27.   URL: https://www.pewresearch.org/journalism/2017/04/27/google-flint-terminology/#Google-Health-API/ [accessed 2017-04-27]
    46. Theil H. A rank-invariant method of linear and polynomial regression analysis. In: Raj B, Koerts J, editors. Henri Theil’s Contributions to Economics and Econometrics. Advanced Studies in Theoretical and Applied Econometrics, vol 23. Dordrecht: Springer; 1992:1397-1392.
    47. Sen PK. Estimates of the regression coefficient based on Kendall's tau. J Am Stat Assoc 1968 Dec;63(324):1379-1389 [FREE Full text] [CrossRef]
    48. Worden L, Wannier R, Hoff NA, Musene K, Selo B, Mossoko M, et al. Projections of epidemic transmission and estimation of vaccination impact during an ongoing Ebola virus disease outbreak in Northeastern Democratic Republic of Congo, as of Feb. 25, 2019. PLoS Negl Trop Dis 2019 Aug 5;13(8):e0007512 [FREE Full text] [CrossRef] [Medline]
    49. Khomsi K, Najmi H, Amghar H, Chelhaoui Y, Souhaili Z. COVID-19 national lockdown in morocco: Impacts on air quality and public health. One Health 2021 Jun;11:100200 [FREE Full text] [CrossRef] [Medline]
    50. Borchers H. pracma: practical numerical math functions. CRAN R Project.   URL: https://CRAN.R-project.org/package=pracma [accessed 2022-03-08]
    51. Komsta L. mblm: median-based linear models. CRAN: R Project. 2019.   URL: https://CRAN.R-project.org/package=mblm [accessed 2022-03-08]
    52. Koller M. robustlmm: an R package for robust estimation of linear mixed-effects models. J Stat Soft 2016;75(6):1-24. [CrossRef]
    53. Fisher N. Statistical analysis of circular data. Cambridge: Cambridge University Press; 1993.
    54. Percival D, Walden A. Wavelet methods for time series analysis. Cambridge: Cambridge University Press; 2000.
    55. Roesch A, Schmidbauer H. WaveletComp: Computational Wavelet Analysis. CRAN: R Project. 2018.   URL: https://CRAN.R-project.org/package=WaveletComp [accessed 2022-03-08]
    56. Lavista Ferres JM, Meirick T, Lomazow W, Lee C, Lee A, Lee M. Association of public health measures during the COVID-19 pandemic with the incidence of infectious conjunctivitis. JAMA Ophthalmol 2022 Jan 01;140(1):43-49. [CrossRef] [Medline]
    57. Fricke LM, Glöckner S, Dreier M, Lange B. Impact of non-pharmaceutical interventions targeted at COVID-19 pandemic on influenza burden - a systematic review. J Infect 2021 Jan;82(1):1-35 [FREE Full text] [CrossRef] [Medline]
    58. Ullah MA, Moin AT, Araf Y, Bhuiyan AR, Griffiths MD, Gozal D. Potential effects of the COVID-19 pandemic on future birth rate. Front Public Health 2020 Dec 10;8:578438. [CrossRef] [Medline]
    59. Harper S. The impact of the Covid-19 pandemic on global population ageing. J Popul Ageing 2021 May 22;14(2):137-142 [FREE Full text] [CrossRef] [Medline]
    60. Yen M, Wu TJ, Chiu AW, Wong W, Wang P, Chan T, et al. Taipei's use of a multi-channel mass risk communication program to rapidly reverse an epidemic of highly communicable disease. PLoS One 2009 Nov 23;4(11):e7962 [FREE Full text] [CrossRef] [Medline]

    ‎
    API: application programming interface
    AtM: amplitude-to-mean ratio
    NIH-NEI: National Institutes of Health National Eye Institute
    STD: sexually transmitted disease

    Edited by T Mackey; submitted 02.07.21; peer-reviewed by A Mavragani, J Trevino; comments to author 09.10.21; revised version received 26.01.22; accepted 16.02.22; published 16.03.22

    Copyright

    ©Michael S Deiner, Gerami D Seitzman, Gurbani Kaur, Stephen D McLeod, James Chodosh, Thomas M Lietman, Travis C Porco. Originally published in JMIR Infodemiology (https://infodemiology.jmir.org), 16.03.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Infodemiology, is properly cited. The complete bibliographic information, a link to the original publication on https://infodemiology.jmir.org/, as well as this copyright and license information must be included.