This paper is in the following e-collection/theme issue:

Misinformation and Disinformation Outbreaks and Information Prevalence Studies (47) Information Quality in Digital Media (347) Quality/Credibility of eHealth Information and Trust Issues (544) Infodemiology and Infoveillance (1369) Infoveillance, Infodemiology, Digital Disease Surveillance, Infodemic Management (1050) Information Retrieval (296) Information Seeking, Information Needs (481)

Published on in Vol 3 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/43001, first published .
The Quality, Readability, and Accuracy of the Information on Google About Cannabis and Driving: Quantitative Content Analysis

The Quality, Readability, and Accuracy of the Information on Google About Cannabis and Driving: Quantitative Content Analysis

The Quality, Readability, and Accuracy of the Information on Google About Cannabis and Driving: Quantitative Content Analysis

Authors of this article:

Maria Josey1 Author Orcid Image ;   Dina Gaid1 Author Orcid Image ;   Lisa D Bishop1 Author Orcid Image ;   Michael Blackwood1 Author Orcid Image ;   Maisam Najafizada1 Author Orcid Image ;   Jennifer R Donnan1 Author Orcid Image
Article Authors Cited by (1) Tweetations (2) Metrics

    Original Paper

    School of Pharmacy, Memorial University of Newfoundland, St. John's, NL, Canada

    Corresponding Author:

    Jennifer R Donnan, PhD, MBA

    School of Pharmacy, Memorial University of Newfoundland

    300 Prince Philip Drive

    St. John's, NL, A1B 3V6

    Canada

    Phone: 1 709 864 3587

    Email: jennifer.donnan@mun.ca


    Background: The public perception of driving under the influence of cannabis (DUIC) is not consistent with current evidence. The internet is an influential source of information available for people to find information about cannabis.

    Objective: The purpose of this study was to assess the quality, readability, and accuracy of the information about DUIC found on the internet using the Google Canada search engine.

    Methods: A quantitative content analysis of the top Google search web pages was conducted to analyze the information available to the public about DUIC. Google searches were performed using keywords, and the first 20 pages were selected. Web pages or web-based resources were eligible if they had text on cannabis and driving in English. We assessed (1) the quality of information using the Quality Evaluation Scoring Tool (QUEST) and the presence of the Health on the Net (HON) code; (2) the readability of information using the Gunning Fox Index (GFI), Flesch Reading Ease Scale (FRES), Flesch-Kincaid Grade Level (FKGL), and Simple Measure of Gobbledygook (SMOG) scores; and (3) the accuracy of information pertaining to the effects of cannabis consumption, prevalence of DUIC, DUIC effects on driving ability, risk of collision, and detection by law enforcement using an adapted version of the 5Cs website evaluation tool.

    Results: A total of 82 web pages were included in the data analysis. The average QUEST score was 17.4 (SD 5.6) out of 28. The average readability scores were 9.7 (SD 2.3) for FKGL, 11.4 (SD 2.9) for GFI, 12.2 (SD 1.9) for SMOG index, and 49.9 (SD 12.3) for FRES. The readability scores demonstrated that 8 (9.8%) to 16 (19.5%) web pages were considered readable by the public. The accuracy results showed that of the web pages that presented information on each key topic, 96% (22/23) of them were accurate about the effects of cannabis consumption; 97% (30/31) were accurate about the prevalence of DUIC; 92% (49/53) were accurate about the DUIC effects on driving ability; 80% (41/51) were accurate about the risk of collision; and 71% (35/49) were accurate about detection by law enforcement.

    Conclusions: Health organizations should consider health literacy of the public when creating content to help prevent misinterpretation and perpetuate prevailing misperceptions surrounding DUIC. Delivering high quality, readable, and accurate information in a way that is comprehensible to the public is needed to support informed decision-making.

    JMIR Infodemiology 2023;3:e43001

    doi:10.2196/43001

    Keywords

    cannabis; driving; quality; readability; accuracy; public education; internet; Google search; analysis; accessibility; information; evaluation; tool; data; misinterpretation 


    In October 2018, the use of nonmedical cannabis became legal in Canada [1]. By the end of 2020, approximately 20% of Canadians, aged 15 years and older, reported using cannabis over the previous 3 months [2]. Certain cannabis use behaviors can increase the risk of experiencing harmful effects [3], such as daily use of cannabis, using cannabis products with high tetrahydrocannabinol content, or driving under the influence of cannabis (DUIC) [4]. In Canada, approximately 1-2 out of every 5 cannabis consumers engage in some form of risky behaviors [3], with 4%-12% of all injuries and deaths from motor vehicle accidents being attributed to DUIC [5]. Additionally, 40% of participants in a Canada-wide survey reported riding with a cannabis-impaired driver within the past year [6].

    There are mixed perceptions among the general public regarding the true risks associated with cannabis use [7-9]. In particular, the mixed beliefs regarding the risks associated with DUIC are concerning given the potential impact on both the consumer and innocent members of the public. Recent literature reported that perception of risks associated with DUIC is low, with one study reporting that 28% of participants believed there was no increased risk of accidents [6]. Another study reported that of those who participated in DUIC, 43% believed it was not a risky behavior [10]. This highlights the need to ensure cannabis consumers have access to evidence-based information to support informed decision-making [7,11,12].

    Although information about cannabis can be retrieved from numerous sources, one study reported that 78% of participants relied on knowledge gained from their own personal experiences, while 39% obtained information from the internet [13]. Cannabis-related Google searches increased by 75% between 2004 and 2016 [14,15]; however, the trustworthiness of information retrieved on the internet is questionable. There have been studies that explored the quality of cannabis labels from products sold on the web [16], the accuracy of cannabis claims on common websites [17], and the quality of cannabis-related information in magazines and newspapers [18,19]. In general, these studies reported that the quality of cannabis-related information were very poor. Among studies that specifically looked at cannabis health claims on the internet, one found only 5% of claims on the health benefits of cannabis aligned with evidence [20]. Other studies reported that web-based information about cannabis use for pain was biased as sources often neglected to discuss potential risks [21] or were just unreliable [22]. This points to variable quality of cannabis-related information available on the internet [20,23-26].

    Web-based search trends related to health-related topics provide insight on the public perception or cannabis use, which also reflect the availability of public health resources [27]. Taking into consideration that searches related to cannabis increased by 75% on Google from 2004 to 2016 [14,15], high quality, easily accessible, evidence-based information is needed for individuals to make informed decisions about cannabis use behaviors [28], which is especially important given the prevalent misconceptions about DUIC. However, the quality, readability, and accuracy of information found through the Google search engine on DUIC are still unknown [6]. The purpose of this study was to assess the quality, readability, and accuracy of information about DUIC found on the internet through the Google search engine.


    Study Design

    A quantitative content analysis about DUIC was performed on public web pages using the Google Canada search engine.

    Eligibility Criteria

    To be included, the web page had to (1) have information related to cannabis and driving, (2) be available in English, (3) be accessible with no fee, (4) have text to analyze, and (5) be available at the time of analysis. Web pages were excluded if (1) the page became no longer available during analysis and (2) the web page only contained images.

    Data Collection

    Web pages were identified through the Google search engine. Google was chosen because it is the dominant search engine in Canada, holding 91.98% of market shares [29], and one study showed that 89.8% of people preferred using Google [30]. A private search through incognito mode was used to avoid the search history from biasing results. Six separate Google searches were performed using the terms outlined in Textbox 1, and the first 20 URLs were collected from each search. Neutral search terms were used to ensure the collected web pages were not biased in one direction. The first 20 URLs were collected, as most people consider no more than the first 20 web pages when performing an internet search [15,31]. For our study, one researcher (SS or MJ) extracted web page addresses with Google Chrome (version 99.0.4844.51) [32]. The search was first completed in October 2021 using the first 4 search terms and then repeated fully in April 2022 after 2 new search terms were added.

    Search terms used to collect web pages for analysis.

    Google search terms

    • Cannabis AND driving
    • Marijuana AND driving
    • Pot AND driving
    • Weed AND driving
    • Driving high
    • Driving stoned
    Textbox 1. Search terms used to collect web pages for analysis.

    Data Analysis

    Web pages were organized into categories based on categories used in similar studies that assessed the quality of health-related information on the internet [33]. These categories included digital media, commercial web pages, government organizations, health organizations, nonprofit foundations, peer-reviewed materials, and “other.”

    Outcome Measures

    Quality of Information

    The quality of the information was measured by 2 tools: the Health on the Net (HON) code and the Quality Evaluation Scoring Tool (QUEST).

    HON Code

    HON is a nonprofit foundation aimed to assess and evaluate the quality of web-based health information [34]. The HON certification is designed so that people of the general public can identify trustworthy sources of information [34] and has been used in previous research to evaluate health-related websites as a beneficial tool that shows the intent of a website to publish high-quality information [35-38].The HON code seeks to promote trustworthy health information for the benefit of internet users [39]. HON code is a voluntary certification used on health websites, indicating that their 8 principles were fulfilled. Those principles relate to the authority, complementarity, confidentiality, attribution, justifiability, transparency, financial disclosure, and advertisement policy of the website content [40]. This certification aims to certify websites that are reliable and of high quality, so it is an easy measure for the general public to quickly determine if the web page is a trustworthy source of health information.

    The QUEST Tool

    The QUEST tool serves as a standard for assessing the quality of web-based health information that does not rely on users’ subjective judgment [41]. The QUEST tool was chosen as it has been validated and assessed for reliability and provides a numeric score allowing for quantitative analysis [42]. The QUEST tool was validated for both treatment and preventative measures of web-based health care information [41] and has since been used in studies to evaluate web-based health care information on various topics, including papillomavirus and oropharyngeal cancer, COVID-19, and using electronic cigarettes [33,43,44]. Additionally, this tool is used for a broad range of health topics as opposed to more focused health topics (eg, treatment) [41]. The QUEST tool assesses 7 aspects of the website information and provides a weighted score out of 28 (Table 1) [41]. Three independent researchers collaborated to assess the quality of the web page, while each page was assessed by at least two researchers (SS, MJ, MB), and any discrepancies were discussed. For our study, if an organization took ownership over the text (rather than a specific author), we gave a score of 1, meaning “all other indications of authorship” on the QUEST tool scoring. Additionally, any language that promoted the sale of cannabis (eg, cannabis brand) or directed the reader to a specific location for purchase was given a score of 1 accordingly under the “Conflicts of Interest” section of the QUEST scoring tool. For example, any mention of a specific cannabis dispensary, even if indirectly mentioned through a picture identifying a dispensary, was considered an endorsement, and therefore, had the potential to be biased.

    Table 1. Description of the Quality Evaluation Scoring Tool (QUEST) criteria to evaluate the quality of web-based health information [41]. Scores in the individual sections are weighted and summed to generate a total score of up to 28. This tool is reproduced and distributed under the terms of the Creative Commons Attribution 4.0 International License [45].
    CharacteristicsScore
    AuthorshipScore x 1

    		0: No indication of authorship or username

    		1: All other indications of authorship

    		2: Author’s name and qualification clearly stated
    AttributionScore x 3

    		0: No sources

    		1: Mention of expert source, research, research findings (although with insufficient information to identify the specific studies), links to various sites, advocacy body, or other

    		2: Reference to at least one identifiable scientific study, regardless of format (eg, information in text or reference list)

    		3: Reference to mainly identifiable scientific studies, regardless of format (in >50% of claims)


    		Type of study (for all articles scoring 2 or 3 on “attribution”)Score x 1



    		0: In vitro, animal models, and editorials



    		1: All observational works



    		2: Meta-analyses, randomized controlled trials, and clinical studies
    Conflicts of interestScore x 3

    		0: Endorsement or promotion of intervention designed to prevent or treat condition (eg, supplements, brain training games, and foods) within the article

    		1: Endorsement or promotion of educational products and services (eg, book and care home services)

    		2: Unbiased information
    CurrencyScore x 1

    		0: No date present

    		1: Article is dated but is 5 years or older

    		2: Article is dated within the last 5 years
    ComplimentaryScore x 1

    		0: No support of the patient-physician relationship

    		1: Support of the patient-physician relationship
    Tone (includes title)Score x 3

    		0: Fully supported—authors fully and unequivocally support the claims; strong vocabulary is used, such as “cure,” “guarantee,” and “easy”; use of nonconditional verb tenses mostly (eg, “can” and “will”); and no discussion of limitations

    		1: Mainly supported (authors mainly support their claims but with more cautious vocabulary, such as “can reduce your risk” or “may help prevent”, and no discussion of limitations)

    		2: Balanced or cautious support (authors’ claims are balanced by caution and include statements of limitations and contrasting findings)
    Readability

    Web page content was assessed for readability by the general public using 4 different scales, including Gunning Fox Index (GFI), Flesch Reading Ease Scale (FRES), Flesh-Kincaid Grade Level (FKGL), and the Simple Measure of Gobbledygook (SMOG) scale (Table 2). There are many scales to measure the readability of information [46], but there is no universally accepted measurement of readability. Therefore, the combination of these 4 readability scores (ie, GFI, FRES, FKGL, and SMOG) has been used together to measure the readability of health information [33,47] in this study. Each web page URL was submitted to the Readable [48] web-based scoring tool by one researcher (DG). If the URL was directed to a PDF, the text was manually entered into the web-based generator by copying and pasting the titles and content. Text were excluded from the analysis if they were advertisements, hyperlinks, author names, or references, as these could bias the results [47]. The scores were compared to a value unique to each readability tool that indicated the content was universally readable.

    Table 2. Tools used to measure readability, their range of scores, the score correlated to text that is readable by the general public, and the formula used to calculate the score.
    Readability toolRangeReadable by the general publicFormula
    GFIa0-20<8 [49]
    FRESb0-100>60 [47]
    FKGLc0-18<8 [47,50]
    SMOGd—e<10 [47]

    aGFI: Gunning Fox Index.

    bFRES: Flesch Reading Ease Scale.

    cFKGL: Flesch-Kincaid Grade Level.

    dSMOG: Simple Measure of Gobbledygook.

    eNot applicable.

    Accuracy

    The 5Cs Website Evaluation Tool is a structured tool that evaluates websites using 36 questions, grouped into the following 5 accuracy criteria: credibility, currency, content, construction, and clarity [51]. Since the construction, credibility, currency, and content of websites included in this study were assessed with the quality and readability tools, we only applied the content criteria.

    The tool asks if the information on the website is evidence based and represents information from published journals and books [51]. To complete this assessment, current evidence from peer-reviewed journals was gathered, as they pertain to 5 key topics related to cannabis and driving (Multimedia Appendix 1). These topics include (1) the effects of cannabis consumption, (2) the prevalence of DUIC, (3) the effects of cannabis on driving performance, (4) risk of collision after using cannabis, and (5) the detection of cannabis-impaired drivers by law enforcement.

    Each web page was assessed for the content across the 5 key categories. For each topic, the web page content was rated as accurate, not accurate, mixed accuracy (ie, some statements were accurate and some were not, or information was not aligning with the literature), or information not present. Each web page was rated independently by 2 researchers (MJ and DG); discrepancies were discussed and resolved. Web pages categorized as peer-reviewed (ie, peer-reviewed journal articles) were not included in the accuracy analysis, as peer-reviewed literature was used to create the evidence-based summary used in the content assessment. This approach has been used by others conducting similar content analyses [21].

    Statistical Analysis

    Descriptive statistics was performed with the mean (μ), standard deviation (σ), and total sample size (n) being reported for the average QUEST score of all web pages and by category. To assess correlations between QUEST scores and readability scores (ie, GFI, FRES, FKGL, and SMOG), a Pearson 2-tailed test was performed [33]. To assess the QUEST score for the presence of the HON code, an unpaired 1-tailed t test was performed, testing if the HON code was present on web pages with higher QUEST scores [33].

    Ethics Approval

    This study was exempted from ethical approval because it does not involve human participants.


    Overview

    A total of 120 web pages were identified for analysis (Multimedia Appendix 2). Of the 120 web pages, 34 were removed as duplicate web pages, and 4 were removed as they did not meet the eligibility criteria, leaving 82 web pages included in the study (Figure 1). Of these, 40% (33/82) of web pages were categorized as digital media, 20% (16/82) as commercial web pages, 13% (11/82) as government organizations, 12% (10/82) as health organizations, 10% (8/82) as nonprofit foundations, 4% (3/82) as peer-reviewed content, and 1% (1/82) as “other.” Multimedia Appendix 3 presents the web pages included in the data analysis.

    ‎
    Figure 1. Included and excluded web pages for quantitative analysis of quality, readability, and accuracy. QUEST: quality evaluation scoring tool.

    Quality

    The range of the QUEST scores was between 7 and 27, with the average Quest score being 17.4 (SD 5.6) out of a total of 28 (Table 3). Average QUEST scores by category showed that the peer-reviewed category had the highest quality with a score of 26.3 out of 28, and government web pages scored the lowest at 10.0/28.

    The HON code was only present on 4 (5%) web pages, and they were found in the categories labelled as commercial (n=2), nonprofit (n=1), or health organization (n=1). There was no significant difference (P=.2) between the presence of a HON code on a website and the QUEST score without a HON code. Multimedia Appendix 4 presents the data from the full quality evaluation for each web page.

    Table 3. Quality Evaluation Scoring Tool (QUEST) scores by category.
    CategoryQUEST score

    		Mean (μ)SD (σ)Total, n
    Peer-reviewed content26.30.63
    Health organizations20.55.610
    OtherN/AaN/A1
    Digital media19.53.533
    Commercial15.76.016
    Nonprofit foundations14.94.28
    Government10.02.511
    Total18.15.682

    aN/A: not applicable.

    Readability

    The average readability scores were 9.7 (SD 2.3) for FKGL, 11.4 (SD 2.8) for GFI, 12.2 (SD 1.9) for SMOG index, and 49.9 (SD 12.3) for FRES. Assessing the readability scores for all web pages in relation to the universal readability score, 19.5% (16/82) of the web pages were universally readable by the FKGL score (score <8 considered universally readable), 16% (13/82) by the FRES score (score >60 considered universally readable), 11.1% (9/82) by the SMOG index (score <10 considered universally readable), and 9.8% (8/82) by the GFI score (score <8 considered universally readable). None of the web pages in the peer-reviewed or other categories were considered universally readable by any readability scoring tool (Table 4). Multimedia Appendix 5 presents the readability scores for each web page.

    Table 4. Web pages by category that were considered universally readable.
    CategoryWeb pages, n (%)
    FKGLaGFIbSMOGcFRESd
    Commercial (n=16)3 (19)2 (13)1 (6)4 (25)
    Digital media (n=33)4 (12)2 (6)3 (9)3 (9)
    Government (n=11)4 (36)3 (27)3 (27)4 (36)
    Other (n=1)0 (0)0 (0)0 (0)0 (0)
    Nonprofit foundations (n=8)2 (25)0 (0)1 (13)1 (13)
    Peer-reviewed material (n=3)0 (0)0 (0)0 (0)0 (0)
    Health organization (n=10)3 (30)1 (10)1 (10)1 (10)

    aFKGL: Flesh-Kincaid Grade Level.

    bGFI: Gunning Fox Index.

    cSMOG: Simple Measure of Gobbledygook.

    dFRES: Flesch Reading Ease Scale.

    Correlation Between Quality and Readability

    A Pearson 2-tailed test showed a significant positive correlation between the QUEST score and the FKGL (r=0.41; P<.001), GFI (r=0.28; P=.01), and SMOG (r=0.34; P=.002) readability scores. A negative correlation was found between the QUEST score and the FRES score (r=–0.40; P<.001).

    Accuracy

    Of the 79 web pages that were eligible to be reviewed for accuracy, 23 web pages discussed information related to the timing of the effects from cannabis consumption; 31 web pages were related to the prevalence of DUIC; 53 were related to the effects of cannabis impairment on driving ability; 51 were related to the risk of collision; and 49 had information related to detection by law (Figure 2). From those, 96% (22/23) had accurate information on the effects from cannabis consumption; 97% (30/31) of the web pages had accurate information about the prevalence of DUIC; 92% (49/53) of the web pages presented accurate information on the effects of cannabis impairment on driving ability; 80% (41/51) of the web pages had accurate information on the risk of collision; and 71% (35/49) of the web pages presented accurate information on detection by law. Sample excerpts from web pages and accuracy categorization are included in Multimedia Appendix 6.

    ‎
    Figure 2. Accuracy ratings of web page content. Content accuracy of the 5 key topics about driving under the influence of cannabis are represented with colors.

    Principal Findings

    This study assessed the quality, readability, and accuracy of information about DUIC found on the internet using the Google search engine. Our findings showed that peer-reviewed papers had the highest quality of information; however, these web pages were not considered universally readable. The difficulty with comprehension may lead to misinterpretation and inaccurate expectations [52,53].

    Surprisingly, our research indicated that government web pages were rated as having the lowest quality, contrary to the general perception that government sources would contain high-quality information. This low rating was likely attributed to the tone of the presented text, given much of the information on government websites was one-sided, used strong words such as “will,” and did not discuss limitations of the information presented. This low quality could be due to the fact that government websites often presented information on laws and regulations and did not provide references to other information. This is unfortunate, as government web pages are typically viewed as an accurate source of information as indicated by various academic guides for evaluating information sources [54,55].

    Readability for the public was problematic for most pages, with less than 20% of all web pages considered readable based on the FKGL, GFI, SMOG, and FRES readability tools. The majority of the content was written at a higher level of reading, which would often be used in academic settings or postsecondary education. The paucity of web pages written at levels that were considered universally readable was consistent with other health information topics on the internet (eg, general surgical procedures [56] and total joint arthroplasty [57]), suggesting that this could be a wider issue than solely information on cannabis [33,47,58]. Kruger et al [58] also suggests that significant efforts are still needed to provide accurate cannabis-related information on the internet for the health and safety of individuals and society [58].

    The readability could be contributing to the misperceptions and behaviors; however, further studies assessing the interpretation of high-quality information with low readability scores could be beneficial. Associations and health advocacy groups should consider the health literacy of the public [59] when creating content to educate the public on DUIC. In addition, a more active form of education for the public could be beneficial as opposed to the passive information presented on a web page.

    Our research shows that 80% of the information available about DUIC and its risks for accidents was accurate. However, although most information on DUIC was accurate, it was the lack of complete information that was most concerning. Of the 79 web pages that were analyzed for information about DUIC, 48% (n=38) either had no information on the risk of collision or had mixed or inaccurate information. Misperceptions surrounding cannabis particularly do not recognize the increased risk of accidents associated with DUIC, which highlights the need for comprehensive and accurate information [6,10], as many people turn to the internet to find information about cannabis [8,60] and about health in general [61].

    Contrary to our finding that many web pages generally presented accurate information regarding DUIC, Lau et al [20] found that around 80% of the internet claims were inaccurate when investigating the information related to cannabis health benefits. This may suggest that the evidence regarding DUIC is less debated compared to suggested health benefits of cannabis; still, DUIC behaviors persist despite the presence of easily accessible accurate information [5,6]. Studies have shown that both adolescents and adults have a low risk perception of cannabis [62] and feel they are in control of their driving after cannabis consumption [63]. This is problematic given the evidence that cannabis can significantly impair motor coordination, judgment, and reaction time [64,65], increasing the risk of motor vehicle accidents [66].

    Limitations

    This study has a number of limitations. Although we have used what appears to be the most appropriate tools to evaluate web page information, there are no best practices for conducting this type of research. Second, the QUEST tool does not have a target quality score or a threshold of acceptable quality, and therefore, we can only make relative comparisons with the web pages included in this study. Finally, we made the assumption that peer-reviewed content was accurate and excluded those sites from the accuracy assessment. However, there is no guarantee that all peer-reviewed materials are fully accurate. Fortunately, only 3 web pages fell into this category, so this would have minimal impact on the overall analysis.

    Conclusions

    Most of the identified web pages on Google Canada search engine provided accurate information about DUIC; however, the information was incomplete, the readability was generally low, and the quality of information varied depending on the source. Health organizations should consider health literacy of the public when creating content to help prevent misinterpretation and perpetuate prevailing misperceptions surrounding DUIC. Delivering high-quality, readable, and accurate information in a way that is comprehensible to the public is needed to support informed decision-making.

    Acknowledgments

    Sandra Schuhmacher, BSc, PharmD Student, has applied the search strategy and extracted the Health on the Net (HON) code for each web page. The authors received financial support for conduct of the research from Canadian Institutes of Health Research (Grant No. RN407334 - 429120) and the Canadian Centre of Substance Use and Addiction for the Partnerships for Cannabis Policy (Grant No. RN407334 - 429120) inclusive of this research.

    Authors' Contributions

    All authors have contributed to the design of this study. MJ carried out the search strategy; MJ and MB applied the QUEST tool. DG rated the readability for the web pages. MJ and DG assessed the accuracy of the web pages. All authors contributed to the analysis of the findings. MJ wrote the initial manuscript, and DG helped to draft the manuscript. JD, LDB, and MN conceptualized the research, reviewed discrepancies, developed the accuracy tool, and reviewed the manuscript. All authors read and approved the final manuscript.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Supplementary material.

    PDF File (Adobe PDF File), 158 KB
    ‎
    Multimedia Appendix 2

    Web pages collected form each Google page.

    PDF File (Adobe PDF File), 152 KB
    ‎
    Multimedia Appendix 3

    Web pages included in the data analysis.

    PDF File (Adobe PDF File), 137 KB
    ‎
    Multimedia Appendix 4

    The quality assessment of the included web pages.

    PDF File (Adobe PDF File), 264 KB
    ‎
    Multimedia Appendix 5

    The readability scores of the included web pages.

    PDF File (Adobe PDF File), 104 KB
    ‎
    Multimedia Appendix 6

    Examples of quotations used for the accuracy assessment.

    PDF File (Adobe PDF File), 95 KB
    1. Taking stock of progress: cannabis legalization and regulation in Canada. Government of Canada. 2022.   URL: https://tinyurl.com/bdfnn6kv [accessed 2023-02-03]
    2. Rotermann M. Health report - Looking back from 2020, how cannabis use and related behaviours changed in Canada. Statistics Canada. 2021 Apr 21.   URL: https://www150.statcan.gc.ca/n1/pub/82-003-x/2021004/article/00001-eng.htm [accessed 2021-07-30]
    3. Lee C, Lee A, Goodman S, Hammond D, Fischer B. The Lower-Risk Cannabis Use Guidelines' (LRCUG) recommendations: how are Canadian cannabis users complying? Prev Med Rep 2020 Dec;20:101187 [FREE Full text] [CrossRef] [Medline]
    4. Fischer B, Russell C, Sabioni P, van den Brink W, Le Foll B, Hall W, et al. Lower-risk cannabis use guidelines: a comprehensive update of evidence and recommendations. Am J Public Health 2017 Aug;107(8):e1-e12 [FREE Full text] [CrossRef] [Medline]
    5. Fischer B, Imtiaz S, Rudzinski K, Rehm J. Crude estimates of cannabis-attributable mortality and morbidity in Canada-implications for public health focused intervention priorities. J Public Health (Oxf) 2016 Mar 28;38(1):183-188 [FREE Full text] [CrossRef] [Medline]
    6. Erin Goodman S, Leos-Toro C, Hammond D. Risk perceptions of cannabis- vs. alcohol-impaired driving among Canadian young people. Drugs (Abingdon Engl) 2019 May 16;27(3):205-212. [CrossRef]
    7. Turna J, Balodis I, Van Ameringen M, Busse JW, MacKillop J. Attitudes and beliefs toward cannabis before recreational legalization: a cross-sectional study of community adults in Ontario. Cannabis Cannabinoid Res 2022 Aug 01;7(4):526-536. [CrossRef] [Medline]
    8. Kruger DJ, Kruger JS, Collins RL. Cannabis enthusiasts' knowledge of medical treatment effectiveness and increased risks from cannabis use. Am J Health Promot 2020 May 09;34(4):436-439. [CrossRef] [Medline]
    9. Choi NG, DiNitto DM, Marti CN. Older marijuana users’ marijuana risk perceptions: associations with marijuana use patterns and marijuana and other substance use disorders. Cambridge University Press. 2017.   URL: https://tinyurl.com/2dwsysh8 [accessed 2023-02-03]
    10. McDonald A, Hamilton H, Wickens C, Watson T, Elton-Marshall T, Wardell J, et al. Driving under the influence of cannabis risk perceptions and behaviour: a population-based study in Ontario, Canada. Prev Med 2021 Dec;153:106793 [FREE Full text] [CrossRef] [Medline]
    11. Kosa K, Giombi K, Rains C, Cates S. Consumer use and understanding of labelling information on edible marijuana products sold for recreational use in the states of Colorado and Washington. Int J Drug Policy 2017 May;43:57-66 [FREE Full text] [CrossRef] [Medline]
    12. Hammond D. Communicating THC levels and 'dose' to consumers: Implications for product labelling and packaging of cannabis products in regulated markets. Int J Drug Policy 2021 May;91:102509 [FREE Full text] [CrossRef] [Medline]
    13. Kruger JS, Kruger D, Collins RL. Knowledge and practice of harm reduction strategies among people who report frequent cannabis use. Health Promot Pract 2021 Jan 22;22(1):24-30. [CrossRef] [Medline]
    14. Lubin G. Americans are searching for weed more than ever, according to Google. Business Insider. 2016.   URL: https://tinyurl.com/ycr2znh6 [accessed 2023-02-03]
    15. Morahan-Martin JM. How internet users find, evaluate, and use online health information: a cross-cultural review. Cyberpsychol Behav 2004 Oct;7(5):497-510. [CrossRef] [Medline]
    16. Bonn-Miller MO, Loflin MJE, Thomas BF, Marcu JP, Hyke T, Vandrey R. Labeling accuracy of cannabidiol extracts sold online. JAMA 2017 Nov 07;318(17):1708-1709 [FREE Full text] [CrossRef] [Medline]
    17. Boatwright KD, Sperry ML. Accuracy of medical marijuana claims made by popular websites. J Pharm Pract 2020 Aug 30;33(4):457-464. [CrossRef] [Medline]
    18. Montané E, Duran M, Capellà D, Figueras A. Scientific drug information in newspapers: sensationalism and low quality. The example of therapeutic use of cannabinoids. Eur J Clin Pharmacol 2005 Jul 28;61(5-6):475-477. [CrossRef] [Medline]
    19. Halvorson RT, Stewart CC, Thakur A, Glantz SA. Scientific quality of health-related articles in specialty cannabis and general newspapers in San Francisco. J Health Commun 2018 Oct 25;23(12):993-998 [FREE Full text] [CrossRef] [Medline]
    20. Lau N, Gerson M, Korenstein D, Keyhani S. Internet claims on the health benefits of cannabis use. J Gen Intern Med 2021 Nov 19;36(11):3611-3614 [FREE Full text] [CrossRef] [Medline]
    21. Ng JY, Dzisiak DA, Saini JB. Cannabis for pain: a cross-sectional survey of the patient information quality on the Internet. J Cannabis Res 2021 Aug 16;3(1):36 [FREE Full text] [CrossRef] [Medline]
    22. Premkumar A, Almeida BA, Lopez J, Pean CA, Nwachukwu BU, Sculco PK. The quality of online resources available to patients regarding cannabidiol for symptomatic relief of hip or knee arthritis is poor. J Am Acad Orthop Surg Glob Res Rev 2021 Jan 22;5(1):1-7 [FREE Full text] [CrossRef] [Medline]
    23. Lamy F, Daniulaityte R, Zatreh M, Nahhas R, Sheth A, Martins S, et al. "You got to love rosin: Solventless dabs, pure, clean, natural medicine." Exploring Twitter data on emerging trends in Rosin Tech marijuana concentrates. Drug Alcohol Depend 2018 Mar 01;183:248-252 [FREE Full text] [CrossRef] [Medline]
    24. Merten JW, Gordon BT, King JL, Pappas C. Cannabidiol (CBD): perspectives from Pinterest. Subst Use Misuse 2020 Jul 25;55(13):2213-2220. [CrossRef] [Medline]
    25. Ramo D, Popova L, Grana R, Zhao S, Chavez K. Cannabis mobile apps: a content analysis. JMIR Mhealth Uhealth 2015 Aug 12;3(3):e81 [FREE Full text] [CrossRef] [Medline]
    26. Ouellette L, Cearley M, Judge B, Riley B, Jones J. Cooking with cannabis: The rapid spread of (mis)information on YouTube. Am J Emerg Med 2018 Jul;36(7):1300-1301. [CrossRef] [Medline]
    27. Edberg M. Essential Readings in Health Behavior: Theory and Practice. Sudbury, MA: Jones & Bartlett Learning; 2010:321.
    28. Swift W, Copeland J, Lenton S. Cannabis and harm reduction. Drug Alcohol Rev Internet 2000;19(1):101-112 [FREE Full text] [CrossRef]
    29. Search engine market share Canada. Statcounter.   URL: https://gs.statcounter.com/search-engine-market-share/all/canada [accessed 2021-07-18]
    30. Schultheiß S, Lewandowski D. Misplaced trust? The relationship between trust, ability to identify commercially influenced results and search engine preference. J Inf Sci 2021 May 14. [CrossRef]
    31. King A. Website Optimization. Sebastopol, CA: O'Reilly Media Inc; Jul 2008.
    32. Google.   URL: https://www.google.ca/ [accessed 2023-03-30]
    33. Schwarzbach HL, Mady LJ, Kaffenberger TM, Duvvuri U, Jabbour N. Quality and readability assessment of websites on human papillomavirus and oropharyngeal cancer. Laryngoscope 2021 Jan 13;131(1):87-94. [CrossRef] [Medline]
    34. Safdari R, Gholamzadeh M, Saeedi S, Tanhapour M, Rezayi S. An evaluation of the quality of COVID-19 websites in terms of HON principles and using DISCERN tool. Health Info Libr J 2022 Aug 10 [FREE Full text] [CrossRef] [Medline]
    35. St John A, Carlisle K, Kligman M, Kavic SM. What's Nissen on the net? the quality of information regarding Nissen fundoplication on the internet. Surg Endosc 2022 Jul 29;36(7):5198-5206. [CrossRef] [Medline]
    36. Flint M, Inglis G, Hill A, Mair M, Hatrick S, Tacchi MJ, et al. A comparative study of strategies for identifying credible sources of mental health information online: Can clinical services deliver a youth-specific internet prescription? Early Interv Psychiatry 2022 Jun 02;16(6):643-650. [CrossRef] [Medline]
    37. Jasem Z, AlMeraj Z, Alhuwail D. Evaluating breast cancer websites targeting Arabic speakers: empirical investigation of popularity, availability, accessibility, readability, and quality. BMC Med Inform Decis Mak 2022 May 09;22(1):126 [FREE Full text] [CrossRef] [Medline]
    38. Smekal M, Gil S, Donald M, Beanlands H, Straus S, Herrington G, et al. Content and quality of websites for patients with chronic kidney disease: an environmental scan. Can J Kidney Health Dis 2019 Jul 30;6:2054358119863091 [FREE Full text] [CrossRef] [Medline]
    39. Boyer C, Baujard V, Geissbuhler A. Evolution of health web certification through the HONcode experience. Stud Health Technol Inform 2011;169:53-57 [FREE Full text] [CrossRef]
    40. HONcode certification. Health On the Net.   URL: https://www.hon.ch/en/certification.html [accessed 2023-02-03]
    41. Robillard JM, Jun JH, Lai J, Feng TL. The QUEST for quality online health information: validation of a short quantitative tool. BMC Med Inform Decis Mak 2018 Oct 19;18(1):87 [FREE Full text] [CrossRef] [Medline]
    42. Lenaerts G, Bekkering G, Goossens M, De Coninck L, Delvaux N, Cordyn S, et al. Tools to assess the trustworthiness of evidence-based point-of-care information for health care professionals: systematic review. J Med Internet Res 2020 Jan 17;22(1):e15415 [FREE Full text] [CrossRef] [Medline]
    43. Chen T, Gentry S, Qiu D, Deng Y, Notley C, Cheng G, et al. Online information on electronic cigarettes: comparative study of relevant websites from Baidu and google search engines. J Med Internet Res 2020 Jan 24;22(1):e14725 [FREE Full text] [CrossRef] [Medline]
    44. Bachu V, Mahjoub H, Holler A, Crihalmeanu T, Bachu D, Ayyaswami V, et al. Assessing COVID-19 health information on Google using the Quality Evaluation Scoring Tool (QUEST): cross-sectional and readability analysis. JMIR Form Res 2022 Mar 11;6(2):e32443 [FREE Full text] [CrossRef] [Medline]
    45. Attribution 4.0 International (CC BY 4.0). Creative Commons.   URL: https://creativecommons.org/licenses/by/4.0/ [accessed 2023-04-25]
    46. Readability Formulas.   URL: https://readabilityformulas.com/ [accessed 2023-02-03]
    47. Worrall AP, Connolly MJ, O'Neill A, O'Doherty M, Thornton KP, McNally C, et al. Readability of online COVID-19 health information: a comparison between four English speaking countries. BMC Public Health 2020 Nov 13;20(1):1635 [FREE Full text] [CrossRef] [Medline]
    48. Readable.   URL: https://app.readable.com/text/ [accessed 2023-02-03]
    49. The Gunning Fog Index. Readable.   URL: https://readable.com/readability/gunning-fog-index/ [accessed 2023-02-03]
    50. Flesch Reading Ease and the Flesch Kincaid Grade Level. Readable.   URL: https://readable.com/readability/flesch-reading-ease-flesch-kincaid-grade-level/ [accessed 2022-02-03]
    51. Roberts L. Health information and the Internet: The 5 Cs website evaluation tool. Br J Nurs 2010 Mar 12;19(5):322-325. [CrossRef] [Medline]
    52. Alshaikh L, Shimozono Y, Dankert JF, Ubillus H, Kennedy JG. Evaluation of the quality and readability of online sources on the diagnosis and management of osteochondral lesions of the ankle. Cartilage 2021 Dec 10;13(1_suppl):1422S-1428S [FREE Full text] [CrossRef] [Medline]
    53. Hungerford D. Internet access produces misinformed patients: managing the confusion. Orthopedics 2009 Oct;32(9):658-660 [FREE Full text] [CrossRef] [Medline]
    54. Government information: evaluating sources/how to read a scholarly article. LibGuides: Wells College.   URL: https://libguides.wells.edu/c.php?g=239219&p=1590822 [accessed 2023-02-03]
    55. Using sources: evaluating sources and avoiding plagiarism. LibGuides: Northern Virginia Community College.   URL: https://libguides.nvcc.edu/c.php?g=361391&p=2440252 [accessed 2023-02-03]
    56. Ramli R, Jambor MA, Kong CY. Dr Google - assessing the reliability and readability of information on general surgical procedures found via search engines. ANZ J Surg 2023 Mar 30;93(3):590-596. [CrossRef] [Medline]
    57. Karimi A, Shah A, Hecht C, Burkhart R, Acuña AJ, Kamath A. Readability of online patient education materials for total joint arthroplasty: a systematic review. J Arthroplasty 2023 Jan 27:A [FREE Full text] [CrossRef] [Medline]
    58. Kruger DJ, Moffet IM, Seluk LC, Zammit LA. A content analysis of internet information sources on medical cannabis. J Cannabis Res 2020 Sep 18;2(1):29 [FREE Full text] [CrossRef] [Medline]
    59. Gordon N, Crouch E. Digital information technology use and patient preferences for internet-based health education modalities: cross-sectional survey study of middle-aged and older adults with chronic health conditions. JMIR Aging 2019 Apr 04;2(1):e12243 [FREE Full text] [CrossRef] [Medline]
    60. Ishida JH, Zhang AJ, Steigerwald S, Cohen BE, Vali M, Keyhani S. Sources of information and beliefs about the health effects of marijuana. J Gen Intern Med 2020 Jan 21;35(1):153-159 [FREE Full text] [CrossRef] [Medline]
    61. AlGhamdi K, Moussa N. Internet use by the public to search for health-related information. Int J Med Inform 2012 Jun;81(6):363-373 [FREE Full text] [CrossRef] [Medline]
    62. Azofeifa A, Mattson M, Schauer G, McAfee T, Grant A, Lyerla R. National estimates of marijuana use and related indicators - national survey on drug use and health, United States, 2002-2014. MMWR Surveill Summ 2016 Oct 02;65(11):1-28 [FREE Full text] [CrossRef] [Medline]
    63. Berg CJ, Daniel CN, Vu M, Li J, Martin K, Le L. Marijuana use and driving under the influence among young adults: a socioecological perspective on risk factors. Subst Use Misuse 2018 Mar 23;53(3):370-380 [FREE Full text] [CrossRef] [Medline]
    64. Lenné MG, Dietze P, Triggs T, Walmsley S, Murphy B, Redman J. The effects of cannabis and alcohol on simulated arterial driving: Influences of driving experience and task demand. Accid Anal Prev 2010 May;42(3):859-866 [FREE Full text] [CrossRef] [Medline]
    65. Hartman R, Huestis M. Cannabis effects on driving skills. Clin Chem 2013 Mar;59(3):478-492 [FREE Full text] [CrossRef] [Medline]
    66. Li M, Brady JE, DiMaggio CJ, Lusardi AR, Tzong KY, Li G. Marijuana use and motor vehicle crashes. Epidemiol Rev 2012 Oct 04;34(1):65-72 [FREE Full text] [CrossRef] [Medline]

    ‎
    DUIC: driving under the influence of cannabis
    FKGL: Flesch-Kincaid Grade Level
    FRES: Flesch Reading Ease Scale
    GFI: Gunning Fox Index
    HON: Health on the Net
    QUEST: quality evaluation scoring tool
    SMOG: Simple Measure of Gobbledygook

    Edited by C Baur; submitted 27.09.22; peer-reviewed by C Zelaya, F Lamy; comments to author 12.12.22; revised version received 06.02.23; accepted 25.03.23; published 02.05.23

    Copyright

    ©Maria Josey, Dina Gaid, Lisa D Bishop, Michael Blackwood, Maisam Najafizada, Jennifer R Donnan. Originally published in JMIR Infodemiology (https://infodemiology.jmir.org), 02.05.2023.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Infodemiology, is properly cited. The complete bibliographic information, a link to the original publication on https://infodemiology.jmir.org/, as well as this copyright and license information must be included.