Public perceptions of synthetic cooling agents in electronic cigarettes on Twitter
==================================================================================

* Andrew H. Liu
* Julia Hootman
* Dongmei Li
* Zidian Xie

## Abstract

Amid a potential menthol ban, electronic cigarette (e-cigarette) companies are incorporating synthetic cooling agents like WS-3 and WS-23 to replicate menthol/mint sensations. This study examines public views on synthetic cooling agents in e-cigarettes via Twitter data. From May 2021 to March 2023, we used Twitter Streaming API, to collect tweets related to synthetic cooling agents with keywords such as ‘WS-23,’ ’ice,’ and ’frozen.’ Two deep learning roBERTa models, classified attitudes expressed in tweets about synthetic cooling agents and identified e-cigarette users. The BERTopic deep-learning model identified major topics of positive and negative tweets. Two proportion Z-tests were used to compare the proportions of positive and negative attitudes between e-cigarette users (vapers) and non-e-cigarette-users (non-vapers). Of 6,940,065 e-cigarettes related tweets, 5,788 non-commercial tweets related to synthetic cooling agents. The longitudinal trend analysis showed a clear upwards trend in discussions. Vapers posted most of the tweets (73.05%, 4,228/5,788). Nearly half (47.87%, 2,771/5,788) held a positive attitude toward synthetic cooling agents, which is significantly higher than those with a negative attitude (19.92%,1,153/5,788) with a P-value < 0.0001. The likelihood of Vapers expressing positive attitudes (60.17%, 2,544/4,228) was significantly higher (*P* < 0.0001) than that from non-vapers (14.55%, 227/1,560). Conversely, negative attitudes from non-vapers (30%, 468/1,560) was significantly (*P* < 0.0001) higher than vapers (16.2%, 685/4,228). Prevalent topics from positive tweets included “enjoyment of specific vape flavors,” “preference for lush ice vapes,” and “liking of minty/icy feelings.” Major topics from negative tweets included “disliking certain vape flavors” and “dislike of others vaping around them.” On Twitter, vapers are more likely to have a positive attitude toward synthetic cooling agents than non-vapers. Our study provides important insights into how the public perceives synthetic cooling agents in e-cigarettes, insights that are crucial for shaping future FDA regulations aimed at safeguarding public health.

## Introduction

Electronic cigarettes (e-cigarettes) are devices used to aerosolize a solution typically containing propylene glycol, vegetable glycerin, flavorings, and in most cases, nicotine for inhalation by consumers [1–2]. The prevalence of e-cigarette use has risen exponentially in the last decade, especially in youth and young adults [3, 4]. E-cigarettes have become the most frequently used tobacco product among high school students with an estimated 3.6 million middle and high school students reporting current e-cigarette use in 2022 [5]. Toxicity and health impact studies of e-cigarettes have shown that components in e-cigarette aerosols could lead to severe adverse health problems, including respiratory disorders, cardiovascular diseases, mental health issues, and possibly cancer [6–9]. In February 2020, the FDA issued a policy to limit the sale of cartridge-based e-cigarette products to only tobacco and menthol flavored e-cigarettes [10]. Following the announcement and implementation of the FDA’s flavor enforcement policy, there was a significant increase in the sales of menthol-flavored e-cigarettes [11]. As menthol-flavored e-cigarettes gain popularity, menthol-flavored cigarettes are also becoming increasingly popular among youth and young adults, particularly in the African American community. In April 2022, the FDA announced the proposed standard to ban menthol–the last allowable flavor– in cigarettes in hopes of saving lives and reducing health disparities [11–13].

In response to the proposed menthol cigarette ban, the market has seen a significant increase in ’ice’ flavors that attempt to circumvent these regulations by incorporating synthetic cooling agents like WS-3 and WS-23 into e-cigarette refill liquids to mimic the cooling sensation like menthol or mint [14]. Ice-flavored e-cigarette use correlates with higher vaping frequency and dependence, and 44.8% of e-cigarette users primarily use ice flavors [15]. Synthetic cooling agents in e-cigarettes imitate menthol’s cooling sensation but induce a unique ’cold’ feeling during inhalation, unlike the ’hot’ sensation from capsaicin or menthol’s ’cool’ feeling [16]. These agents are now prevalent in ’ice’ flavored e-cigarettes, despite many consumers’ intake of the agents exceeding established safety thresholds [17–18]. This increasing popularity of synthetic cooling agents creates new concerns about the potential health risks posed by industry attempts to bypass regulations [17]. While the long-term health effects of synthetic cooling agents are largely unknown due to their relative newness, one recent study showed that synthetic cooling agents may disrupt respiratory airway epithelial cell (AEC) responses, a vital defense against inhaled toxins and allergens [19]. This disruption could impact the physiology of the airway and impact susceptibility to health-threatening respiratory diseases [19].

Understanding the public perceptions and discussions of synthetic cooling agents is crucial for shaping future regulation. Social media platforms, notably Twitter (now rebranded as “X”), have been widely used in capturing public perceptions and discussions of tobacco products [20]. As of mid-2023, Twitter has over 235 million daily active users, with an average of 500 million tweets posted daily [21]. This massive volume of interactions has made it an important resource for investigating public perceptions and discussions on various topics, including health and lifestyle behaviors like vaping. For instance, researchers analyzed thousands of tweets to investigate attitudes toward e-cigarette flavors and found that preferences for certain flavors, such as fruit/fruit beverage, dessert/pastry, and candy, chocolate, or sweets, might be associated with continued e-cigarette use [22]. Twitter has also been employed to study the perceived health impacts of vaping [23]. A study analyzing Twitter posts found that many e-cigarette users reported negative health effects, ranging from minor complaints to more serious conditions [24]. A cross-sectional study on marketing of electronic cigarettes on Twitter highlighted Twitter’s value in tracking real-time public sentiment [25]. Overall, Twitter served as an ideal resource for understanding public perceptions and discussions of synthetic cooling agents.

Our study aims to examine the public perceptions and discussions of ’ice’ flavored e-cigarettes and associated synthetic cooling agents using Twitter data. Using natural language processing and deep-learning algorithms, our study results will provide a snapshot of public discourse and attitudes towards ‘ice’ flavored e-cigarettes and synthetic cooling agents. Our findings will provide vital insights into the dynamic e-cigarette landscape, specifically in relation to ’ice’ flavors and synthetic cooling agents. Understanding these dynamics can inform future regulations and strategies to protect public health. This aim was successfully achieved, as evidenced by our detailed analysis and significant results, which provide a comprehensive understanding of public sentiment regarding synthetic cooling agents in e-cigarettes.

## Methods

### Ethics Statement

This study was reviewed and approved by the Research Subjects Review Board of the Office for Human Subject Protection at the University of Rochester (STUDY00006570). Patient consent for publication is not required as the data were analyzed anonymously.

### Data collection and preprocessing

For this study, we leveraged Twitter data from the Twitter Streaming API (Application Programming Interface) collected from May 3, 2021, to March 14, 2023 using keywords related to electronic cigarettes [26]. Tweets were initially filtered based on keywords related to e-cigarettes, including but not limited to keywords like “e-cig”, “vaping”, “e-liquid”, and “vapenation”. After filtering out the retweets from e-cigarette related tweets, we obtained 2,597,206 tweets. We applied another layer of filter to filter out promotional content with promotional keywords within the username, retweets, and content of the tweet from further analysis [26]. This resulted in a collection of 2,426,615 non-promotional tweets. We applied a third layer of filter to filter out “ice” flavored e-cigarettes or synthetic cooling agents related tweets using keywords like ’ice’, ’frozen’, and ’arctic’ (S1 Table) and ultimately identified 5,788 tweets related to synthetic cooling agents and sensations.

### Deep learning models for classification

We used an inductive method to manually label 2,000 randomly selected tweets, which served as the training data for our deep learning classification models. We first randomly selected 200 tweets and manually labeled them according to the users’ attitudes toward synthetic cooling agents and sensations into negative, neutral, and positive categories. Additionally, we determined whether the Twitter users were e-cigarette users (vapers), indicated from the tweets. Two authors (AL, and JH) hand-coded the 200 tweets independently and reached a high inter-rater reliability (Cohen’s Kappa coefficient was 0.9219 for attitude and 0.9256 for whether the Twitter user was an e-cigarette user). Then, the remaining 1,800 tweets were manually coded by the same two authors (AL and JH) with each coding 900 tweets.

We built two roBERTa (Robustly Optimized BERT Pre-Training Approach) models using the 2,000 manually coded tweets as the training dataset [27], one for sentiment analysis and the other for binary classification to determine whether a Twitter user was an e-cigarette user. RoBERTa is a deep learning model developed by Facebook AI, which builds upon BERT (Bidirectional Encoder Representations from Transformers) [28]. This model differs from its predecessor by enhancing the pretraining process, involving increased training data and a more dynamic masking pattern, leading to improved accuracy on various natural language processing tasks. We employed ten-fold cross-validation to ensure the robustness of our models. Our models achieved an F1-score of 0.83 for attitude and 0.92 for e-cigarette user classification, ensuring the validity of our model results. The two-proportion Z-test was used to compare differences in the proportions of various sentiment categories.

### Topic modeling

To understand the topics discussed in tweets related to synthetic cooling agents and sensations, we employed BERTopic [29]. BERTopic is an advanced, context-aware topic modeling technique. BERTopic is based on the BERT language model, which allows us to grasp the larger context of the conversation by capturing semantic relationships between words and topics. We determined the optimal number of topics based on the coherence score and inter-topic distances [30–31].

## Results

### Public discussions on synthetic cooling agents, sensations, and E-cigarettes on Twitter

We observed a clear increasing trend in the number of tweets related to ice flavors or synthetic cooling agents in e-cigarettes from May 2021 to March 2023 with some variations (Fig 1).

![Fig 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2023/09/25/2023.09.21.23295881/F1.medium.gif)

[Fig 1.](http://medrxiv.org/content/early/2023/09/25/2023.09.21.23295881/F1)

Fig 1. The number of tweets on synthetic cooling agents and sensations over time.

Among 5,788 tweets related to synthetic cooling agents and sensations in e-cigarettes, 47.81% (2,771/5,788) of tweets had a positive sentiment, 19.92% (1,153/5,788) had a negative sentiment, and 32.20% (1864/5,788) had a neutral sentiment. The proportion of tweets with a positive attitude was significantly higher than that with a negative attitude (*P*-value <0.0001).

As shown in Fig 2, the proportion of tweets with either a positive or negative attitude from May 2021 to April 2023 was relatively consistent. While it is not significant, there is a small increase in the proportion of negative tweets and a slight decrease in the proportion of positive tweets over time. Among 3,924 tweets related to synthetic cooling agents and sensations in e-cigarettes with positive or negative sentiment (omitting neutral), approximately 70.62% (2,771/3,924) had positive sentiment and 29.38% (1,153/3,924) had negative sentiment. The proportion of tweets with a positive attitude is significantly higher than that with a negative attitude when observing only tweets of positive and negative sentiment (*P*-value <0.0001).

![Fig 2.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2023/09/25/2023.09.21.23295881/F2.medium.gif)

[Fig 2.](http://medrxiv.org/content/early/2023/09/25/2023.09.21.23295881/F2)

Fig 2. The attitude toward synthetic cooling sensation on Twitter over time.

### Twitter users’ attitudes toward synthetic cooling agents and sensations between vapers and non-vapers

From 5,788 tweets related to synthetic cooling agents and sensations, we have identified 5,067 unique Twitter users. Among them, 3,757 (74.17%) are e-cigarette users (vapers) and 1,310 (25.83%) are non-e-cigarette users (non-vapers). As shown in S2 Fig, the longitudinal proportion of e-cigarette users and non-e-cigarette users from May 2021 to March 2023 has been relatively consistent. Vapers predominantly expressed positive attitudes in their tweets (59.70%, 2,243/3,757). In addition, 23.13% (869/3,822) of vapers expressed neutral attitudes, and 17.17% (645/3,822) expressed negative attitudes. Nearly half of all non-vapers expressed neutral attitudes (49.77%, 652/1,310). More than a third non-vapers showed negative attitudes (34.73%, 455/1,326) and less than one sixth non-vapers showed positive attitudes (15.50%, 203/1,326).

The comparison of frequency distributions revealed that Twitter users’ attitudes toward synthetic cooling agents and sensations varied between vapers and non-vapers (Fig 3). Vapers displayed more positive attitudes (59.70%) than non-vapers (15.50%). Conversely, non-vapers exhibited more negative attitudes (34.73%) than vapers (17.17%). Additionally, non-vapers (49.77%) showed more neutral attitudes than vapers (23.13%).

![Fig 3.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2023/09/25/2023.09.21.23295881/F3.medium.gif)

[Fig 3.](http://medrxiv.org/content/early/2023/09/25/2023.09.21.23295881/F3)

Fig 3. Comparison of attitudes toward synthetic cooling agents and sensations between vapers and non-vapers.

### Public discussions of synthetic cooling agents and sensations in e-cigarettes on Twitter

Table 1 showed the major topics discussed about the synthetic cooling agents and sensations in e-cigarettes. Among tweets with positive attitude, the most prevalent topic is the enjoyment of ice vapes (64.49%, 1,787/2,771), followed by liking lush ice vapes (18%, 499/2,771), liking the minty or icy feeling (7.32%, 203/2,771), certain flavor being refreshing (3.1%, 86/2,771), and enjoying the smell of vapes (0.79%, 22/2,771).

View this table:
[Table 1.](http://medrxiv.org/content/early/2023/09/25/2023.09.21.23295881/T1)

Table 1. Major topics identified from tweets with positive or negative attitudes

Table 1 also highlights the main issues brought up in tweets with a negative attitude towards the synthetic cooling agents and sensations in e-cigarettes. The most recurrent topic is disliking certain vape flavors (53.69%, 619/1,153), followed by discomfort from others vaping around them (20.82%, 240/1,153), disagreement with the act of vaping itself (6.42%, 74/1,153), and disliking the mintiness of vapes (4.51%, 52/1,153).

## Discussion

### Principal findings

We identified an increasing trend in the discussions of the synthetic cooling agents and sensations in e-cigarettes from May 2021 to March 2023. Interestingly, the public attitudes toward the synthetic cooling agents and sensations in e-cigarettes remains relatively constant over the study period. Furthermore, we found a predominantly positive attitude toward synthetic cooling agents and sensations in e-cigarettes. Further analysis of Twitter users revealed that this positive sentiment was largely driven by e-cigarette users, or vapers. The topics discussed within these positive tweets mainly centered on the enjoyment of ice-flavored vaping. Though, the importance of flavor variety in vaping experiences was also noted. Conversely, the primary concerns arising from tweets with negative attitudes involved second-hand exposure to vaping and potential addiction.

### Comparisons with prior work

Consistent with our findings of a mostly positive attitude towards synthetic cooling agents and sensations in e-cigarettes, a previous content analysis of ice-flavored e-cigarette products using Twitter data from January to July 2021 also revealed a majority favorable attitude towards these products [32].

We observed an increasing trend in the discussions of the synthetic cooling agents and sensations during the study period, which might partially be due to the aggressive marketing of ice-flavored e-cigarette products identified from the previous study [32]. Another reason for this increasing trend might be due to their increased popularity and conversations related to their regulations. This trend suggests that synthetic cooling agents are becoming more prevalent and widely used, which may be due to their perceived benefits or effectiveness in providing a pleasant experience [33]. However, there is also growing concern about their potential health risks, leading to increased discussions about policy and regulation. Studies have already shown that the amount of synthetic cooling agent, WS-3/WS-23, in e-cigarettes often cause levels of exposure higher than the safety threshold [17, 33]. Elevated exposure to WS-3/WS-23 has been linked to changes in airway epithelial cells, potentially increasing susceptibility to respiratory diseases [19]. Although more research is needed on the broader health effects that these synthetic agents may have, preliminary findings suggest a need for immediate regulatory attention.

The comparison of attitudes between vapers and non-vapers towards synthetic cooling agents and sensations indicated that a higher percentage of vapers expressed positive sentiments, while non-vapers displayed more negative and neutral sentiments. This underlines the divergent views between these two groups and can be attributed to their direct experiences and exposure to synthetic cooling agents, especially enjoyment of specific vape flavors and preference for certain vape types. For example, tweets like “I don’t vape until someone pulls out lush ice” emphasize the allure of specific mixtures like Lush Ice, which offers a mix of watermelon and melon flavors with a minty kick. This contrasts with standard ice vapes, known for a straightforward cooling sensation. Tweets like “Told mum I like vaping for the minty flavor and she goes I’ll make you a mint chutney pls stop,” underline the minty flavors’ appeal. Additionally, mentions of enjoying the vapor smell, such as in the tweet “hi moots I ran out of my disposable vape and now I miss my ice grape-smelling room,” show that sensory enjoyment isn’t limited to taste.

The recurring theme of addictiveness and pleasurable sensations highlights the sensory and innovative appeal of vaping. This trend, reflecting a growing acceptance or normalization of vaping within certain communities, has crucial implications for future policy. Policymakers may need to address these specific attractions when instituting regulations, ensuring that marketing and promotion of vaping products do not exploit these preferences.

Tweets with negative attitudes expressed dislike of certain flavors and concerns about second-hand exposure. Examples like “@mentholdiet banana ice OR literally anything but watermelon (watermelon vapes make me vomit in a bad way :/)” and “Minty vape flavors give me major brain freeze vibes. I can’t do it,” point to specific aversions to flavors, ranging from mint to fruit. These dislikes could be due to individual taste preferences or sensations like “brain freeze,” contrasting with a broader trend of users finding non-traditional flavors like fruit or candy more satisfying [34]. Concerns about second-hand exposure also resonate strongly. Tweets such as “you blow peach ice in my face and watch how i shove that vape down your throat,” or “Vape smokers will blow banana ice in ya face while u telling em how ya grandma died,” spotlight the intrusion of vapor into personal spaces, exacerbating existing concerns about the inhalation of harmful substances such as nicotine and toxic chemicals by bystanders [35–37].

These findings provide insight into the specific factors that influence people’s perceptions of synthetic cooling agents, highlighting concerns about health, etiquette, and the social impact of vaping.

Our study has several limitations. Despite demonstrating the impressive performance of the deep-learning models we employed for tweet labeling, they are not flawless and could potentially introduce some misclassification and bias into our findings. Furthermore, the absence of demographic data (such as age, gender, and race/ethnicity) for the Twitter users in our dataset restricts our ability to explore the attitudes and topics discussed based on each demographic subgroup. We also deliberately avoided using the term “cool” as a keyword to minimize the collection of irrelevant tweets. While this decision reduced noise, it also likely omitted some relevant tweets discussing synthetic cooling agents in a relevant context. We also did not account for the potential influence of bot accounts, which could have skewed both the sentiment and the topical focus of the tweets collected. Furthermore, the longitudinal nature of our data collection doesn’t consider temporal shifts in public opinion that could be influenced by new research findings or policy changes. Lastly, our study is constrained by its focus on English-language tweets and its reliance on Twitter as the sole platform, which may not fully represent global and/or multilingual perspectives.

## Conclusion

Using Twitter data, we investigated public perceptions and discussions of synthetic cooling agents and sensations in e-cigarettes. Our analysis revealed an increasing trend in discussions about these agents and sensations over time, with positive attitudes consistently dominating the study period. Vapers were found to be the major contributors to the overall positive attitudes, expressing their preference for ice-flavored e-cigarette products. Tweets with negative attitudes expressed dislike for certain flavors and concerns about second-hand vapor exposure. Our results provide valuable information for future regulation of synthetic cooling agents. The favorable view of ice-flavored e-cigarette products raises significant public health concerns, given the potential harms of these synthetic cooling agents. Public health campaigns are needed to educate the public about the potential risks associated with synthetic cooling agents. These campaigns could be delivered through popular social media platforms such as Twitter to reach a large and engaged audience.

## Author contributions

DL, ZX: Conceived and designed the Study; AL and JH: analyzed the data; AL, JH, DL and ZX: wrote the manuscript; AL, DL and ZX: edited the manuscript. All authors approved the final version of the manuscript.

## Conflicting interests

All authors have no potential conflict of interest to declare.

## Data availability statement

Data are available upon reasonable request through corresponding author.

## Supporting information

**S1 Fig. Flowchart of Twitter data pre-processing**

**S2 Fig. The proportion of vapers and non-vapers mentioning synthetic cooling agents and sensations on Twitter.**

**S1 Table. Keywords used in Twitter data filtering.**

## Acknowledgements

This study was supported by REU Site: Computational Methods for Understanding Music, Media, and Minds grant funded by National Science Foundation (Award number: 1950460) and by the WNY Center for Research on Flavored Tobacco Products (CRoFT) under cooperative agreement U54CA228110 funded by National Cancer Institute and US Food and Drug Administration (FDA). The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH or the FDA.

*   Received September 21, 2023.
*   Revision received September 21, 2023.
*   Accepted September 25, 2023.


*   © 2023, Posted by Cold Spring Harbor Laboratory

This pre-print is available under a Creative Commons License (Attribution 4.0 International), CC BY 4.0, as described at [http://creativecommons.org/licenses/by/4.0/](http://creativecommons.org/licenses/by/4.0/)

## References

1.  1.Oriakhi M. Vaping: An Emerging Health Hazard. Cureus. 2020;12.
    
    

2.  2.Grana R, Benowitz N, Glantz SA. E-Cigarettes. Circulation. 2014;129:1972–1986.
    
    [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MTQ6ImNpcmN1bGF0aW9uYWhhIjtzOjU6InJlc2lkIjtzOjExOiIxMjkvMTkvMTk3MiI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIzLzA5LzI1LzIwMjMuMDkuMjEuMjMyOTU4ODEuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

3.  3.Obisesan OH, et al. Trends in e-Cigarette Use in Adults in the United States, 2016-2018. JAMA Intern Med. 2020;180:1394–1398.
    
    

4.  4.Bandi P, et al. Changes in E-Cigarette Use Among U.S. Adults, 2019–2021. Am J Prev Med. 2023;65:322–326.
    
    

5.  5.Park-Lee E, et al. Tobacco Product Use Among Middle and High School Students — United States, 2022. 2022:1429–1435.
    
    

6.  6.McConnell R, et al. Electronic cigarette use and respiratory symptoms in adolescents. Am J Respir Crit Care Med. 2017;195:1043–1049.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1164/rccm.201604-0804OC&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=27806211&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F09%2F25%2F2023.09.21.23295881.atom) 

7.  7.Bhatnagar A, et al. Electronic cigarettes: a policy statement from the American Heart Association. Circulation. 2014;130:1418–1436.
    
    [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MTQ6ImNpcmN1bGF0aW9uYWhhIjtzOjU6InJlc2lkIjtzOjExOiIxMzAvMTYvMTQxOCI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIzLzA5LzI1LzIwMjMuMDkuMjEuMjMyOTU4ODEuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

8.  8.Lechner WV, et al. The comparative efficacy of first-versus second-generation electronic cigarettes in reducing symptoms of nicotine withdrawal. Addiction. 2015;110:862–867.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/add.12870&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25639148&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F09%2F25%2F2023.09.21.23295881.atom) 

9.  9.Lee HW, et al. E-cigarette smoke damages DNA and reduces repair activity in mouse lung, heart, and bladder as well as in human lung and bladder cells. Proc Natl Acad Sci. 2018;115:E1560–E1569.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoicG5hcyI7czo1OiJyZXNpZCI7czoxMToiMTE1LzcvRTE1NjAiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMy8wOS8yNS8yMDIzLjA5LjIxLjIzMjk1ODgxLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

10. 10.Sindelar JL. Regulating Vaping - Policies, Possibilities, and Perils. N Engl J Med. 2020;382:e54.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMp1917065&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F09%2F25%2F2023.09.21.23295881.atom) 

11. 11.Ali FRM, Seaman EL, Diaz MC, Ajose J, King BA. Trends in unit sales of cooling flavoured e-cigarettes, USA, 2017–2021. Tobacco Control. doi: 10.1136/tobaccocontrol-2022-057395
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1136/tobaccocontrol-2022-057395&link_type=DOI) 

12. 12.U.S. Food and Drug Administration. FDA proposes rules prohibiting menthol cigarettes and flavored cigars to prevent youth initiation, significantly reduce tobacco-related disease and death. 2022 Apr 28 [cited 2023 Sep 17]. Available from: [https://www.fda.gov/news-events/press-announcements/fda-proposes-rules-prohibiting-menthol-cigarettes-and-flavored-cigars-prevent-youth-initiation](https://www.fda.gov/news-events/press-announcements/fda-proposes-rules-prohibiting-menthol-cigarettes-and-flavored-cigars-prevent-youth-initiation).
    
    

13. 13.Campaign for Tobacco-Free Kids. FDA must finalize rules to prohibit menthol cigarettes and flavored cigars without delay – They will have a profound impact on the nation’s health, especially among Black Americans. 2023 Apr 28 [cited 2023 Sep 17]. Available from: [https://www.tobaccofreekids.org/press-releases/2023\_04\_28\_fda-must-finalize-rules-to-prohibit-menthol-cigarettes-and-flavored-cigars](https://www.tobaccofreekids.org/press-releases/2023_04_28_fda-must-finalize-rules-to-prohibit-menthol-cigarettes-and-flavored-cigars).
    
    

14. 14.FDA Commits to Evidence-Based Actions Aimed at Saving Lives and Preventing Future Generations of Smokers: Efforts to ban menthol cigarettes, ban flavored cigars build on previous flavor ban and mark significant steps to reduce addiction and youth experimentation, improve quitting, and address health disparities. PR Newswire. 2021 [cited 2023 Sep 17]. Available from: [https://www.fda.gov/news-events/press-announcements/fda-commits-evidence-based-actions-aimed-saving-lives-and-preventing-future-generations-smokers](https://www.fda.gov/news-events/press-announcements/fda-commits-evidence-based-actions-aimed-saving-lives-and-preventing-future-generations-smokers).
    
    

15. 15.Leventhal A, et al. ’Ice’ flavoured e-cigarette use among young adults. Tobacco Control. 2023;32:114–117.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTQ6InRvYmFjY29jb250cm9sIjtzOjU6InJlc2lkIjtzOjg6IjMyLzEvMTE0IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjMvMDkvMjUvMjAyMy4wOS4yMS4yMzI5NTg4MS5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

16. 16.Yogeswaran S, et al. The role of synthetic coolants, WS-3 and WS-23, in modulating E-cigarette-induced reactive oxygen species (ROS) in lung epithelial cells. Toxicol Rep. 2022;9:1700–1709.
    
    

17. 17.Jabba SV, et al. Synthetic Cooling Agents in US-marketed E-cigarette Refill Liquids and Popular Disposable E-cigarettes: Chemical Analysis and Risk Assessment. Nicotine Tob Res. 2022;24:1037–1046.
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F09%2F25%2F2023.09.21.23295881.atom) 

18. 18.Joint FAO/WHO Expert Committee on Food Additives, et al. Evaluation of Certain Food Additives: Sixty-ninth Report of the Joint FAO/WHO Expert Committee on Food Additives. Albany, SWITZERLAND: World Health Organization; 2009.
    
    

19. 19.Manevski M, et al. E-cigarette synthetic cooling agent WS-23 and nicotine aerosols differentially modulate airway epithelial cell responses. Toxicol Rep. 2022;9:1823–1830.
    
    

20. 20.Zou C, et al. Perceptions of the IQOS Heated Tobacco Product on Twitter in the United States. Front Commun. 2021;6.
    
    

21. 21.OmnicoreAgency. Twitter by the Numbers (2023): Stats, Demographics & Fun Facts. 2023 [cited 17 September 2023]. In: OmnicoreAgency [Internet]. [about 4 screens]. Available from: [https://www.omnicoreagency.com/twitter-statistics/](https://www.omnicoreagency.com/twitter-statistics/)
    
    

22. 22.Russell C, et al. Changing patterns of first e-cigarette flavor used and current flavors used by 20,836 adult frequent e-cigarette users in the USA. Harm Reduct J. 2018;15.
    
    

23. 23.Majmundar A, et al. Monitoring Health Effects of Vaping Discussed on Twitter in 2018 and 2019. J Gen Intern Med. 2022;37:673–675.
    
    

24. 24.Marques P, Piqueras L, Sanz MJ. An updated overview of e-cigarette impact on human health. Respir Res. 2021;22:1–14.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/S12931-020-01610-X/FIGURES/4&link_type=DOI) 

25. 25.Huang J, et al. A cross-sectional examination of marketing of electronic cigarettes on Twitter. Tob Control. 2014;23:iii26–iii30.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTQ6InRvYmFjY29jb250cm9sIjtzOjU6InJlc2lkIjtzOjE2OiIyMy9zdXBwbF8zL2lpaTI2IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjMvMDkvMjUvMjAyMy4wOS4yMS4yMzI5NTg4MS5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

26. 26. Xinyi Lu, et al. User Perceptions of Different Electronic Cigarette Flavors on Social Media: Observational Study. J Med Internet Res. 2020;22:e17280.
    
    

27. 27.Liu Y, et al. RoBERTa: A Robustly Optimized BERT Pretraining Approach. 2019 arXiv 1907.11692 [submitted 2019 Nov 11; revised 2020 Mar 27; cited 2023 Sep 17]: [13 p.]. Available from: [https://arxiv.org/abs/1907.11692](https://arxiv.org/abs/1907.11692)
    
    

28. 28.Devlin J, et al. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. 2018 arXiv 1810.04805 [submitted 2018 Oct 11; revised 2019 May 24; cited 2023 Sep 17]: [16 p.]. Available from: [https://arxiv.org/abs/1810.04805](https://arxiv.org/abs/1810.04805)
    
    

29. 29.Grootendorst M. BERTopic: Neural topic modeling with a class-based TF-IDF procedure. 2022 arXiv 2201.13014 [submitted 2022 Jan 4; cited 2023 Sep 17]: [25 p.]. Available from: [https://arxiv.org/abs/2201.13014](https://arxiv.org/abs/2201.13014)
    
    

30. 30.Syed S, Spruit M. Full-Text or Abstract? Examining Topic Coherence Scores Using Latent Dirichlet Allocation. In: Proceedings of the 2017 IEEE International Conference on Data Science and Advanced Analytics (DSAA); 2017 Oct 19-21. doi: 10.1109/DSAA.2017.61.
    
    

31. 31.Sievert C, Shirley K. LDAvis: A method for visualizing and interpreting topics. In: Proceedings of the Workshop on Interactive Language Learning, Visualization, and Interfaces; 2014: 63–70. doi: 10.3115/v1/W14-3110.
    
    

32. 32.Galimov A, et al. Ice Flavor–Related Discussions on Twitter: Content Analysis. J Med Internet Res. 2022;e41785. doi: 10.2196/41785.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.2196/41785&link_type=DOI) 

33. 33.Leventhal AM, et al. Ice flavours and non-menthol synthetic cooling agents in e-cigarette products: a review. Tob Control. 2022. doi: 10.1136/tobaccocontrol-2021-057073.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTQ6InRvYmFjY29jb250cm9sIjtzOjU6InJlc2lkIjtzOjI4OiJ0b2JhY2NvY29udHJvbC0yMDIxLTA1NzA3M3YxIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjMvMDkvMjUvMjAyMy4wOS4yMS4yMzI5NTg4MS5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

34. 34.Leventhal AM, et al. Flavored E-cigarette Use and Progression of Vaping in Adolescents. Pediatrics. 2019;144(5):e20190789. doi: 10.1542/peds.2019-0789.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1542/peds.2019-0789&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=31659004&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F09%2F25%2F2023.09.21.23295881.atom) 

35. 35.Czogala J, Goniewicz ML, Fidelus B, Zielinska-Danch W, Travers MJ, Sobczak A. Secondhand Exposure to Vapors From Electronic Cigarettes. Nicotine Tob Res. 2014;16:6. DOI: 10.1093/ntr/ntt203
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/ntr/ntt203&link_type=DOI) 

36. 36.Gentzke AS, Wang TW, Marynak KL, Trivers KF, King BA. Exposure to Secondhand Smoke and Secondhand E-Cigarette Aerosol Among Middle and High School Students. Prev Chronic Dis. 2019;16:180531. DOI: 10.5888/pcd16.180531
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.5888/pcd16.180531&link_type=DOI) 

37. 37.Islam T, Braymiller J, Eckel SP, Liu F, Tackett AP, Rebuli M, Barrington-Trimis J, McConnell R. Secondhand nicotine vaping at home and respiratory symptoms in young adults. Thorax. 2022. DOI: 10.1136/thoraxjnl-2021-217041
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToidGhvcmF4am5sIjtzOjU6InJlc2lkIjtzOjg6Ijc3LzcvNjYzIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjMvMDkvMjUvMjAyMy4wOS4yMS4yMzI5NTg4MS5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=)