A systematic review and meta-analysis of school-based preventive interventions targeting e-cigarette use among adolescents

Lauren A. Gardner, Amy-Leigh Rowe, Nicola C. Newton, Lyra Egan, Emily Hunter, Emma K. Devine, Tess Aitken, Louise Thornton, Maree Teesson, Emily Stockings, Katrina E. Champion
doi: https://doi.org/10.1101/2023.12.19.23300263

Abstract

Objective To examine the efficacy of school-based e-cigarette preventive interventions via a systematic review and meta-analysis.

Data sources We searched MEDLINE, Embase, PsycINFO, Scopus, CINAHL, Cochrane and clinical trials registries for studies published between January 2000-June 2023 using keywords for e-cigarettes, adolescents, and school.

Study selection Of 1566 double-screened records, 11 met criteria of targeting adolescents, evaluating an e-cigarette preventive intervention, being conducted in a secondary school, using a randomised controlled trial (RCT), cluster RCT or quasi-experimental design, and comparing an intervention to a control.

Data extraction Pre-specified data pertaining to the study design, outcomes, and quality were extracted by one reviewer and confirmed by a second, and where necessary, third reviewer.

Data synthesis Our narrative synthesis showed some school-based interventions prevented or reduced e-cigarette and/or tobacco use, however some increased use. Meta-analyses on a subsample of studies found that, overall, school-based interventions were not associated with the prevention of e-cigarette (OR=0.43, 95%CI=0.16, 1.12; p=0.09) or tobacco (OR=1.01, 95%CI=0.65, 1.59, p=0.95) use, however were associated with reductions in past 30-day tobacco use (OR=0.59, 95%CI=0.39, 0.89, p=0.01) which encompassed e-cigarettes in some studies. School-based interventions were also associated with improved knowledge (SMD=-0.38, 95%CI=-0.68, -0.08, p=0.01), intentions (SMD=-0.15, 95%CI=-0.22, -0.07, p=0.0001), and attitudes (SMD=-0.14, 95%CI=-0.22, -0.06; p=0.0007) in the short-term. Overall, the quality of evidence was low-to-moderate.

Conclusions School-based interventions hold potential for addressing e-cigarette use, however, can have null or iatrogenic effects. More high-quality research is needed to develop efficacious interventions, and schools must be supported to adopt evidence-based programs.

The growing use of electronic cigarettes (‘e-cigarettes’, also known as ‘vapes’) among young people is a critical public health concern due to the significant potential for harm. For example, e-cigarettes can cause a range of health issues including respiratory disease, seizures, poisoning, and injuries.1 E-cigarettes have also been associated with adverse mental health outcomes among young people including depression and suicidal ideation, with relatively little known about the longer-term health effects.1 2 Additionally, adolescents are particularly susceptible to nicotine addiction, putting the developing brain at risk of damage.1 3 In Australia, approximately one in four adolescents aged 14-17 have tried e-cigarettes, with one in ten reporting past 30-day use.4 Rates of past 30-day use are also high among adolescents in Canada and the United States, at 13% and 10%, respectively.5 6 Among 11-18-year-olds in the United Kingdom, 40% have used e-cigarettes and approximately 5% use at least monthly.7 Evidence suggests that e-cigarette use is also associated with an increased likelihood of tobacco cigarette smoking.8 9 Indeed, recent Australian data shows that tobacco smoking has increased among young people for the first time in recent decades,10 with increases similarly observed in Canada.11 This is highly concerning, given the substantial health, economic and societal burden of tobacco smoking.8 12 Effective preventive interventions and public health strategies are therefore urgently needed to address e-cigarette use among adolescents.

While policy-level prevention initiatives can be effective and continue to evolve, they are unlikely to eliminate e-cigarette use completely. For example, there are minimum age of purchase regulations in the United Kingdom and United States (US), with some US states aiming to reduce access, supply and use via banning online sales and flavours. Australia adopts a prescription-only model, restricting sales of nicotine-containing e-cigarettes to those over age 18, with a prescription from their GP, which should only be available via pharmacies or online via the Therapeutic Goods Administration personal importation scheme.13 However, research indicates that most e-cigarettes used by Australian adolescents are illegally obtained and contain nicotine.14 15 Further regulations for Australia were recently announced and are due to commence at the beginning of 2024, including a ban on all disposable vapes (regardless of nicotine content) and restrictions on flavours and packaging, leading to concerns over the development of a black market. Despite the varied measures, rates of e-cigarette use among young people in these regions remain unacceptably high, highlighting the need to provide critical education and resistance skills training to prevent or reduce the harms from e-cigarette use.

School-based interventions are an efficient, effective and economical prevention strategy. Schools offer an opportune setting to reach large numbers of adolescents during a critical period of exposure to substance use, and in an environment designed for learning and shaping of behaviour.16 17 This is important as health habits formed during adolescence are likely to become entrenched.18 Further, adolescents’ social lives often revolve around the school context, meaning education can be delivered to peer groups whom can be strong influences on substance use behaviours.16 17 Substance use preventive interventions are also feasible to implement in the school context, given drug education is typically mandatory within health education curriculums.19

Evidence shows that school-based interventions can be effective at preventing and/or delaying tobacco, alcohol and other substance use among adolescents,17 20 21 with some interventions demonstrating sustained effects into early adulthood.22 The strongest evidence exists for interventions that utilise a social competence and social influence approach to prevention.23 24 As adolescent e-cigarette use and related harms have grown rapidly in recent years, so to have the number of interventions aiming to reduce these issues. However, to our knowledge, no study has systematically examined and meta-analysed the efficacy of school-based preventive interventions for e-cigarette use. This study therefore aims to:

  1. Evaluate the efficacy of school-based preventive interventions in preventing e-cigarette use and improving secondary outcomes (e.g., tobacco use, knowledge, intentions, attitudes, and mental health) among adolescents.

  2. Identify and summarise the key components and characteristics associated with efficacious interventions.

Methods

Approach and search terminology

This systematic review was conducted in accordance with the published review protocol25 and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines26, and was prospectively registered with the International Prospective Register of Systematic Reviews (PROSPERO; CRD42022323352).

A research librarian (TA) conducted a systematic search of MEDLINE (Ovid), Embase (Ovid), PsycINFO (Ovid), Scopus, CINAHL, the Cochrane Database of Systematic Reviews (Ovid) and international clinical trial registries via the Cochrane Central Register of Controlled Trials (Ovid) for studies published from January 2000 (to slightly precede the advent of e-cigarettes in 2003 and thus ensure full capture of studies) to June 2022, which was re-run in June 2023. The search was limited to human studies, had no language restrictions, and was designed to identify grey literature and unpublished work, including dissertations, clinical trial registries and conference proceedings. An example search strategy is provided in Supplemental Table S1. All records identified in the search strategy were exported into EndNote and uploaded to the Covidence online software programme for deduplication and screening. Reference lists of eligible papers were reviewed to identify other relevant studies.

View this table:
Table S1. Example Search Strategy (CINAHL)

Eligibility criteria

To be eligible for inclusion, studies must have: (1) targeted adolescents aged between 11 and 18 years of age at study intake (i.e., those of secondary school age); (2) evaluated an intervention targeting the prevention of e-cigarette use; (3) been conducted in a secondary school setting, however school-based interventions incorporating additional components (such as family-based or community-based elements) were also eligible; (4) used a randomised controlled trial, cluster randomised controlled trial, or a quasi-experimental design; and, (5) compared an intervention group to a control group (did not receive an intervention, education as usual, or alternative intervention). Interventions addressing other risk behaviours in addition to e-cigarette use (e.g., tobacco use or illicit drug use), and of both universal (i.e., delivered to all students in the intervention condition, regardless of their level of risk) and selective (i.e., delivered to higher-risk students in the intervention condition) nature were eligible.

Exclusion criteria

Studies were excluded on the basis of: (1) not targeting adolescents; (2) not directly addressing e-cigarette use in the intervention; (3) the intervention having no school-based components; and, (4) having a non-experimental design or no control group.

Article Screening and Coding

Two reviewers (LAG and AR) independently screened 1566 title and abstract records (98% agreement), as well as 36 full text records (94% agreement). Discrepancies at both screening stages were resolved by a third reviewer (KEC), resulting in 11 articles eligible for inclusion (see PRISMA flow diagram in Supplemental Figure S1). Data were extracted by one reviewer (EH or LE) and confirmed by a second (LAG), and where necessary, third (ES) reviewer. The following information from each eligible article was extracted: publication details, study characteristics, participant characteristics, intervention characteristics, primary and secondary outcomes of interest across all time points, measurement tools employed, details of the comparison group, data to assess risk of bias, and process data to determine the degree to which an intervention was implemented as intended. Corresponding authors were contacted for missing data. Further information on data extraction can be found in the published protocol.25

Figure S1.
Figure S1. PRISMA flow diagram

Data analysis

The primary outcome was the prevention of e-cigarette use (lifetime use/ever use) at longest follow-up, treated as a dichotomous variable where N of participants in the intervention group reporting e-cigarette use is compared with N of participants in the control group reporting e-cigarette use. Raw Ns were extracted or reverse engineered, where possible, otherwise effect sizes and their confidence intervals were extracted. Secondary outcomes included the reduction or cessation of e-cigarette use (past 30-day) among adolescents already reporting e-cigarette use at baseline; the prevention (lifetime use/ever use) and reduction/cessation (past 30-day) of tobacco cigarette use; knowledge, attitudes (termed ‘outcome expectations’ in some studies), normative beliefs, harm perceptions, and future intentions related to e-cigarette/tobacco use; mental health outcomes; and, other substance use.

A narrative synthesis of study and intervention characteristics was conducted. When examining the characteristics associated with efficacious interventions, programs were deemed efficacious if a significant difference (at p < 0.05) was reported between the intervention and control groups on at least one primary or secondary outcome.

For the meta-analysis, data were entered into RevMan (version 6.7.1, Cochrane, London, UK) and combined using an inverse variance weighted random-effects analysis. Dichotomous outcomes are reported using odds ratios (ORs) and continuous outcomes using standardised mean difference (SMD). Where Standard Deviations were not reported, they were calculated. In line with recommendations in the Cochrane Handbook,27 where some scales increased for an outcome (e.g., higher scores indicate greater knowledge about e-cigarettes) whilst others decreased (e.g., lower scores indicate greater knowledge about e-cigarettes), the mean values from one set of studies was multiplied by -1 to ensure all scales pointed the same direction. This occurred for two secondary outcomes: knowledge and harm perceptions. Where improvement in an outcome is associated with higher scores on a scale, SMDs greater than zero indicate the degree to which the intervention is more efficacious than control, and SMDs less than zero indicate the degree to which treatment is less efficacious than placebo. Where improvement is associated with lower scores on a scale, SMDs lower than zero indicate the degree to which the intervention is more efficacious than control and SMDs greater than zero indicate the degree to which the intervention is less efficacious than control.28 If a study reported data at multiple timepoints, e-cigarette/tobacco use outcomes were meta-analysed at the longest follow-up timepoint, as per our prespecified primary outcome and given substance use behaviour change is more likely to be observed over the longer time period, as exposure increases throughout adolescence.16 21 Conversely, outcomes theorised to precede behaviour change and exhibit change over the shorter-term (e.g., knowledge, attitudes, beliefs, and intentions) were examined at the first post-intervention timepoint.29 30 Results are presented using forest plots and heterogeneity was assessed using the Higgins I2 statistic, with values of 25%, 50% and 75%, representing small, moderate or large heterogeneity, respectively. The significance of any heterogeneity was examined using the Cochran’s Q (χ2) test (p<0.05). Where appropriate, sub-analyses were conducted to explore sources of significant heterogeneity.

Two authors (AR and EKD [first search]; AR and LAG [updated search]) independently conducted the risk of bias assessment. Randomised studies were assessed using the Cochrane Collaboration’s tool for assessing risk of bias (RoB 2)31 and non-randomised studies were assessed using the Risk of Bias in Non-randomised Studies of Interventions (ROBINS-I).32 There was 100% agreement between all raters on the overall risk of bias for each of the included studies. The certainty of primary and secondary outcomes included in the meta-analysis was assessed using the Cochrane Grading of Recommendations Assessment, Development and Evaluation (GRADE) Framework.33

Results

Study characteristics

Of 1566 records identified, 36 full-text articles were screened, of which 11 were deemed eligible for inclusion. Nine studies provided sufficient data for meta-analysis.34–42 Table 1 provides characteristics of each study. Overall, the 11 articles included five cluster RCTs and six quasi-experimental trials. The studies comprised a total of 36,275 students, with sample sizes ranging from 158 to 13,269 students. Students were between 12 to 21 years at baseline and 50.98% were female. Trials were conducted between 2014-2020, most commonly in the US (n=5), and length of follow-up varied from immediately post-intervention to 36-months. Comparison groups included assessment only (n=6), education as usual (n=4), and an education-only component of an intervention (n=1). All studies used self-report survey measures to assess their outcomes. Baseline e-cigarette use, which sometimes encompassed broader tobacco use, was reported in 9 of the studies,35 36 38–44 of which six reported on lifetime use with prevalence rates ranging from 0%44 (due to only including never users at baseline) to 13.4%41. Three studies reported on past 30-day e-cigarette use at baseline, with prevalence rates of 2.2%,40 4.3%43, and 36%38 (the latter being a combined measure of tobacco and e-cigarette use). Some studies (n=6) also measured other substance use at baseline, which included tobacco use (n=5), straw cigarettes (n=1), water pipe/ hookah (n=4), alcohol (n=2), marijuana (n=2), and hard drugs and crystal meth (n=1).

View this table:
Table 1. Characteristics of included studies

Intervention characteristics

Most interventions targeted e-cigarette and tobacco use concurrently (n=834 35 37–41 43), however one42 targeted e-cigarette use alone, and another36 focused more broadly on transforming the school environment through restorative approaches to address conflict, behaviour management policies and social and emotional learning. Additionally, in one study,44 multiple prevention and cessation programs and policy interventions were evaluated across 24 schools. Although the descriptions were limited, the interventions appeared to vary substantially (e.g., some focused on e-cigarettes and others included tobacco more broadly, some involved teacher-led sessions and others involved external facilitators, police officers or school nurses, some involved classroom education and others involved presentations, eHealth components, school policy, or theme weeks). Among the other eligible studies, interventions included in-class student information and skills training programs led by peers and/or teachers (n=634 37 39 40 42 43), multicomponent programs (n=235 36), school-wide policy (n=141), and a mobile phone app (n=138). Delivery methods comprised face-to-face (n=236 37), eHealth-only (n=238 42), hybrid (n=534 35 39 40 43) and policy-only (n=141) formats. All studies evaluated universal preventive interventions, however the one study that evaluated multiple programs across schools44 also included cessation programs for students already using e-cigarettes or tobacco cigarettes. Intervention duration and frequency ranged from a one-off 45-minute presentation37 to a 3-year tobacco-free contract between adolescents and an adult.35 Most interventions (n=9) were underpinned by behavioural theory, spanning: social cognitive theory (n=4); a social influence approach (n=3), the theory of planned behaviour (n=2); the theory of human functioning and school organisation (n=1); the social norms approach (n=1); and/or, motivational interviewing (n=1).

Characteristics of efficacious interventions

Of the 11 trials, nine34–40 42 43 found a significant improvement on at least one primary or secondary outcome. Six studies reported specifically on the prevention of e-cigarette use,35,36 39 41 42 44 of which half found significant intervention effects in the expected direction.35 36 39 Two35 36 of these three efficacious interventions were multicomponent programs, consisting of school-based components (e.g., classroom education and teacher training) along with broader initiatives involving parents or external adults. The other39 involved classroom education and skills training alone, including both teacher- and peer-led components. The classroom education in all three efficacious interventions was delivered over multiple sessions, ranging between 4x25min lessons to a 10hr learning curriculum, and was overseen by trained teachers. However, only two interventions35 39 focused specifically on e-cigarettes/tobacco, both via a hybrid delivery format, whereas the other36 focused on broader behaviour management via social and emotional learning in a face-to-face format.

Of the seven trials that examined change in tobacco use – the definition of which varied across studies (e.g., referred to tobacco cigarettes specifically in some studies35 36 41 and more encompassed e-cigarettes and/or other types such as cigars, pipes, and hookah in other studies38–40 43) – five reported significant intervention effects in the expected direction. Three of these were the same efficacious interventions that were associated with the prevention of e-cigarette use,35 36 39 with the addition of two other classroom education and skills training programs.40 One of which40 involved a one-off 90-minute peer-led module delivered in a hybrid format (face-to-face by medical students along with an eHealth component) and the other43 involved a nine-lesson, video-enhanced curriculum delivered by teachers. Theoretical underpinnings of these studies included the social cognitive theory (n=235 39), the theory of planned behaviour (n=140), the theory of human functioning and school organisation (n=136) and, although not explicitly stated, social influence principles (n=143).

Iatrogenic effects on the prevention of e-cigarette use44 and tobacco smoking onset41 were reported within two studies. The two interventions included a broad “theme week”44 and a school-wide policy.41 Descriptions were limited, however neither of these interventions appeared to include classroom education and skills training or be grounded in theory.

Four studies were associated with a significant improvement in theoretical constructs related to e-cigarette and/or tobacco cigarette use, including knowledge,34 37 39 42 attitudes,34 37 39 normative beliefs,34 harm perceptions,42 and future intentions to use tobacco.37 All of these interventions centred on classroom education and skills training, however some involved teacher- and peer-led components delivered over multiple lessons via hybrid format,34 39 one involved a one-off peer-led face-to-face presentation,37 and the other comprised an eHealth program used over multiple lessons.42 The most common theoretical underpinning was the social cognitive theory (n=337 39 42), with two interventions also drawing on social influence principles (n=134) and the theory of planned behaviour (n=142).

In terms of other secondary outcomes, two studies were associated with significantly better mental health outcomes, including lower perceived stress38 and greater mental wellbeing, psychological functioning, and health-related quality of life.36 Although both studies incorporated student education and skills training over multiple sessions, one did so via face-to-face format within a broader multicomponent intervention that additionally comprised staff training and school policies and practices,36 while the other used an eHealth intervention delivered outside of class.38 Both of these interventions were also associated with reduced alcohol use. Finally, two interventions were associated with the prevention or reduction of illicit drug use, including the broader multicomponent intervention focusing on social and emotional learning,36 and another intervention similarly involving student education and skills training over multiple sessions, however delivery was via a video-enhanced drug prevention curriculum.43 There were no clear characteristics of successful studies in terms of theoretical underpinnings.

Results from the meta-analyses of primary and secondary outcomes are presented below.

Outcomes

Primary outcome: The prevention of e-cigarette use at longest follow-up

Five studies included primary outcome data sufficient for meta-analysis (see Figure 1). Overall, these studies found that school-based interventions were not significantly associated with the prevention of e-cigarette use at longest follow-up (OR=0.43, 95% CI=0.16, 1.12; p=0.09) and there was considerable heterogeneity between studies (I2=98%, p<0.00001). To explore sources of heterogeneity, we conducted sub-group analysis by intervention type (Figure 1). Interventions centring on student education and resistance skills training alone were not significantly associated with the prevention of e-cigarette use (OR=0.77, 95% CI=0.21, 2.86, p=0.69; I² = 45%, p=0.18). There was some evidence that broader school-based interventions prevented e-cigarette use, however this did not reach traditional significance levels (OR=0.31, 95% CI=0.08, 1.16, p=0.08) and substantial heterogeneity remained (I² = 99%, p< 0.00001).

Figure 1:
Figure 1: The prevention of e-cigarette use at longest follow-up

Tobacco use

Pooled analysis of three studies showed that overall, school-based interventions were associated with a significant reduction in past 30-day tobacco use at longest follow-up (OR=0.59, 95% CI=0.39, 0.89, p=0.01; see Figure 2). However, there was substantial and significant heterogeneity between trials (I²=79%, p=0.009). Intervention and control groups did not significantly differ in terms of lifetime tobacco use (OR=1.01, 95% CI=0.65, 1.59, p=0.95), with considerable inconsistency between the two studies (I²=86%, p=0.008; Figure 3).

Figure 2:
Figure 2: Past 30-day tobacco use at longest follow-up
Figure 3:
Figure 3: Lifetime tobacco use at longest follow-up

Knowledge

School-based interventions had a small, yet significant effect on improving knowledge about e-cigarettes compared to controls (SMD=-0.38, 95% CI=-0.68, -0.08, p=0.01; Figure 4). However, there was considerable heterogeneity between studies (I2=78%, p=0.004).

Figure 4:
Figure 4: Knowledge about e-cigarettes at the first post-intervention timepoint

Intentions to use e-cigarettes/tobacco

Overall, school-based interventions were associated with a significant reduction in students’ intentions to use e-cigarettes/tobacco (SMD=-0.15, 95% CI=-0.22, -0.07, p=0.0001), with no heterogeneity between studies (I2=0%; p=0.40; Figure 5).

Figure 5:
Figure 5: Intentions to use e-cigarettes at the first post-intervention timepoint

Risky attitudes

Pooled analysis found a small, significant effect of school-based interventions on reducing risky attitudes towards e-cigarette use (SMD=-0.14, 95% CI=-0.22, -0.06; p=0.0007), with little variability between the three studies (I2=0%, p=0.39; Figure 6).

Figure 6:
Figure 6: Risky attitudes towards e-cigarettes at the first post-intervention timepoint

Harm perceptions

Overall, school-based interventions and controls groups did not significantly differ in terms of perceptions about the harms of e-cigarettes (SMD=-0.29, 95% CI=-0.73, 0.15, p=0.20; Figure 7). There was substantial and significant heterogeneity between trials (I2=69%, p=0.04).

Figure 7:
Figure 7: Harm perceptions at the first post-intervention timepoint

Risk of Bias and Quality of Evidence

Risk of bias assessments are provided in Supplemental Figures S1 and S2. Among randomised studies, one38 was judged at high risk of bias for past 30-day tobacco use due to missing outcome data, and there were some concerns for the remaining studies. This was primarily due to insufficient availability of information to determine whether there were any biases in outcome measurement or deviations from the intended intervention, along with missing outcome data. Among non-randomised studies, one34 was judged at serious risk of bias across outcomes due to bias in the classification of interventions and outcome measurement. There was also a moderate risk of bias judgement for all other studies, primarily due to potential bias in the measurement of outcomes, again related to insufficient availability of a prespecified protocol, and confounding.

Figure S2.
Figure S2. Risk of Bias of Randomised Studies
Figure S3.
Figure S3. Risk of Bias of Non-Randomised Studies

Overall, we judged the quality of evidence to be low to moderate (see summary table in Supplemental Table S2). The quality of evidence for the prevention of e-cigarette use (both classroom education and skills training programs alone, as well as broader interventions), lifetime tobacco use, attitudes, and intentions was moderate. We judged the evidence related to past 30-day tobacco use, knowledge, and harm perceptions to be of low quality, primarily due to risk of bias and inconsistency between studies.

View this table:
Table S2. Summary of Findings Table (Quality of Evidence Ratings)

Discussion

This is the first systematic review and meta-analysis to examine the efficacy of school-based preventive interventions for e-cigarette use. Our narrative synthesis showed that three35 36 39 of the six trials that reported specifically on the prevention of e-cigarette use found significant intervention effects in the expected direction, while one intervention inadvertently increased e-cigarette use.44 Our meta-analysis of five of these studies found that overall, school-based interventions were not significantly associated with the prevention of e-cigarette use. When considering tobacco use more broadly, which encompassed e-cigarettes in some studies, our narrative synthesis found that five trials35 36 39 40 43 reported significant intervention effects in the expected direction, whereas one increased tobacco smoking onset.41 Overall, our meta-analysis showed that school-based interventions were associated with a significant reduction in past 30-day tobacco use, albeit with substantial and significant heterogeneity between studies, but not lifetime tobacco use. Our narrative synthesis also revealed intervention effects on knowledge,34 37 39 42 attitudes,34 37 39 normative beliefs,34 harm perceptions,42 future intentions to use tobacco,37 mental health outcomes,36 38 and other substance use,36 38 43 with our meta-analyses finding that overall, school-based interventions were significantly associated with improvements in knowledge, intentions and attitudes at the first post-intervention timepoint. We judged the certainty in the body of evidence to be low-to-moderate overall.

The meta-analysis finding that school-based interventions were not significantly associated with the prevention of e-cigarette use highlights the need for more high-quality research to develop effective prevention programs, particularly given the existing evidence for school-based programs in preventing tobacco, alcohol and other drug use.22 23 45 When considering the findings of the narrative synthesis, although the components of the three interventions that prevented e-cigarette use varied, they all included a classroom education and skills training component that was delivered over multiple sessions (ranging between 4x25min lessons to a 10hr learning curriculum). The provision of developmentally appropriate information along with resistance and social skills training over a series of structured sessions aligns with established recommendations for effective school-based prevention of tobacco, alcohol and other drugs.46 Additionally, although the ‘CATCH My Breath’ program39 involved peer facilitators, all three programs kept teachers who received training within a central role; another characteristic previously linked to effective school-based tobacco and other drug prevention programs.21 46 Two interventions35 36 also included broader components, such as parental/adult involvement. For example, the core component of the ‘Tobacco-Free Duo’ intervention35 is a formal agreement between the student and a parent/adult to be tobacco-free for 3-years. A previous review of parent-based interventions found mixed results for the prevention of adolescent tobacco and alcohol use, with some interventions producing iatrogenic effects.47 However, the parent intervention components were more intensive than those in the present review and were typically not delivered as part of a broader school-based intervention.

The three interventions identified through the narrative synthesis as being efficacious in preventing e-cigarette use35 36 39 simultaneously produced improvements related to tobacco use, as did two additional interventions which included e-cigarettes within their broad definition of tobacco.40 43 Although both additional interventions also involved classroom education along with resistance and social skills training, only the ‘HoLJouna Pono Drug Prevention Curriculum’43 was delivered over multiple sessions. In contrast, the ‘Education Against Tobacco (EAT)’ intervention40 was delivered as a one-off module via medical students; however, the total intervention dose (90mins) was similar to the efficacious ‘CATCH my breath’ program39 (100mins), and medical students may be considered akin to trained teachers. When tobacco outcomes were meta-analysed, school-based interventions were only associated with improvements in past 30-day tobacco use, but not lifetime use.

This likely relates to the small number of studies eligible for inclusion in the meta-analysis. Moreover, given previous reviews have demonstrated that school-based interventions can prevent tobacco use,21 this may also suggest that current interventions targeting both e-cigarettes and tobacco need to be improved upon. This could be done by ensuring alignment with the principles of effective school-based substance use prevention,46 or by improving engagement and implementation fidelity, which few studies reported on.

Notably, two interventions were associated with iatrogenic effects on the prevention of e-cigarette use44 and tobacco smoking onset.41 This included a “theme week”44 and school-wide policy which also produced null effects on e-cigarette use.41 From the limited descriptions, both interventions appeared broad, without specific classroom education and skills training, nor a theoretical underpinning. While the stated theories behind the interventions that successfully improved e-cigarette/tobacco use varied between the social cognitive theory, the theory of planned behaviour, and the theory of human functioning and school organisation, many of the interventions’ components aligned with the principles of a social competence and influence approach. This approach has previously exhibited the strongest evidence of effectiveness for school-based tobacco and other drug prevention.21 24 46 These findings highlight the critical importance of ensuring schools implement evidence-based programs to prevent e-cigarette/tobacco use.

Despite the lack of overall evidence generated for the prevention of e-cigarette and tobacco use, the meta-analyses indicated that school-based interventions were associated with significant improvements in knowledge, intentions, and attitudes. These constructs are theorised precursors of behaviour change,29 30 yet, in the two studies that examined these constructs along with actual e-cigarette or tobacco use, only one39 observed positive intervention effects on all outcomes, which was at 16-month post-intervention timepoint. The other intervention, ‘Invite Only VR’,42 was associated with improved knowledge, but did not have a significant effect on e-cigarette use. This may have been due to the follow-up period only extending to 6-months, as a previous review found the effects of tobacco preventive interventions tend to only emerge after 1 year.21 Nevertheless, the four interventions identified via the narrative synthesis as having positive effects across knowledge,34 37 39 42 attitudes,34 37 39 normative beliefs,34 harm perceptions,42 and future intentions to use tobacco37 all involved classroom education and skills training that was grounded in theory, again highlighting the potential of this intervention strategy. Three of the interventions34 37 39 also involved peer-led components, which has previously been shown to be effective at addressing adolescent substance use when compared to adult-led education.48 The use of eHealth intervention components, either in hybrid34 39 or eHealth-only42 format, with delivery over multiple sessions also appeared beneficial. Previous research has found school-based eHealth interventions can be effective to prevent substance use, potentially because interactive and pre-programmed content can improve intervention fidelity and enhance student engagement and accessibility.49

Finally, although there were insufficient data for meta-analyses, the narrative synthesis found some interventions were associated with improvements in mental health36 38 and other substance use, including reduced alcohol36 38 and illicit drug use.36 43 This is promising, given the strong associations between mental health and adolescent substance use, including e-cigarette use.2 Indeed, two of these studies36 43 reported simultaneous improvements in e-cigarette and/or tobacco use, both of which involved classroom education and skills training over multiple sessions. Although the ‘Ready4Life’ intervention evaluated in the other study38 did not improve tobacco use, this may have been due to the limited follow-up period of 6-months as well the mobile-app being delivered outside of the classroom, with only 25% of students in the intervention condition engaging with the tobacco/e-cigarette smoking coaching topic.

Limitations & Future Directions

Despite the rigorous methodology, this study had several limitations, including the small number of studies and significant heterogeneity present in many of our meta-analyses.

The quality of evidence was also low for some outcomes and effects were generally small and short-lived. In future, prospective registration of trial protocols would be beneficial to reduce potential bias. Only six out of the 11 identified studies measured actual e-cigarette and/or tobacco cigarette use, and there was substantial variation in the definitions across studies, making it difficult to tease out effects specifically on e-cigarettes compared to tobacco cigarettes and other tobacco products. The timeframes for the longest follow-up were also highly variable, ranging between 6-42 and 36-months.36 Longer-term follow-up periods are important when evaluating substance use preventive interventions, as effects are most likely to emerge in later adolescence as exposure to substances increases.16 21 The remainder of studies focused on theoretical constructs related to e-cigarette/tobacco use, however, to fully understand the efficacy of such interventions in preventing e-cigarette use, assessment of actual substance use is required.

Conclusions

Although some studies demonstrated that school-based e-cigarette preventive interventions can produce positive effects, some interventions negatively impacted students, highlighting the critical importance of supporting schools to identify and adopt evidence-based programs. Overall, our meta-analyses on a small subsample of studies found that school-based interventions were not effective in preventing e-cigarette or tobacco use, however, were associated with significant reductions in past 30-day tobacco use, which encompassed e-cigarettes in some studies. School-based interventions were also associated with improvements in knowledge, intentions, and attitudes, with some individual studies reporting improvements in mental health outcomes and other substance use. Classroom education and student skills training that is grounded in theory and delivered by trained teachers was commonly associated with beneficial program effects. Peer-led and eHealth components also appeared promising to improve precursors of behaviour change, however more research, over the longer-term, is required to evaluate whether this translates into effects on e-cigarette use. Given previous research has demonstrated that school-based interventions can be effective in preventing tobacco, alcohol and other drug use, school-based interventions may have unmet potential for addressing e-cigarette use and more high-quality research is required to develop efficacious interventions.

Data Availability

All data produced in the present study are available upon reasonable request to the authors

Funding

This work was supported by the Paul Ramsay Foundation (award/grant number N/A). The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Competing interests

None declared.

Footnotes

  • amy-leigh.rowe{at}sydney.edu.au, nicola.newton{at}sydney.edu.au, lyra.egan{at}sydney.edu.au, e.hunter{at}sydney.edu.au, emma.devine{at}sydney.edu.au, tess.aitken{at}sydney.edu.au, louise.thornton{at}sydney.edu.au, maree.teesson{at}sydney.edu.au, emily.stockings{at}sydney.edu.au, katrina.champion{at}sydney.edu.au

References

  1. 1.↵
    Banks E, Yazidjoglou A, Brown S, et al. Electronic cigarettes and health outcomes: umbrella and systematic review of the global evidence. Medical Journal of Australia 2023;218(6):267–75. doi: 10.5694/mja2.51890
    OpenUrlCrossRef
  2. 2.↵
    Truong M, Cotton E. The impact of vaping on adolescent mental health. In: Australian Institute of Family Studies, ed., 2023.
  3. 3.↵
    Yuan M, Cross SJ, Loughlin SE, et al. Nicotine and the adolescent brain. The Journal of Physiology 2015;593(16):3397-412. doi: 10.1113/JP270492
    OpenUrlCrossRefPubMed
  4. 4.↵
    Gardner LA, O’Dean S, Champion KE, et al. Prevalence, patterns of use, and socio-demographic features of e-cigarette use by Australian adolescents: a survey. Medical Journal of Australia 2023;219:332–34.
    OpenUrl
  5. 5.↵
    Statistics Canada. Canadian Tobacco and Nicotine Survey (CTNS), 2021. In: Statistics C, ed. V1 ed: Abacus Data Network, 2023.
  6. 6.↵
    Birdsey J, Cornelius M, Jamal A, et al. Tobacco Product Use Among U.S. Middle and High School Students — National Youth Tobacco Survey, 2023. Morbidity and Mortality Weekly Report 2023;72:1173–82.
    OpenUrl
  7. 7.↵
    Vrinten C, Parnham JC, Radó MK, et al. Patterns of cigarette and e-cigarette use among UK adolescents: a latent class analysis of the Millennium Cohort Study. European Journal of Public Health 2023;33(5):857–63. doi: 10.1093/eurpub/ckad124
    OpenUrlCrossRef
  8. 8.↵
    Yoong SL, Hall A, Turon H, et al. Association between electronic nicotine delivery systems and electronic non-nicotine delivery systems with initiation of tobacco use in individuals aged < 20 years. A systematic review and meta-analysis. PloS one 2021;16(9):e0256044. doi: 10.1371/journal.pone.0256044 [published Online First: 2021/09/09]
    OpenUrlCrossRefPubMed
  9. 9.↵
    Soneji S, Barrington-Trimis JL, Wills TA, et al. Association Between Initial Use of e-Cigarettes and Subsequent Cigarette Smoking Among Adolescents and Young Adults: A Systematic Review and Meta-analysis. JAMA Pediatr 2017;171(8):788–97. doi: 10.1001/jamapediatrics.2017.1488 [published Online First: 2017/06/28]
    OpenUrlCrossRefPubMed
  10. 10.↵
    Wakefield M, Haynes A, Tabbakh T, et al. Current vaping and current smoking in the Australian population aged 14+ years: February 2018-March 2023. In: Care DoHaA, ed.: Centre for Behavioural Research in Cancer, Cancer Council Victoria, 2023.
  11. 11.↵
    Hammond D, Reid JL, Rynard VL, et al. Prevalence of vaping and smoking among adolescents in Canada, England, and the United States: repeat national cross sectional surveys. Bmj 2019;365:l2219. doi: 10.1136/bmj.l2219 [published Online First: 2019/06/22]
    OpenUrlAbstract/FREE Full Text
  12. 12.↵
    Rethink Addiction and KPMG. Understanding the Cost of Addiction in Australia. Richmond, Victoria: Rethink Addiction, 2022.
  13. 13.↵
    The Therapeutic Goods Administration. Nicotine vaping product access Canberra: Commonwealth of Australia; 2022 [Available from: https://www.tga.gov.au/products/medicines/prescription-medicines/nicotine-vaping-products-hub/nicotine-vaping-product-access#:~:text=On%2021%20December%202020%2C%20the,nicotine%20pods%20and%20liquid%20nicotine. accessed 11 May 2023.
  14. 14.↵
    Watts C, Egger S, Dessaix A, et al. Vaping product access and use among 14–17-year-olds in New South Wales: a cross-sectional study. Australian and New Zealand Journal of Public Health 2022;46(6):814–20. doi: 10.1111/1753-6405.13316
    OpenUrlCrossRefPubMed
  15. 15.↵
    Jenkins C, Powrie F, Kelso C, et al. Chemical Analysis and Flavour Distribution of Electronic Cigarettes in Australian Schools. ChemRxiv (This content is a preprint and has not been peer-reviewed) 2023 doi: 10.26434/chemrxiv-2023-rlmhl
    OpenUrlCrossRef
  16. 16.↵
    Guerin N, White V. ASSAD 2017 Statistics & Trends: Australian Secondary Students’ Use of Tobacco, Alcohol, Over-the-counter Drugs, and Illicit Substances: Cancer Council Victoria, 2018.
  17. 17.↵
    Tully L. Early intervention strategies for children and young people 8 to 14 years: literature review. NSW department of community services 2007
  18. 18.↵
    Harris K, King R, Gordon-Larsen P. Healthy Habits among Adolescents: Sleep, Exercise, Diet, and Body Image 2005:111–32.
  19. 19.↵
    Authority ACAaR. Health and physical education (version 8.4) 2016 [Available from: https://www.australiancurriculum.edu.au/f-10-curriculum/health-and-physical-education/.
  20. 20.↵
    Wiehe SE, Garrison MM, Christakis DA, et al. A systematic review of school-based smoking prevention trials with long-term follow-up. J Adolesc Health 2005;36(3):162–9. doi: 10.1016/j.jadohealth.2004.12.003 [published Online First: 2005/03/02]
    OpenUrlCrossRefPubMedWeb of Science
  21. 21.↵
    Thomas RE, McLellan J, Perera R. Effectiveness of school-based smoking prevention curricula: systematic review and meta-analysis. BMJ Open 2015;5(3):e006976. doi: 10.1136/bmjopen-2014-006976 [published Online First: 2015/03/12]
    OpenUrlAbstract/FREE Full Text
  22. 22.↵
    Newton NC, Stapinski LA, Slade T, et al. The 7-Year Effectiveness of School-Based Alcohol Use Prevention From Adolescence to Early Adulthood: A Randomized Controlled Trial of Universal, Selective, and Combined Interventions. J Am Acad Child Adolesc Psychiatry 2022;61(4):520–32. doi: 10.1016/j.jaac.2021.10.023 [published Online First: 2021/11/26]
    OpenUrlCrossRefPubMed
  23. 23.↵
    Thomas RE, McLellan J, Perera R. School-based programmes for preventing smoking. Cochrane Database Syst Rev 2013;2013(4):Cd001293. doi: 10.1002/14651858.CD001293.pub3 [published Online First: 2013/05/02]
    OpenUrlCrossRef
  24. 24.↵
    Cuijpers P. Effective ingredients of school-based drug prevention programs. A systematic review. Addict Behav 2002;27(6):1009–23. doi: 10.1016/s0306-4603(02)00295-2 [published Online First: 2002/10/09]
    OpenUrlCrossRefPubMedWeb of Science
  25. 25.↵
    Gardner LA, Rowe A-L, Newton NC, et al. School-based preventive interventions targeting e-cigarette use among adolescents: a systematic review protocol. BMJ Open 2022;12(9):e065509. doi: 10.1136/bmjopen-2022-065509
    OpenUrlAbstract/FREE Full Text
  26. 26.↵
    Moher D, Shamseer L, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev 2015;4(1):1. doi: 10.1186/2046-4053-4-1 [published Online First: 2015/01/03]
    OpenUrlCrossRefPubMed
  27. 27.↵
    Higgins J, Thomas J, Chandler J, et al. Cochrane Handbook for Systematic Reviews of Interventions version 6.4 (updated August 2023): Cochrane, 2023.
  28. 28.↵
    Faraone SV. Interpreting estimates of treatment effects: implications for managed care. P t 2008;33(12):700–11. [published Online First: 2009/09/15]
    OpenUrlPubMed
  29. 29.↵
    Bandura A. Social foundations of thought and action: A social cognitive theory. Englewood Cliffs, N.J: Prentice-Hall 1986.
  30. 30.↵
    Ajzen I. The theory of planned behavior. Organizational Behavior and Human Decision Processes 1991;50(2):179–211. doi: 10.1016/0749-5978(91)90020-T
    OpenUrlCrossRef
  31. 31.↵
    Higgins JPT, Altman DG, Gøtzsche PC, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ 2011;343:d5928. doi: 10.1136/bmj.d5928
    OpenUrlFREE Full Text
  32. 32.↵
    Sterne JA, Hernán MA, Reeves BC, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ 2016;355:i4919. doi: 10.1136/bmj.i4919
    OpenUrlFREE Full Text
  33. 33.↵
    Guyatt GH, Oxman AD, Schünemann HJ, et al. GRADE guidelines: a new series of articles in the Journal of Clinical Epidemiology. J Clin Epidemiol 2011;64(4):380–2. doi: 10.1016/j.jclinepi.2010.09.011 [published Online First: 2010/12/28]
    OpenUrlCrossRefPubMed
  34. 34.↵
    Asdigian NL, Riggs NR, Valverde PA, et al. Reducing Youth Vaping: A Pilot Test of the Peer-Led “Youth Engaged Strategies for Changing Adolescent Norms!” (YES-CAN!) Program. Health Promot Pract 2023;24(5):956–62. doi: 10.1177/15248399221100793 [published Online First: 2022/06/10]
    OpenUrlCrossRef
  35. 35.↵
    Beeres D, Arnö E, Pulkki-Brännström AM, et al. Evaluation of the Swedish school-based program “tobacco-free DUO” in a cluster randomized controlled trial (TOPAS study). Results at 2-year follow-up. Prev Med 2022;155:106944. doi: 10.1016/j.ypmed.2021.106944 [published Online First: 2021/12/31]
    OpenUrlCrossRef
  36. 36.↵
    Bonell C, Dodd M, Allen E, et al. Broader impacts of an intervention to transform school environments on student behaviour and school functioning: post hoc analyses from the INCLUSIVE cluster randomised controlled trial. BMJ Open 2020;10(5):e031589. doi: 10.1136/bmjopen-2019-031589 [published Online First: 2020/05/18]
    OpenUrlAbstract/FREE Full Text
  37. 37.↵
    Brown LD, Bandiera FC, Harrell MB. Cluster Randomized Trial of Teens Against Tobacco Use: Youth Empowerment for Tobacco Control in El Paso, Texas. Am J Prev Med 2019;57(5):592–600. doi: 10.1016/j.amepre.2019.06.013 [published Online First: 2019/10/01]
    OpenUrlCrossRef
  38. 38.↵
    Haug S, Boumparis N, Wenger A, et al. Efficacy of a Mobile App-Based Coaching Program for Addiction Prevention among Apprentices: A Cluster-Randomized Controlled Trial. Int J Environ Res Public Health 2022;19(23) doi: 10.3390/ijerph192315730 [published Online First: 2022/12/12]
    OpenUrlCrossRef
  39. 39.↵
    Kelder SH, Mantey DS, Van Dusen D, et al. A Middle School Program to Prevent E-Cigarette Use: A Pilot Study of “CATCH My Breath”. Public Health Rep 2020;135(2):220–29. doi: 10.1177/0033354919900887 [published Online First: 2020/01/23]
    OpenUrlCrossRef
  40. 40.↵
    Lisboa OC, Bernardes-Souza B, Xavier LEF, et al. A Smoking Prevention Program Delivered by Medical Students to Secondary Schools in Brazil Called “Education Against Tobacco”: Randomized Controlled Trial. J Med Internet Res 2019;21(2):e12854. doi: 10.2196/12854 [published Online First: 2019/02/23]
    OpenUrlCrossRef
  41. 41.↵
    Rozema AD, Hiemstra M, Mathijssen JJP, et al. Impact of an Outdoor Smoking Ban at Secondary Schools on Cigarettes, E-Cigarettes and Water Pipe Use among Adolescents: An 18-Month Follow-Up. Int J Environ Res Public Health 2018;15(2) doi: 10.3390/ijerph15020205 [published Online First: 2018/01/26]
    OpenUrlCrossRef
  42. 42.↵
    Weser VU, Duncan LR, Sands BE, et al. Evaluation of a virtual reality E-cigarette prevention game for adolescents. Addict Behav 2021;122:107027. doi: 10.1016/j.addbeh.2021.107027
    OpenUrlCrossRef
  43. 43.↵
    Okamoto SK, Kulis SS, Helm S, et al. An Efficacy Trial of the Ho’ouna Pono Drug Prevention Curriculum: An Evaluation of a Culturally Grounded Substance Abuse Prevention Program in Rural Hawai’i. Asian Am J Psychol 2019;10(3):239–48. doi: 10.1037/aap0000164 [published Online First: 2020/05/13]
    OpenUrlCrossRef
  44. 44.↵
    Williams GC, Cole AG, de Groh M, et al. More support needed: Evaluating the impact of school e-cigarette prevention and cessation programs on e-cigarette initiation among a sample of Canadian secondary school students. Preventive Medicine 2022;155:106924. doi: 10.1016/j.ypmed.2021.106924
    OpenUrlCrossRef
  45. 45.↵
    Rowland B, Benstead M, Ghayour Minaie M, et al. A review of alcohol and drug education and early intervention programs in Australian government schools. Victoria, Australia, 2019.
  46. 46.↵
    Botvin GJ, Griffin KW. School-based programmes to prevent alcohol, tobacco and other drug use. International Review of Psychiatry 2007;19(6):607–15. doi: 10.1080/09540260701797753
    OpenUrlCrossRefPubMedWeb of Science
  47. 47.↵
    Champion KE, Gardner LA, McCann K, et al. Parent-based interventions to improve multiple lifestyle risk behaviors among adolescents: A systematic review and meta-analysis. Preventive Medicine 2022;164:107247. doi: 10.1016/j.ypmed.2022.107247
    OpenUrlCrossRef
  48. 48.↵
    Mellanby AR, Rees JB, Tripp JH. Peer-led and adult-led school health education: a critical review of available comparative research. Health Education Research 2000;15(5):533–45. doi: 10.1093/her/15.5.533
    OpenUrlCrossRefPubMedWeb of Science
  49. 49.↵
    Champion KE, Newton NC, Barrett EL, et al. A systematic review of school-based alcohol and other drug prevention programs facilitated by computers or the Internet. Drug and Alcohol Review 2013;32(2):115–23. doi: 10.1111/j.1465-3362.2012.00517.x
    OpenUrlCrossRefPubMedWeb of Science
Back to top
Posted December 22, 2023.
Download PDF
Data/Code
Email
A systematic review and meta-analysis of school-based preventive interventions targeting e-cigarette use among adolescents
Lauren A. Gardner, Amy-Leigh Rowe, Nicola C. Newton, Lyra Egan, Emily Hunter, Emma K. Devine, Tess Aitken, Louise Thornton, Maree Teesson, Emily Stockings, Katrina E. Champion
medRxiv 2023.12.19.23300263; doi: https://doi.org/10.1101/2023.12.19.23300263
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools

Subject Area