Abstract
On April 13, 2021 the Centers for Disease Control and Prevention (CDC) and Food and Drug Administration (FDA) recommended in a pause in use of the Johnson & Johnson (J&J)-Janssen COVID-19 vaccine due to reports of cerebral venous sinus thrombosis (CVST) in recently vaccinated individuals. The announcement of the pause required development of a coordinated communication strategy under extreme time pressure and careful messaging by stakeholders to mitigate reduced public confidence in COVID-19 vaccines, as was observed following the temporary suspension of the Oxford-AstraZeneca vaccine in many countries. In this survey study, we evaluated understanding and impressions of the CDC’s public online information about the J&J-Janssen pause among unvaccinated US adults.
Introduction
On April 13, 2021 the Centers for Disease Control and Prevention (CDC) and Food and Drug Administration (FDA) recommended in a pause in use of the Johnson & Johnson (J&J)-Janssen COVID-19 vaccine due to reports of cerebral venous sinus thrombosis (CVST) in recently vaccinated individuals.1 The announcement of the pause required development of a coordinated communication strategy under extreme time pressure and careful messaging by stakeholders to mitigate reduced public confidence in COVID-19 vaccines, as was observed following the temporary suspension of the Oxford-AstraZeneca vaccine in many countries.2,3 In this survey study, we evaluated understanding and impressions of the CDC’s public online information about the J&J-Janssen pause among unvaccinated US adults.
Methods
We administered the online survey to two cohorts of US adults recruited through Prolific between April 19-21, 2021 (cohort A) and April 21-23, 2021 (cohort B). The passages and survey questions are provided in eAppendix 1 and eAppendix 2. Cohort B was given an updated version of the web page text, reflecting changes made by the CDC on April 20, 2021.
Both cohorts were assembled using convenience sampling of unvaccinated adults; the first cohort was further restricted to individuals who expressed neutral or negative sentiments about COVID-19 vaccines (eMethods). The study was approved by Harvard University’s Committee on the Use of Human Subjects, and participants agreed to a consent statement on the first page of the survey.
Associations between participant characteristics and responses to the comprehension questions were assessed using ordinal logistic regression.
Results
The Simple Measure of Gobbledygook readability grade was 12.9 for the first version and 12.7 for the second version of the passage (eMethods).
N = 271 and N = 286 participants were included in cohort A and cohort B, respectively; their demographic characteristics are listed in the Table. Across participants the median number of correct responses to the comprehension questions was 6 in both cohort A (IQR, 1.5; range, 0-7) and cohort B (IQR, 1.0; range, 1-7). In cohort B, a majority of respondents answered that a person who develops a severe headache after receiving the J&J-Janssen vaccine should self-monitor for 24 hours (87 [30.4%]) or report the side effect through CDC’s v-safe application (74 [25.9%]) instead of seeking immediate medical care for possible CVST (eTable1). Total number of correct responses was negatively associated with intention not to seek vaccination in both cohort A (odds ratio [OR], 0.61; 95% CI, 0.45-0.82; P = .001; eTable2) and cohort B (OR, 0.48; 95% CI, 0.31-0.74; P = .001; eTable3).
Characteristics and Responses of Participants Who Completed the Online Surveys About the J&J-Janssen Vaccine Pause
The web page mentioned “a small number of reports” of CVST in individuals who received the J&J-Janssen vaccine. When asked to guess a specific number, 188 (69.4%) respondents in cohort A and 133 (46.5%) respondents in cohort B estimated 100 or more cases, at least an order of magnitude higher than the actual value; 176 (64.9%) respondents in cohort A and 128 (44.8%) respondents in cohort B estimated 10 or more deaths after vaccination (Figure). In addition, over one third of participants in both cohorts (126 [46.5%] and 106 [37.1%], respectively) predicted that the pause would last longer than 2 months.
The graphs show (A) the number of respondents who expressed changes in attitude before and after the pause in response to three counterfactual questions and (B) the estimated number of cases and deaths that led to the pause. 0 was not included as an answer choice for the question about cases.
In response to a counterfactual question (eMethods), 127 (46.9%) participants in cohort A and 139 (48.6%) participants in cohort B indicated that the pause reduced their confidence in the safety of the J&J-Janssen vaccine (Figure). A majority of participants reported no change in their confidence in the safety of COVID-19 vaccines in general (182 [67.2%] for cohort A, 194 [67.8%] for cohort B) or intention to receive the Pfizer-BioNTech or Moderna vaccine (206 [76.0%] for cohort A, 211 [73.8%] for cohort B).
Discussion
After reading online information from the CDC about the J&J-Janssen pause, many respondents overestimated the number of case reports that prompted the pause. Since verbal descriptors are elastic concepts that can be misinterpreted, grounding them with numbers can reduce variability in risk perception and promote informed decision making.4
Respondents also expressed reduced confidence in the safety of the J&J-Janssen vaccine, highlighting the danger of conveying piecemeal information about risk during a pandemic response.3 The negative association between understanding of the passage and self-reported vaccine hesitancy, and the unwillingness of most participants to share the information on social media, suggest a need for more targeted and accessible messaging to promote confidence in the J&J-Janssen vaccine among unvaccinated adults.5,6
The study is limited by the convenience sampling strategy, which was used to investigate response to the J&J-Janssen vaccine pause soon after it was announced. The participants recruited were not representative of the US population as a whole, and the findings of this study should not be generalized to other contexts.
Author Contributions
Drs Mishra and Dexter had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.
Concept and design
Both authors.
Acquisition, analysis, or interpretation of data
Both authors.
Drafting of the manuscript
Both authors.
Critical revision of the manuscript for important intellectual content
Both authors.
Statistical analysis
Both authors.
Obtained funding
Dexter.
Supervision
Both authors.
Conflict of Interest Disclosures
Dr Dexter reported receiving grants from the Poynter Institute, the Neukom Institute for Computational Science, and the Harvard Data Science Initiative during the conduct of the study. No other disclosures were reported.
Funding/Support
This work was supported by a CoronaVirusFacts Alliance Grant from the Poynter Institute, a Neukom Fellowship, and a Harvard Data Science Fellowship.
Role of the Funder/Sponsor
The funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.