Abstract
In the absence of highly effective antiviral therapies against SARS-CoV-2, it is crucial to counter the known pathophysiological causes of severe COVID-19. Evaluating the efficacy existing drugs may expedite the development of such therapeutics. Severe COVID-19 is largely the result of a dysregulated immune response characterized by lymphocytopenia, neutrophilia and critical hypercytokinemia, or “cytokine storm,” which is largely mediated by the cytokine interleukin-6 (IL-6). The IL-6 inhibitor tocilizumab (TCZ) could potentially suppress the effects of the pro-inflammatory cytokine and thereby lower mortality from the disease. This systematic analysis aimed to investigate and synthesize existing evidence for the efficacy of TCZ in reducing COVID-19 mortality. PubMed and SearchWorks searches were performed to locate clinical studies with primary data on TCZ treatment for severe COVID-19. Sixteen case-control studies comparing mortality between TCZ and standard of care (SOC) were identified for quantitative synthesis. Combined mortality for the TCZ-treated and SOC groups were 26.0% and 43.4% respectively. In all but one of the studies, the odds ratio of mortality from COVID-19 pointed towards lower fatality with TCZ versus the SOC. A combined random effects odds ratio calculation yielded an odds ratio of 0.453 (95% CI 0.376-0.547, p<0.001). Additionally, eighteen uncontrolled trials were identified for qualitative analysis producing a raw combined mortality rate of 16.0%. Important caveats to this research include the lack of prospective randomized control trials (RCTs) and the absence of data from the large COVATA study from the published literature. However, results from this systematic analysis of published research provide positive evidence for the potential efficacy of TCZ to treat severe COVID-19, validating the ethical basis and merit of ongoing randomized controlled clinical trials.
Introduction
Coronavirus Disease 2019 (COVID-19) – caused by the novel Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) – manifests in a broad range of disease severity. Roughly 85% of confirmed cases present as a mild respiratory illness defined as minor fatigue, low-grade fever and dry cough, 15% develop severe pneumonia requiring hospitalization and 5% become critical indicated by acute respiratory distress syndrome (ARDS), septic shock, and multi-organ failure resulting in ICU admission, mechanical ventilation, and death.1 The most significant known risk factors for COVID-19-related death are increasing age, chronic comorbidities including diabetes, cardiac disease, pulmonary and kidney dysfunction and male sex.2 A dysregulated immune response – characterized by decreased T-cell counts, increased inflammatory cytokines and extra-pulmonary systemic hyperinflammation syndrome – is principally responsible for inducing critical pulmonary failure observed in COVID-19 and largely driven by interleukin-6 (IL-6).3 This systematic review concerns the efficacy of an interleukin-6 inhibitor, tocilizumab (TCZ) in reducing severe COVID-19 mortality.
COVID-19 Dysregulated Immune Response and the Role of IL-6
Severe COVID-19 is characterized by a dysregulated immune response to SARS-CoV-2 infection that is implicated in disease mortality even after viral load decreases.4 The immune dysregulation presents with two sequential and diametrically opposed reactions that both instigate symptom aggravation.5 The first pattern is impaired adaptive immune response with lymphocytopenia, which includes markedly reduced CD4+ and CD8+ T-cells, B-cells and natural killer (NK) cells. While T-cells are significantly decreased in all COVID-19 patients, reduction in B and NK cells are more affected in severe cases.6,7 Adaptive immune cell depletion impairs the body’s ability to clear the virus and mitigate inflammatory reactions. 8
The second deleterious response is an over-activation of the innate immune system. This pathogenic response is characterized by an increase in neutrophils and pro-inflammatory cytokines including IL-6, IL-1β, IL-2, IL-8, CCL3 and TNF-α. The rapidly increasing cytokine levels – also known as a “cytokine storm” – drives progression to septic shock, tissue damage and multiple organ failure (heart, liver, kidney, respiratory).5 The effects are instigated by excessive NF-κB pathway activation, alarmin release by damaged epithelial cells, neutrophil and macrophage infiltration, and alveolar damage by vessel permeability and alveolar wall thickening.8
Roughly three-quarters of patients in severe condition present with IL-6 mediated respiratory failure.9 IL-6 concentration is thus a reliable predictor of COVID-19 severity as it is significantly elevated in fatal cases.10 IL-6 has pleotropic effects including hematopoiesis, metabolic regulation, inflammation, autoimmunity and acute phase response.11 Some IL-6-dependent outcomes help stave off infections such as directing neutrophil migration to the infection site, increasing CD8+ T cell cytolytic capacity, and regulating antiviral thermostatic reactions. However, IL-6 is also implicated in viral infection disease progression as it leads to tissue permeability and edema, reduces IFN-γ production, drives anti-apoptotic molecules and promotes excessive neutrophil survival. The above adverse effects promote lethal inflammation and enable viral infiltration to distant organs.12 Furthermore, elevated serum IL-6 is associated with impaired cytotoxic activity of NK cells, thus weakening their virus-killing capacity.13 IL-6 is known to increase the rate of fibrotic clot formation, so it also may play a role in the thrombotic complications observed in COVID-19.12 The renin-angiotensin system, which controls blood pressure and electrolyte balance, is an additional important factor in IL-6 modulation and COVID-19 pathology. As virus binds ACE2, thus reducing its availability, there is an increase of angiotensin II in COVID-19 patients, creating a positive feedback loop that advances pro-inflammatory signaling. 12 The responses and physiological effects of IL-6 release are summarized in Figure 1.
Responses to IL-6 release and their physiological effects. Red indicates negative consequences while green designates positive ones in COVID-19.
COVID-19 Treatments Antivirals
Without a targeted drug for COVID-19, scientists and clinicians are attempting to rapidly find alternative treatments and solutions to combat the disease’s lethal immunological effects.14 One strategy is to utilize existing antiviral drugs with the expectation that they may exhibit similar effects against SARS-CoV-2. One of the more promising treatments is RNA-dependent RNA polymerase inhibitor remdesivir which is shown to reduce COVID-19 mortality but is less effective in severe cases.15 Other commonly used antivirals are hydroxychloroquine and chloroquine. Despite widespread utilization for COVID-19 patients, evidence is lacking for the clinical efficacy and prophylactic properties of hydroxychloroquine or chloroquine despite their in vitro antiviral and in vivo immunomodulatory properties.16
Immune Suppressants
There are numerous investigations of existing immune suppressing and anti-cytokine interventions to counter the dysregulated, excessive immune response. After early evidence and recommendations against the use of corticosteroids to treat severe COVID-19,17,18 a large randomized evaluation of dexamethasone found that the drug significantly reduced 28-day mortality in patients included in the study (rate ratio 0.83; 95% CI 0.74-0.92; p<0.001). However, mortality rate reductions varied depending on baseline respiratory demands upon randomization as there was reduction for patients on mechanical ventilation and oxygen but not for patients without respiratory support.19 As of mid-August 2020, the WHO modified their recommendation against corticosteroids to include judicious administration under respiratory failure with ARDS.20 Because of the systemic effects of corticosteroids, more options for targeted immune regulation is warranted. Common targets for inhibition include IL-6, the IL-1 family (IL-1β and IL-18), TNF-α and IFN-γ cytokines and the JAK pathway.8
IL-6 is a particularly promising target due to its correlation with ARDS severity and mortality.21 IL-6 inhibitors are already successfully utilized for other cytokine storm syndromes such as adverse T cell therapy reactions and Still’s disease-associated hemophagocytic lymphohistiocytosis.8 In COVID-19, IL-6 inhibitors should be carefully administered with appropriate timing due to its control of viral replication.22
IL-6 Inhibitor Tocilizumab
Tocilizumab (TCZ) [Actemra] is a recombinant monoclonal antibody with a humanized murine variable domain and a human IgG1 constant domain. TCZ binds to both membrane-bound and soluble IL-6 receptors, thus preventing IL-6 mediated signal transduction. The drug was initially developed to treat rheumatoid arthritis and now it is also approved for giant cell arteritis and similar autoimmune ailments. Its safety profile was analyzed in a phase III double-blind placebo-controlled trial and it is reportedly effective in treating other cases severe cytokine release syndrome such as chimeric antigen receptor T-cell immunotherapy.11
While TCZ is not yet approved for treatment of COVID-19, clinicians across the globe are utilizing the drug under emergency use authorization, including in the United States. One of the largest initial observational studies of TCZ evaluated 547 COVID-19 ICU patients in New Jersey comparing the survival rate of 134 individuals treated with standard of care (SOC) and TCZ with SOC controls finding a 46% and 56% mortality rate respectively and a 0.76 adjusted hazard ratio.23 However, there was insufficient statistical power to conclude clinical efficacy of TCZ with the clinical data and they only focused cases that already progressed to a critical stage leading to an inflated mortality rate for both groups.
Randomized controlled trials (RCT) are the gold standard for evaluating the clinical efficacy of a drug. The first analyzed RCT for TCZ presented negative results. Genentech (Roche) – the producer of TCZ – discontinued their 450-participant phase III trial COVACTA because it failed to meet the primary endpoint of improved clinical status after 4 weeks with TCZ versus the SOC.24 The disappointing outcome from COVACTA places serious doubt on the efficacy of TCZ against COVID-19. Additionally, another IL-6 inhibitor Sarilumab failed its Phase III RCT in the United States but still has some ongoing (NCT04322773, NCT04327388, NCT04412772).25 Other IL-6 inhibitors under investigation include siltuximab (SYLVANT, NCT04322188) and fingolimod (NCT04280588) Nonetheless, several phase III and phase II RCTs remain in progress into at least September (REMDACTA, NCT04409262; NCT04372186, NCT04356937) and healthcare providers are still currently administering TCZ globally for advanced COVID-19 cases. However, the logic of suppressing IL-6 remains convincing. Therefore, it is essential that the known impact of TCZ is analyzed in a systematic manner to ascertain whether its continuing use is ethical, even in RCTs. Since dexamethasone is a broadly acting immunosuppressant, it should be noted that the use of this drug in clinical trials may obscure the effects of more targeted immunomodulatory drugs like TCZ.
Existing systematic reviews investigate only case studies of TCZ treatment without controls.26,27 Therefore, this systematic review will synthesize the evidence from individual case-control studies and analyze uncontrolled trials to determine whether the drug is potentially effective at reducing severe COVID-19-related mortality, thus corroborating the logic for continuing RCTs to evaluate the potential use of IL-6 inhibitors.
Systematic Review Methods and Statistics
Articles utilized for the systematic review were selected from a PubMed search on August 4, 2020. For the initial screening, the primary search terms were COVID-19 or SARS-CoV-2 and tocilizumab. Papers with primary data for a case-control study comparing mortality rate from severe COVID-19 between TCZ and standard of care (SOC) were included for data synthesis. Uncontrolled studies on severe COVID-19 mortality with TCZ were reviewed separately without data synthesis. Exclusion criteria included papers without primary data, case reports, reviews, protocols, and studies without mortality numbers available or potentially repeating patient data. An additional search was performed on SearchWorks to identify case-control studies not found in PubMed.
For each study included in the synthesis, the mortality rate for the TCZ and SOC group were calculated. In the controlled studies, the odds ratio (RR) of mortality from COVID-19 with TCZ versus the SOC was determined followed by the 95% confidence interval (CI) and p-value calculation. The data from the individual controlled studies were synthesized by a random effects meta-analysis calculation using MedCalc software. MedCalc was also used to perform a sample size calculation with an alpha of 0.01 and power of 90% to detect a difference between the total crude TCZ and SOC mortality rates.
The systematic review protocol was pre-registered with PRISMA and approved on June 22, 2020 (CRD42020193479).
Results
A total of 314 articles were identified by the initial PubMed search and three additional case-control studies were found on a SearchWorks (Fig. 2).28 38 articles were selected for full-text review yielding 16 uncontrolled studies for qualitative analysis and 18 case-control studies for both quantitative synthesis and qualitative analysis. The study characteristics for the controlled studies are summarized in Supplementary Table 1 while the uncontrolled studies are outlined in Supplementary Table 3.
Study characteristics for the controlled trials
Individual subjective strengths and additional specific shortcomings of controlled trials
Study characteristics for the uncontrolled trials.
PRISMA flow diagram for systematic review article search.28
Controlled Studies
The systematic review of sixteen controlled studies encompassed a total of 1008 TCZ-treated and 1537 SOC control patients (Table 1). 13 of the studies occurred in a single medical center while the remaining 3 aggregated data from multiple hospitals. The largest patient contributions to the analysis were from the multiple-hospital studies [Ip et al. and Guaraldi et al.] The baseline patient characteristic for all but one study [Guaraldi et al.] was severe COVID-19, generally qualified by oxygen supplementation needs. Ip et al., Eimer et al. and Potere et al. only analyzed patients who were already admitted into the ICU. 61% and 44.8% of both cases and controls in Rojas-Marte et al. and Roumier et al. respectively began the trial in critical condition. There was some variation in TCZ administration and SOC treatments, the most common being hydroxychloroquine – utilized in all but one study (Capra et al.) – and lopinavir/ritonavir. Length of observation ranged from 7 days to 30 days with endpoints of death or discharge. Mean age of participants in the treatment and control groups was 55.5 to 76.8 with no more than 6.1 years separating the two groups within one study.
Quantitative synthesis of individual case-control study mortality data.
Combined mortality for the TCZ-treated and SOC groups were 26.0% and 43.4% respectively. All of the studies trended toward lower mortality from severe COVID-19 with TCZ versus the SOC with the exception of Patel et al. Six studies yielded a statistically significant result (Capra et al., Guaraldi et al., Gokhale et al., Rossotti et al., Somers et al., Potere et al.) (Fig. 3). A random effects odds ratio analysis generated an odds ratio of 0.453 (95% CI 0.376-0.547) with a p-value less than 0.001. A sample size analysis with alpha of 0.01 and power of 90% determined that 392 total case and control patients are needed to detect a difference between 26.0% and 43.4% mortality. With the exception of Capra et al., the studies also scattered symmetrically around the overall odds ratio from the analysis suggesting a low likelihood of publication bias (Fig. 4). TCZ patients in five studies had significant secondary bacteremia but one reported a lower rate than the SOC (Rojas Marte et al.). Eight studies reported no adverse effects from TCZ.
Forrest plot depicting odds ratio for death from severe COVID-19 with TCZ versus the SOC.
Funnel plot relating the odds ratio to the standard of the effect estimate for each study. Vertical blue line depicts the overall random effects odds ratio.
Center point on each line is the odds ratio for the study with the size of the circle correlating to the percent contribution to the total random effects calculation. Horizontal length corresponds to the 95% CI. The Total (Random Effects) synthesizes data from the 16 individual case-control studies.
Several variables varied between studies that could impact the mortality rate results. These include SOC, observation time, TCZ administration, treatment date, baseline clinical characteristics, geographic location and resources and mean/median age. Study design was also an important varying factor that may change results as nine of the sixteen studies matched cases with controls and thirteen studies were retrospective as opposed to prospective cohort.
Uncontrolled Studies
The 18 uncontrolled trials encompassed 886 total patients who received TCZ. The mortality rate from severe COVID-19 ranged from 0% to 42.4% (SD 9.87%), although the two studies with 0% had relatively small sample sizes (20 for Xu et al. and 12 for Borku Uysal et al.). The raw overall mortality rate from the 12 studies is 16.0%. The initial patient severity level ranged from “severe” – requiring supplemental oxygen – to ICU admission. One study only investigated ICU patients (Issa et al.) and others included as many as 77.7% on MV. SOC varied more widely in the uncontrolled trials than the controlled, but hydroxychloroquine was still the most common additional drug used. Few major side effects such as bacterial/fungal infections and increased hepatic enzymes were reported.
Comparing the combined data between uncontrolled (n=18) and controlled trials (n=14) with TCZ (Table 2), excluding controlled studies with all the patients initially in the ICU, the mortality rate was 19.3% and 16.0% respectively (p=0.384).
Comparison of mortality rate between controlled (n=14) and uncontrolled (n=18) studies. Mortalities and total patient values are simple tallies from each study.
Discussion
Controlled Studies
The purpose of this systematic analysis was to analyze and synthesize clinical data on the efficacy of TCZ treatment against severe COVID-19. In the sixteen existing case-control trials published as of August 4, 2020, combined mortality for the TCZ-treated and SOC groups were 26.0% and 43.4% respectively. All of the studies at least trended towards reduced mortality with TCZ with one exception (Fig. 2) including six with statistical significance (Capra et al., Guaraldi et al., Gokhale et al., Rossotti et al., Somers et al., Potere et al.). After performing a quantitative synthesis, the random effects odds ratio of mortality with TCZ versus the SOC was 0.453 (95% CI 0.376-0.547, p<0.001) illustrating a reported difference in patient outcomes associated with the use of TCZ. There was no indication of publication bias except for Capra et al. (Fig. 3) and the number of patients in the meta-analysis exceeded the 392 required total case and control patients to statistically detect the difference in mortality rate. TCZ also appears to be mostly benign as few serious side effects were reported in most of the studies. As expected from an immune suppressant, the most notable adverse event was secondary infection reaching as high as 32.4% of participants (Rossotti et al.) but not at a statistically greater rate than SOC. Although the value of any single controlled clinical study does not hold definitive proof of efficacy, the consistent positive trend and statistical significance from the combined data in this analysis corroborates TCZ’s potential positive effects.
It is important to acknowledge that only one of the studies (Guaraldi et al.) randomized who received TCZ which introduces the possibility for selection bias into each study’s research methodology. Specific strengths and shortcomings for the controlled trials are outlined in Supplementary Table 2, which points towards additional methodological issues in each of the studies analyzed. Common themes include short observation timing, small sample size, difference in treatment time (later patients may benefit from better SOC), variation in disease severity within groups which can confound results, and changes to TCZ administration mid-study.
Additionally, it is possible that individual studies finding a negative effect of TCZ were not published and could not be accounted for in this systematic review. Most notably, the known public results from the COVACTA trial were not yet released in published format as of late August and were therefore not included in the quantitative synthesis. It is significant that the RCT COVACTA did not find reduced COVID-19 mortality with TCZ versus SOC, placing doubt as to the drug’s potential efficacy and the ethical basis of continuing other trials. Nonetheless, there are still multiple RCTs in progress to evaluate the efficacy of TCZ (NCT04409262; NCT04372186, NCT04356937, NCT04412772). Data from this systematic review adds merit to clinical investigations despite the initial negative results from COVACTA.
Uncontrolled Studies
Uncontrolled trials were analyzed separately to explore trends in treatment data. Recognizing the wide variation in patient outcomes between the studies, the combined mortality rate from 12 single-arm studies using TCZ against severe COVID-19 was 16.0% (SD 9.87%). However, without clinical trials, it is difficult to determine the baseline rate COVID-19 mortality for hospitalized patients to compare with the rate calculated from the uncontrolled trials. Clinical data reviews are subject to geographic and demographic differences, such as a 5700-person evaluation in New York from April 2020 that found a 21% fatality rate for hospitalized patients which is higher than other locations and later studies.44 Participants must be matched to controls to eliminate bias and account for other confounding factors to draw definitive conclusions. Comparing the uncontrolled and controlled trials from this systematic review, excluding controlled trials with all the patients initially in the ICU (Ip et al. and Rojas-Marte et al.), there was no significant difference in mortality rate between the two experimental approaches (p=0.384). This observation supports the assertion that the combined reported results from the uncontrolled results from this systematic analysis are potentially accurate and corroborate the merit in evaluating TCZ efficacy. Nevertheless, the uncontrolled trials should still be evaluated with some degree of skepticism. Specific shortcomings for the individual uncontrolled trials are delineated in Supplementary Table 4.
Additional specific, subjective shortcomings of uncontrolled trials
TCZ Treatment Timing
There is a question of timing for the IL-6 blocking treatment. All of the studies evaluated included only patients who were already in a severe disease state. Given the patterns of COVID-19 pathology and immune dysregulation, it may be logical to defer TCZ until the inflammatory phase due to the positive effects of IL-6 release in the acute infection stage which theoretically prevents SARS-CoV-2 proliferation. Given the unique, aberrant immune reaction in COVID-19, some researchers argue that the optimal time to employ targeted immune suppressants such as TCZ, in order to curtail and not enhance mortality, is when patients begin to trend towards hypoxia and inflammation.3 However, this timing is theoretical and must be demonstrated in a RCT.
Limitations
There are notable limitations to this systematic analysis and qualitative synthesis of TCZ. First, only one of the studies presented randomized who received TCZ, opening the possibility for selection bias and confounding factors that cannot be accounted for statistically. This systematic analysis synthesizes data from studies with different SOCs, geographies, resources, demographics, and TCZ dosing amount, number and timing. It is not possible to conclude that TCZ is efficacious in reducing COVID-19 mortality, simply that the data trends towards a lower odds ratio for mortality with incomplete generalizability. Similarly, while patients across all of the studies were at least in severe condition, the combined data still represents individuals at various stages of COVID-19. Not all of the studies offered a longitudinal time component, so an overall hazard ratio or Kaplan-Meir survival curve cannot be produced. Additionally, many patients were still in the hospital at the end of the observation period potentially skewing the mortality rate. Importantly, in the random effects odds ratio calculation, there was no control for age, sex and baseline characteristics like individual studies were able to accomplish. As noted, the uncontrolled trials on TCZ cannot be adequately evaluated without direct comparison to a control group. Finally, it is possible that studies finding a negative effect of TCZ were not published and not accounted for in this systematic review.
Conclusions
A systematic review of the clinical data of IL-6 inhibitor tocilizumab (TCZ) for severe COVID-19 points towards efficacy in reducing mortality from the disease. There are numerous notable methodological limitations in the studies analyzed including the lack of randomization in controlled trials and potential for an inadequate evaluation due to unpublished data. The results from this systematic analysis corroborate the logic and ethical basis for ongoing phase III RCTs on TCZ. However, use of TCZ in outside the clinical trial context is discouraged until results from these clinical trials are released.
Declarations
* All authors have seen and approved the manuscript
** We declare no conflict of interest
*** All the data from this systematic review are presented in this manuscript
**** There was no funding provided
Footnotes
Updated Systematic Review on August 4, 2020. Updated figures and tables to match the most recent review. Addressed results from phase III trial COVACTA. Added figure to illustrate effects of IL-6.