Māori and Pacific People in New Zealand have higher risk of hospitalisation for COVID-19 ========================================================================================= * Nicholas Steyn * Rachelle N. Binny * Kate Hannah * Shaun C. Hendy * Alex James * Audrey Lustig * Kannan Ridings * Michael J. Plank * Andrew Sporle ## Abstract **Aims** We aim to quantify differences in clinical outcomes from COVID-19 infection by ethnicity with a focus on risk of hospitalisation. **Methods** We used data on age, ethnicity, deprivation index, pre-existing health conditions, and clinical outcomes on 1,829 COVID-19 cases reported in New Zealand. We used a logistic regression model to calculate odds ratios for the risk of hospitalisation by ethnicity. We also consider length of hospital stay and risk of fatality. **Results** Māori have 2.5 times greater odds of hospitalisation than non-Māori, non-Pacific people, after controlling for age and pre-existing conditions. Similarly, Pacific people have 3 times greater odds. **Conclusions** Structural inequities and systemic racism in the healthcare system mean that Māori and Pacific communities face a much greater health burden from COVID-19. Older people and those with pre-existing health conditions are also at greater risk. This should inform future policy decisions including prioritising groups for vaccination. ## Introduction Up to 25 September 2020, New Zealand reported 1,829 confirmed and probable cases of COVID-19, a disease caused by a novel coronavirus originating in Wuhan, China. The majority of these cases were associated with one of two outbreaks of sustained community transmission: the first in March/April 2020 and the second in August/September 2020. Up to 22 May, there 1,504 confirmed and probable cases. Between 22 May and 11 August, there were 65 cases, all of which were in detected in international arrivals and contained in government-managed isolation facilities. Between 11 August and 25 September, 260 cases were reported, with the majority linked to a large cluster in Auckland. The August cluster differed substantially from the initial outbreak in March/April 2020. The vast majority of cases resulted from workplace, community, public transport and household transmission, rather than being associated with international travel 1. The August cluster had a higher proportion of cases under 20 years old and a lower proportion of cases over 60 years old than the earlier outbreak (Figure 1). It also contained a much higher proportion of cases among the Pacific and Māori populations that the first outbreak 1, 2. The Pacific community values multi-generational living, but the lack of high-quality suitable housing means that this is often overcrowded3. Pacific people also experience poorer access to healthcare4, 5 and are at greater risk of clinically severe outcomes from COVID-19 infection 6. ![Figure 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/12/27/2020.12.25.20248427/F1.medium.gif) [Figure 1.](http://medrxiv.org/content/early/2020/12/27/2020.12.25.20248427/F1) Figure 1. Age-ethnicity structure of New Zealand’s two major outbreaks of COVID-19 using prioritised ethnicity. The plots on the right give the number of cases per 1000 people in that age-ethnicity grouping, population data from Census 2018 2. Historically, Māori, and Pacific communities both in New Zealand and in the Pacific have had worse experiences of pandemics. During the 2009 H1N1 influenza pandemic, the rate of infection for Māori was twice that of Pākehā, with increased severity 7. Our recent research estimated similar inequities would occur in the infection fatality rate for COVID-19 6. New Zealand’s effective public health response to the pandemic has so far limited the number of COVID-19 fatalities to 25 8, which corresponds to a fatality rate of 5 deaths per million people. This means that there is, thankfully, insufficient empirical data at present to reliably estimate the effect of ethnicity on the infection fatality rate. Here, we aim to estimate the effect of ethnicity on the risk of clinically severe outcomesfrom COVID-19 measured by the hospitalisation rate and length of hospital stay. The results are important for future policy decisions and pandemic planning, for example identification of priority groups for vaccination against COVID-19. ## Methods We developed three separate risk models to quantify the risk of hospitalisation, length of hospital stay and fatality risk. Each model used the same methodology and set of predictor variables. ### Data Case data was obtained on all 1,829 confirmed and probable cases of COVID-19 reported in New Zealand up to 25 September 2020. The data included hospitalisation status and dates, clinical outcome (i.e. recovered, death), age, sex, underlying health conditions, StatsNZ meshblock of current home address, and ethnicity (see Table 1). View this table: [Table 1.](http://medrxiv.org/content/early/2020/12/27/2020.12.25.20248427/T1) Table 1. Summary of case data. Deprivation index was used in its raw index form in the model but has been presented as quintiles for ease of interpretation, with the 1st quintile representing those that reside in a meshblock with the lowest socioeconomic deprivation and the 5th quintile the highest deprivation. Age is also presented in discretised brackets. The use of total ethnicity statistics means sums over these rows will be greater than the totals where some cases are recorded as having multiple ethnicities. The data on underlying health conditions were simplified into a binary variable indicating if the individual had at least one of the following conditions: chronic lung disease, cardiovascular disease, diabetes, immunodeficiency, asthma, or malignancy. These are all known to be associated with increased risk of COVID-19 hospitalisation 9. The meshblock number of residential address was used to allocate a measure of geographic socioeconomic deprivation based on the New Zealand deprivation index (NZDep18) 10. This was not available for 34 cases, so any models that include deprivation index had a smaller sample size of 1,795 cases and 114 hospitalisations. Total ethnicity data was used to assign individuals into one or more of the following groups: Māori, Pacific, Asian, NZ European/Other. We assigned individuals whose ethnicity was recorded as Middle Eastern/Latin American/African (n=54 cases, 0 hospitalisations) or Unknown (n=8 cases, 0 hospitalisations) to the NZ European/Other ethnicity group. Individuals for whom total ethnicity data was missing (n=29 cases, 1 hospitalisation) were assigned to the ethnicityrecorded in the “prioritised ethnicity” field. Of the 120 hospitalised cases, only 102 had listed discharge dates, which were required for analysis on the length of hospitalstay. Five of the 18 cases without discharge dates recorded resulted in death, so their discharge date was set to the date of their death. The remaining 13 cases (two who had not recovered by 25 September 2020 and 11 with no discharge date recorded) were excluded from the length of stay analysis. One additional case was excluded as the discharge date recorded was prior to the hospitalisation date. This resulted in a sample of 106 cases with a recorded length of stay in hospital (see Figure 2). Of the 11 cases with no discharge date or date of death, 5 (45%) were in Pacific people, despite Pacific people only making up 18% of hospitalisations. This reduced the sample size for Pacific people and likely biased the results. ![Figure 2.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/12/27/2020.12.25.20248427/F2.medium.gif) [Figure 2.](http://medrxiv.org/content/early/2020/12/27/2020.12.25.20248427/F2) Figure 2. Sankey diagram of case data that was included/excluded from the length of hospital stay analysis. Those with valid discharge dates or death dates (n = 106) were included in the analysis. The remaining cases were excluded (n = 14). Data are for cases reported up to 25 September 2020. ### Model Selection For each of the three models, we carried out a simple analysis to determine which predictor variables to include in the model. We used a logistic regression to determine which of ethnicity, underlying health conditions, sex, age, and deprivation should be included. We used Akaike information criterion (AIC) and the area under the receiver operating characteristic curve (AUC) for model selection 11, 12. The complete model was: ![Formula][1] Ethnicity was treated as a categorical variable with individuals belonging to one of Māori, Pacific, Asian, or NZ European/Other. In the case of multiple recorded ethnicities, as there was insufficient data to consider all ethnicity combinations, the standard prioritisation was used 13 for the model selection phase (see below for estimation of effect sizes using multiple ethnicity data). The NZ European/Other group is used as the baseline group so that resulting odds-ratios are interpreted as “difference in risk relative to NZ European/Other”. AIC requires all models to have the same sample size, so during model selection the 34 records with missing deprivation index were removed. ### Estimating the Effect of Ethnicity During the model selection phase, ethnicity (using prioritised ethnicity) was consistently identified as a significant predictor variable in all three models. Using priority ethnicity neglects important information on individuals who were in multiple ethnicity groups 14. For example, there were 19 individuals who were recorded as Māori and Pacific, none of whom were hospitalised. In the standard prioritisation routine, these individuals were classified as Māori and did not, therefore, contribute to model estimates for Pacific people. This undercounted Pacific cases and potentially created age-related biases in the results for Pacific people, as younger Pacific people are more likely to report multiple ethnicities 15. To correct for this, we reran each model using different ethnicity prioritisation orderings (see Table 2). Odds-ratios and confidence intervals on the odds-ratios were obtained by exponentiating the coefficient estimates and confidence intervals on the coefficient estimates for each risk factor. View this table: [Table 2.](http://medrxiv.org/content/early/2020/12/27/2020.12.25.20248427/T2) Table 2. Ethnicity prioritisation ordering depending on the ethnicity effect being estimated. ### Length of Stay and Risk of Fatality In addition to the risk of hospitalisation, we used a linear model to consider the effect of these variables on length of hospital stay: ![Formula][2] Finally, despite very limited data, we also considered fatality risk under the same framework: ![Formula][3] In this final model, as there were no fatalities in Asian people, we combined the Asian and NZ European/Other ethnicity groups. For both these models, we used the same methodology as for the risk of hospitalisation model, i.e. we used standard ethnicity prioritisation to identify significant predictor variables then re-analysed the contribution of these predictor variables under different ethnicity prioritisation orderings. ## Results ### Risk of Hospitalisation For risk of hospitalisation, the model containing age, ethnicity, and the presence of underlying health conditions as predictor variables gave the most parsimonious fit (lowest AIC). This model also has the same predictive power (similar AUC) as more complex models (see Table 3). Including interaction terms did not improve the model fit as measured by AIC. Age was always the strongest predictor of hospitalisationand was included in all models. After age has been accounted for, the best two-variable model also included ethnicity. View this table: [Table 3.](http://medrxiv.org/content/early/2020/12/27/2020.12.25.20248427/T3) Table 3. AIC and AUC values for the eight models for risk of hospitalisation with lowest AIC, as well as the age-only and ethnicity-only models. Smaller values of AIC indicate a mare parsimonious model fit; larger values of AUC indicate better predictive power. Coefficient estimates associated with sex were always close to zero and had consistently large p-values, indicating that sex was not a strong predictor of hospitalisation in New Zealand’s COVID-19 cases. This is contrary to some international evidence that suggests men suffer worse clinical outcomes on average 9. Deprivation indexwas only statistically significant when considered alongside age but not ethnicity. Deprivation index and ethnicity were slightly correlated, so this suggests the effect of deprivation index was partially capturedby ethnicity. Different age groups were represented differently across different levels of deprivation index, suggesting a model containing a deprivation index-age interaction term may be suitable. This was tested and the resulting coefficients were not statistically significant. Table 4 and Figure 3 show the results for the preferred model for risk of hospitalisation. Age was associated with a 4.5% increase in odds of hospitalisation per additional year. The presence of at least one underlying health condition increased the odds of hospitalisation by 1.74 times. Aftercontrolling for age and underlying conditions, Māori and Pacific people had substantially higher odds of being hospitalised for COVID-19 than other ethnicities: Māori 2.5 times higher odds (*p* = 0.002) and Pacific people 3.06 times higher odds (*p* = 8 × 10−5). Asian people were also at higher risk, with 1.35 times higher odds, although this result was not statistically significant. View this table: [Table 4.](http://medrxiv.org/content/early/2020/12/27/2020.12.25.20248427/T4) Table 4. Results of the preferred model (age, ethnicity, underlying conditions) for risk of hospitalisation under each ethnicity prioritisation ordering. Coefficient estimates for ethnicity that is not the priority (grey text) should be treated with caution. These models use the full sample of 1,829 individuals. ![Figure 3.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/12/27/2020.12.25.20248427/F3.medium.gif) [Figure 3.](http://medrxiv.org/content/early/2020/12/27/2020.12.25.20248427/F3) Figure 3. Odds-ratios and 95% confidence intervals for the considered risk factors. The odds-ratio for underlying conditions was taken from the model with Māori as the priority ethnicity, however these results change very little under different prioritisations. In the same model, the odds-ratio for an additional year of age was 1.045 (1.034, 1.057). Analysis based on cases reported up to 25 September 2020. The odds ratios for different ethnicities shown in Figure 3 represent the increase in risk after controlling for underlying health conditions, which are present in higher rates in Māori and Pacific people 16. In the 1,829 cases in the data, there was only a very small correlation between having underlying conditions recordedand either Māori ethnicity (Pearson’s r-squared *r*2 = 0.07) or Pacific ethnicity (*r*2 = 0.02), so the results were not affected by multi-collinearity in these variables. The model can be used to estimate the probability of hospitalisation following infection with COVID-19 for an individual of a given age, ethnicity, and presence/absence of underlying health conditions (see Figure 4). These estimates should be used with caution as they assume that age has the samem proportional effect in each ethnicity. Māori and Pacific people have lower life expectancy, higher rates of multi-morbidity and respiratory illness, higher rates of under-reporting of comorbid conditions, and typically experience adverse health outcomes at an earlier age 16,17,18. These factors have not been accounted for in the model and may exacerbate the risk of clinically severe outcomes from COVID-19 for Māori and Pacific people. ![Figure 4.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/12/27/2020.12.25.20248427/F4.medium.gif) [Figure 4.](http://medrxiv.org/content/early/2020/12/27/2020.12.25.20248427/F4) Figure 4. Estimated probability of hospitalisation by age and ethnicity, with and without underlying health conditions. Analysis based on cases reported up to 25 September 2020. ### Length of Hospital Stay For length of hospital stay, the model containing only age and ethnicity as predictor variables gave the most parsimonious fit (lowest AIC). Age was a more important factor than in the probability of hospitalisation model, with an additional year of age predicting an additional 0.224 days in hospital on average (*p* = 2 × 10−6). When used as the priority ethnicity, Māori are expected to spend 4.88 days (*p* = 0.052) longer in hospital than NZ European/Other, and Pacific people are expected to spend 5.16 days (*p* = 0.049) longer in hospital than NZ European/Other. Length of hospital stay for Asian people was not significantly different from NZ European/Other. ### Risk of Fatality For risk of fatality, the model containing only age and deprivation index as predictor variables gave the most parsimonious fit (lowest AIC). In this model, an additional year of age increased the odds of fatality by 15.9% (11.5%, 20.4%) (*p* = 3 × 10−14). A unit increase in deprivation indexwas associated with a 0.80% (0.33%, 1.27%) increase in the odds of fatality (*p* = 0.001). The difference in deprivation score between the 1st and 4th quintiles in the dataset was 146. This means that the model predicts that an individual at the 80th percentile of deprivation has 3.19 times the risk of fatality as someone at the 20th percentile in this dataset. International evidence suggests a linear relationship between log infection fatality rates and age, with one paper estimating an increase in probability of death of 12.9% per year of age 19. This is comparable to our results (although changes in the infection fatality rate are not identical to changes in odds, they are close at small probabilities). The number of fatalities was, fortunately, too small to draw any concrete conclusions on the relationship between risk of fatality and ethnicity. There were no models where ethnicity was a consistently statistically significant predictor of fatality risk. However, this is most likely due to inadequate statistical power of the small sample. Furthermore, the majority of fatalities are linked to aged care facilities, so are not a representative sample of fatalities if COVID-19 were to become more widespread in the community. ## Discussion New Zealand’s experience with the COVID-19 epidemic indicates that Māori and Pacific people are at much greater risk of hospitalisation following infection with COVID-19. It is widely understood from overseas experience that the risk of hospitalisation for COVID-19 increases rapidly with age. However, the effects of ethnicity in New Zealand are not so well understood. Our results show that a healthy Māori person has the same risk of hospitalisation for COVID-19 as a healthy person in the NZ European/Other ethnic group who is 21 years older. A healthy Pacific person has the same risk of hospitalisation as a healthy person in the NZ European/Other ethnic group who is 25 years older. These differences in age-specific risk are broadly consistent with earlier estimates of inequities in the COVID-19 infection fatality rate 6. Furthermore, Māori and Pacific people are more likely to have underlying health conditions, which puts them at even higher risk of hospitalisation. We have only considered the risk of being hospitalised given an individual had COVID-19. The overall risk of being hospitalised also depends on the likelihood of infection. COVID-19 can spread quickly in communities with higher levels of workplace or community interaction, crowded housing, insecure employment, and decreased access to healthcare or COVID-19 testing. These are frequentlythe same communities that are at higher risk of hospitalisation and fatality if infected, meaning there is additional potential burden of the epidemic on these people. When fitting each model, we assigned each individual to only one ethnicity as the sample size precluded investigation of all ethnicity combinations. This means that our results cannot be used additively to estimate the risk of hospitalisation for an individual belonging to multiple ethnicities. Other effects are additive in the log-odds. For example, an individual with underlying health conditions has log-odds of hospitalisation that is 0.553 greater than another individual of the same age and ethnicity without underlying health conditions. We have presented the results of a simple analysis that ignores several potential sources of bias and additional inequities. For example, the recording and the analysis of the effect of underlying health conditions are crude. Different health conditions have significantly different effects and the presence of multiple health conditions may increase risk further. We did not have a sufficient sample size to estimate the effect of individual health conditions or combinations of conditions. Māori are more likely to experience multiple health conditions and this could exacerbate the risk of clinically severe outcomes from COVID-19. Testing rates were much higher in the second outbreak in August/September 2020 than in the first outbreak in March/April 2020, meaning that more mild cases of COVID-19 would have been identified. As this second outbreak disproportionately affected Pacific and Māori people, the model may underestimate their relative risk of hospitalisation. Our model is fitted to data from a period in which the prevalence of COVID-19 was low and healthcare services had adequate capacity. Structural biases and systemic racism within the healthcare system could further exacerbate inequities in outcomes if COVID-19 prevalence increased and healthcare capacity was overstretched 20,16,21. Deprivation index was assigned according to the meshblock of an individual’s home address. This may be a good proxy for general socioeconomic deprivation on average, but our sample size may not be sufficient for this to apply. Finally, Asian and NZ European/Other are very broad ethnicity groups that cover a wide range of lived experiences. Further work is needed to accurately capture their risk profiles. We conclude that Māori and Pacific people have substantially higher risk of hospitalisation for COVID-19, after controlling for age, presence of underlying health conditions, and socioeconomic deprivation. We have previously estimated that Māori and Pacific people would experience higher infection fatality rates from COVID-19 6. Our new results add to the imperative for New Zealand’s COVID-19 response to include a focus on measures to protect high-risk groups and to prevent the large-scale inequities in health outcomes that would result from widespread community transmission 22. Our results also have clear implications for identifying priority groups for vaccination against COVID-19, for which planning is currently underway. They demonstrate that it will be essential to account for ethnicity when targeting vaccination to age groups based on their risk of clinically severe infection. For example, our results show that NZ European/Other people aged 80 have a comparable risk to that of Māori aged 59 and Pacific people aged 55. ## Data Availability The database of individual cases cannot be made available for privacy reasons. ## Acknowledgements The authors acknowledge the support of StatsNZ, ESR, and the Ministry of Health in supplying data in support of this work. In particular, we would like to acknowledge Laura Cleary for her work in providing data on total ethnicity and meshblock of home address. This work was funded by the New Zealand Ministry of Business, Innovation and Employment and Te Pūnaha Matatini, Centre of Research Excellence in Complex Systems. * Received December 25, 2020. * Revision received December 25, 2020. * Accepted December 27, 2020. * © 2020, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/) ## References 1. 1.ESR. NZ COVID-19 Dashboard 2020 [Available from: [nzcoviddashboard.esr.cri.nz](http://nzcoviddashboard.esr.cri.nz). 2. 2.1. Stats NZ StatsNZ. Census 2018 Usually Resident Population. In: Stats NZ, editor. 2018. 3. 3.Salesa D. Island Time - New Zealand’s Pacific Futures: Bridget Williams Books; 2017. 4. 4.Talamaivao N, Harris R, Cormack D, Paine S-J, King P. Racism and health in Aotearoa New Zealand: a systematic review of quantitative studies. NZMJ. 2020;133(1520):55–68. 5. 5.Ward H, Atchison CJ, Whitaker M, Ainslie KE, Elliot J, Okell LC, et al. Antibody prevalence for SARS-CoV-2 in England following first peak of the pandemic: REACT2 study in 100,000 adults. medRxiv. 2020. 6. 6.Steyn N, Binny RN, Hannah K, Hendy SC, James A, Kukutai T, et al. Estimated inequities in COVID-19 infection fatality rates by ethnicity for Aotearoa New Zealand. NZMJ. 2020;133(1520):28–39. 7. 7.Wilson N, Baker MG, Eichner M. Estimating the Impact of Control Measures to Prevent Outbreaks of COVID-19 Associated with Air Travel into a COVID-19-free country: A Simulation Modelling Study. medRxiv. 2020. 8. 8.Jefferies S, French N, Gilkison C, Graham G, Hope V, Marshall J, et al. COVID-19 in New Zealand and the impact of the national response: a descriptive epidemiological study. The Lancet Public Health. 2020;5(11):e612–e23. 9. 9.Williamson EJ, Walker AJ, Bhaskaran K, Bacon S, Bates C, Morton CE, et al. Factors associated with COVID-19-related death using OpenSAFELY. Nature. 2020;584(7821):430–6. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41586-020-2521-4&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F12%2F27%2F2020.12.25.20248427.atom) 10. 10.Atkinson J, Salmond C, Crampton P. NZDep2018 Index of Deprivation, Interim Research Report, December 2019. University of Otago; 2019. 11. 11.Anderson D, Burnham K. Model selection and multi-model inference. New York: Springer; 2004. 12. 12.Fawcett T. An introduction to ROC analysis. Pattern Recognition Letters. 2006;27(8):861–74. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.patrec.2005.10.010&link_type=DOI) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000237462800002&link_type=ISI) 13. 13.Ministry of Health. HISO 10001:2017 Ethnicity Data Protocols. 2017. 14. 14.Cormack D. The politics and practice of counting: ethnicity in official statistics in Aotearoa/New Zealand: Te Rōpū Rangahau Hauora a Eru Pōmare; 2010. 15. 15.StatsNZ. Census 2018 ethnic group summaries. 2018. 16. 16.Ministry of Health. Wai 2575 Māori Health Trends Report. Wellington; 2019. 17. 17.Yon Y, Crimmins EM. Cohort morbidity hypothesis: health inequalities of older Māori and non-Māori in New Zealand. New Zealand Population Review. 2014;40:63. 18. 18.Reid J, Taylor-Moore K, Varona G. Towards a social-structural model for understanding current disparities in Maori health and well-being. Journal of Loss and Trauma. 2014;19(6):514–36. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1080/15325024.2013.809295&link_type=DOI) 19. 19.Levin AT, Hanage WP, Owusu-Boaitey N, Cochran KB, Walsh SP, Meyerowitz-Katz G. Assessing the age specificity of infection fatality rates for COVID-19: systematic review, meta-analysis, and public policy implications. European Journal of Epidemiology. 2020. 20. 20.Robson B, Harris R. Hauora: Māori Standards of Health IV. A study of the years 2000– 2005. Wellington: Te Ropu Rangahau Hauora a Eru Pomare. 2007. 21. 21.Cormack D, Harris R, Stanley J, Lacey C, Jones R, Curtis E. Ethnic bias amongst medical students in Aotearoa/New Zealand: Findings from the Bias and Decision Making in Medicine (BDMM) study. PloS one. 2018;13(8):e0201168. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0201168&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=30096178&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F12%2F27%2F2020.12.25.20248427.atom) 22. 22.1. Health Mo Ministry of Health. Annual Data Explorer 2018/19: New Zealand Health Survey. In: Health Mo, editor. 2019. [1]: /embed/graphic-4.gif [2]: /embed/graphic-6.gif [3]: /embed/graphic-7.gif