ABSTRACT
Background Measuring self-esteem and internalized stigma among persons affected by leprosy is important to monitor stigma-reduction interventions. While the English versions of the Rosenberg self-esteem scale (RSES) and Internalized Stigma of Mental Illness Scale (ISMI) as originally developed have been validated and widely used in many settings, to date, no cross-culturally adapted or validated Nigerian Pidgin English version exists. We describe the translation, cross-cultural validation and adaptation of the Nigerian Pidgin English versions of the RSES and ISMI in Cross River state, southern Nigeria.
Methods The Nigerian Pidgin English version of the RSES and ISMI was developed systematically following the World Health Organization’s (WHO) guidelines on the process of translation and adaptation of instruments. The cultural equivalence of the instruments including their conceptual, item, semantic and their operational equivalences were evaluated using qualitative methods through the process of forward and back-translation, expert panel review, pre-testing and cognitive interviewing to generate the final version. A cross-sectional study of 56 participants with leprosy (Hansen’s disease) enrolled from rural and urban communities in 3 local government areas (Boki, Obubra and Calabar-South) in Cross River state, southern Nigeria was undertaken to assess the psychometric equivalence of the tools. After 2-weeks interval, one-third of them (16 participants) had a re-test.
Results The conceptual, item, semantic and the operational equivalences of the Nigerian Pidgin English versions of the RSES and ISMI scale showed adequate fit with all items identified as important in the context of the Pidgin speaking population. There was a negative inverse correlation between the mean total scores of the RSES and the ISMI scale (r = -0.57; p <0.001); confirming the construct validity of the two scales. The exploratory factor analysis for the scales indicated good fit as one-dimension scale. The Cronbach’s alpha values representing internal consistency were 0.82 and 0.95 for the RSES and ISMI scale respectively. The test-retest reliability intra-class correlation coefficient for the RSES and the ISMI scale was 0.98 and 0.67, respectively. There were no floor or ceiling effects in the distribution of the responses to the RSES and the ISMI scale.
Conclusion The Nigerian Pidgin English version of the RSES and ISMI scales were successfully developed and showed evidence to be reliable and valid instruments for the assessment of self-esteem and internalized stigma respectively among Nigerian Pidgin English speaking population of southern Nigeria.
INTRODUCTION
Leprosy is a neglected tropical disease due to infection with Mycobacterium leprae. Early diagnosis and treatment of the chronic granulomatous condition using multidrug therapy (MDT) has demonstrated successful treatment outcomes [1]. However, delays in diagnosis and treatment of leprosy can cause extensive and irreversible destruction of tissues and nerves, manifesting as skin ulcers, physical impairments, and disabilities [2–4]. Therefore, as over two million people live with leprosy-related disabilities, it suggests that majority of these persons were either not diagnosed early or had substantial delays before the condition is diagnosed [3–4]. There is substantial variation in the burden of leprosy in endemic countries. In 2019, three countries consisting of Brazil, India and Indonesia each reported over 10,000 new leprosy cases, while 13 additional countries mainly in Asia and Africa including Nigeria each reported 1000–10,000 new cases [5]. In 2020, Nigeria reported 1559 incident cases of leprosy. Although some of these countries have since achieved the global target for the elimination of leprosy as a public health problem (defined as prevalence of below 1 per 10,000 population); even within such countries that have reached elimination status there are local hotspots of high endemicity [6–7].
Stigma is an important challenge in the management of chronic diseases particularly neglected tropical diseases (NTDs). People presenting with NTDs like Buruli ulcer, cutaneous leishmaniasis, leprosy, and lymphatic filariasis tend to encounter stigma [8–9]. Such health-related stigma can have major deleterious effects such as reduced social participation by affected persons and their family members, and it could lower their opportunities in life and affect their human rights [10–11]. In leprosy affected persons, the assessment of stigma is very important. Stigma encountered by individuals affected by leprosy has been shown to be associated with participation limitations, shame, divorce and challenges with employment [4, 12–13]. Together, these lead to a poor quality of life among the affected persons. Evaluating stigma in this group is important because it provides useful information for planning, implementing and evaluation of rehabilitation services. Moreover, such stigma data is crucial in informing interventions to address the participation rights of people with disabilities [14]. In addition, having a validated tool to assess stigma may encourage clinicians to include stigma reduction as a critical treatment goal in addition to symptom reduction. This is because interventions that could achieve symptomatic improvement and could reduce stigma are more likely to be effective and efficient [15]
To advance the study of stigma reduction strategies and interventions, validated tools to assess levels of stigma in the society are needed [13]. The Internalized Stigma of Mental Illness Scale (ISMI) scale was developed to measure the internalized stigma of people with a mental illness [15]. The leprosy-adapted version of the ISMI scale was previously validated among persons with leprosy in India [16]. The Rosenberg self-esteem stigma scale (RSES) is one of the most extensively used instruments to assess self-esteem. Within the context of a cluster-randomized controlled trial with stigma reduction outcomes in Nigeria, these two instruments have been selected for assessing stigma and self-esteem among persons affected by leprosy. The primary project aims to compare audio-delivered vs. written material health education interventions and will assess their impact on perception, knowledge of and attitudes towards leprosy including stigma. This paper describes the cross-cultural validation and adaptation of the Nigerian Pidgin versions of the RSES and the ISMI scales in Cross River state, southern Nigeria.
METHODS
Study design
This study uses a cross-sectional design.
Study area
This validation study was carried out in three local government (LGAs) namely, Boki, Calabar-South, and Obubra of Cross River State Southern Nigeria with data collected between December 2022 and January 2023. The study area has a population of 797, 520 people as projected from 2006 census, and each year an average of 106 new cases (17% with Grade 2 disability) are notified. The most common language spoken in the State is the Nigerian Pidgin English. Over 90% of the people living in the selected locations speak the Nigerian Pidgin English language.
Inclusion and exclusion criteria
The participants of the study were persons affected by leprosy (18 years and above), who have lived in the aforementioned selected areas for at least 2 years and can speak and understand the Nigerian Pidgin language. Persons affected by leprosy who declined consent for any reason were excluded from the study.
Instruments
Leprosy-adapted ISMI Scale
The ISMI Scale was developed to assess internalized stigma in persons with abnormal mental wellbeing. Like the original scale, the Leprosy-adapted ISMI scale consists of 29 Likert items as well as five subscales (Alienation, Stereotype Endorsement, Discrimination Experience, Social Withdrawal, Stigma Resistance) [16]. Internalized stigma is the devaluation, shame, secrecy and withdrawal triggered by applying negative stereotypes to oneself due to the (mental) illness [17]. This may lead to stereotype agreement, self-prejudice and self-discrimination long after the precipitating illness has been treated. The items on the ISMI are rated on a four-point Likert scale (from 1— strongly disagree to 4—strongly agree) and the ISMI score is calculated by adding up the ratings of all items, after reverse coding of the five stigma resistance items. High scores indicate higher levels of internalized stigma. The internal consistency of the original version was 0.90 (N = 127) and the test–retest reliability coefficient was r = 0.92 (n = 16, p <0.05), after a 6 weeks interval. All subscales of the ISMI scale had high Cronbach’s alpha [16].
RSES
The assessment of self-esteem was used as a criterion indicator of the construct validity of the ISMI scale [15]. This is because some studies in the past have demonstrated that stigma was closely related to but different from low self-esteem [18–19]. Thus, in the design of the ISMI scale it was hypothesized that ISMI scores would be moderately negatively correlated with self-esteem scores [15]. The RSES consists of 10 items rated on a four-point Likert scale (from 1— strongly disagree to 4— strongly agree) and the Rosenberg score is calculated by adding up the ratings of all items, after reverse coding of the five items (2, 5, 6 8 and 9) that were negatively worded. High scores indicate higher levels of self-esteem [20]. The original version of the RSES has good internal consistency (Cronbach’s alpha= 0.87).
Procedure
The cross-cultural validation involved many stages following the World Health Organization’s (WHO) guidelines on the process of translation and adaptation of instruments [21]. The first stage involved forward translation to Nigerian Pidgin English by an experienced linguistic professional who is proficient in both languages. After which there was a bilingual expert panel review (including a person affected by leprosy) who identified and resolved any inadequate expressions/concepts of the Nigerian Pidgin English translation. Then, a back translation of the generated Nigerian Pidgin English RSES and ISMI scales was done back to English language by another independent linguistic professional. As with the first stage, emphasis was to ensure conceptual and cultural equivalence, not linguistic equivalence of the translated scales. Discrepancies were discussed and further iterations with consensus generated a satisfactory version for use. The third stage involved pre-testing of the tools among 10 leprosy-affected persons with or without disability not used for the present study and discussions were held with the participants. to clarify their conceptual, item, semantic and operational equivalence of the items. Difficult or unclear words or phrases were reviewed together with the expert translators and consensus was used to select alternatives. The expert committee met again to adopt the final version of the questionnaire for use. Lastly, the psychometric validation cross-sectional study was performed. Data collection using the final Nigerian Pidgin English translated version was performed by trained research assistants using KoboCollect mobile phone app translation-enabled feature. Persons with leprosy were interviewed at the health centres in the different LGAs.
Cultural and measurement equivalence assessment
This cross-cultural validation study utilized the framework for cultural validity assessment by Stevelink et al., who integrated Herdman’s model with metric standards assessment of Terwee et al [9, 22–23]. In this study the conceptual, item, semantic and operational equivalences were evaluated as described above. The measurement equivalence was assessed by testing the psychometric properties, exploratory factor analysis, test-retest reliability analysis and construct validity highlighting the relationship between the scales. Mean and standard deviation (SD) were used to describe each item of the scale. For this study, we used SPSS version 26 to carry out all statistical analysis including inferential statistics. A two-sided test p <0.05 was considered statistically significant.
Ethical considerations
The study was approved by the by the Heath Research and Ethics Committee of the University of Nigeria Teaching Hospital (UNTH), Ituku-Ozalla, Enugu, Nigeria. Approval was also obtained from the Ethics Committee of Cross Rivers State Ministry of Health. Informed consent was obtained from all participants. The study guarantees the confidentiality of the content of the data provided by the participants.
RESULTS
Cultural Equivalence
Conceptual equivalence
Several approaches such as expert opinion, discussion with frontline health care workers, in-depth interviews with persons affected by leprosy (Hansen’s disease) and pre-testing of the tools were utilized to evaluate the correspondence of the conceptual meanings between cultures in relation and equivalence of the Pidgin versions of the RSES and ISMI scale. The instruments were found to be relevant and useful in the target Nigerian Pidgin English-speaking persons-affected by leprosy in southern Nigeria.
Item equivalence
Review by experts who undertook forward- and back-translation of the tools to the Nigerian Pidgin English version as well as observations obtained during pre-testing indicated that there was no basis to change any of the items in the Nigerian Pidgin English versions of RSES and ISMI scale. All the items found in the English version of the tools were found to be relevant and useful in the Nigerian Pidgin English version.
Semantic equivalence
Although the target population speaks several local languages and dialects, the Nigerian Pidgin English versions of the RSES and ISMI scales were used because Nigerian Pidgin English is the most common language spoken and understood by over 90% of the target population. Adjustments were made in the questionnaires of confusing words, and differences were resolved by consensus by the experts involved in the translation.
Operational equivalence
The Nigerian Pidgin English versions of the RSES and ISMI scale used for the survey were delivered as interviewer-administered tools. Also, the format of the Nigerian Pidgin English version of RSES and ISMI scales as well as the scoring system corresponded with those of the English version of the tools.
Measurement Equivalence
Characteristics of study participants
A total of 56 patients with complete data were included in the analysis. Most of the patients 41 (73.2%) were over 40 years with a mean age of 47.43 ± 14.65 years, and 29 (51.8%) of them were females. Also, 40 (71.4%) of the participants were married, 52 (92.9%) had some formal education. The study participants characteristics are as summarized in Table 1. Most of the patients 37 (66.1%) resided in the rural area, and 44 (78.6%) of them belonged to households earning less than ₦30,000; with the mean monthly household income of the participants being ₦27,626.79 ± 43,385.
Sociodemographic characteristics of the patients, Cross River (N = 56)
Most of the patients 55 (98.2%) had multibacillary leprosy with 20 (35.7%) and 23 (41.1%) presenting with grade 1 and grade 2 disability, respectively.
Item characteristics
The mean total scores for the items in the RSES was 27.86 (± 5.91) with scores ranging from 14 as the minimum score to 40 representing the maximum total self-esteem score by the patients. Table 2 summarizes the mean score per item in the scale. The individual items in the Rosenberg scale had means ranging from 1.70 to 3.45, and standard deviations ranging from 0.75 to 1.09. The mean total score of the items of the ISMI scale was 65.75 (± 19.67) and the total scores ranged from 30 representing the minimum internalized stigma score to 113 representing the maximum total score obtained by the patients. Table 3 summarizes the mean score per item in the ISMI scale. The individual items in the ISMI scale had mean values ranging from 1.57 to 2.71 and standard deviations ranging from 0.78 to 1.16.
Descriptive statistics of items on the Rosenberg self-esteem scale (N = 56)
Descriptive statistics of items on statistics items of Leprosy-adapted ISMI scale (N = 56)
Construct validity
The total scores of the RSES and ISMI scale were correlated to test the construct validity and assess the relationship between the two scales. ISMI was inversely associated with self-esteem as assessed using the RSES (r = -0.57; p <0.001) indicating that that internalized stigma construct was different from the self-esteem construct. The construct validity of the two scales was therefore confirmed.
Exploratory factor analysis
For the exploratory factor analysis (EFA) of the RSES, the Kaiser–Meyer–Olkin measure of sampling adequacy was 0.73, which indicated that the sample was adequate for EFA for the overall scale. Using principal axis factoring and varimax rotation, two factors were extracted with eigenvalues greater than 1, and the absolute values of factor loadings less than 0.40 were suppressed. EFA for the RSES suggested a good fit as a one-dimensional scale, with a first factor accounting for 39.8% of the variance. Although, the EFA suggested that there are two potential factors explaining 52.3% of the variance, parallel analysis indicated that the overall instrument should have one overriding factor. The EFA of the RSES in relation to the two-factor structure is as shown in Table 4. The analysis revealed that the first factor had six (6) items, and the second factor had four (4). items. Overall, the inter-item correlations were high supporting the existence of one overriding factor. Cronbach’s alphas for the overall Rosenberg scale and the identified subscales are as shown in Table 4.
Internal consistency of the RSES and ISMI scale and their sub-scales
For the ISMI scale, the value of the Kaiser–Meyer–Olkin measure of sampling adequacy was 0.80 suggesting sample adequacy for the overall scale. Using principal axis factoring and varimax rotation, with the absolute values of factor loadings less than 0.40 being suppressed; EFA for the ISMI scale indicated a moderate fit as a one-dimension scale with one factor explaining 45.5% of the variance observed. It should be noted that the subscales generated from the EFA of the ISMI scale did not load as per the design of the English version of the scale probably due to low sample size of the study population which is inadequate for analyzing the subscales. The analysis revealed that the scale had up to five subscales (Table 5). Overall, the inter-item correlations were high supporting the existence of one overriding factor. Cronbach’s alpha for the overall ISMI scale was 0.95 as seen in Table 5.
Exploratory Factor analysis for the ISMI scale (N = 56)
Reliability
The Cronbach’s alpha values representing internal consistency were 0.82 and 0.95 for the RSES and ISMI scale, respectively. If an item was deleted, the value of Cronbach’s alpha for all items in the RSES was higher than 0.78; and higher than 0.94 in the ISMI scale. These values confirm the internal consistency of the RSES and ISMI scale in the population. However, the corrected item-total correlations for items 3 and 7 of the RSES; and items 7 and 24 of the ISMI scale were less than 0.3, meaning that they were weakly were correlated with the respective total scores.
Test-retest reliability was assessed using 16 participants who were administered the Pidgin versions of the tools at least two weeks apart. The mean Rosenberg score at the first and second visit were 29.67 ± 6.07 and 29.47 ± 6.36, respectively. Test-retest reliability analysis gave an excellent positive correlation (r= 0.97; p <0.001); and the intraclass correlation coefficient was 0.98 (95% CI 0.95 – 0.99; p < 0.001) indicating excellent reliability of the RSES. The mean ISMI scores at the first and second visits were 59.07 ± 20.70 and 67.00 ± 21.02, respectively. For the ISMI scale, test-retest reliability analysis gave a moderate positive correlation (r = 0.51; p = 0.05); and the intraclass correlation coefficient was 0.67 (95% CI 0.03 – 0.89; p = 0.02) indicating moderate reliability of the ISMI scale. The SEM for the Rosenberg and ISMI scores were 1.56 and 20.71, respectively.
Floor and ceiling effects
No floor or ceiling effects were identified for the RSES and the ISMI scale. None (0%) of the respondents scored the lowest possible score of 0 and only 3 (5.4%) scored the highest possible score of 40 points on the RSES. Similarly, for the ISMI scale, none (0%) of the respondents had the lowest possible score of 29 and none (0%) had the highest possible score of 116. Therefore, no evidence exists for the occurrence of floor and ceiling effect in the two scales.
Interpretability
The means and SD of the total scores of the tools for the different subgroups in relation to the baseline data of the participants are as shown in Table 6. The mean total score of RSES significantly differed according to area of residence (p = 0.04). However, it did not differ according to the other sub-groups assessed (Table 6). The mean total score on the ISMI scale significantly differed according to age categories (p = 0.01), marital status (p = 0.02) or whether the participants had a close relationship with an individual affected by leprosy (p = 0.003). However, the mean ISMI scores did not differ according to the other sub-groups assessed (Table 6).
Relation between total mean of the Nigerian Pidgin English versions of Rosenberg and Leprosy-adapted ISMI scores by patient subgroups
A summary of the key psychometric properties of the Nigerian Pidgin English versions of the RSES and ISMI scales can be found in Table 7.
Summary of key psychometric properties of the Nigerian Pidgin English versions of the RSES and Leprosy-adapted ISMI scale
DISCUSSION
The aim of this study was to undertake the translation, cross-cultural validation and adaptation of the Nigerian Pidgin English version of the RSES and Leprosy-adapted ISMI scales among persons affected by leprosy in Cross River, Southern Nigeria. The findings of the study revealed that both the RSES and ISMI scale were culturally valid in the Nigerian Pidgin English-speaking population of Cross River State as they had very good internal consistency and reproducibility, as well as moderate construct and content validity. Also, there was no evidence of floor and ceiling effect in the two scales. However, there are some areas in the scales requiring either some improvement or modifications based on the findings of this validation process.
Rosenberg Self-esteem Scale (RSES)
The study findings revealed the cross-cultural nature of self-esteem among persons affected by leprosy suggesting that the Nigerian Pidgin English version of the RSES has adequate cultural and measurement equivalence. Therefore, the results of the study suggest that the Nigerian Pidgin English version of the RSES has adequate utility for the assessment of self-esteem among persons affected by leprosy in Cross River, Southern Nigeria. The RSES assessed the perception of self-esteem among persons-affected by leprosy (R1 to R10). The finding of the present study indicates that all items in the scale were important and for the assessment of self-esteem among the study population. The three most important items in the context of the target population with the highest total means scores were: ‘R10: I take a positive attitude toward myself’ with a mean score of 3.45 (highest), ‘R4: I am able to do things as well as most other people.’ with a mean score of 3.27 (second highest), and ‘R7: I feel that I’m a person of worth, at least on an equal plane with others’ with a mean score of 3.27 (third highest). Overall, items R2 and R8 of the scale had the lowest mean total scores.
The psychometric properties of the Nigerian Pidgin English version of the RSES suggest that the scale had an excellent internal consistency, with an excellent reliability and the distribution of the scale was acceptable with no evidence of a floor or ceiling effect. The Cronbach’s alpha observed in the present study for the Nigerian Pidgin English version of the RSES (0.82) is consistent with the values reported by other studies [20, 24]. Our finding indicate that the Cronbach’s alpha indicates that all items loaded well. The EFA of the Nigerian Pidgin English version of the RSES indicated a moderate fit as a one-dimensional scale, with the first factor explaining 39.8% of the variation observed. This finding is consistent with those of an earlier report from Brazil indicating that the RSES is an overall one-dimensional scale [20, 25]. The distribution of the Nigerian Pidgin English version of the RSES is acceptable with no floor or ceiling effects. This indicates that the respondents had clear understanding of the items contained in the scale which ensured they were not giving extreme responses or responses that suggest social desirability bias.
The Leprosy-adapted ISMI Scale
The findings of this study suggest that the Nigerian Pidgin English version of the Leprosy-adapted ISMI scale has good cross-cultural reliability and validity. The reliability was assessed by evaluating the internal consistency of the items, and by the test–retest reliability of the scale. The construct validity of the scale was assessed by evaluating the correlation of the mean total scores of the Leprosy-adapted ISMI and the Rosenberg self-esteem scores. Overall, our findings were consistent with those of the original (English) scales for internal consistency, test–retest reliability, and construct validity [15–16]. The psychometric properties of the Nigerian Pidgin English version of the ISMI scale indicate a Cronbach’s alpha of 0.95 which is excellent; and consistent with the findings of the original English version of the scale as well as other studies in patients with leprosy and mental illness [15–16, 26–27]. Furthermore, the test–retest reliability coefficient was similar to the value obtained using the original English version of the scale. Therefore, the Nigerian Pidgin English version of the Leprosy-adapted ISMI scale demonstrated a similar level of reliability to the original version of the scale [15]. Although the EFA showed that there are five potential sub-scales of the Pidgin version of the ISMI scale, the items did not align in accordance with the original version of the ISMI scale [15–16]. This may be due to the low sample size of the study which did not have sufficient power to detect and classify the items in accordance with the original English version of the sub-scales.
Furthermore, in our examination of construct validity, we also obtained the same result as for the original English version [15, 26–27]. The Leprosy-adapted ISMI total mean scores was inversely associated with self-esteem as assessed using the RSES (r = -0.57) indicating that that internalized stigma construct was different from the self-esteem construct. Therefore, the construct validity of the two scales was therefore confirmed.
Overall, the findings of this study advance previous studies on internalized stigma in two main aspects. First, the findings strengthen the cross-cultural nature of internalized stigma, indicating that the Nigerian Pidgin English version of the Leprosy-adapted ISMI has adequate psychometric properties, and is therefore suitable for assessing the level of internalized stigma across very distinctive linguistic and cultural settings [28]. The present study found no floor or ceiling effects in the overall ISMI scale based on the detailed criteria by Terwee et al [22]. This indicate that the scale is sensitive enough at the high ends of the scale and further highlights its good content validity.
This study has some limitations. First, the sample size of the study is small which does not have adequate power to allow for detailed sub-scale analysis of the leprosy-adapted ISMI scale. The assessment of measurement equivalence utilized a descriptive cross-sectional design. Therefore, any associations found should not imply causation. Third, the questionnaire was presented and delivered as an interviewer-administered questionnaire where the research assistants read questions and answer selections aloud, and waited for patients to respond. Therefore, the reliability and validity of the Nigerian Pidgin English version of the ISMI scale may give different findings if the scales were self-administered; though this was mitigated by ensuring the selected research assistants were bi-lingual and were thoroughly trained before commencing data collection.
CONCLUSIONS
The findings of this study revealed that the Nigerian Pidgin English version of the RSES and Leprosy-adapted ISMI scale had good levels of reliability and validity compared to the original English versions of the scales. Therefore, the Nigerian Pidgin English versions of the RSES and leprosy-adapted ISMI scales may be used as a valid tool to reliably assess self-esteem and internalized stigma in persons-affected by leprosy in Nigeria. It is expected that these Nigerian Pidgin English versions of both scales will be of use to researchers and policymakers in advancing our understanding of self-esteem and internalized stigma experienced by people-affected by leprosy in Nigeria. However, assessment of the Leprosy-adapted ISMI sub-scales will require further validation using a larger sample size in the study setting.
Data Availability
All data produced in the present study are available upon reasonable request to the authors
REFERENCES
