Larger social networks may increase stigma against vocal illness: An integrated empirical and computational study of deciphering help-seeking behaviors and vocal stigma ======================================================================================================================================================================== * Aaron R. Glick * Colin Jones * Lisa Martignetti * Lisa Blanchette * Theresa Tova * Allen Henderson * Marc D. Pell * Nicole Y. K. Li-Jessen ## Abstract **Background** Individuals with a stigmatized medical condition are often reluctant to seek medical help. Among professionals, singers and actors often experience stigma associated with voice disorders. Scientific evidence for vocal stigma is, however, limited and primarily anecdotal. No quantitative research has explored the impact that vocal stigma may have on help-seeking behavior in professional vocal performers. This study deployed and integrated empirical and computational tools to (1) quantify the experience of vocal stigma and help-seeking behaviors and (2) predict their modulations with peer influences in social networks. **Methods** Experience of vocal stigma and information-motivation-behavioral (IMB) skills were prospectively profiled using online surveys from a total of 403 Canadians (200 vocal performers and 203 controls). The survey data were used to formulate an agent-based network model that numerically simulates the effect of social interactions on vocal stigma and help-seeking behaviors. Each virtual agent updates their IMB states via social interaction, which in turn changes their self- and social-stigma states. Profiles from vocal performers and non-vocal performers were compared as a function of network size. Network analysis was performed to evaluate the effect of social network structure on the flow of information and motivation among virtual agents. **Results** Over 4000 simulation runs in each context, larger social networks are more likely to contribute to an increase in vocal stigma. For small social networks, total stigma was reduced with higher total IMB but much less so for large networks with around 400 agents. For the agent population of vocal performers with high social-stigma and risk for voice disorder, their vocal stigma is resistant to large changes in IMB. Agents with extreme IMB and stigma values are also likely to polarize their networks faster in larger social groups. **Conclusions** We used empirical surveys to contextualize vocal stigma and IMB in real world populations and developed a computational model to theorize and quantify the interaction among stigma, health-seeking behavior and influence of social interactions. This work establishes an effective, predictable experimental platform to provide scientific evidence in developing public policy or social interventions of reducing health stigma in voice disorders and other medical conditions. Keywords * agent-based models * health stigma * social computing * social networks * vocal health ## Background Occupational voice users contribute a significant labour force in Canada and elsewhere [1–5]. For instance, more than 35,000 professional artists such as voice performers, radio hosts and singers are employed in Canada as of 2016 [6]. Alarmingly, the estimated lifetime prevalence of voice problems is as much as 80% for occupational voice users [7–9]. They also report devastating physical and emotional difficulties as well as challenges in professional and career development [7, 8, 10, 11]. The direct health care cost associated with voice problems is estimated as $1.75 billion/year in Canada [12, 13]. Indirect health care costs related to anxiety, loss of workdays and employment, and other negative quality-of-life sequelae are incalculable [14–18]. Reduction in occupational vocal problems would improve patient well-being and reduce the healthcare burden on society. ### Theoretical Framework of Health Stigma Stigma is considered a serious threat to population health inequalities as it disrupts resource availability, social relationships and coping behaviors within society [19]. Individuals with a stigmatized medical condition may become reluctant to seek medical help [20]. For example, a meta-analysis on mental health stigma found a negative correlation between stigma and help-seeking [21]. Similarly, a meta-analysis of stigma and health outcomes in HIV/AIDS found that those who experience symptoms of stigma were 21% less likely to access health and social services [22]. Individual studies also found associations between stigma and avoidance or delaying of help-seeking in other health issues, including alcoholism [23] and cancers [24]. Similarly, stigma against vocal illness, i.e., *vocal stigma*, is a known barrier to vocal performers seeking help for work-related illness. In 2019, Stangl et al. published a seminal paper “*The Health Stigma and Discrimination Framework*” in BMC Medicine [25]. The paper proposed a hierarchy of social levels on which stigma operates, and a series of processes leading from the creation of a stigma to its measurable outcomes. In brief, the proposed framework consists of a multi-level social hierarchy, namely, individual, interpersonal, organizational, community, and public policy. Within this hierarchy, the stigmatization process starts with constituent factors that drive or facilitate health stigma. Then, individuals with a specific health condition are “marked” or “labeled” with a stigma, followed by manifestations, i.e., attitudes, behaviors, and experiences that arise from the stigma in those who are marked by the stigma and those around them. Finally, the stigma manifestations affect a range of measurable outcomes on affected populations (e.g., access to healthcare) and the society (e.g., public policies against discrimination). By adopting Stangl et al.’s framework to vocal stigma, vocal performers with vocal impairments can entail catastrophic fears about losing the employment, social status, and creative fulfilment that their art provides [26]. In other words, they fear the consequences of not being able to meet the vocal demands of performance. This fear is a strong candidate for a driving factor in vocal stigma among vocal performers. However, individuals face different vocal demands and consequences for being unable to perform. For example, actors and singers face different vocal demands, and full-time performers face greater consequences from voice disorders than those who have other sources of income. (**Figure 1**) ![Figure 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2023/12/09/2023.12.08.23299730/F1.medium.gif) [Figure 1.](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/F1) Figure 1. Proposed Health Stigma and Discrimination Framework for Vocal Stigma. Adapted from Stangl et al. (2019) ### Predicting Help-Seeking Behavior Predicting help-seeking and other behaviors that influence health is a major topic in the field of health psychology [27]. One prominent psychological model for making these predictions is the Information Motivation Behavioral Skills (IMB) model [28]. *Information* represents a person’s knowledge and beliefs about the behavior, and about the issue that the behavior is intended to address. *Motivation* represents a person’s attitudes toward the predicted behavior, and their perception of social norms around it, i.e., what attitudes does the person believe other people hold? An example can be perceived costs and benefits of the behavior. *Behavioral Skills* represents a person’s ability to perform the behavior. This component can include objective skills, psychological skills and more importantly self-efficacy, i.e., a person’s intention to seek help [29]. By applying this IMB model to vocal stigma, *information* includes a person’s knowledge and belief about voice disorders and related issues. *Motivation* includes a person’s attitudes and perception of social norms about seeking professional medical help for a voice disorder. Finally, *behavioral skills* represent the intention to seek professional medical help if they acquire a voice disorder (**Figure 2**). ![Figure 2.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2023/12/09/2023.12.08.23299730/F2.medium.gif) [Figure 2.](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/F2) Figure 2. Proposed Information Motivation Behavioral Skills Model of Predicting Help-Seeking Behavior for Voice Disorders. Adopted from Fisher et al. (2002). ### Computer Simulation of Social Networks In response to the well-recognized health challenges presented by stigma, various strategies have been proposed to reduce the stigma around conditions such as HIV and mental illness. At the level of social-stigma, one common approach is to provide information about a health condition to the general public, emphasizing that affected individuals are not to blame for their condition. Other interventions includ promoting empathy and understanding toward affected individuals, for example via testimonials or social contact between affected and unaffected individuals. For self-stigma, a provision of counselling or coping strategies can also be implemented to affected individuals [30–32]. Of these, social contact has emerged as the most successful strategy for reducing stigma in adults [30, 33]. Computer simulation has emerged as a powerful, quantitative way to study social networks and their effects on human behavior and public policy. In fact, social networks have been investigated as a structural determinant of health on their role in the spread of social behaviors and attitudes affecting health outcomes [34]. For instance, testable models have been developed to simulate the mechanisms of misinformation, bias, and polarization in social networks [35, 36], characterize the effects of misinformation during the COVID-19 pandemic [37], and help understand stigma and its impact on obesity, depression, mental illness, heart disease, and HIV-prevention [38–41]. In particular, agent-based models (ABM) have become a pivotal simulation platform in social and behavioral sciences in the fast-growing field of *social computing* [42–44]. ABM have been applied for building and testing theories in stock markets [45–47], consumer behaviors [48–53], and psychological cooperation [54–57]. For driver behaviors in particular [58–66], ABMs are used to simulate how the behavior of a driver (*an individual agent*) will affect other drivers (*other agents*) and the evolving traffic patterns (*emergent population behavior*). Rather than individual isolated decisions, social behaviors often resulted from interactions among people with diverse backgrounds over time. Such characteristics match very well with the framework of ABMs. In essence, an ABM is built up by a collection of entities called *agents*, whose state and behavior are governed by a set of computational *rules*. Agents “live” in the virtual *world,* which is discretized into grids, or *patches*. Each *patch* is a certain situation or a physical environment that an agent lives in. In the application of social behaviors, each agent can represent an individual person with distinctive features with respect to demography, psychology and social history. Second, an individual agent makes its own decision and adapts the behavior to the environment over time that effectively represents the dynamics of social and physical influences on human behavior in the real world [43]. Lastly, ABM is technically flexible for users to explore a wide parameter space and a long temporal scale, which otherwise would be very costly or at times prohibitive with empirical experiments. For example, ABM can simulate human interactions in social networks with the ability to control for network sizes, type and frequency of interaction, and observe individual and group outcomes from weeks to years. Given that the process of stigmatization is multiscale and time-evolving, ABM presents a new, exciting opportunity in the research of health stigma. ### Study Objectives The objective of this study was to investigate the experience of vocal stigma using empirical survey questionnaires and computer network models. The primary focus was to predict how peer interactions could affect an individual’s help-seeking behaviors and vocal stigma experience especially in vocal performers. With a better understanding of vocal stigma, clinicians, social epidemiologists and public health policy makers will be more informed of devising interventions aimed at reducing vocal stigma and improving access to voice healthcare. ## 2. Methods ### 2.1. Empirical Study of Vocal Stigma Profiling #### 2.1.1. Survey Development and Deployment The study protocol (A09-B73-20A) was approved by the Institutional Review Board at McGill University, Canada. A 64-item questionnaire was constructed to survey individuals’ demographics (6 items), occupation and training (3 items), vocal health history (14 items), IMB profile (30 items, 10 each for information, motivation, and behavioral skills), experiences of vocal stigma (10 items, 5 each for social-stigma and self-stigma) plus a single, open item for feedback. The questionnaire was developed in consultation with an expert panel, including: (a) a speech-language pathologist with over 10 years of experience working with clinical voice disorders; and (b) three professional vocal performers (one actor, one singer, one actor/singer; each with over 20 years of experience) from the Alliance of Canadian Cinema, Television and Radio Artists (ACTRA) or the National Association of Teachers of Singing (NATS). Specific details of the survey construct and coding scheme are provided in ***Supplementary Information: Additional File 1***. The survey was deployed via *LimeSurvey*, Version 3 (LimeSurvey GmbH, Hamburg, Germany), an open-source survey tool housed at McGill University. The survey took participants around 10-15 minutes to complete all items. #### 2.1.2. Participant Recruitment and Compensation A convenience sample of 200 professional vocal performers and 203 gender-matched controls were recruited for this study. Professional vocal performers were recruited through membership offices of ACTRA and NATS. For this study, professional vocal performers were defined as those receiving at least part of their income via singing or acting performance. For the gender-matched control group, an online recruiting platform Prolific ([www.prolific.co](http://www.prolific.co)) was used for recruiting non-vocal performers to the study. Non-vocal performers were defined as receiving no income via singing or acting performance and having no past or present employment in the arts sector listed in their participant profiles on Prolific. Participants without a valid Canadian postal code were excluded from this study because an individual’s stigma experience and tendency to seek help are specific to their own countries’ healthcare systems. Participants were also excluded if they had a history of vocal pathology arising from cancer, stroke, degenerative neurological conditions, or physical trauma to the throat, head and neck. Interested individuals would first need to answer a set of screening questions to ensure their eligibility on *LimeSurvey*. Eligible participants were directed to the consent form, in which the general purpose of the study was described. Explicit reference to stigma was omitted to avoid response biases. A debrief with the full purpose of the study was disclosed to participants at the end of the questionnaire, at which time they could opt to withdraw their data from the study. In this study, no opt outs were requested at the end. In terms of compensation, individuals in the vocal performer group, were given the choice to enter a raffle for gift cards (each CAD $50) by following an external link and providing their email address at the end of the study. Participants in the control group were paid CAD $5 via the Prolific platform. #### 2.1.3. Data Privacy All data were collected anonymously and were stored on a secure server, hosted by McGill University. Participant data did not contain any identifying information. The emails in the gift card raffle were not linked to individual participant data. Participant identity was thus not traceable or identifiable. No additional information was collected passively about participants’ computers, e.g., IP address, cookies etc. #### 2.1.4. Preparatory Data Analysis Given that the survey data is the data source for ABM development, we opted to summarize the statistics of the empirical data here to avoid duplication and confusion from those of simulation experiments in Section 3. In short, a total of 200 professional singers and actors and 203 controls participated in the survey (both groups: ages 21-65; female 65%, male 32%, other 3%). Full details of the empirical data, participant demographics and survey data statistics can be found in ***Supplementary Information: Additional File 2, Table 2.1-2.3*** and ***Additional File 3, Table 3.1-3.6*** respectively. With respect to vocal stigma experience, performers reported 14% more stigma than controls (*t*(401)=8.87, *p*=0.025) overall. Among professionals, singers reported 15% more stigma than actors (*t*(198)=-1.67, *p=*0.025). Irrespective of groups, stigma was negatively associated with (1) *age* (Performers: *r*=-0.27, p<0.001; Controls: *r*=-0.17, *p*=0.018), (2) *recency of a voice disorder* (Performers: ρ=0.15, *p*=0.033; Controls, ρ=0.14, *p*=0.047), and (3) *frequency of voice disorder* (Performers: ρ=0.46, *p*=0.005; Controls: ρ=0.26, *p*=0.031). To assess the association of stigma experience with IMB profiles, Pearson’s product-moment correlations showed that stigma correlated negatively with motivation (Performers: *r*=-0.49; Controls: *r*=-0.59, *p*<0.001) and behavioral skills (Performers: *r*=-0.28; Controls: *r*=-0.46, *p*<0.001) in both participant groups. Stigma was not significantly associated with information (Performers: *r*=-0.09, *p*=0.205; Controls: r=-0.09, *p*=0.200), meaning there was not a definitive trend between stigma and an individual’s knowledge/beliefs regarding voice disorder or vocal health. Broadly speaking, vocal stigma is found present among professional singers and actors in Canada. The level of Motivation and Behavioral Skills of an individual were negatively associated with vocal stigma. The negative association between age and experiences of stigma may indicate that early-career vocal performers are more vulnerable to this stigma. The positive association between a history of vocal illness and experience of vocal stigma may indicate that vocal stigma is not commonly recognized by individuals without direct experience with a voice condition. ### 2.2. Computational Study of Simulating Social Interactions and Vocal Stigma #### 2.2.1. Vocal Stigma Agent-Based Models: Conceptual Framework In this vocal stigma agent-based model (VS-ABM), each agent represents an avatar of a vocal performer (VP) or a non-vocal performer (non-VP), who functions as a social actor and interacts with their peers to share information and their motivations for help-seeking related to voice health. Depending on an agent’s geolocation, they have access to a small or a large peer network in the VS-ABM. When two agents interact, they will exchange information and motivations related to vocal health. An agent’s vocal health (history and frequency of disordered voice), stigma experience (self- and social-stigma) and IMB are connected via two feedback loops (social and personal), which in turn affects an agent’s tendency to seek help **(Figure 3)**. The social loop simulates the interrelationship between social-stigma and IMB. Also, an agent’s motivation is linked to its own frequency of voice disorder. For instance, if an individual has frequent relapses in voice disorders, they will likely have less motivation to seek help from social partners and professionals. In contrast, the personal loop simulates the interrelationship between self-stigma and IMB. Also, an agent’s information related to vocal health is contingent on its history of voice disorder. For instance, if an individual has prior experience with a voice disorder, they will likely have more information about the nature of it and may have reduced their self-stigma as a result. ![Figure 3.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2023/12/09/2023.12.08.23299730/F3.medium.gif) [Figure 3.](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/F3) Figure 3. The Framework of Vocal Stigma Agent-Based Models (VS-ABM). An agent’s vocal health, vocal stigma, information, motivation, and behavioral skills (IMB) are presumably interrelated and modulated via the social and personal feedback loops, which collectively affects an agent’s tendency to seek help. #### 2.2.2 VS-ABM Design: World The VS-ABM is developed with NetLogo version 6.3.0, a free and open-source, cross-platform, agent-based modelling framework [67]. In our implementation, the VS-ABM world represents a small urban community, which is divided into a total of 1089 patches (33 x 33), with a densely populated urban center and a sparser rural perimeter. This geographical specification of the VS-ABM is based on the following considerations. (**Table 1**) View this table: [Table 1.](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T1) Table 1. Variables of World and Agents in the Vocal Stigma Agent-Based Model. First, the VS-ABM world size was set to approximate to the lower boundary of a sparse geographi network. This is because simulated social network in all sizes need to fit within the ABM world without being too densely populated. If the ABM world is too big, agents will be too far away from each other for social interactions. Second, the VS-ABM world is set as box-bound. That is, agents on the left or the top edges do not interact with the agent on the right or the bottom edges and vice versa. That way, agents in the rural region at the outer border are constrained to have fewer possible connections compared to those in the urban center of the simulation space. Note that about 5% of survey respondents were from rural areas in Canada (***Supplementary Information: Additional File 2, Table 2.1*)**. To approximate this real-world geographical distribution in the VS-ABM, we set the smallest network (50 agents) to have around 5% patches occupied by agents, whilst the same proportion of rural agents approaches 100% of occupied patches for the largest social network (400 agents). This geographical specification allows the proportion of rural agents to remain 5% in both geographically sparse networks (with 50 agents) and socially sparse networks (with 400 agents). #### 2.2.2 VS-ABM Design: Individual Agent Attributes Each agent has a set of attributes in terms of personal background (e.g., gender, age, education level, vocal training etc.) as well as experience related to voice health (e.g., information, motivation, behavior skills, self-stigma, social-stigma, history of voice disorder). (**Table 1**) All attributes are randomly assigned to each agent based on the normal distribution of the values from the demographic data in the empirical study. (***Supplementary Information: Additional File 2)*** #### 2.2.3 VS-ABM: Agent-Agent Social Interactions Within the ABM world, agents are free to interact and exchange information with nearby peers. These agents cannot move their location and are surrounded by neighbouring peers whom they are free to interact with. Agents also randomly select their next agent for each interaction. The potential peers are limited to a circular region around each agent with a radius of three patches. In other words, agents’ interaction space is 2.5% of the possible geographic space. We also assume that an agent with high initial social-stigma may be reluctant to interact with their peers. As such, in the VS-ABM, if either agent has high social-stigma (over 7.5), the chance of their peer interaction is set as 75%. After each interaction, the IMB and vocal stigma of an agent will change incrementally. The exact incrementation is formulated based on the linear regression analyses of help-seeking and stigma relationship in the survey study (***Supplementary Information: Additional File 3, Table 5)***. For example, within the social loop, social-stigma is associated with information. After each peer interaction, an agent’s information will slightly change by a value that is randomly sampled from a normal distribution centered around the mean, as obtained from the corresponding regression analysis (Information-Social-Stigma: 0.066). The change in an agent’s information can also cascade to changes in behavior skills and motivation. The formulation is the same but with different center means derived from the corresponding regression terms (Information-Behavioral Skills: 0.232; Motivation-Social-Stigma: 0.316). The formulation of all agent-rules is detailed in ***Supplementary Information: Additional File 4, Table 4.2***. Below is pseudocode for the VS-ABM. View this table: [Table2](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T2) View this table: [Table3](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T3) #### 2.2.4 VS-ABM Simulation Experiments This VS-ABM is designed to simulate social interaction and transfer of information/motivation among peers as functions of network size and initial social-stigma. Simulation experiments were set up to answer three research questions respectively *(**Supplementary Information: Additional File 4,*** ***Table 4.1 for the ABM world initialization and Table 4.3 for the initialization procedure of simulation experiments****)*. ##### Research Question #1: Does vocal stigma decrease when there are larger social groups? To investigate the relation between network size and total stigma, we ran 500 simulations for each network size with 50, 100, 150, 200, 250, 300, 350 and 400 agents up to 500,000 social interactions. We hypothesize that an agent’s total stigma will reduce with increasing peer networks. With more peers available to interact with, agents have a greater variety of peers to gain experiences and information from. More peers, more information, and more interactions should make agents more likely to increase their total IMB and lower their vocal stigma. Peers with extreme values for IMB and stigma may polarize their limited network more severely than with a larger peer group. ##### Research Question #2: Does vocal stigma decrease when peers are more willing to socially interact? To evaluate social willingness for agent-agent interactions, we ran additional 800 simulations initialized for five agent populations with distinctive initial social-stigma profiles, since empirical data showed differences between non-VP and VP groups *(**Supplementary Information: Additional File 3,*** ***Table 3.1-3.4)***. Each group is assigned with an initial social-stigma value obtained from the empirical data *(**Supplementary Information: Additional File 3,*** ***Table 3.6)***. For instance, the initial social-stigma value for the “General Population” is 5.4, which is derived by averaging social-stigma scores from non-VPs and VPs. While the VS-ABM does not explicitly model medical intervention, we assume that social interventions based on peer interactions will act similarly on social-stigma. Related hypotheses are: (1) social-stigma will decrease over time for agents who are more willing to interact; and (2) agents with high social-stigma will be less likely to transfer information/motivation to peers. A total of 4000 simulations were run for the following five agent populations. 1. General Population of both non-VPs and VPs with average social-stigma and average risk and incentive. 2. non-VP group with low social-stigma with low risk of voice disorder and little incentive to seek professional help. 3. VP group with higher social-stigma with higher risk of voice disorder and more incentive to seek professional help. 4. VP group with a history of voice disorder having very high social-stigma elevated in part by no intervention for the voice disorder. 5. VP group with a history of voice disorder having high social-stigma that has been mitigated by some social intervention. ##### Research Question #3: How does social network structure impact IMB and stigma? A comprehensive network-based analysis was employed to evaluate the impact of social network structure on the flow of information and motivation among agents for all 4000 simulations run. A NetLogo network extension procedure (*“nw”*) was used to quantify two standard network measures, namely, the degree of a node and local clustering coefficient [68]. The degree of the node (*count links*) is used to measure the number of peers that an agent is connected to in the network. The local clustering coefficient (*nw:clustering-coefficient*) is used to measure how densely connected an agent’s neighbors are and how much they tend to group together in a network by averaging all individual nodes. While this analysis could be performed on both the network size and social-stigma manipulations, we chose to focus on network size for two reasons. First, social structure in these networks should be directly correlated to the number agents in the simulation, since the simulation space does not change nor does the radius which agents survey for neighbors. Second, in order to generalize across all simulations, we use an outcome measure agnostic to initialized values of social-stigma, change in total stigma, which also allows us to compare directly with change in IMB so they are on similar measurement scales. We thus test which network structure, degree (number of peer connections) or clustering coefficient (peer connectedness), has the largest impact on change over time. ## 3. Results ### 3.1 Overall Relation between Total Stigma and Social Network Size Our original hypothesis for Research Question #1 was that vocal stigma would decrease with larger social networks. Unexpectedly, this hypothesis was not supported by our ABM simulation results in looking at changes in total stigma relative to the number of interactions with network sizes (50-400 agents) and initial social-stigma profiles (low vs average vs high) for each VP, non-VP and general populations (**Figure 4A**). ![Figure 4.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2023/12/09/2023.12.08.23299730/F4.medium.gif) [Figure 4.](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/F4) Figure 4. Total Stigma Experience as Functions of Network Size and Number of Interactions in Agents with Low, Average and High Initial Social-Stigma. (A) Aggregated trends of mean total stigma scores. Each trend aggregated from 100 simulations initialized with social-stigma and network size. (B) Varying outcomes of mean total stigma score from individual simulations for VP agents with high risk of voice disorders, high initial social-stigma, and no intervention within the 400-agent network size. The aggregated trend, same as VP group in Fig 4A, for all 100 simulations is shown in bold. (C) A representative snapshot of simulated social networks with 400 VP agents near the maximal total stigma after 100,000 interactions in the 400-VP network. An agent’s social-stigma is color-coded from low (Green) to high (Red). First on the VP networks, agents in the two smallest network sizes (50 and 100) had their total stigma stabilized as early as 25,000 social interactions. Their final total stigma values were also lower than initial values, regardless of initial social-stigma. In contrast, when the networks became sizable (> 150 agents), the trajectories of total stigma started to follow a log-normal distribution pattern. That is, agents’ total stigma quickly increased to a peak and then slowly leveled off but did not always return to initial values. Interestingly, VP agents with high initial social-stigma took 25% fewer social interactions (50,000 to 100,000) to reach the peak of total stigma, compared to those with low initial social-stigma (the general and non-VP groups). This initial observation suggests that total stigma likely worsens over time with social interactions in larger network groups, particularly for individuals prone to higher social-stigma such as VP at high risk for voice disorder and a tendency to not seek intervention. To further examine this paradox, we proceeded to examine individual-specific variations in the evolution of total stigma in the largest network (400 agents) from the VP group with initial high stigma up to 500,000 interactions (**Figure 4B**). Three distinct patterns emerged from this case simulation. (1) First, one set of simulations quickly leveled off towards a total stigma value lower than the initial value, which is denoted as the “*decreasing cohort*”. (2) Another set of simulations, which is denoted as the “*increasing cohort*”, increased rapidly towards a maximum between 50,000 and 200,000 interactions and then slowly leveled off to a total stigma value larger than the initial value. (3) Lastly, the “*chaotic cohort*” is a set of agent simulations that appeared to fluctuate randomly and did not appear to stabilize even after 500,000 social interactions. An extended set of simulations were further run for the “*chaotic cohort*” and confirmed that the total stigma value continued fluctuating randomly up to 10,000,000 interactions (data not shown). Except for the “*chaotic cohort*”, most agents’ total stigma appeared to approach maximum around 100,000 social interactions with large social networks. To understand one such maxima, we further visualized an established social network from the “*increasing cohort*” in 400 VP agents after 100,000 social interactions (**Figure 4C**). Multiple clusters or social groups with similar social-stigma values were formed within the global network, suggesting a homogenization with these highly interconnected social groups. Also, these clusters were not isolated but rather fairly connected to neighboring groups. In other words, peers were connecting with the whole set of the neighboring group, rather than simply bottlenecking through a few nearby peers. In particular, a few social groups appeared to have a heterogeneous mix of agents with initial low and initial high social-stigma profiles (**Figure 4C: networks with mixed green and red color**), confirming that agents could interact with opposite social-stigma values. Especially in this “*increasing cohort*”, the emergence of mixed social groups in the global network coincides with the stabilization of total stigma around the critical point of 100,000 social interactions. We speculated that, at the beginning of interactions, agents would establish social groups with peers around them, becoming more like their neighbors. Then, when social groups became homogenous, the total stigma would approach to its peak. Eventually, when social groups with polarized views interacted, a mix of agents with low and high social-stigma emerged and, paradoxically, stabilized the population’s social-stigma. To answer Research Question #1, our simulation results indicated that, on average, vocal stigma increases with larger social groups. However, there are non-trivial trends where total stigma diminishes as social groups become less polarized. In addition, our results suggested that interactions between groups are not bottlenecked with a small set of agents but distributed among the entire social group. The clusters can exchange information/motivation with multiple members of neighboring groups, which may ultimately result in less polarized neighboring groups. ### 3.2 Social Network Size in relation to Each IMB and Vocal Stigma Components For Research Question #2, the original hypothesis was that social-stigma would decrease when agents were more willing to socially interact, i.e., lower social-stigma and higher IMB. This hypothesis was partially supported by our ABM simulation results in comparing the probability distributions of final IMB and final total stigma scores between the smallest and largest social networks (50 vs 400 agents) (**Figure 5A-B**). ![Figure 5.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2023/12/09/2023.12.08.23299730/F5.medium.gif) [Figure 5.](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/F5) Figure 5. Probability Distribution of Total IMB and Total Stigma Experience. A total of 500,000 social interactions were simulated for VP, Non-VP and general populations with low, average or high initial social-stigma. (A) Total IMB and its components (information, motivation, and behavioral skills) at 50 and 400 network sizes (B) Total stigma and its components (self-stigma and social-stigma) at 50 and 400 network sizes (C) Average change in total IMB (diamonds) and total stigma (circles) from their initial values. Each row of subplots represents a specific magnitude of change, i.e., from less than 1 SD (σ) to more than 2 SD increase (inc.) or decrease (dec.), in total IMB and total stigma. % = percentage of simulations with corresponding changes in total stigma across all network sizes. (D) Ratio of simulation with total stigma changes more than 1 SD (Panel C row 1 + 2) relative to those with little or no change (Panel C row 3). Following a total of 500,000 social interactions, a clear bimodal distribution of total IMB score was noted in large but not in small networks across all three agent populations (**Figure 5A**). Of the total IMB score, the first mode (local maximum) appeared around 60 and 75, whereas the second mode appeared around 110 in the probability density function. Each IMB element (information, motivation and behavioral skills) also appeared to be highly coupled. That is, an agent population, regardless of its initial social-stigma, can be sub-grouped into either with low IMB and high IMB. Such sub-group distinction is much more pronounced in large social networks than small ones. For the total stigma, a bimodal distribution also appeared in large but not small social networks across all three agent populations (**Figure 5B**). Of the total stigma score, the first mode was centered around 10, whereas the second mode was around 20 within the data. Each total stigma element (social- and self-stigma) also displayed two distinctive peaks, but their distance was more separated in social-stigma score. Additionally, comparing high-risk VP groups, those with social intervention had overall lower social-stigma, whereas the maximal mode for the no intervention group showed higher social-stigma. Our results indicated that social-stigma experience has more weight than self-stigma in the total stigma experience. Further analysis was performed to evaluate the magnitude of changes in total IMB and total stigma by aggregating VP, non-VP, and general populations before and after the 500,000 interactions (**Figure 5C-D**). For total IMB, about 35% and 63% of agents showed increases or no changes of their scores in smaller networks (50 and 100 agents) at the end of simulations. With larger network sizes (>150 agents), about 36% of agents showed significant increases in their total IMB scores with more than two standard deviations (SD, σ), i.e., between 30 and 40 points increase from initial values. At the same time, about 39% and 21% of agents showed reduction in their IMB scores more than 1 and 2 SD respectively in these larger networks (**Figure 5C**). For total stigma, all agents in smaller networks had negligible changes of their scores, whilst 25% of them had total stigma increased by more than 6 points when they were in larger networks. For those with high risk and high social-stigma, VP agents were 1.5 times more likely to experience more total stigma if they had no intervention, compared to those with social intervention, when they are in the largest social network (**Figure 5D**). All in all, the aforesaid simulation results confirmed that higher total IMB was associated with lower total stigma for small networks. Interestingly, IMB outcomes vary across network sizes. Despite minimal change to total stigma, IMB tended to decrease more for larger social networks, while IMB for smaller networks tended to increase. The bimodal distribution noted in large social networks (i.e., 400) may be attributed to the increased likelihood that extreme values of social-stigma arise in the population. Also, within a large social network, their social groups tend to be more polarized with group size as noted in **Figure 4C**, leading to a wider separation between the two modes of the bimodal distributions. To address Research Question #2, our results supported the hypothesis in cases of small networks, i.e., lower social-stigma leads to an overall decrease in total stigma. Larger networks are far more likely to have significantly increased total stigma. For high-risk VPs, social interventions might help mitigate high social-stigma and eventually a reduction in total stigma over time. ### 3.3 Network Structure in relation to Total IMB and Total Stigma To understand the connections among agents in the social network, degree of node and clustering coefficient were computed in relation to the changes in total IMB and total stigma when the social network was established (i.e., after 100,000 social interactions) in all 4000 simulations. First, the degree of node represents the number of social links that an agent has in a social network. (**Figure 6A**) The average number of links ranged from 2.5 in the smallest social network (50 agents) to 13.5 in the largest social network (400 agents). This positive linear relationship is expected because each agent has more peers to interact within their vicinity in larger social networks. For instance, the relative patch coverage increases from 5% in the 50-agent network to nearly 36% in the 400-agent network. ![Figure 6.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2023/12/09/2023.12.08.23299730/F6.medium.gif) [Figure 6.](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/F6) Figure 6. Network Structure Analysis of Network Size Effects on IMB and Vocal Stigma. (A) Distribution of average number of peer links (degree of nodes) by network size. (B) Distribution of average local clustering coefficient by network size. (C) Total IMB values decrease as a function of average number of peer links, which is highly correlated with network size. A clear bifurcation appears around 4.5 peer links. (D) Total stigma values increase as a function of average number of peer links. No bifurcation appears. However, distributions show a larger range of changing stigma values for more peer links. Second, the clustering coefficient represents how close-knit an agent’s social group (i.e., cluster) i interconnected in a social network. The clustering coefficient is measured on a scale of 0 to 1. A lower cluster coefficient is when peers are only connected through the agent, whereas a higher cluster coefficient is when agents’ peers connected independently and create denser and tighter connections. Interestingly, the average clustering coefficient for the network does not show a linear trend with network size (**Figure 6B**). A wide spread of clustering coefficients was observed in small social networks wherea the probability distribution approximated to a normal distribution towards a larger social network. The cluster coefficient is also higher in larger networks (400 agents; mean (SD) = 0.61 (0.009)) than that of smaller networks (50 agents; mean (SD) = 0.31 (0.086)). In small networks, agents were sparsely randomized in the simulation space, which geographically favored agents being connected with their neighboring peers only but not reaching out to other social groups that are further away. Finally, we analyzed how the number of peer links (i.e., social partners) affects an agent’s total IMB and total stigma scores when the social network is stabilized, i.e., all links are maximally connected. For total IMB, more peer links might relate to a gradual decrease in IMB. (**Figure 6C**) Upon the stabilization of social networks, the IMB increases by 7.6 points in the smallest 50-agent network (1.5 social links); whereas it decreases by 10.6 points in the largest 400-agent network (12.5 social links). For total stigma, more peer links might contribute to a slight increase in total stigma (**Figure 6D**). Upon network stabilization, the total stigma decreases by 1.2 points in the 50-agent network yet increases by 3.5 points in the 400-agent network. ## 4. Discussion By using a prospective survey and network simulations, we were able to: (1) characterize population behavior related to vocal stigma in professional vocal performers; (2) identify which IMB and stigma components contribute most to population outcomes; and (3) analyze network structure and social groups to understand the impact of social interactions on population outcomes. Our VS-ABM allows each IMB and stigma component to be examined independently while simultaneously modelling how each element influences others. These components can vary for each individual and change as individuals interact with peers with distinct IMB and health profiles. ### 4.1. Diverging population outcomes and heterogeneity within social groups Three population behaviors, namely decreasing, increasing, and chaotic cohorts, were identified across all network sizes. The “*decreasing cohort*” had characteristics that resembled the small network trends, such that total stigma decreases and quickly stabilizes at a value less than the original population stigma. The “*increasing cohort*” had characteristics that resembled the large network trends, where total stigma increases to a maximum and then levels off towards a value larger than the initial stigma value. Such stigma maxima are seen when the social network of the population is fully established, and social groups are largely homogenous. When polarized homogenous groups start to interact and exert more influence on each other, greater heterogeneity of the groups emerges at a population level. Lastly, the “*chaotic set*” is referred to an oscillatory behavior when total stigma does not stabilize. Such complex patterns of vocal stigma are not programmed (i.e., hard-coded) in VF-ABM but rather emerge *de novo* (i.e., emergency) from dynamical systems. Our simulation outcomes may also be in line with a new notion of “stigma mutation”. [69] For instance, stigma associated with COVID-19 has a social-historical context and changes over time in response to the local and global environment. In our case, agents’ social-personal backgrounds (e.g., occupation, medical history, initial social-stigma) modulate the evolution of their total stigma in a network environment. ### 4.2 Social-stigma drives change in vocal stigma We further investigated which specific IMB and stigma components drove changes in population outcomes in relation to network size. Overall, information and behavioral skills tend to be coupled more strongly with motivation being inversely related, i.e., higher information and behavioral skills relative to a lower motivation. Social-stigma has more impact than self-stigma on total stigma. The variance of IMB changes is considerably large across all network sizes, ranging from −6 to +5 SD changes on average. In contrast, the variance of total stigma changes remains quite consistent – around 75%-85% of all simulations show less than 1 SD change on average. Moreover, in larger network sizes, social interactions led to three distinctive patterns of social-stigma, namely, (1) small decreases in low/ average risk groups, (2) small increases in high-risk groups; or (3) large increases regardless of risk group. In particular, larger networks with higher risk groups of voice disorders have considerably higher odds of increasing the total stigma than those of lower risk groups. Among these higher risk individuals, those without medical interventions have higher odds (4:4) to increase total stigma after social interaction than those who received treatment (3:4). That is, for large networks (i.e., 400 agents), about 51% of VP with no intervention are likely to increase their stigma after interacting with their peers; this likelihood drops to 41% if they receive intervention. Another key observation is that IMB and stigma do not always have a directional relationship. For instance, if we looked at simulated populations whose total stigma changed more than 1 SD with social interactions, their IMB scores could increase by 20 points at most. For those with changes more than 2 SD in total stigma, IMB decreased significantly by 30 points – in this case, vocal stigma might get worse despite informational and social intervention. Similar notions were also confirmed in reducing public stigma of mental illness, in which stigma is difficult to eliminate especially if it is deep rooted in social relationships [70]. ### 4.3 Larger social groups may promote vocal stigma Two standard network measures were analyzed to evaluate how connected VPs were (i.e., degree of node) and how close their social groups were linked (i.e., clustering coefficient). As the network size increased, a VP agent had more peers to interact and connect with in their vicinity. That is, for larger networks, peers had consistently larger social groups. However, as we simulated hundreds of thousands of social interactions, all agents were able to eventually interact and connect with all their potential peers and all social groups were maximally interconnected or clustered. As social group networks stabilize and become maximally connected, a gradual increase in total stigma and decrease in IMB was evident in larger but not smaller social groups. These analytics also provided part of the evidence to answer Research Question #1, i.e., larger networks stabilized towards more polarized social groups. This observation aligns with similar social network findings of polarization of political groups and how negativity spreads through larger social networks faster than positivity [71]-[72]. ### 4.4. Limitations and Future Directions This study investigates vocal stigma, for the very first time, in the context of social computing with expected technical challenges. To start, our vocal-stigma specific questionnaire was deployed to Canadians only for this initial round of analysis. Additional data from other countries can be collected to evaluate the sensitivity and specificity of VS-ABM or if additional organization or institutional factors (e.g., reimbursement system) will be needed to be included in future simulations. Second, our initial model results suggest the presence of a “*chaotic set*” in the population behavior. A more rigorous analysis of systems dynamics can be performed to evaluate when the system is in equilibrium or cycling in parameter space, which is out of the scope of this paper. Third, causal models can be considered to further examine the direction and causal relationships between components of IMB and stigma, since we primarily focused on correlations between these measures. Lastly, for the network analysis, we took a measured approach to establish a general trend for the population dynamics. However, more complex network measures such as information transmission and node similarity can be employed to characterize the details of stigma spread through the social network, instead of focusing on population averages in IMB and stigma. ## Conclusions Stigma is a serious, intractable barrier that prevents vocal performers from seeking vocal healthcare. This study integrated empirical survey and network simulation approaches to quantify the relationship of social interaction and vocal stigma. VS-ABM computer models were built to numerically simulate peer interactions and track person-level changes in the IMB framework. Our results highlight that an individual’s social network plays an important role in the experience of vocal stigma. Especially for vocal performers, social interventions, e.g., close peer support, may help reduce high vocal stigma over time. ## Data Availability The computational code and the research data that support the findings of this study are available from the corresponding author upon reasonable request. ## Declarations ### Ethics approval and consent to participate This study protocol (A09-B73-20A) was approved by the Institutional Review Board at McGill University. All participants of this study gave their informed, written consent. ### Consent for publication Not applicable ### Availability of data and materials The computational code and the research data that support the findings of this study are available from the corresponding author upon reasonable request. ### Competing interests The authors declare that they have no competing interests. ### Funding This study was supported by the Social Sciences and Humanities Research Council of Canada (#430-2020-00108), the Canadian Institutes of Health Research (388583), Digital Research Alliance of Canada and Canada Research Chair research stipend (N.L.-J.). The presented content is solely the responsibility of the authors and does not necessarily represent the official views of the above funding agencies. ### Contributions **Aaron Glick:** Conceptualization (lead), Investigation (lead), Formal Analysis (equal), Writing – original draft (lead). **Colin Jones:** Formal Analysis (equal), Data Curation (lead), Writing – original draft (supporting). **Lisa Martignetti**: Investigation (supporting), Writing – review and editing (supporting). **Lisa Blanchette**: Investigation (supporting), Writing – review and editing (supporting). **Theresa Tova**: Investigation (supporting), Writing – review and editing (supporting). **Allen Henderson**: Investigation (supporting), Writing – review and editing (supporting). **Marc Pell:** Supervision (supporting), Conceptualization (supporting), Writing – review and editing (supporting). **Nicole Li-Jessen:** Supervision (lead), Conceptualization (supporting), Funding Acquisition (lead), Resources (lead), Writing – review and editing (lead). ## Supplementary Information ### Additional File 1: Study Questionnaire The study questionnaire contained 64 items, grouped into 6 sections (sections A through F). Sections A, B, and C respectively pertained to demographics (6 items), occupation and training (3 items), and vocal health history (14 items). Section D measured predictors of help-seeking, and was divided into three subsections: DI, DM, and DB, respectively measuring participants’ levels of Information, Motivation, and Behavioral Skills. Section E measured experiences of vocal stigma. Finally, section F consisted of a single, open-ended item for feedback. Based on early piloting, we estimated the survey would take participants around 10-15 minutes to complete, which is a good length of survey to ensure low dropout rates[73]. The contents of each section are described below. #### Survey Sections A and B: Demographics and Occupation The questionnaire included a maximum of six items for demographics (including one item that was only presented to some participants, based on responses to previous items), and three items for occupational variables. Together, these nine items evaluated possible drivers and facilitators of stigma as well factors which could otherwise influence survey results (e.g., level of education). #### Survey Section C: Vocal Health History Vocal health variables were assessed by 14 items, including the complete Voice Handicap Index-10 (VHI-10). The VHI-10 is a well-validated [74] clinical tool commonly used to measure the impact that voice disorders have on quality of life. Two additional questions: one in which participants were asked when they had most recently experienced a voice disorder, and one which asked how frequently they experience voice disorders (with “never” being an available response for both). For participants who indicated that they have or previously had a voice disorder, two items ask whether they sought professional help, and if so, from which professionals. #### Survey Section D: IMB Scales for Predicting Help-Seeking All items in section D used a five-point, Likert scale format from 0 to 4, in line with the VHI-10. The scales were labeled as 0 = strongly disagree, 1 = disagree, 2 = neutral, 3 = agree, and 4 = strongly agree except Information. In all three sections, a participant’s likelihood of seeking help was represented as the sum of their scores on all ten items in the scale. This sum was a number between 0 and 40, where 40 represented the highest likelihood of seeking help and 0 the lowest. To reduce the impact of response bias, some items were reverse-coded, but item clarity was prioritized above creating a fully balanced scale [75]. ##### Section D-I: Information Scale Items in the Information scale were selected to assess participants’ knowledge and beliefs about the following five facets of voice and vocal health: (a) vocal health issues (items DI-2 and 10), (b) vocal health resources (DI-4 and 5), (c) voice care (DI-1 and 3), (d) vocal anatomy and physiology (DI-6 and 7), and (e) signs and symptoms of voice disorders (DI-8 and 9). Of these, DI-3, 4, 5, and 10 were adapted from Braun-Janzen and Zeine [76], DI-2 was adapted from Jung et al. [77], and the rest, DI-1, 6, 7, 8, and 9, were written for this study based on information in Colton et al. [78]. Response categories for Information items were labeled to indicate perceived truthfulness of the statements: 0 = definitely false, 1 = probably false, 2 = not sure, 3 = probably true, and 4 = definitely true. There were four reverse-coded items in the Information section. ##### Section D-M: Motivation Scale Items in the Motivation scale were selected to assess participants’ attitudes and normative beliefs toward help-seeking for voice disorders. Items DM-1, 2, 3, 4, and 9 were either based on or taken directly from Gilman et al. [79]; item DM-10 was adapted from Christopher [80]; item DM-5 was adapted from Jung et al. [77]; and items DM-6, 7, and 8 were adapted from Fischer and Farina [81]. There were five reverse-coded items in this section. ##### Section D-B: Behavioral Skills Scale Items in the Behavioral Skills scale were selected to assess participants’ intentions to seek help. Items DB-1 and 2 were adapted from the Mental Help-Seeking Intentions Scale, items DB-3 through 6 were adapted from the Intentions of Seeking Counselling Inventory, and DB-7 through 10 were adapted from the General Help-Seeking Questionnaire, all reviewed by Hammer and Spiker [82]. There was one reverse-coded Behavioral Skills item. This imbalance in reverse-coded items rises from a lack of reversed items in the source materials. ##### Survey Section E: Stigma Scale Section E used the same Likert format as section D-M and D-B. The ten items making up the stigma scale were selected to assess participants’ perceptions of both self-stigma (items ES-1 through ES-5), and social-stigma (items EO-1 through EO-5). Items ES-1, 2, 3, and 5 were adapted from Vogel et al. [83], while ES-4 was written for this study based on Rosen et al. [84]. Items EO-1, 2, 3, and 5 were based on Clough et al. [85], and EO-4 was based on discussions of VPs’ reputation found in, among others, Bradshaw and Cooper [86], Sataloff et al. [87], and Sloggy et al. [88]. The stigma scale included four reverse-coded items. As with each of the I, M, and B sections, the level of stigma experienced by a participant was measured as the sum of the ten scores. #### Survey Section F: Open-Ended Feedback After answering all the other items, participants could share perspectives on voice disorders and vocal stigma that they felt were not addressed by the rest of the questionnaire. *Special Notes: Below is a reproduction of the content in the final survey. Text in italics is for the reader’s information only and was not visible to participants. Questions marked with a * were reverse-coded*. ### WELCOME MESSAGE #### Vocal Illness Experiences Welcome to this survey about people’s experiences with vocal illnesses. We’ll start with a few simple questions to make sure you fit our study’s criteria. After that, there will be a consent form, followed by a survey. You can save your progress and return at any time, but you can’t go back to previous questions after you have moved to the next page. Click next to continue. ### PARTICIPANT SCREENING * *X1* **Do you have a Canadian Address?** 1. Yes 2. No * *X2* **Are you between the ages of 20 and 65?** 1. Yes 2. No * *X3* **Has your voice ever been affected by one of the following conditions:** * **Cancer in the head/neck** * **Stroke** * **Parkinson’s Disease, ALS, or other neurodegenerative conditions** * **Physical trauma to the throat, neck, or head (e.g., caused by car accident)** 1. Yes 2. No *Participants who answered X1, yes; X2, yes; X3, no were able to continue to the consent section. Otherwise, they saw the following message:* “Thank you for responding to our survey. Unfortunately, you don’t quite fit for what we’re trying to study. Feel free to share our study if you know anyone who does, so they can enter the draw for a gift card!” ### CONSENT SECTION *Consent split* Are you a professional singer or actor (i.e., you make at least some income via performance)? 1. Yes 2. No *Participants who answered “yes” became part of the performer group, while participants who answer “no” became part of the control group. Their respective consent forms were presented here*. *Participants in both groups who did consent to participate were able to proceed to the rest of the study.* 1. – Demographics * *A-1* **What gender do you identify as?** 1. Male 2. Female 3. I prefer not to answer 4. Other: \_\_\_|\\_\_\_|\\_\_\_|\\_\__| * *A-2* **Are you a member of a visible minority?** 1. No 2. Yes 3. I prefer not to answer * *A-3* **What is your age? (Years) \_\_\_|\\_\_\_|\\_\_\_|\\_\__|** * *A-4* **What are the first three characters of your Canadian post-code? \_\_\_|\\_\_\_|\\_\_\_|\\_\__|** * *A-5* **What is the highest level of education you have completed?** 1. High school diploma 2. Apprenticeship or trades certificate/diploma 3. College or CEGEP degree/diploma, or university degree lower than bachelor’s 4. Bachelor’s degree 5. Graduate degree (master’s or doctorate) 6. None of the above *Participants who responded to A-5 with any answer other than (a) or (f) were shown item A-5.1:* * *A-5.1* **In which area(s) did you obtain a degree/diploma/certificate?** * Check all that apply 1. Performance (e.g., music, acting, dance…) 2. Healthcare 3. Biology or Physiology 4. Other * *B - Occupation* * *B-1* Which of these statements about your occupation best describe you? 1. I am a professional actor (including theatre, film/TV, Voice Actor; not including musical theatre/opera). 2. I am a professional singer (including concerts, recordings, staged productions; solo and ensemble). 3. I am not a professional vocal performer. * *B-2* How much voice training have you received? (Training includes any lessons, classes, or coaching with a focus on learning voice skills for spoken or sung performance.) 1. None 2. Less than 1 year 3. 3 years or less 4. 5 years or less 5. More than 5 years * *B-3* Approximately how much of your income is made by working as a singer or actor in an average year (pre-pandemic)? 1. None or almost none 2. Less than half 3. About half 4. More than half 5. All or almost all 6. I prefer not to answer * C - Vocal Health **Please read the following information about voice disorders before continuing.** **Voice disorders are a wide range of conditions that impact a person’s voice in various ways, including the tone, pitch, loudness, and more. A voice disorder is not the same a speech disorder (which impacts your ability to speak fluently and accurately, such as a stutter or a lisp).** **For this study, a voice disorder refers to any disturbance to how your voice normally functions or sounds, in a way that interferes with your daily conversation and/or your professional work as a performer.** * Exceptions: (the following would not be considered a voice disorder): * **The problem resolves on its own within 1-2 days and does not come back regularly.** * **The problem is related to a brief illness such as a cold or flu, and voice symptoms resolve at a similar time to other symptoms**. * C-1 When was the last time you had a voice disorder? 1. I have never had a voice disorder 2. I currently have a voice disorder 3. Within the past month 4. Within the past year 5. More than a year ago *Participants who responded to C-1 with any answer other than (a) were shown item C-1.1:* * *C-1.1* **Did you approach a professional to help identify, overcome, or cope with this issue?** (In this question, a professional can include anyone whose job includes helping people with their voice or other health issues. Possible examples include: doctor, speech-language pathologist, voice teacher/coach, massage therapist, psychologist, acupuncturist, etc.) 1. No 2. Yes *Participants who responded to C-1.1 with (b), were shown item C-1.1.1:* * *C-1.1.1* What type of professional did you seek help from? (You may list several) * \_\_\_|\\_\_\_|\\_\_\_|\\_\__| * \_\_\_|\\_\_\_|\\_\_\_|\\_\__| * \_\_\_|\\_\_\_|\\_\_\_|\\_\__| * \_\_\_|\\_\_\_|\\_\_\_|\\_\__| * \_\_\_|\\_\_\_|\\_\_\_|\\_\__| * C-2 **How often have you experienced a voice disorder?** 1. Never 2. Once every few years 3. Once or twice every year 4. Once or twice every three months 5. Once or twice every month 6. Almost all the time * C-3 **These are statements that many people have used to describe their voices and effects of their voices on their lives. Choose the response that indicates how frequently you have the same experience.** View this table: [Table4](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T4) ***D – Likelihood of Seeking Help*** ***DI: Information*** **Please rate the following statements according to how confident you are that they are true: 0 = definitely false; 1 = probably false; 2 = not sure; 3 = probably true; 4 = definitely true** View this table: [Table5](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T5) View this table: [Table6](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T6) ***DM: Motivation*** **Please rate the statements below on a scale of 0 – 4, where:** **0 = strongly disagree; 1 = disagree; 2 = neutral; 3 = agree; 4 = strongly agree** View this table: [Table7](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T7) **DB: Behavioral Skills** **Please rate the statements below on a scale of 0 – 4, where:** **0 = strongly disagree; 1 = disagree; 2 = neutral; 3 = agree; 4 = strongly agree** View this table: [Table8](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T8) **The next 4 items fill in the blank of the following sentence:** **“If I was experiencing a voice disorder, I would be likely to seek help from\_\_\_|\\_\_\_|\\_\_\_|\\_\__|.”** View this table: [Table9](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T9) **For the purposes of the rest of the questionnaire, the term “vocal health professional” will refer to laryngologists/ENT (Ear, Nose, and Throat doctors), and speech-language pathologists.** **The next 4 items fill in the blank of the following sentence:** “I would be likely to seek help from a vocal health professional if \_\_\_|\\_\_\_|\\_\_\_|\\_\__|.” View this table: [Table10](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T10) ***E - Experiences of Stigma*** **Please rate the statements below on a scale of 0 - 4, where:** **0 = strongly disagree; 1 = disagree; 2 = neutral; 3 = agree; 4 = strongly agree** *Items numbered as EO pertain to social-stigma; items numbered as ES pertain to self-stigma* View this table: [Table11](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T11) **Reminder: for this survey, “vocal health professional” refers to laryngologists/ENTs (Ear, Nose, and Throat doctors), and speech-language pathologists.** ***F – Feedback*** * *F-1* If there is anything you would like to say about stigma and voice disorders that was not covered by this questionnaire, you can tell us here: View this table: [Table12](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T12) ## Additional File 2: Study participant demographics View this table: [Supplementary Table 2.1.](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T13) Supplementary Table 2.1. **Participant Demographics**. Data are presented as response frequencies except the age variable as group means. View this table: [Supplementary Table 2.2.](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T14) Supplementary Table 2.2. **Occupation and Training**. Data are presented as response frequencies. View this table: [Supplementary Table 2.3.](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T15) Supplementary Table 2.3. **Vocal Health Profiles.** Data are presented as response frequencies except VHI-10 score in group means. ## Additional File 3: Questionnaire results for VP and control group View this table: [Table 3.1.](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T16) Table 3.1. **Means and standard deviations (SD) of stigma experience scores between vocal performers and controls. * < 0.05** View this table: [Table 3.2.](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T17) Table 3.2. **Means and standard deviations (SD) of IMB scores between vocal performers and controls. * < 0.05** View this table: [Table 3.3.](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T18) Table 3.3. **Correlations for help-seeking and stigma relationship from the vocal performer group** View this table: [Table 3.4.](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T19) Table 3.4. **Correlations for help-seeking and stigma relationship from the control group** View this table: [Table 3.5.](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T20) Table 3.5. **Linear regression predictions for help-seeking and stigma relationship from the performer group** View this table: [Table 3.6.](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T21) Table 3.6. **Means and standard deviations (SD) of IMB and Stigma values for demographic subgroups related to history of voice disorder and tendency to seek professional help. Bolded numbers are used to set up the five agent populations in the VS-ABM.** ## Additional File 4: Agent-based model rule for Stigma and IMB model View this table: [Supplementary Table 4.1.](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T22) Supplementary Table 4.1. **Initial Configuration of VS-ABM**. View this table: [Supplementary Table 4.2.](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T23) Supplementary Table 4.2. **Rules of VS-ABM** View this table: [Supplementary Table 4.3.](http://medrxiv.org/content/early/2023/12/09/2023.12.08.23299730/T24) Supplementary Table 4.3. **Initial Values for Analysis Groups of VS-ABM Simulation Experiments** ## Acknowledgements The authors would like to thank for all individuals who participated in the survey study. ## List of Abbreviations ABM : Agent-based model IMB : Information-Motivation-Behavioral Skills Model LS/HS : Low stigma and High stigma groups VP : Vocal performer * Received December 8, 2023. * Revision received December 8, 2023. * Accepted December 9, 2023. * © 2023, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/) ## References 1. 1.Titze, I.R., J. Lemke, and D. Montequin, Populations in the U.S. workforce who rely on voice as a primary tool of trade: a preliminary report. J Voice, 1997. 11(3): p. 254–9. 2. 2.Verdolini, K. and L.O. Ramig, Review: occupational risks for voice problems. Logoped Phoniatr Vocol, 2001. 26(1): p. 37–46. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1080/140154301300109125&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=11432413&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F12%2F09%2F2023.12.08.23299730.atom) 3. 3.Vilkman, E., Voice problems at work: a challenge for occupational safety and health arrangement. Folia phoniatrica et logopaedica, 1999. 52(1-3): p. 120–125. 4. 4.Jones, K., et al., Prevalence and risk factors for voice problems among telemarketers. Archives of Otolaryngology–Head & Neck Surgery, 2002. 128(5): p. 571–577. 5. 5.Fellman, D. and S. Simberg, Prevalence and Risk Factors for Voice Problems Among Soccer Coaches. Journal of Voice, 2017. 31(1): p. 121. e9-121. e15. 6. 6.Arts, C. C.f.t. A Statistical Profile of Artists in Canada in 2016. 2019 [cited 2020 2020/01/10]; Available from: [https://canadacouncil.ca/research/research-library/2019/03/a-statistical-profile-of-artists-in-canada-in-2016](https://canadacouncil.ca/research/research-library/2019/03/a-statistical-profile-of-artists-in-canada-in-2016). 7. 7.Cutiva, L.C.C., I. Vogel, and A. Burdorf, Voice disorders in teachers and their associations with work-related factors: a systematic review. Journal of Communication Disorders, 2013. 46(2): p. 143–155. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jcomdis.2013.01.001&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23415241&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F12%2F09%2F2023.12.08.23299730.atom) 8. 8.Martins, R.H.G., et al., Voice disorders: etiology and diagnosis. Journal of Voice, 2015. 9. 9.Boltezar, L. and M. Sereg Bahar, Voice Disorders in Occupations with Vocal Load in Slovenia. Zdr Varst, 2014. 53(4): p. 304–10. 10. 10.Cohen, S.M., et al., Direct health care costs of laryngeal diseases and disorders. Laryngoscope, 2012. 122(7): p. 1582–8. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/lary.23189&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22544473&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F12%2F09%2F2023.12.08.23299730.atom) 11. 11.Cohen, S.M., et al., The impact of laryngeal disorders on work-related dysfunction. Laryngoscope, 2012. 122(7): p. 1589–94. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/lary.23197&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22549455&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F12%2F09%2F2023.12.08.23299730.atom) 12. 12.Canada, H., Canada Health Act Annual Report. 2012-2013. 13. 13.Canada, S.-L.A., Insurance Programs. 14. 14.Roy, N., et al., *Voice disorders in teachers and the general population: effects on work performance, attendance, and future career choices.* Journal of Speech, Language, and Hearing Research, 2004. 47: p. 542–551. 15. 15.Thibeault, S., et al., Occupational risk factors associated with voice disorders among teachers. Annals of Epidemiology, 2004. 14(10): p. 786–792. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.annepidem.2004.03.004&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=15519901&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F12%2F09%2F2023.12.08.23299730.atom) 16. 16.Dietrich, M., et al., The frequency of perceived stress, anxiety, and depression in patients with common pathologies affecting voice. Journal of Voice, 2008. 22(4): p. 472–488. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jvoice.2006.08.007&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=18395419&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F12%2F09%2F2023.12.08.23299730.atom) 17. 17.Smith, E., et al., Effect of voice disorders on quality of life. Journal of Medical Speech-Language Pathology, 1996. 4(4): p. 223–244. 18. 18.Siupsinskiene, N., A. Razbadauskas, and L. Dubosas, Psychological distress in patients with benign voice disorders. Folia phoniatrica et Logopaedica, 2011. 63(6): p. 281–288. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1159/000324641&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21430386&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F12%2F09%2F2023.12.08.23299730.atom) 19. 19.Hatzenbuehler, M.L., J.C. Phelan, and B.G. Link, Stigma as a fundamental cause of population health inequalities. American journal of public health, 2013. 103(5): p. 813–821. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.2105/AJPH.2012.301069&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23488505&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F12%2F09%2F2023.12.08.23299730.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000330949300026&link_type=ISI) 20. 20.Scott, N., et al., Stigma as a barrier to diagnosis of lung cancer: patient and general practitioner perspectives. Primary health care research & development, 2015. 16(6): p. 618–622. 21. 21.Clement, S., et al., What is the impact of mental health-related stigma on help-seeking? A systematic review of quantitative and qualitative studies. Psychological medicine, 2015. 45(1): p. 11–27. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1017/S0033291714000129&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24569086&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F12%2F09%2F2023.12.08.23299730.atom) 22. 22.Rueda, S., et al., Examining the associations between HIV-related stigma and health outcomes in people living with HIV/AIDS: a series of meta-analyses. BMJ open, 2016. 6(7): p. e011453. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYm1qb3BlbiI7czo1OiJyZXNpZCI7czoxMToiNi83L2UwMTE0NTMiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMy8xMi8wOS8yMDIzLjEyLjA4LjIzMjk5NzMwLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 23. 23.Cellucci, T., J. Krogh, and P. Vik, Help seeking for alcohol problems in a college population. The Journal of general psychology, 2006. 133(4): p. 421–433. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.3200/GENP.133.4.421-433&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=17128960&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F12%2F09%2F2023.12.08.23299730.atom) 24. 24.Carter-Harris, L., et al. Lung cancer stigma predicts timing of medical help–seeking behavior. in Oncology nursing forum. 2014. NIH Public Access. 25. 25.Stangl, A.L., et al., The Health Stigma and Discrimination Framework: a global, crosscutting framework to inform research, intervention development, and policy on health-related stigmas. BMC medicine, 2019. 17(1): p. 31. 26. 26.Rosen, D.C., J.B. Sataloff, and R.T. Sataloff, Psychology of voice disorders. 2020: Plural Publishing. 27. 27.Norman, P. and P. Conner, Predicting health behaviour: a social cognition approach. Predicting health behaviour, 2005. 1(478): p. 17.8. 28. 28.Fisher, W.A., J.D. Fisher, and J. Harman, The information-motivation-behavioral skills model: A general social psychological approach to understanding and promoting health behavior. Social psychological foundations of health and illness, 2003: p. 82–106. 29. 29.DeBate, R.D., A. Gatto, and G. Rafal, The effects of stigma on determinants of mental health help-seeking behaviors among male college students: an application of the information-motivation-behavioral skills model. American journal of men’s health, 2018. 12(5): p. 1286–1296. 30. 30.Thornicroft, G., et al., Evidence for effective interventions to reduce mental-health-related stigma and discrimination. The Lancet, 2016. 387(10023): p. 1123–1132. 31. 31.Morgan, A.J., et al., Interventions to reduce stigma towards people with severe mental illness: Systematic review and meta-analysis. Journal of psychiatric research, 2018. 103: p. 120–133. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jpsychires.2018.05.017&link_type=DOI) 32. 32.Brown, L., K. Macintyre, and L. Trujillo, Interventions to reduce HIV/AIDS stigma: what have we learned? AIDS education and prevention, 2003. 15(1): p. 49–69. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1521/aeap.15.1.49.23844&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=12627743&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F12%2F09%2F2023.12.08.23299730.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000181134200004&link_type=ISI) 33. 33.Adu, J., et al., Social contact: Next steps in an effective strategy to mitigate the stigma of mental illness. Issues in Mental Health Nursing, 2022. 43(5): p. 485–488. 34. 34._Zhang, J. and D. Centola, Social Networks and Health: New Developments in Diffusion, Online and Offline. Annual Review of Sociology, 2019. 45(1): p. 91–109. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1146/annurev-soc-073117-041421&link_type=DOI) 35. 35.Sikder, O., et al., A minimalistic model of bias, polarization and misinformation in social networks. Sci Rep, 2020. 10(1): p. 5493. 36. 36.Tokita, C.K., A.M. Guess, and C.E. Tarnita, Polarized information ecosystems can reorganize social networks via information cascades. Proc Natl Acad Sci U S A, 2021. 118(50). 37. 37.Gradoń, K.T., et al., Countering misinformation: A multidisciplinary approach. Big Data & Society, 2021. 8(1). 38. 38.Mooney, S.J. and A.M. El-Sayed, Stigma and the etiology of depression among the obese: An agent-based exploration. Soc Sci Med, 2016. 148: p. 1–7. 39. 39.Drapalski, A.L., et al., A model of internalized stigma and its effects on people with mental illness. Psychiatr Serv, 2013. 64(3): p. 264–9. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1176/appi.ps.001322012&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23573532&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F12%2F09%2F2023.12.08.23299730.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000327265600011&link_type=ISI) 40. 40.Garney, W.R., et al., Evaluating community-driven cardiovascular health policy changes in the United States using agent-based modeling. J Public Health Policy, 2022. 43(1): p. 40–53. 41. 41.Marshall, B.D., et al., A complex systems approach to evaluate HIV prevention in metropolitan areas: preliminary implications for combination intervention strategies. PLoS One, 2012. 7(9): p. e44833. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0044833&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23028637&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F12%2F09%2F2023.12.08.23299730.atom) 42. 42.Giabbanelli, P.J., et al. *Ideal, best, and emerging practices in creating artificial societies*. in *Proceedings of the Annual Simulation Symposium*. 2019. Society for Computer Simulation International. 43. 43.Smith, E.R. and F.R. Conrey, Agent-based modeling: A new approach for theory building in social psychology. Personality and social psychology review, 2007. 11(1): p. 87–104. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/1088868306294789&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=18453457&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F12%2F09%2F2023.12.08.23299730.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000243887100005&link_type=ISI) 44. 44.Elliott, E. and L.D. Kiel, Agent-based modeling in the social and behavioral sciences. Nonlinear Dynamics Psychol Life Sci, 2004. 8(8): p. 121–30. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=15068732&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F12%2F09%2F2023.12.08.23299730.atom) 45. 45.Chen, S.-H. and C.-H. Yeh, Evolving traders and the business school with genetic programming: A new architecture of the agent-based artificial stock market. Journal of Economic Dynamics and Control, 2001. 25(3-4): p. 363–393. 46. 46.LeBaron, B., Empirical regularities from interacting long-and short-memory investors in an agent-based stock market. Ieee transactions on evolutionary computation, 2001. 5(5): p. 442–455. 47. 47.Llacay, B. and G. Peffer, Using realistic trading strategies in an agent-based stock market model. Computational and Mathematical Organization Theory, 2018. 24(3): p. 308–350. 48. 48.Chen, D.-N., et al., An agent-based model for consumer-to-business electronic commerce. Expert Systems with Applications, 2008. 34(1): p. 469–481. 49. 49.Garifullin, M., A. Borshchev, and T. Popkov. Using AnyLogic and agent-based approach to model consumer market. in Proceedings of the 6th EUROSIM Congress on Modelling and Simulation. 2007. 50. 50.North, M.J., et al., Multiscale agent based consumer market modeling. Complexity, 2010. 15(5): p. 37–47. 51. 51.Said, L.B., T. Bouron, and A. Drogoul. Agent-based interaction analysis of consumer behavior. in Proceedings of the first international joint conference on Autonomous agents and multiagent systems: part 1. 2002. ACM. 52. 52.Schenk, T.A., G. Löffler, and J. Rauh, Agent-based simulation of consumer behavior in grocery shopping on a regional level. Journal of Business research, 2007. 60(8): p. 894–903. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jbusres.2007.02.005&link_type=DOI) 53. 53.Zhang, T. and D. Zhang, Agent-based simulation of consumer purchase decision-making and the decoy effect. Journal of business research, 2007. 60(8): p. 912–922. 54. 54.Gotts, N.M., J.G. Polhill, and A.N.R. Law, Agent-based simulation in the study of social dilemmas. Artificial Intelligence Review, 2003. 19(1): p. 3–92. 55. 55.Elliott, E. and L.D. Kiel, Exploring cooperation and competition using agent-based modeling. Proceedings of the National Academy of Sciences, 2002. 99(suppl 3): p. 7193–7194. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoicG5hcyI7czo1OiJyZXNpZCI7czoxNToiOTkvc3VwcGxfMy83MTkzIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjMvMTIvMDkvMjAyMy4xMi4wOC4yMzI5OTczMC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 56. 56.Ceschi, A., et al., Cooperate or Defect? How an agent based model simulation on helping behavior can be an educational tool, in Methodologies and Intelligent Systems for Technology Enhanced Learning. 2014, Springer. p. 189–196. 57. 57.Marsella, S.C., D.V. Pynadath, and S.J. Read. PsychSim: Agent-based modeling of social interactions and influence. in Proceedings of the international conference on cognitive modeling. 2004. 58. 58.Bernhardt, K., Agent-based modeling in transportation. Artificial Intelligence in Transportation, 2007. 72. 59. 59.Dia, H., An agent-based approach to modelling driver route choice behaviour under the influence of real-time information. Transportation Research Part C: Emerging Technologies, 2002. 10(5-6): p. 331–349. 60. 60.Handford, D. and A. Rogers, Modelling driver interdependent behaviour in agent-based traffic simulations for disaster management, in Advances on Practical Applications of Agents and Multiagent Systems. 2011, Springer. p. 163–172. 61. 61.Manley, E., et al., *A framework for simulating large-scale complex urban traffic dynamics through hybrid agent-based modelling.* Computers, Environment and Urban Systems, 2014. 44: p. 27–36. 62. 62.Mizuta, H. Evaluation of metropolitan traffic flow with agent-based traffic simulator and approximated vehicle behavior model near intersections. in Proceedings of the 2015 Winter Simulation Conference. 2015. IEEE Press. 63. 63.Paruchuri, P., A.R. Pullalarevu, and K. Karlapalem. Multi agent simulation of unorganized traffic. in Proceedings of the first international joint conference on Autonomous agents and multiagent systems: part 1. 2002. ACM. 64. 64.Wahle, J., et al., Anticipatory traffic forecast using multi-agent techniques, in Traffic and Granular Flow’99. 2000, Springer. p. 87-92. 65. 65.Wahle, J. and M. Schreckenberg. A multi-agent system for on-line simulations based on real-world traffic data. in Proceedings of the 34th annual Hawaii international conference on system sciences. 2001. IEEE. 66. 66.Zhang, L., et al., Integrating an agent-based travel behavior model with large-scale microscopic traffic simulation for corridor-level and subarea transportation operations and planning applications. Journal of Urban Planning and Development, 2012. 139(2): p. 94–103. 67. 67.Wilensky, U., *NetLogo*. 1999, Center for Connected Learning and Computer-Based Modeling: Northwestern University. Evanston, IL. 68. 68.Stonedahl, F., NetLogo Network Extension [Source code]. 2011. 69. 69.Farrimond, H., Stigma Mutation: Tracking Lineage, Variation and Strength in Emerging COVID-19 Stigma. Sociol Res Online, 2021. 28(1): p. 171–188. 70. 70.Pescosolido, B.A., The public stigma of mental illness: what do we think; what do we know; what can we prove? Journal of Health and Social behavior, 2013. 54(1): p. 1–21. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/0022146512471197&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23325423&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F12%2F09%2F2023.12.08.23299730.atom) 71. 71.Antypas, D., A. Preece, and J. Camacho-Collados, Negativity spreads faster: A large-scale multilingual twitter analysis on the role of sentiment in political communication. Online Social Networks and Media, 2023. 33. 72. 72.Felix, E. and F. Lynn, Mental Health Stigma and Social Contact Revisited: The Role of Network Closeness and Negativity. Society and Mental Health, 2021. 12(1): p. 49–63. 73. 73.Bosnjak, M.G.M., Effects of Questionnaire Length on Participation and Indicators of Response Quality in a Web Survey. Public Opinion Quarterly, 2009. 73(2): p. 349–360. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/poq/nfp031&link_type=DOI) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000266968000007&link_type=ISI) 74. 74.Rosen, C.A., Lee, A. S., Osborne, J., Zullo, T., & Murry, T., Development and validation of the VHI10. The Laryngoscope, 2004. 114(9): p. 1549–1556. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1097/00005537-200409000-00009&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=15475780&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F12%2F09%2F2023.12.08.23299730.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000224314800009&link_type=ISI) 75. 75.Tsang, S., Royse, C. F., & Terkawi, A. S., Guidelines for developing, translating, and validating a questionnaire in perioperative and pain medicine. Saudi Journal of Anaesthesia, 2017. 11: p. S80. 76. 76.Braun-Janzen, C., & Zeine, L. (2009), Singers’ interest and knowledge levels of vocal function and dysfunction: Survey findings. Journal of Voice, 2009. 23(4): p. 470-483. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=18468844&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F12%2F09%2F2023.12.08.23299730.atom) 77. 77.Jung, H., von Sternberg, K., & Davis, K., Expanding a measure of mental health literacy: Development and validation of a multicomponent mental health literacy measure. Psychiatry Research, 2016. 273: p. 278–286. 78. 78.Colton, R.H., Casper, J. K., & Leonard, R., Understanding voice problems: A physiological perspective for diagnosis and treatment. 2011: Wolters Kluwer Health/Lippincott Williams & Wilkins. 79. 79.Gilman, M., Merati, A. L., Klein, A. M., Hapner, E. R., & Johns, M. M., Performer’s attitudes toward seeking health care for voice issues: Understanding the barriers. Journal of Voice,, 2009. 23(2): p. 225–228. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=18037270&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F12%2F09%2F2023.12.08.23299730.atom) 80. 80.Christopher, M.S., The ability of self-construals to predict psychological distress, satisfaction with life, and help-seeking in ethnically diverse American college students 2004: University of South Dakota. 81. 81.Fischer, E.H., & Farina, A., Attitudes toward seeking professional psychological help: A shortened form and considerations for research. Journal of College Student Development, 1995. 36(4): p. 368–373. [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=A1995RG77400008&link_type=ISI) 82. 82.Hammer, J.H., & Spiker, D. A., Dimensionality, reliability, and predictive evidence of validity for three help-seeking intention instruments: ISCI, GHSQ, and MHSIS. Journal of Counseling Psychology, 2018. 65(3): p. 394–401. 83. 83.Vogel, D.L., Wade, N. G., & Haake, S., Measuring the self-stigma associated with seeking psychological help. Journal of Counseling Psychology, 2006. 53(3): p. 325–337. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1037/0022-0167.53.3.325&link_type=DOI) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000239045900005&link_type=ISI) 84. 84.Rosen, D.C., Sataloff, J. B., & Sataloff, R. T., The psychology of voice disorders 2ed. 2021: Plural Publishing Inc. 85. 85.Clough, B.A., Hill, M., Delaney, M., & Casey, L. M., Development of a measure of stigma towards occupational stress for mental health professionals. Social Psychiatry and Psychiatric Epidemiology, 2020. 55(7): p. 941–951. 86. 86.Bradshaw, N., & Cooper, A. L., Medical privacy and the professional singer: Injury stigma, disclosure, and professional ramifications on Broadway. Journal of Singing, 2018. 74(5): p. 513–520. 87. 87.Sataloff, R.T., Divi, V., Heman-Ackah, Y. D., & Hawkshaw, M. J., Medical history in voice professionals. Otolaryngologic Clinics of North America, 2007. 40(5): p. 931–951. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.otc.2007.05.003&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=17765689&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F12%2F09%2F2023.12.08.23299730.atom) 88. 88.Sloggy, J., Stemple, J., Rowles, G., & Andreatta, R., In support of the exceptional voice. Perspectives of the ASHA Special Interest Groups, 2019. 4(6): p. 1306–1310