A Survey of Open Science Attitudes and Behaviors among US Pharmacy Faculty ========================================================================== * Spencer E. Harpe ## Abstract Objectives: To describe the current attitudes, behaviors, and perceived disciplinary norms related to open science practices among full-time pharmacy faculty in the US and to examine differences in attitudes and behaviors across pharmacy disciplines. Methods: In this cross-sectional study, the Center for Open Science’s Open Scholarship Survey modules on data sharing, code sharing, materials sharing, preregistration, preprints, and open access publishing were administered to a random sample of 3,200 faculty from the AACP Roster of Pharmacy Faculty as of February 2022. Individuals with at least a 0.8 full-time equivalent faculty appointment in pharmacy practice or one of the pharmaceutical sciences were eligible to participate. Results: Responses were obtained from 663 faculty (502 complete; 161 partial). The most positive attitudes were for open access publishing (overall mean [SD]: 4.1 [0.9]) with the lowest attitudes for study preregistration (3.2 [0.9]) and posting preprints (3.1 [1.1]). Statistically significant differences in attitudes across pharmacy disciplines were identified for data sharing, code sharing, and study preregistration. The most commonly reported open science practice was open access publishing (mean [SD], 27.7% [29.1%]). Study preregistration was the least common (mean [SD], 1.7% [7.0%]). After accounting for respondent and institutional characteristics, differences in open science behaviors were noted across pharmacy disciplines. Conclusion: This study provides a baseline assessment of faculty attitudes towards and engagement in open science practices among US pharmacy faculty. Given the relatively low frequency with which open science practices were reported, there is considerable room for improvement in the uptake of open science practices. Keywords * Open science * Preregistration * Preprints * Open access * Data sharing * Meta-research ## 1. Introduction According to the United Nations Educational, Scientific, and Cultural Organization (UNESCO), open science is “an inclusive construct that combines various movements and practices aiming to make multilingual scientific knowledge openly available, accessible and reusable for everyone, to increase scientific collaborations and sharing of information for the benefits of science and society, and to open the processes of scientific knowledge creation, evaluation and communication to societal actors beyond the traditional scientific community.”1 UNESCO’s recommendations required open science infrastructures, open engagement of societal actors, open dialog with other knowledge systems, and open scientific knowledge.1 The US National Academies of Science, Engineering, and Medicine have emphasized that open science involves not only the *products* of science (i.e., evidence generated through research), but also the *processes* of science in all their various forms.2 Two commonly cited benefits of open science relate to increased availability and transparency of research to other researchers and society at large.3 By increasing transparency, open science may increase trust in the processes and products of science.4,5 With the high estimates of research waste,6,7 open science may improve efficiency and reduce waste by supporting collaboration amongst researchers and promoting the reuse of existing data.2,3,8,9 Engaging in open science provides benefits to individual researchers, such as increased citations, employability, and research collaborations.4,10,11 From a holistic perspective, open science has been proposed as a means to improve equity in the scientific enterprise for researchers, research participants, and research consumers alike.1–3,12 Open science is not without potential challenges or disadvantages. There remain notable costs for open access publishing.13 Some in the scientific community have raised the concerns surrounding the privacy of research participants or communities14 and even potential security threats15 associated with sharing research data and materials. Despite the intentions to promote research equity, open science may inadvertently increase inequities.16,17 Recent research has sought to examine attitudes and behaviors related to various open science practices. The State of Open Data survey, conducted annually since 2016, has shown increasingly positive views about data sharing as a requirement for funding, especially among early career researchers.18 Previous research on open science practices has included a broad range of disciplines across the physical, life, social, and health sciences.9,19–21 Although health sciences and health professions have been included in previous studies, pharmacy was not able to be viewed separately. This study provides a baseline of open science attitudes and behaviors among US pharmacy faculty allowing for the detection of changes in the future. The objectives of this study were (1) to describe the current attitudes, behaviors, and perceived disciplinary norms related to selected open science practices among full-time pharmacy faculty in the US and (2) to examine potential differences in current attitudes and behaviors across pharmacy disciplines. ## 2. Methods ### 2.1. Study Design and Sample This cross-sectional study included a random sample of faculty from the AACP Roster of Pharmacy Faculty as of February 2022. This roster includes an estimated 6,500 faculty across pharmacy practice and the pharmaceutical sciences. Participants were eligible for inclusion if they had at least a 0.8 full-time equivalent faculty appointment in pharmacy practice or one of the pharmaceutical sciences at a school or college of pharmacy in the US. There were no other restrictions placed on type of faculty position (clinical, teaching, research, tenure-track, etc.). Chief executive officer (CEO) deans listed in the Directory of Professional Programs of Colleges and Schools of Pharmacy maintained by the Accreditation Council for Pharmacy Education in March 2022 were excluded from the roster prior to sampling faculty for questionnaire administration; however, respondents who identified as CEO deans were retained in the data. Based on a total population size of 6,500, a 95% confidence level, and a 3% margin of error, a total sample of 363 was needed for accurate and reliable results. Using a conservative estimated response rate of 15%, which is consistent with previous online surveys of pharmacy faculty,22,23 a total sample of 3,200 was drawn randomly from the AACP faculty roster. ### 2.2. Study Questionnaire and Administration The study questionnaire was based on the Open Scholarship Survey (OSS), a modular survey developed by the Center for Open Science.24 The modules on data sharing, code sharing, materials sharing, preregistration, preprints, and open access publishing were used for this study. Questions within each module related to respondents’ attitudes, behaviors, and perceived disciplinary norms (i.e., the percentage of other faculty within their discipline who have engaged in various open science activities and the distribution of attitudes within their discipline towards various open science activities). As part of a larger study, the full study questionnaire included a total of 217 to 220 questions depending on the responses selected as skip logic used as part of the questionnaire flow. The questionnaire was broken into 4 sections: open science attitudes and behaviors, open science incentives and barriers, open science knowledge and future use, and demographics. Only the questionnaire sections on open science attitudes and behaviors and demographics are reported here. Recruitment took place in 8 waves of 400 randomly selected faculty. Each wave lasted 2 weeks. As the current best, evidence-based practice for conducting survey research, Dillman’s tailored design method25 was used as a framework for survey administration. The online questionnaire was open for 2 weeks within each recruitment wave. Each sampled faculty member received an introductory email that included a personalized link to the online questionnaire to prevent duplicate responses. Reminder emails were sent to non-respondents 3, 6, and 10 business days after the introductory email. Questionnaire administration occurred between April 26 and June 26, 2022, using the Qualtrics XM online survey platform (Qualtrics LLC; Provo, UT). The order of the OSS modules was randomized for each respondent to avoid any potential ordering effects. All other questionnaire sections were presented in the same order across respondents. Individuals who completed the survey were offered a $10 gift card to a selection of nationwide retailers. Identifiable information (names, email addresses, IP addresses, etc.) was not collected as part of questionnaire administration. Mailing information for gift cards was collected separately and not linked to any questionnaire responses. To approximate attentiveness when completing the questionnaire, time spent on each questionnaire page was measured through embedded timer questions. Respondents spending >1 standard deviation below the mean response time across all respondents for the questionnaire page were excluded. If a respondent exceeded the threshold for ≥80% of survey pages, all their responses were excluded. ### 2.3. Study Variables The OSS modules collected information on attitudes, behaviors, and perceived disciplinary norms related to open science attitudes and behaviors. Attitudes towards open science activities were obtained from the relevant OSS modules using the following response options: Very much against, Against, Neither in favor nor against, In favor, Very much in favor, and No opinion. For open science behaviors, respondents provided the percentage of their scholarly works that involved the 6 open science practices examined in this study. Disciplinary norms for attitudes were assessed by asking respondents to estimate the approximate percentage of faculty within their discipline who fell into each attitude category (Very much against, Against, etc.) for each open science practice. For behavioral norms, respondents estimated the percentage of faculty within their discipline who had engaged in each open science practice. Individual characteristics (time since highest degree, gender, pharmacy discipline, administrative position, etc.) were obtained from each respondent. Institutional characteristics were obtained from publicly available resources. The standardized set of pharmacy disciplines maintained by AACP was used for this study. Research funding from the 2021-2022 fiscal year research was obtained from AACP Funded Research Grant Institutional Tables.26 ### 2.4. Statistical Analysis Representativeness of the study sample was assessed by comparing respondent characteristics to the 2021-2022 academic year AACP Profile of Pharmacy Faculty.27 The potential for non-response bias was assessed by comparing respondent characteristics and attitudes and behaviors for early and late responders within waves (individuals responding in the first 3 days of the wave vs. individuals responding on or after the last reminder within the wave) and across the data collection period (Waves 1 and 2 vs. Waves 7 and 8). Current attitudes were described using means and standard deviations and percentage of responses in each response category. Behaviors were described as the percentage of faculty who had any scholarly works using the open science practice. For the comparison of attitudes and perceived attitudinal norms, the “Very much in favor” and “In favor” responses were combined to describe the total percentage of respondents with favorable attitudes towards each open science practice. Differences in attitudes towards open science practices across pharmacy disciplines were analyzed via ordinary least squares regression with response on the attitude item for each open science practice as the outcome variable and pharmacy discipline as the predictor variable. For open science behaviors, the proportion of scholarly outputs using the open science practice of interest was the outcome variable for a generalized linear model (GLM) with a log link and binomial distribution. For open science behaviors, three models were constructed: Model 1 (pharmacy discipline only), Model 2 (pharmacy discipline and respondent characteristics), and Model 3 (pharmacy discipline, respondent characteristics, and institutional characteristics). Robust standard errors were estimated to account for clustering of respondents within institutions for all models. Statistical analyses were conducted in R version 4.4.0 (R Foundation, Vienna, Austria) with p < 0.05 denoting statistical significance. As a pre-specified analysis, comparisons of attitudes across pharmacy discipline were adjusted for multiple comparisons using the Bonferroni method. No additional adjustments were made for the multiple testing across the analyses conducted for this study.28 Disciplinary norms for attitudes and behaviors were compared to respondents’ attitudes and behaviors without formal statistical analysis. Respondents not providing their pharmacy discipline, indicating “No opinion” for attitudes towards an open science practice, or not providing any response for attitudes or behavior for an open science practice were excluded from statistical analyses; however, all eligible respondents were included when reporting respondent demographics. ### 2.5. Ethical Approval and Study Registration This study was reviewed by the Midwestern University Illinois Campus Institutional Review Board and determined to qualify for an exemption (File Number 22011). The study protocol was registered at Open Science Framework Registries ([https://osf.io/68rvy](https://osf.io/68rvy)) prior to data collection. ## 3. Results ### 3.1. Response Rate and Missing Data Of the 3200 emails sent, 49 were unable to be delivered. Of those delivered, 116 individuals opted out of participation, and 59 did not meet the eligibility criteria upon completing the screening questions. Complete responses were obtained from 502 faculty with an additional 161 providing partial responses yielding the following response rates using the American Association of Public Opinion Research29 definitions: 16.0% (RR1, complete responses only) and 21.2% (RR2, complete and partial responses). Given the availability of additional financial resources after study initiation, recruitment was not concluded once the original sample size requirement was met. No respondents were excluded because of insufficient attentiveness. Missing attitudes ranged from 103 for open access publishing to 219 for sharing code. Missing frequency of open science practices ranged from 134 for open access publishing to 177 for sharing code. By randomizing the order of the open science attitude and behavior sections, missingness was assumed to be at random for those variables. Pharmacy discipline was not provided by 175 respondents. The effective sample sizes are provided in the appropriate tables for each analysis. ### 3.2. Sample Representativeness and Non-Response Bias Most characteristics of the respondents were within a 5 percentage-point difference of the pharmacy faculty profile with a few exceptions. Faculty from the economic, social, and administrative sciences were more common in the sample (15.9%) than in the faculty profile (7.2%). Faculty at the rank of assistant professor were somewhat underrepresented in the sample (24.6%) compared to the faculty profile (31.7%). There were more tenured faculty responding (36.7%) and fewer tenure-eligible faculty (14.4%) compared to the faculty profile (14.3% and 32.3%, respectively). The full comparisons for representativeness can be found in Supplemental File 1. Based on the comparisons of early and late responders, there was little concern for non-response bias. Respondent characteristics were similar across early and late respondents both within waves and across the data collection period (Waves 1/2 vs. Waves 7/8). No statistically significant differences were noted in the comparisons and the absolute differences were generally within 5 percentage points. When comparing open science attitudes and behaviors, there were some differences to note. For within-wave comparisons, the mean attitudes were not statistically significantly different; however, late respondents appeared to be more divided on attitudes toward data sharing (i.e., fewer “neither in favor nor against” responses) and were more positive with respect to material sharing. For comparisons across the data collection period, late wave respondents appeared to have slightly less positive attitudes surrounding code sharing than early wave respondents. Although late wave respondents had a statistically higher mean percentage of scholarly works published under open access pathways, there was no difference in the percentage of respondents who had any scholarly work published as open access. The full non-response assessment can be found in Supplemental File 2. ### 3.3. Respondent Characteristics Respondents were primarily women (53.5%) with White racial identities (72.3%). Over half of the respondents were from the pharmacy practice discipline. Respondents were approximately equally distributed across academic rank with slightly higher representation of associate professors. Time in academia was approximately equally distributed with slightly fewer respondents in the 16- to 20-year category (14.5%). Respondents reported having published a mean (SD) of 27.3 (40.2) studies (median (IQR): 15 (4, 32)). The reported mean (SD) of total publications was 42.9 (58.9) with a median (IQR) of 25 (11, 50). Additional respondent characteristics are provided in Table 1. Based on the distribution of responses, pharmacy disciplines were collapsed into the following groups: pharmaceutical sciences (biological and biomedical sciences; medicinal or pharmaceutical chemistry and pharmacognosy; pharmaceutics; pharmacology and toxicology); economic, social, and administrative sciences (ESAS); pharmacy practice; and clinical sciences (pharmacokinetics, pharmacodynamics, genetics, pharmacotherapeutics, translational research). This was done to streamline analysis and reporting while maintaining groupings that were generally similar in nature with respect to research topics and approaches. View this table: [Table 1:](http://medrxiv.org/content/early/2024/06/23/2024.06.20.24309260/T1) Table 1: Respondent Characteristics ### 3.4. Attitudes Towards Open Science Practices Attitudes were generally neutral (neither in favor nor against) to positive for all open science practices. The most positive attitudes were related to open access publishing (overall mean [SD]: 4.1 [0.9]) with the lowest attitudes related to study preregistration (3.2 [0.9]) and posting preprints (3.1 [1.1]). The mean (SD) attitudes across pharmacy disciplines are presented in Table 2. Statistically significant differences in attitudes across pharmacy disciplines were identified for data sharing, code sharing, and study preregistration. The largest differences across disciplines were noted for study preregistration where the mean (SD) attitudes for clinical sciences was 3.5 (1.5) compared to 2.9 (1.0) for pharmaceutical sciences. There were only 2 instances where mean responses were “against” an open science practice: study preregistration among pharmaceutical sciences faculty and posting preprints for clinical sciences faculty. View this table: [Table 2:](http://medrxiv.org/content/early/2024/06/23/2024.06.20.24309260/T2) Table 2: Attitudes towards Open Science Practices by Pharmacy Discipline Respondents generally reported more positive attitudes for themselves compared to their estimates of the open science attitudes for other faculty within their discipline (Figure 1). Faculty estimated that other faculty within their discipline had the most positive attitudes towards open access publishing (ranging from 42% for ESAS faculty to 57% for clinical and translational sciences faculty). With the exception of code sharing for clinical and translational sciences faculty (41%), estimates of favorable attitudes were below 40% for all other open science practices across pharmacy disciplines. Faculty generally estimated that their colleagues held less favorable attitudes towards open science practices. The differences between their own attitudes versus estimated favorable attitudes ranged from -37.1 percentage points for sharing code in clinical and translational sciences faculty (i.e., respondents estimated that their own attitudes were more favorable than their colleagues) to +2.1 percentage points for posting preprints in clinical and translational sciences faculty (i.e., respondents estimated that their colleagues’ attitudes were more favorable than their own attitudes). ![Figure 1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2024/06/23/2024.06.20.24309260/F1.medium.gif) [Figure 1:](http://medrxiv.org/content/early/2024/06/23/2024.06.20.24309260/F1) Figure 1: Comparison of Respondents’ Favorable Attitudes and Estimated Favorable Attitudes by Pharmacy Discipline ### 3.5. Open Science Behaviors Respondents reported less than half of their prior scholarly works had involved open science practices (Figure 2). The most common open science practice was open access publishing (overall mean [SD], 27.7% [29.1%]), which ranged from 23.2% (27.9%) of works for pharmacy practice faculty to 37.5% (30.1%) for clinical and translational sciences faculty. The least common open science practice was study preregistration (overall mean [SD], 1.7% [7.0%]). Aside from open access publishing, there were only 3 instances where the reported percentage of scholarly works was below 10%: data sharing among pharmaceutical sciences faculty, materials sharing among pharmaceutical sciences faculty, and data sharing among clinical and translational sciences faculty. ![Figure 2:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2024/06/23/2024.06.20.24309260/F2.medium.gif) [Figure 2:](http://medrxiv.org/content/early/2024/06/23/2024.06.20.24309260/F2) Figure 2: Comparison of Respondents’ Open Science Practices and Estimated Open Sciences Practices by Pharmacy Discipline The comparison of open science behaviors across pharmacy disciplines is presented in Table 3. For these generalized linear models, pharmacy practice faculty were chosen as the reference group since they were the most common group of respondents and because that group was assumed to be somewhat different from the other disciplines given their primary focus on practice rather than research. From Model 1 (pharmacy discipline as the only predictor), the odds of pharmaceutical sciences or clinical and translational sciences faculty engaging in data sharing, code sharing, or open access publishing were from 2 to almost 8 times higher than pharmacy practice faculty. ESAS faculty had an almost 70% lower odds of sharing data compared to pharmacy practice faculty. Additionally, pharmaceutical sciences faculty had over 3 times higher odds of sharing materials than pharmacy practice faculty and clinical and translational sciences faculty had an almost 6 times greater odds of preregistering studies compared to pharmacy practice faculty. View this table: [Table 3.](http://medrxiv.org/content/early/2024/06/23/2024.06.20.24309260/T3) Table 3. Participation in Open Science Practices by Pharmacy Discipline In Model 2, gender, identifying as a racial or ethnic minority, current enrollment in a training program, possessing a research-based doctoral degree, percent effort allocated to research, academic rank, and tenure status were included as confounders based on results from previous studies18,30–34 and conceptual relevance. Other combinations of individual characteristics were considered but resulted in adverse effects on model performance. The findings from Model 2 showed similar patterns to Model 1. Three-year total funding for the school or college of pharmacy and a collapsed Carnegie classification were included in Model 3. Each institution’s basic Carnegie classification35 was collapsed in the following manner: baccalaureate institution (arts and science focus or diverse field), master’s institution (M1, M2, or M3), doctoral professional university, medical or health sciences university (Special Focus- Medical Schools and Centers, Special Focus-Other Health Professions Schools), and research-intensive universities (R1, R2, or Special Focus-Research Institution). Other combinations of institutional characteristics were considered but resulted in statistical challenges with model estimation. The results from Model 3 were somewhat different than for Models 1 or 2. The odds of data sharing among pharmaceutical sciences faculty were over 12 times higher than for pharmacy practice faculty (OR [95% CI]: 12.30 [3.04–49.72]). ESAS and clinical and translational sciences faculty had a higher odds of study preregistration compared to pharmacy practice faculty (OR [95% CI]: 5.2 [1.22–22.24] and 21.50 [2.10– 220.14], respectively). Clinical and translational sciences faculty had 70% lower odds of posting preprints (OR [95% CI]: 0.31 [0.10–0.97]) than pharmacy practice faculty. There were no statistically significant differences by pharmacy discipline for materials sharing, code sharing, or open access publishing in Model 3. It is important to note the wide confidence intervals for Model 3 suggesting imprecise estimates potentially associated with small sample sizes resulting from additional variables being added to the models. Figure 2 provides a comparison of the percentage of respondents’ scholarly works using various open science practices with their estimates of the percentage of faculty within their discipline who have used open science practices. Compared to their own scholarly work, respondents estimated that more faculty within their discipline had engaged in open science practices. This ranged from a 1.3 percentage point difference for data sharing in clinical and translational sciences faculty to a 22.9 percentage point difference for open access publishing in ESAS faculty. ## 4. Discussion This study provides an overview of the current attitudes and behaviors of US pharmacy faculty in relation to selected open science practices. Faculty had the most positive views of open access publishing. This was also the most frequently reported open science practice. This was expected given the rise in popularity and uptake of open access publishing pathways. Although sharing preprints and study preregistration had the least positive responses for attitudes, these were still in the neutral range. This is similar to findings from a 2020 study by Soderberg, Errington, and Nosek20 where medical researchers reported the least positive views towards preprints (51% favorable views for medical and health sciences vs. ≥70% favorable views for life, physical, and psychosocial science). This low favorability and slow uptake of preprints in health sciences may arise, in part, from their questionable value and appropriateness.36–40 The most frequent open science activity was open access publishing. All other open science practices were relatively infrequent for all pharmacy disciplines. Across pharmacy disciplines, there was notable variability in open science attitudes and behaviors. The comparisons between respondent attitudes and behaviors with their perceived disciplinary norms revealed an interesting pattern. Respondents rated themselves as having more positive attitudes than the rest of faculty within their discipline. Conversely, respondents believed that more faculty in their discipline engaged in each open science practice than they did in their own research. Whether this reflects a lack of familiarity with the various open science practices or faculty feeling like they are less like their peers than they may be remains unclear and should be examined more closely in the future. The random sampling strategy used in current study should allow these findings to be generalizable to the broader population of full-tine US pharmacy faculty. The representativeness of the respondents in relation to the known characteristics of US pharmacy faculty and the lack of concern surrounding non-response bias further supports generalizability. There are, however, several limitations to note when interpreting the results of this study. Although there were no major indications of non-response bias or concerns related to sample representativeness, there were some differences as noted previously. The over- representation of economic, social, and administrative sciences faculty among respondents is likely related to this being the author’s discipline. The “name recognition” may have promoted increased responses among ESAS faculty. The proportion of respondents from the clinical and translational sciences was smaller than the other disciplines. It is unclear whether this is an artefact of that being the smallest group of pharmacy faculty or if there were other reasons. The extent to which this may have influenced the results is unknown, but it could have resulted in difficulties identifying differences across groups. In the originally registered study plan, the analysis of attitudes involved ordinal logistic regression. For some open science practices, the proportional odds assumption was violated requiring slightly different model specifications across the open science practices. Analyzing the data using OLS regression indicated similar patterns across pharmacy disciplines with respect to statistical significance and the directions of the relationships. For the sake of consistency, to facilitate interpretation, and to avoid confusion, the results for open science attitudes based on OLS regression were reported. Robust standard errors were used in all models to account for clustering within institutions. Different model specifications could have resulted in different results. The wide confidence intervals for some estimates shown in Table 3 likely reflect small sample sizes, especially for clinical and translational science faculty. Although the directions of the relations were consistent for most open science practices when moving from Model 1 to Model 3, those results should be interpreted with caution given the low frequency of the outcomes. Research is ongoing with the data collected in this study. This includes an examination of barriers and incentives to researcher engagement in open science practices. Using behavioral models, examining faculty intentions to engage in open science practices is also in process. The current study recruited current US pharmacy faculty; however, current graduate students and post-graduate trainees should be considered in future work as they represent the next generation of pharmacy researchers and faculty. Continued research in this area will be important to identify intervention points to improve the awareness and uptake of open science practices in pharmacy. This is especially true as open science requirements becoming increasingly required by funding agencies.41–43 ## 5. Conclusions This study provides a current assessment of attitudes towards and engagement in various open science practices among US pharmacy faculty. Overall, faculty had the most positive views of open access publishing with the lowest attitudes related to posting preprints and study preregistration. Open access publishing was the most common open science practice reported by faculty. Given the relatively low frequency with which other open science practices were reported, there is considerable room for improvement in all other open science practices. ## Supporting information Supplemental File 1 [[supplements/309260_file02.xlsx]](pending:yes) Supplemental File 2 [[supplements/309260_file03.xlsx]](pending:yes) ## Data Availability All data produced will available online at the project's Open Science Framework (OSF) page after acceptance of the paper. [https://osf.io/udywr/](https://osf.io/udywr/) ## Footnotes * Disclosures: The author has no financial conflicts of interest to disclose. The current work has not been presented or published elsewhere. * Data availability: The data supporting this study will be available on the study project page on Open Science Framework ([https://osf.io/udywr](https://osf.io/udywr)). * Received June 20, 2024. * Revision received June 20, 2024. * Accepted June 23, 2024. * © 2024, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/) ## References 1. 1.United Nations Educational, Scientific and Cultural Organization. UNESCO Recommendation on Open Science. UNESCO; 2021. doi:10.54677/MNMH8546 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.54677/MNMH8546&link_type=DOI) 2. 2.National Academies of Sciences, Engineering, and Medicine, Policy and Global Affairs, Board on Research Data and Information, Committee on Toward an Open Science Enterprise. Open Science by Design: Realizing a Vision for 21st Century Research. National Academies Press (US); 2018. Accessed September 14, 2021. [http://www.ncbi.nlm.nih.gov/books/NBK525417/](http://www.ncbi.nlm.nih.gov/books/NBK525417/) 3. 3.Fecher B, Friesike S. Open science: one term, five schools of thought. In: Bartling S, Friesike S, eds. Opening Science. Springer; 2014:17–47. 4. 4.Allen C, Mehler DMA. Open science challenges, benefits and tips in early career and beyond. PLoS Biol. 2019;17(5):e3000246. doi:10.1371/journal.pbio.3000246 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pbio.3000246&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=31042704&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F23%2F2024.06.20.24309260.atom) 5. 5.Rosman T, Bosnjak M, Silber H, Koßmann J, Heycke T. Open science and public trust in science: Results from two studies. Public Underst Sci Bristol Engl. 2022;31(8):1046–1062. doi:10.1177/09636625221100686 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/09636625221100686&link_type=DOI) 6. 6.Chalmers I, Glasziou P. Avoidable waste in the production and reporting of research evidence. Lancet Lond Engl. 2009;374(9683):86-89. doi:10.1016/S0140-6736(09)60329-9 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S0140-6736(09)60329-9&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19525005&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F23%2F2024.06.20.24309260.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000267768800037&link_type=ISI) 7. 7.Freedman LP, Cockburn IM, Simcoe TS. The economics of reproducibility in preclinical research. PLoS Biol. 2015;13(6):e1002165. doi:10.1371/journal.pbio.1002165 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pbio.1002165&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=26057340&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F23%2F2024.06.20.24309260.atom) 8. 8.Arza V, Fressoli M. Systematizing benefits of open science practices. Inf Serv Use. 2018;37(4):463–474. doi:10.3233/ISU-170861 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.3233/ISU-170861&link_type=DOI) 9. 9.Zečević K, Houghton C, Noone C, Lee H, Matvienko-Sikar K, Toomey E. Exploring factors that influence the practice of Open Science by early career health researchers: a mixed methods study. HRB Open Res. 2021;3:56. doi:10.12688/hrbopenres.13119.2 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.12688/hrbopenres.13119.2&link_type=DOI) 10. 10.Piwowar HA, Day RS, Fridsma DB. Sharing detailed research data is associated with increased citation rate. PLoS One. 2007;2(3):e308. doi:10.1371/journal.pone.0000308 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0000308&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=17375194&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F23%2F2024.06.20.24309260.atom) 11. 11.McKiernan EC, Bourne PE, Brown CT, et al. How open science helps researchers succeed. eLife. 2016;5. doi:10.7554/eLife.16800 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.7554/eLife.16800&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=27387362&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F23%2F2024.06.20.24309260.atom) 12. 12.OECD. Making Open Science a Reality. Vol 25.; 2015. doi:10.1787/5jrs2f963zs1-en [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1787/5jrs2f963zs1-en&link_type=DOI) 13. 13.Halevi G, Walsh S. Faculty attitudes towards article processing charges for open access articles. Publ Res Q. 2021;37(3):384–398. doi:10.1007/s12109-021-09820-x [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s12109-021-09820-x&link_type=DOI) 14. 14.Ross MW, Iguchi MY, Panicker S. Ethical aspects of data sharing and research participant protections. Am Psychol. 2018;73(2):138–145. doi:10.1037/amp0000240 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1037/amp0000240&link_type=DOI) 15. 15.Smith JA, Sandbrink JB. Biosecurity in an age of open science. PLoS Biol. 2022;20(4):e3001600. doi:10.1371/journal.pbio.3001600 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pbio.3001600&link_type=DOI) 16. 16.Gray RJ. Sorry, we’re open: golden open-access and inequality in non-human biological sciences. Scientometrics. 2020;124(2):1663–1675. doi:10.1007/s11192-020-03540-3 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s11192-020-03540-3&link_type=DOI) 17. 17.Zhang L, Wei Y, Huang Y, Sivertsen G. Should open access lead to closed research? The trends towards paying to perform research. Scientometrics. 2022;127(12):7653–7679. doi:10.1007/s11192-022-04407-5 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s11192-022-04407-5&link_type=DOI) 18. 18.Smith G, Schoenenberger H, Day L, Hahnel M, Scaplehorn N, Digital Science. The State of Open Data 2023. Digital Science; 2023:32. doi:10.6084/M9.FIGSHARE.24428194 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.6084/M9.FIGSHARE.24428194&link_type=DOI) 19. 19.Tenopir C, Levine K, Allard S, et al. Trustworthiness and authority of scholarly information in a digital age: results of an international questionnaire. J Assoc Inf Sci Technol. 2016;67(10):2344–2361. doi:10.1002/asi.23598 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/asi.23598&link_type=DOI) 20. 20.Soderberg CK, Errington TM, Nosek BA. Credibility of preprints: an interdisciplinary survey of researchers. R Soc Open Sci. 2020;7(10):201520. doi:10.1098/rsos.201520 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1098/rsos.201520&link_type=DOI) 21. 21.Linek SB, Fecher B, Friesike S, Hebing M. Data sharing as social dilemma: Influence of the researcher’s personality. PLoS One. 2017;12(8):e0183216. doi:10.1371/journal.pone.0183216 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0183216&link_type=DOI) 22. 22.Conklin MH, Desselle SP. Job turnover intentions among pharmacy faculty. Am J Pharm Educ. 2007;71(4):62. doi:10.5688/aj710462 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.5688/aj710462&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=17786250&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F23%2F2024.06.20.24309260.atom) 23. 23.Lindfelt TA, Ip EJ, Barnett MJ. Survey of career satisfaction, lifestyle, and stress levels among pharmacy school faculty. Am J Health Syst Pharm. 2015;72(18):1573–1578. doi:10.2146/ajhp140654 [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiYWpocCI7czo1OiJyZXNpZCI7czoxMDoiNzIvMTgvMTU3MyI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDI0LzA2LzIzLzIwMjQuMDYuMjAuMjQzMDkyNjAuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 24. 24.Center for Open Science. Open Scholarship Survey. Center for Open Science. Accessed October 15, 2023. [https://www.cos.io/initiatives/open-scholarship-survey](https://www.cos.io/initiatives/open-scholarship-survey) 25. 25.Dillman DA, Smyth JD, Christian LM. Internet, Phone, Mail, and Mixed-Mode Surveys: The Tailored Design Method. 4th ed. John Wiley & Sons Inc; 2014. 26. 26.American Association of Colleges of Pharmacy. Funded research grant institutional tables. Accessed December 18, 2023. [https://www.aacp.org/research/funded-research-grant-institutional-tables](https://www.aacp.org/research/funded-research-grant-institutional-tables) 27. 27.American Association of Colleges of Pharmacy. 2021-22 Profile of Pharmacy Faculty. Accessed December 18, 2023. [https://www.aacp.org/node/2660](https://www.aacp.org/node/2660) 28. 28.Rubin M. When to adjust alpha during multiple testing: a consideration of disjunction, conjunction, and individual testing. Synthese. 2021;199(3-4):10969–11000. doi:10.1007/s11229-021-03276-4 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s11229-021-03276-4&link_type=DOI) 29. 29.American Association for Public Opinion Research. Standard Definitions: Final Dispositions of Case Codes and Outcome Rates for Surveys. 10th ed. AAPOR; 2023. Accessed October 15, 2023. [https://aapor.org/standards-and-ethics/standard-definitions/](https://aapor.org/standards-and-ethics/standard-definitions/) 30. 30.What HHMI Scientists Think About Scientific Publishing. HHMI. Accessed September 14, 2021. [https://www.hhmi.org/content/what-hhmi-scientists-think-about-scientific-publishing](https://www.hhmi.org/content/what-hhmi-scientists-think-about-scientific-publishing) 31. 31.Tenopir C, Allard S, Douglass K, et al. Data sharing by scientists: practices and perceptions. PLoS One. 2011;6(6):e21101. doi:10.1371/journal.pone.0021101 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0021101&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21738610&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F23%2F2024.06.20.24309260.atom) 32. 32.Rathi VK, Strait KM, Gross CP, et al. Predictors of clinical trial data sharing: exploratory analysis of a cross-sectional survey. Trials. 2014;15:384. doi:10.1186/1745-6215-15-384 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/1745-6215-15-384&link_type=DOI) 33. 33.Toribio-Flórez D, Anneser L, deOliveira-Lopes FN, et al. Where do early career researchers stand on open science practices? A survey within the Max Planck Society. Front Res Metr Anal. 2020;5:586992. doi:10.3389/frma.2020.586992 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.3389/frma.2020.586992&link_type=DOI) 34. 34.Digital Science, Hahnel M, Borrelli LM, et al. The State of Open Data 2020. Digital Science; 2020:2621716 Bytes. doi:10.6084/M9.FIGSHARE.13227875 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.6084/M9.FIGSHARE.13227875&link_type=DOI) 35. 35.American Council on Education. Carnegie Classification of Institutions of Higher Education-Basic Classification. Accessed June 20, 2024. [https://carnegieclassifications.acenet.edu/carnegie-classification/classification-methodology/basic-classification/](https://carnegieclassifications.acenet.edu/carnegie-classification/classification-methodology/basic-classification/) 36. 36.Bauchner H. The rush to publication: an editorial and scientific mistake. JAMA. 2017;318(12):1109–1110. doi:10.1001/jama.2017.11816 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jama.2017.11816&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=28973598&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F23%2F2024.06.20.24309260.atom) 37. 37.Krumholz HM, Ross JS, Otto CM. Will research preprints improve healthcare for patients? BMJ 2018;362:k3628. doi:10.1136/bmj.k3628 [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE3OiIzNjIvc2VwMjRfNC9rMzYyOCI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDI0LzA2LzIzLzIwMjQuMDYuMjAuMjQzMDkyNjAuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 38. 38.Xu J, Zhang L. Will Medical Preprints Change Oncology Practice? JAMA Oncol. 2020;6(4):471–472. doi:10.1001/jamaoncol.2019.5972 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jamaoncol.2019.5972&link_type=DOI) 39. 39.Flanagin A, Fontanarosa PB, Bauchner H. Preprints involving medical research-Do the benefits outweigh the challenges? JAMA. 2020;324(18):1840–1843. doi:10.1001/jama.2020.20674 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jama.2020.20674&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=33170226&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F06%2F23%2F2024.06.20.24309260.atom) 40. 40.Kang H, Oh HC. Current concerns on journal article with preprint: Anesthesia and Pain Medicine perspectives. Anesth Pain Med. 2023;18(2):97–103. doi:10.17085/apm.23036 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.17085/apm.23036&link_type=DOI) 41. 41.Gates open access policy. The Bill & Melinda Gates Foundation. Accessed June 18, 2024. [https://openaccess.gatesfoundation.org/](https://openaccess.gatesfoundation.org/) 42. 42.Open access policy. Wellcome. Accessed June 18, 2024. [https://wellcome.org/grant-funding/guidance/open-access-guidance/open-access-policy](https://wellcome.org/grant-funding/guidance/open-access-guidance/open-access-policy) 43. 43.Nelson A. *Ensuring Free, Immediate, and Equitable Access to Federally Funded Research.* The White House Office of Science and Technology Policy (OSTP); 2022. Accessed June 15, 2024. [https://www.whitehouse.gov/wp-content/uploads/2022/08/08-2022-OSTP-Public-access-Memo.pdf](https://www.whitehouse.gov/wp-content/uploads/2022/08/08-2022-OSTP-Public-access-Memo.pdf)