BugSigDB: accelerating microbiome research through systematic comparison to published microbial signatures

BugSigDB – a curated database of experimentally-derived microbiome signatures

BugSigDB comprises a comprehensive database of manually-curated, host-associated microbial signatures from published microbiome studies, currently of human, mouse, and rat (Figure 1). The database has been simultaneously developed and expanded over the course of 4+ years with contributions from more than 25 curators trained in-house, currently containing >2,500 microbial signatures extracted from >600 scientific articles (Figure 1A). The curated papers cover two decades of microbiome research, with the majority of studies being published in the last 5 years (459 / 628 articles, 73.1%, Supplementary Figure S1). Among them are microbiome studies of participants from more than 50 different countries, with more than 50% of the studies originating from China and the USA (201 and 157 studies, respectively; Figure 1B).

• Download figure
• Open in new tab

Figure 1: BugSigDB – a curated database of experimentally-derived microbial signatures.

(A) BugSigDB is a community-editable collection of published microbiome studies reporting differentially abundant host-associated microbiota (including bacteria, archaea, fungi, protists, and viruses) that currently includes >2,500 microbial signatures extracted from >600 scientific articles over the course of 4+ years. These papers report microbiome studies of (B) participants representing different countries and ethnogeographies, and (C) microbiome samples from different human body sites; 28 studies of Mus musculus and 5 studies of Rattus norvegicus not shown. (D) Number of signatures associated with a specific microbe, with the top 10 most frequently reported microbes annotated. BugSigDB signatures contain taxonomic levels from phylum to strain, standardized based on the NCBI Taxonomy²⁹. (E) Signature sizes, with more than 50% of the signatures containing 5 or more microbes. (F) Percentage of signatures annotated to major disease categories when classifying the study condition associated with each signature according to the Experimental Factor Ontology³². (G) The top 10 most frequently reported microbes and the number of associated signatures, stratified by disease category.

Studying microbiome samples from 14 broad body areas comprising more than 60 refined anatomical sites according to the UBERON Anatomy Ontology²⁸ (Supplementary Table S1), the majority of studies in BugSigDB analyzed gut (440 / 628 studies, 70.1%), oral (80 studies, 12.8%), and vaginal microbiome samples (59 studies, 9.4%, Figure 1C). The signatures are generated by both 16S amplicon sequencing (92.5%) and metagenomic shotgun sequencing (MGX, 7.5%, Table 1), and contain taxonomic levels from phylum to strain standardized based on the NCBI Taxonomy²⁹ (Supplementary Figure S2). BugSigDB is implemented as a semantic MediaWiki³⁰ web interface available at https://bugsigdb.org, supporting data entry, semantic validation, and web-based programmatic access to annotations for studies, experiments, signatures, and individual taxa (Supplementary Figure S3 and Methods, Section Data entry, validation, and access).

Most of the roughly 1,400 unique taxa contained in BugSigDB are reported as differentially abundant in fewer than 5 signatures (1,009 of 1,370 unique microbes, 69.5%, Figure 1D). Conversely, genera Streptococcus, Prevotella, Bacteroides, and Lactobacillus are each reported as differentially abundant in more than 100 signatures, reflecting the large number of species belonging to these genera and paralleling previous observations of gene signatures with certain genes being reported disproportionately often as differentially expressed³¹. Signatures contain 6 microbes on average, with roughly 55% of the signatures containing 5 or more microbes (Figure 1E).

Study conditions associated with each signature are classified according to the Experimental Factor Ontology (EFO³², Figure 1F), with large proportions associated with different types of cancer (23.1%), anatomical system diseases such as asthma and endometriosis (22.6%), and metabolic diseases such as obesity and diabetes (15.3%). Apart from different disease categories, substantial proportions of signatures in BugSigDB are also associated with diet (6%), use of antibiotics (4.8%), and birth delivery mode (vaginal vs. C-section, 4.1%). These distributions approximately reflect the human microbiome literature. Non-human host species remain under-represented although the database can support any host organism.

Condition-specific associations were investigated for the 10 most-reported taxa (Figure 1G). For instance, signatures containing the Bacteroides genus are related to metabolic disease (21%) more frequently than are all signatures (13%) (p=0.003, χ² = 8.4, df = 1); Bacteroides is similarly enriched in signatures of antibiotic exposure (11% of Bacteroides-containing signatures being of antibiotics exposure vs 5% of all signatures; p=0.0009, χ² = 11.2, df = 1). BugSigDB makes such commonalities across groups of related studies straightforward to identify, and provides for continuous updates of these associations as the database grows.

Curated metadata for studies, experiments, and signatures in BugSigDB reveals common practices in human microbiome research

BugSigDB provides curated metadata at the level of Study (study design and automatically-generated citation information), Experiments within a Study that each define one contrast for differential abundance analysis (such as characteristics about subjects, lab analysis, statistical analysis, as well as alpha diversity), Up to two Signatures within an Experiment, each of which contains one or more Taxon (see Table 1 for summary statistics of Studies and Experiments and Methods Section Definition of semantic concepts for details of the design). In this manuscript we use “study group” to refer to cases in case-control studies, the exposed group in exposure-control studies, and whichever group corresponds to the condition of interest with increased microbial relative abundance in other comparisons of two sample groups.

Signatures are available primarily from observational study designs: case-control (281 studies, 44.7%) and cross-sectional studies (171 studies, 27.2%) were most prevalent, while prospective cohort studies (66, 10.5%), time-series/longitudinal studies (51, 8.1%), laboratory studies (29, 4.6%), randomized controlled trials (28, 4.4%), and meta-analyses (6, 0.9%) are also present. Subject information includes host species (95.9% human out of 1,223 experiments), location, condition, body site (Figure 1), antibiotics exclusion criteria (median exclusion time = 60 days), and sample size in study and control sample groups (median total sample size = 25).

A survey of statistical methods most frequently applied for differential abundance testing in BugSigDB revealed that nonparametric tests such as Wilcoxon-family tests and the related LEfSe software³³ were most frequently used, whereas recently suggested tools for differential abundance tests accounting for the compositionality of microbiome data³⁴ were rarely used (Supplementary Results S1.1). Furthermore, when stratifying experiments by body site and condition, oral and vaginal samples were frequently reported with increased alpha diversity in the study group, as opposed to samples from the GI tract which were frequently found with decreased alpha diversity in the study group (Supplementary Tables S2-S4).

Analysis of signature similarity in BugSigDB identifies conditions with replicable microbiome changes across studies

BugSigDB facilitates meta-analysis of differential abundance studies and enables the identification of experimental conditions and disease phenotypes where microbiome changes replicate across studies. Focusing on 1,194 signatures derived from human fecal samples in 311 published studies, we computed signature similarity within conditions and assessed whether the resulting similarity exceeds the similarity of randomly sampled signatures (Figure 2). This simultaneously determines whether signatures of the same phenotype reproduce across studies, and whether different phenotypes share similar microbial signatures.

• Download figure
• Open in new tab

Figure 2. Analysis of signature similarity in BugSigDB identifies conditions with replicable microbiome changes across studies.

(A) Signature similarity analysis for conditions from at least two studies for the same body site. Signatures were stratified by direction of abundance change into signatures with decreased abundance (DOWN panel, left) and increased abundance (UP panel, right) in the study group. Shown is the p-value (x-axis, negative log scale) obtained from testing whether the semantic similarity of signatures for each condition (y-axis) exceeds the semantic similarity of randomly sampled signatures. The size of each dot corresponds to the number of studies investigating a condition. (B-E) Example exploration of two top ranked conditions in more detail: fecal signatures of decreased abundance for patients with HIV infection (B,C), and fecal signatures of decreased abundance for patients treated with antibiotics (D,E). (B,D) Semantic similarity between signatures. Each node corresponds to a signature. The size of each node is proportional to the number of taxa in a signature. More similar signatures are connected by shorter and thicker edges. (C,E) Microbial contents of the signatures shown in panels B and D (y-axis) delineating the genera contained in these signatures (x-axis). Signatures are clustered by semantic similarity and the relative frequency of each genus across signatures is indicated by a color scale. Display of contained taxa is restricted to genera occurring in at least two signatures (full signatures are shown in Supplementary Figure S5 and S6).

To do this, we applied two alternative approaches for computing similarity between signatures: (1) the more restrictive Jaccard index³⁵ based on pairwise overlaps between signatures harmonized to genus level, and (2) the more sensitive semantic similarity³⁶ based on taxonomic distance between signatures of mixed taxonomic levels (see Methods, Section Signature similarity). Hierarchical clustering of signature similarity for both similarity measures was in good agreement, reflecting the dominance of genera reported so far in BugSigDB, but demonstrated better resolution using semantic similarity compared to the sparse results obtained from the application of Jaccard similarity (Supplementary Figure S4). The advantages of semantic similarity may grow as taxonomic ranks in BugSigDB become more mixed due to increased reporting of species-level results made possible by shotgun metagenomics.

To assess replication by independent studies of the same condition, we compared semantic similarity between signatures reported for a single condition to the similarity of randomly sampled signatures in repeated simulation, and ranked conditions based on the resulting empirical p-value (Figure 2A). Differential abundance signatures of antibiotic treatment and HIV infection were among the most consistent, each investigated by 5 or more studies in BugSigDB^37–48. Closer inspection of signatures of decreased abundance after antibiotics treatment (semantic similarity = 0.64, resampling p-value = 0.0005, Figure 2D and E, Supplementary Figure S5) were enriched for genera of fastidious anaerobes that are often short-chain fatty acid producers, and displayed frequent loss of Bifidobacterium and Blautia, in agreement with previous reports⁴⁹. On the other hand, signatures of decreased abundance of HIV-infected individuals versus healthy controls (semantic similarity = 0.68, resampling p-value = 0.002, Figure 2B and C, Supplementary Figure S6) displayed a loss of abundant members of healthy gut microbial communities as typically observed for diseases associated with GI inflammation⁵⁰, but also resembling a response to antibiotics treatment, a likely side effect of antibiotics often being prescribed for HIV-positive patients to prevent or treat opportunistic and associated infections⁵¹. Additional examples of replicable microbiome shifts between studies included similarity (i) among fecal signatures of decreased abundance in patients with COVID-19, displaying alterations associated with intensive care units and antibiotics treatment⁵² (Supplementary Figure S7), and (ii) among stomach signatures of patients with gastric cancer driven by consistently increased abundance of Streptococcus, Lactobacillus, and Prevotella (Supplementary Figure S8).

Bug set enrichment analysis reveals established and novel associations between gut dysbiosis in colorectal cancer and other disease phenotypes

We integrated BugSigDB signatures with the manually curated metagenomic datasets from curatedMetagenomicData⁵³ in order to systematically benchmark enrichment methods from the EnrichmentBrowser package^7,54 and evaluate whether top-performing gene set enrichment methods can be directly applied to microbiome data. We applied two enrichment methods that have performed well in previous benchmarking of gene set analysis methods⁷ - Over-Representation Analysis (ORA¹¹), and Pathway Analysis with Down-weighting of Overlapping Genes (PADOG³¹) - to 10 colorectal cancer datasets from curatedMetagenomicData. We performed enrichment analysis of all microbiome signatures from BugSigDB simultaneously, employing as “spike-in” controls two signatures of the colorectal cancer-associated fecal microbiome, derived previously by two independent meta-analyses of individual-participant data^55,56 from 8 of the studies included in this dataset (Figure 3). The two signatures based on meta-analysis are thus expected to be among the most enriched of all microbiome signatures: in the 8 training studies for the meta-analyses due to their shared utilization in both datasets, and in the remaining two independent studies due to the relevance and large sample size of the colorectal cancer signatures.

• Download figure
• Open in new tab

Figure 3. Bug set enrichment analysis reveals established and novel associations of the human microbiome with colorectal cancer and other disease phenotypes.

(A) Overrepresentation analysis (ORA) of BugSigDB signatures with differentially abundant genera between 662 colorectal cancer samples and 653 control samples pooled from 10 published metagenomic datasets. Each dot corresponds to an enriched published signature from BugSigDB (FDR < 0.05, Fisher’s exact test, color scale). The size of each dot corresponds to the number of differentially abundant genera in a signature, given as a proportion on the x-axis. * Prior meta-analytic signatures from Thomas et al., 2019⁵⁵ and Wirbel et al., 2019⁵⁶ which reported differentially abundant species and genera from meta-analysis of 8 colorectal cancer datasets. These act as positive controls, as several of the datasets being tested for enrichment were included at the time these signatures were derived. (B) Differentially abundant genera (x-axis) in the top 15 enriched signatures (y-axis) from the overrepresentation analysis in (A). The x-axis is sorted by occurrence frequency of each genus in decreasing order, the y-axis is sorted by Jaccard similarity between signatures. (C) Percentile of ranks (y-axis) of both meta-analytic signatures for ORA, pathway analysis with down-weighting of overlapping genes (PADOG), and competitive balances for taxonomic enrichment analysis (CBEA) relative to all signatures when applied to the 10 published metagenomic datasets individually (x-axis). ^# Datasets not included as training sets in the meta-analyses of Thomas et al., 2019, and Wirbel et al., 2019. (D) Assessment of statistically significant differences of the percentile ranks shown in (C) between the three methods using Wilcoxon’s signed-rank test.

ORA analysis of 647 BugSigDB signatures yielded 19 signatures enriched in contrasts employing 662 colorectal cancer samples and 653 control samples from 10 datasets (FDR < 0.05, Fisher’s exact test, Figure 3A). Only signatures containing 5 or more genera associated with any condition were included. The two positive control spike-in signatures from Thomas et al., 2019⁵⁵ and Wirbel et al., 2019⁵⁶ were top-ranked as expected. Other enriched signatures included colorectal cancer signatures from Wu et al., 2013⁵⁷ and Allali et al., 2018⁵⁸. These are notable because neither study was included in the 10 datasets from which the meta-analysis signatures were computed. Additionally, both were based on 16S amplicon sequencing, whereas the meta-analysis signatures were based on shotgun sequencing. This analysis therefore also provides a proof of concept for integrating species-level signatures from shotgun metagenomic data with genus-level signatures derived from 16S amplicon profiles (see Methods, Section Bug set enrichment analysis), while also providing independent replication of the signatures from Thomas et al., 2019⁵⁵ and Wirbel et al., 2019⁵⁶.

The presence of 11 enriched signatures (58%) from saliva samples from studies of oral diseases such as gingivitis, peptic esophagitis, and oral carcinoma, is consistent with recent reports that oral to gut microbial introgression is a feature of colorectal cancer⁵⁹, and with periodontal diseases being a well-established risk factor for CRC^60,61. Frequently overlapping genera between the enriched signatures include Fusobacterium, Porphyromonas, and Peptostreptococcus, all displaying strongly increased abundance in colorectal cancer patients relative to healthy controls (Figure 3B).

Although these findings demonstrate the usefulness of ORA as a fast and effective enrichment method for microbiome signatures, the method has known shortcomings in the presence of correlated features⁶² or an inappropriately large feature universe⁶³. The PADOG method, a top performer in several independent assessments^7,64,65, is theoretically superior, as it applies sample permutation to preserve correlations and, by working on the full abundance matrix, does not require thresholding on differential abundance or the definition of a feature universe. In addition, the method downweights frequently overlapping microbes between signatures (such as those displayed in Figure 1D), leading to increased sensitivity and the identification of more specific signatures for the phenotype under investigation.

We therefore benchmarked PADOG against ORA in each of the 10 individual-participant shotgun metagenomics datasets of colorectal cancer, and compared the rankings of the two spike-in signatures from the meta-analyses of Thomas et al., 2019⁵⁵ and Wirbel et al., 2019⁵⁶ (Figure 3C). On average, PADOG ranked the spike-in signatures better than ORA, although the difference was statistically significant only for the spike-in signature from Thomas et al., 2019 (p = 0.049, Wilcoxon signed-rank test, Figure 3D). This difference was largest for datasets with smaller sample sizes, where the lack in power was more detrimental for ORA than for PADOG (Supplementary Figure S9).

Despite the apparent effectiveness of established gene set enrichment methods for application to microbiome data, these methods were not developed with microbiome data in mind^34,66. Competitive Balances for taxonomic Enrichment Analysis (CBEA¹⁸) is a recent taxonomic enrichment method specifically developed for microbiome data that accounts for compositionality via application of an isometric log-ratio transformation of relative abundance data for the computation of sample-level enrichment scores. Benchmarked against ORA and PADOG in the CRC setting (Figure 3C), CBEA tended to rank the spike-in signature from Thomas et al., 2019, significantly higher than ORA (p = 0.021, Wilcoxon signed-rank test), but did not display a notable performance gain over PADOG (p = 0.92, Figure 3D).

Microbe co-occurrence and mutual exclusivity within signatures of differential abundance

BugSigDB enables the exploration of compositional patterns within signatures of differential abundance for different body sites. Focusing on 1,194 signatures of fecal microbiomes from 311 published studies, we analyzed patterns of co-occurrence and mutual exclusivity for individual microbes and groups of microbes (Figure 4). Inspection of the top 20 genera most frequently reported as differentially abundant in signatures from fecal samples (Figure 4A) revealed genera predominantly belonging to the phyla Firmicutes (13 genera) and Bacteroidetes (4 genera), in agreement with those being the dominant phyla of the human gut microbiome^67,68. Among the 20 were Bacteroides, Prevotella, and Ruminococcus, three dominant gut genera that are highly variable in relative abundance⁶⁹ and have a large effect on gut microbiome clustering⁷⁰.

• Download figure
• Open in new tab

Figure 4. Microbe co-occurrence and mutual exclusivity in BugSigDB reveals recurrent groups of taxa within signatures of differential abundance.

(A) Microbe-microbe co-occurrence and mutual exclusivity across 1,194 signatures of fecal microbiomes from 311 published studies. “Abundance in Group 1” shows the top 20 genera most frequently reported as differentially abundant in the study group of these signatures. Stars indicate microbes which tend to be predominantly unidirectional, i.e. reported specifically with increased or decreased abundance in the study group (based on a >2-fold difference in proportions). “Prevalence” shows the prevalence of these genera in 9,623 healthy adult stool samples pooled from 68 different studies. The top heatmap shows co-occurrence between these top 20 genera, i.e. in how many signatures these microbes are reported together as differentially abundant with the same direction of abundance change (i.e. occurring together in either the UP or the DOWN signature). The bottom heatmap shows mutual exclusivity between these top 20 genera, i.e. in how many signatures these microbes are reported as differential abundant with opposite direction of abundance change (i.e. one microbe in the UP signature and the other in the DOWN signature, or vice versa). (B) Spearman correlation between the top 20 genera in healthy adult stool samples as indicated by circles of varying size in A. (C) Proportion of signatures where each of the top 20 genera was reported with increased abundance in the study group (y-axis) against the prevalence of these genera (x-axis) in healthy adult stool samples as shown in A.

When comparing the proportions of signatures where these genera were reported either with increased or decreased abundance in the study sample group (panel “Abundance in Group 1” in Figure 4A), the genera most disproportionately increased in the study group were Enterococcus (64 out of 73 signatures, 87.7%), Lactobacillus (73/105, 69.5%), Veillonella (50/74, 69.4%), and Streptococcus (83/128, 66.4%). Pathogenicity of certain Streptococcus and Enterococcus species is well documented^71,72, whereas Lactobacillus and Veillonella are typically considered to be commensal gut microbiota of limited pathogenicity^73,74. Genera instead decreased in the study group were Roseburia (77/103, 74.8%), a beneficial gut organism with established anti-inflammatory activity⁷⁵; and Alistipes (61/88, 69.3%), for which protective and harmful associations with a range of diseases have been described⁷⁶.

To elucidate the extent to which frequency of differential abundance in disease phenotypes can be explained by prevalence in the healthy gut microbiome, we contrasted these findings with the prevalence of these genera in 9,623 stool samples from healthy adult controls of 68 different studies in curatedMetagenomicData (panel “Prevalence” in Figure 4A). We observed a strong negative correlation between prevalence, measured as the percentage of control samples in which the genus is observed at non-zero relative abundance, and the proportion of BugSigDB signatures in which the genus is reported with increased abundance in disease (r = -0.84, p = 3 · 10⁻⁶, Pearson correlation test, Figure 4C). This indicates that across the many diseases and exposures present in BugSigDB, high-prevalence genera tend to be lost in study groups relative to controls, and low-prevalence genera have increased abundance in the study group. This was particularly apparent for Enterococcus, a genus of low prevalence in healthy samples (13%), that was reported almost exclusively with increased abundance in the diseased group (64 out of 73 signatures, 88%). Presence of Enterococcus, accompanied by exclusion of other genera of the Clostridia class (below), may therefore be considered as a commonly reported “dysbiotic” signature.

The human gut is a complex ecosystem where microbes compete and cooperate⁷⁷. To investigate which of these interactions are associated with disease, we next studied patterns of co-occurrence and mutual exclusivity for the top 20 genera most frequently reported as differentially abundant. For each pair of microbes we counted the number of signatures where both microbes were reported with either the same or opposite direction of change in relative abundance (top and bottom heatmap in Figure 4A). This resulted in clusters of co-occurrence driven primarily by functional and phylogenetic similarity, with frequent co-occurrence of genera of the phylum Bacteroidetes and blocks of positive associations in the class Clostridia (top red heatmap in Figure 4A, third cluster from top to bottom). On the other hand, clusters of mutual exclusivity displayed clear signs of the established Firmicutes-Bacteroidetes gradient in gut microbiomes⁶⁷ and a strong negative association between Bacteroides and Prevotella within the phylum Bacteroidetes, as previously reported⁷⁸ and also observed in healthy samples (r = -0.49, p < 2.2 · 10⁻¹⁶, Spearman correlation test, bottom blue heatmap in Figure 4A, third cluster from top to bottom). Overall, these patterns largely recapitulated correlation of these genera in healthy adult stool samples (Figure 4B), arguing against the existence of specific disease-promoting interactions between these genera. Exceptions were patterns of pronounced mutual exclusivity within the class Clostridia in signatures associated with disease, as observed for Clostridium, Enterococcus, and Streptococcus, which were not observed in healthy samples.

Pooled microbial signatures display robust body-site specificity and shared and exclusive patterns of gut dysbiosis between disease phenotypes

BugSigDB provides novel opportunities for the discovery of microbial biomarkers and re-assessment of previous findings across a much larger and more heterogeneous data source than previously possible. To identify similarities between microbial shifts within and across body sites, we aggregated signatures for one body site at a time, and within body sites for one condition at a time (see Methods, Section Signature pooling). To account for differences in sample size between studies, we applied a voting approach where each taxon of a pooled signature obtained a weight based on the aggregated sample size of reporting studies, and performed hierarchical clustering based on pairwise similarity between the weighted meta-signatures (Figure 5). Clustering of 27 meta-signatures, representing body sites studied by at least 2 studies in BugSigDB and generated from 1,909 individual signatures of either increased or decreased differential abundance in the study group, resulted in two major body site clusters: a cluster primarily composed of oral and nasal sites, and a cluster dominated by vaginal and gastrointestinal sites (Figure 5A). This clustering was largely invariant to the similarity measure used for clustering (Supplementary Figure S10), confirming the expected dominant effect of host body site of origin, and in particular, the availability of oxygen.

• Download figure
• Open in new tab

Figure 5. Pooled genus-level microbial signatures display robust body-site specificity and shared and exclusive patterns of gut dysbiosis between disease phenotypes.

A) Clustering of 27 meta-signatures (y-axis) representing host body sites studied by at least 2 studies in BugSigDB and generated from 1,909 individual signatures. The clustering shows a separation of vaginal and gastrointestinal sites (top) from oral and nasal sites (bottom). A total of 560 different genera (x-axis) colored by phylum were observed across the meta-signatures. The number of genera in each meta-signature is shown in the barplot on the left. The following three panels display representative genera that frequently occur across meta-signatures (“shared”), predominantly occur in either cluster of body sites (“compartmentalized”), or were reported in only one body site as differentially abundant (“exclusive”). The size of each dot corresponds to the relative sample size of studies reporting a genus as differentially abundant. B) Clustering of fecal meta-signatures drawn from 34 different conditions, each represented by at least 2 studies in BugSigDB and generated from 504 individual signatures with increased abundance in the study group. The clustering shows a separation of cancer phenotypes (top) from non-neoplastic diseases (bottom). A total of 248 different genera colored by phylum were observed across the fecal meta-signatures. The number of genera in each meta-signature is shown in the barplot on the left.

Within body-site clustering of fecal meta-signatures of 34 different conditions, studied by at least 2 studies in BugSigDB and generated from 504 signatures of increased relative abundance in the study group, revealed similarities in reported differential abundance patterns between disease phenotypes (Figure 5B). This included similarities in microbial shifts for (i) HIV infection and different gastrointestinal cancers, both characterized by chronic inflammation of the GI tract and microbial signatures that point to shared pathogenic pathways including tryptophan catabolism and butyrate synthesis⁷⁹, (ii) chronic kidney disease and autism, linked through deleterious copy number variants^80,81 and pathogenic gut microbiota-derived metabolites produced by species of the Clostridia class^82,83, and (iii) type 2 diabetes and schizophrenia, consistent with observations that people with schizophrenia are at increased risk of type 2 diabetes, and conversely, that traditional risk factors for type 2 diabetes are common in people with schizophrenia and can affect the gut microbiome, especially obesity, poor diet, and sedentary lifestyle⁸⁴. A strong enrichment of genera of the Clostridia class drove the similarity between the meta-signatures of Hashimoto’s thyroiditis (12 out of 14 genera, 85.7%, p-value = 2.1 · 10⁻⁰⁵, proportion test) and chronic fatigue syndrome (11/17, 64.7%, p-value = 0.003). Chronic fatigue is common in patients with Hashimoto’s thyroiditis; the disorder affects the thyroid gland, potentially also through a gut microbiota-driven thyroid-gut-axis⁸⁵, reducing thyroid hormone production which causes extreme fatigue⁸⁶.

Genera reported as differentially abundant exclusively in one condition, in particular those replicated by independent studies, are candidates for condition-specific biomarkers (Supplementary Figure S11, prioritized by relative sample size). This included an exclusive abundance increase of the genus Hungatella for colorectal cancer, which is notable given a reported role of Hungatella hathewayi in driving host colonic epithelial cell promoter hypermethylation of tumor suppressor genes in colorectal cancer⁸⁷. On the other hand, an exclusive decrease in abundance was observed for Marvinbryantia in type 2 diabetes, for which a reduction in Marvinbryantia through treatment with glucagon like peptide-1 (GLP-1) receptor agonist drugs such as Liraglutide has been shown to contribute to treatment success⁴.

Definition of semantic concepts (study, experiment, signature, taxon)

Study

BugSigDB collects and standardizes microbial signatures from published 16S and MGX microbiome studies. Studies are categorized by study design and each study is associated with a study identifier such as a PubMed ID and/or a DOI, depending on whether studies are indexed in PUBMED.

Data entry, validation, and access

BugSigDB is implemented as a semantic MediaWiki³⁰ web interface available at https://bugsigdb.org. It supports data entry, semantic validation, and web-based programmatic access to annotations for studies, experiments, signatures, and individual taxa. The semantic wiki (i) enforces data entry to follow the nomenclature of the NCBI Taxonomy Database²⁹, (ii) enforces metadata annotation of signatures to follow established ontologies and controlled vocabulary for body site²⁸, disease condition³², and type of evidence, (iii) provides an API to access all signatures, potentially filtered on taxonomy and metadata attributes, and (iv) allows commenting and error reporting on data elements and relationships. The data curation interface provides type-forward autocomplete to assist with valid data entry (including validation against the NCBI Taxonomy²⁹, Experimental Factor Ontology³², UBERON Anatomy Ontology²⁸, and administrator-defined controlled vocabulary for other fields such as statistical test and sequencing methods), to facilitate organization, filtering, and comparison of signatures. External contributions from the community, including signatures, annotations, and comments, are supported similarly to Wikipedia. Quality of contributions is controlled by tagging contributions as verified after review by a trusted editor, a method for flagging suspect entries, and the option to exclude from analysis unreviewed contributions or based on elements of study quality such as sample size.

Signatures can be searched and browsed by study and experimental attributes, and by individual taxa, at bugsigdb.org. Bulk export of all signatures and associated metadata is available in plain-text formats for use in any programming language and software (including .csv, and the .gmt standard used by GeneSigDB²³ and MSigDB²¹) of the current database version or as weekly and semi-annual snapshots. The companion bugsigdbr R/Bioconductor package (bioconductor.org/packages/bugsigdbr) provides advanced features such as ontology-based filtering, limitation of taxonomic level, look-up of individual signature and taxon pages, and conversion to application-centric formats. The exported files are compatible with most enrichment software and are included by default in our lab’s EnrichmentBrowser R/Bioconductor package⁵⁴ to facilitate a large number of GSEA methods and visualizations. The BugSigDBStats R package continuously integrates with bugsigdb.org and provides weekly updated database statistics in an HTML report page (https://waldronlab.io/BugSigDBStats).

Signature similarity

Signature similarity was computed based on two different measures: (1) Jaccard index based on pairwise overlaps between signatures harmonized to genus level, and (2) semantic similarity between signatures of mixed taxonomic levels. Pairwise calculation of Jaccard similarity for genus-level signatures was carried out using the calcJaccardSimilarity function of the BugSigDBStats package. Genus-level signatures from BugSigDB were obtained using bugsigdbr’s getSignatures function. Taxonomic clades given at a more specific taxonomic level (species or strain) were transformed by cutting the taxonomic tree at the genus level. The Jaccard index, also known as the Jaccard similarity coefficient, is defined as the size of the intersection divided by the size of the union of two input signatures A and B: Note that by design 0 ≤ J(A, B) ≤ 1.

Semantic similarity was computed based on Lin’s measure of semantic similarity⁹⁷ as implemented in the ontologySimilarity package from the ontologyX R package series⁹⁸. Measures of semantic similarities have been proposed for comparing concepts within a taxonomy⁹⁹, with numerous applications for biomedical ontologies³⁶. Of note, semantic similarity has conceptual parallels with the computation of UniFrac distance¹⁰⁰. Here, individual taxa can be considered nodes of the NCBI Taxonomy when represented as a directed acyclic graph. Computing semantic similarity between two taxa corresponds then to computing a topological similarity such as the shortest path linking the two taxon nodes. More specifically, computing Lin’s measure of semantic similarity between two taxa corresponds to computing the information content of the lowest common ancestor (LCA) of the two taxa⁹⁷. The more frequently a taxon occurs, i.e., the higher its probability of being an ancestor of other taxa in the taxonomy, the lower its information content. If the LCA of two taxa corresponds to a taxon at a higher taxonomic level, these taxa are not very similar and this is reflected in a low information content of their LCA. Given pairwise semantic similarities between individual taxa, semantic similarity between two signatures (i.e. two taxon sets) is then obtained using a best-match average combination approach¹⁰¹, where each taxon of the first signature is paired with the most similar taxon of the second one and vice-versa.

Bug set enrichment analysis

Metagenomic datasets providing species-level relative abundance for fecal microbiomes of colorectal cancer patients and healthy controls were obtained from curatedMetagenomicData 3.0⁵³. Relative abundance proportions were multiplied by read depth and rounded to the nearest integer prior to obtain integer read counts compatible with bulk RNA-seq tools for differential expression and gene set enrichment analysis. For genus-level analysis, species-level counts were summed across branches using the splitByRanks function from the mia package. Given a recent assessment that reported good performance of bulk RNA-seq tools for microbiome data¹⁰², differential abundance analysis was carried out following the limma-trend approach¹⁰³. Read counts were transformed to log counts-per-million (CPMs) using edgeR’s cpm function with a prior count of 3 to damp down the variances of logarithms of low counts¹⁰⁴. Genus-level and species-level microbial signatures from BugSigDB were obtained using bugsigdbr’s getSignatures function. To keep signatures meaningfully sized, taxonomic clades given at the species- or strain level were transformed by cutting the taxonomic tree at the genus level. ORA and PADOG were carried out as implemented in the EnrichmentBrowser package⁵⁴. CBEA was carried out as implemented in the CBEA package¹⁸.

Taxon co-occurrence

Genus-level signatures from BugSigDB were obtained using the getSignatures function of the bugsigdbr package. Signatures were filtered by body site for fecal samples and stratified by direction of abundance change (increased / decreased). The top 20 most frequently occurring genera in the resulting signatures were reported. Prevalence of these genera was computed as percentage of healthy adult stool samples in which the genus was observed at non-zero relative abundance in metagenomic datasets from curatedMetagenomicData 3.0⁵³. The correlation between prevalence in healthy samples and the proportion of signatures with increased abundance for the top 20 genera was assessed using Pearson’s correlation test as implemented in the cor.test function of the stats package. Taxon co-occurrence in signatures associated with disease was contrasted against Spearman rank correlation of the top 20 genera in healthy samples using the cor function of the stats package.

Signature pooling

Signatures were pooled for one body site at a time, and within body sites for one condition at a time, as implemented in the getMetaSignatures function of the bugsigdbr package. Taxa within a pooled signature were weighted based on the aggregated sample size of the studies that reported this taxon as differentially abundant, divided by the total sample size of studies contributing to the pooled signature. Resulting weighted meta-signatures were clustered by semantic similarity, where the weights were incorporated into the best-match average combination approach³⁶ as implemented in the weightedBMA function of the BugSigDBStats package. Analysis was restricted to body sites and conditions studied by at least two studies in BugSigDB and containing at least 5 taxa in the resulting pooled signature. Robustness of the clustering was evaluated by comparing to rank-biased overlap¹⁰⁵.