Deep generative modeling of the human proteome reveals over a hundred novel genes involved in rare genetic disorders ==================================================================================================================== * Rose Orenbuch * Aaron W. Kollasch * Hansen D. Spinner * Courtney A. Shearer * Thomas A. Hopf * Dinko Franceschi * Mafalda Dias * Jonathan Frazer * Debora S. Marks ## Abstract Identifying causal mutations accelerates genetic disease diagnosis, and therapeutic development. Missense variants present a bottleneck in genetic diagnoses as their effects are less straightforward than truncations or nonsense mutations. While computational prediction methods are increasingly successful at prediction for variants in *known* disease genes, they do not generalize well to other genes as the scores are not calibrated across the proteome. To address this, we developed a deep generative model, popEVE, that combines evolutionary information with population sequence data and achieves state-of-the-art performance at ranking variants by severity to distinguish patients with severe developmental disorders from potentially healthy individuals. popEVE identifies 442 genes in a cohort of developmental disorder cases, including evidence of 119 novel genetic disorders without the need for gene-level enrichment and without overestimating the prevalence of pathogenic variants in the population. By placing variants on a unified scale, our model offers a comprehensive perspective on the distribution of fitness effects across the entire proteome and the broader human population. popEVE provides compelling evidence for genetic diagnoses even in exceptionally rare single-patient disorders where conventional techniques relying on repeated observations may not be applicable. Interactive web viewer and downloads available at [pop.evemodel.org](http://pop.evemodel.org). ## Introduction Even if every human were sequenced and their phenotypes recorded, the space of disease-causing genetic variation is too large to be studied by population variation alone. Patients with unique sets of symptoms and genotypes would still go undiagnosed. The biodiversity of life on earth provides a deeper view of genetic variation across billions of years of evolution, providing a unique opportunity to uncover complex genetic patterns preserved to maintain fitness. Thus, models that can distill such information have the potential to massively accelerate our ability to leverage genetics for diagnosis, preventive care, and treatment. In the context of severe genetic disorders likely to be caused by a single variant, the task is to identify the causal variant amongst the millions of mutations in a single individual. One powerful approach is the sequencing of trios – patient and their parents – which provides a way to narrow down the candidate pathogenic variants to those arising *de novo* when the parents are thought to be unaffected(1). However, despite impressive analysis of large rare disease cohorts(2–7), genetic diagnostic yield is relatively low. The low hanging fruit, genetic disorders common enough to aggregate in these cohorts, have largely already been discovered, leaving those too rare to find by enrichment alone. There is a need for alternative strategies to identify causal variants directly from a patient’s sequencing data, without relying on frequency of observations in large cohorts. In this work, we present how probabilistic modelling of diverse sequencing efforts provides an answer with the potential to enable clinical interpretation of never-before-seen variants. Recent work using deep unsupervised models trained only on evolutionary sequences have shown strong promise for accurate clinical variant effect prediction(8–13) and have demonstrated comparable accuracy to experimental approaches(8). In addition, since these models do not depend on functional or clinical labeling, they can generalize to variants in genes without previous annotation. However, although these models often perform well in terms of separating *Benign* from *Pathogenic* clinical labels in known disease genes, they are overall not calibrated well across the human proteome. Consequently, previous methods excel at identifying variants that disrupt the function of the resulting protein but do not necessarily predict if it is detrimental at the organismal level. Variant severity lies on a spectrum: disruption of function in one protein could have modest effects late in life, while the disruption of another protein can be lethal in childhood. Both can be considered “pathogenic” and correctly identified as such by a model, but when attempting to find the genetic cause of a severe disorder when neither variant is in a previously known gene, it is imperative to be able to distinguish between these two scenarios. Current state-of-the-art variant effect prediction models have not been designed with this spectrum of severity in mind. To help overcome this, we developed popEVE, a model that places variants on a proteome-wide scale of pathogenicity, enabling us to predict if a variant seen in one gene is more detrimental to human health than a variant seen in another. popEVE leverages deep evolutionary data to achieve missense resolution variant effect prediction and shallow variation across the UK Biobank(14) population to transform the score to reflect human- specific constraint. We identify score thresholds corresponding to moderate and severe pathogenic variants, based on the distribution of scores seen in a meta-cohort of patients with severe developmental disorders, without recourse to clinical annotation. Further analyzing this cohort, we find variant-level evidence for at least 119 novel genetic disorders. 44% more than previously identified in the same cohort, with uncanny functional similarity to known developmental disease genes. By providing a pathogenicity spectrum rather than binary classification, the model presents a new perspective on the distribution of fitness effects in the population and across the proteome. ## Results ### A unified model of population and evolutionary sequences popEVE is designed to provide a human-specific measure of pathogenicity that enables the effect of variants to be compared across the entire proteome. It leverages both cross-species data and human variation data during training, with the former enabling missense resolution predictions and the latter enabling a proteome-wide human-calibrated measure of pathogenicity (Fig. 1a, Supp. Fig. 1 & 2). ![Figure 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2023/11/28/2023.11.27.23299062/F1.medium.gif) [Figure 1.](http://medrxiv.org/content/early/2023/11/28/2023.11.27.23299062/F1) Figure 1. popEVE combines deep evolution and human variation. a. popEVE combines variation from across evolutionary sequences, modeled with EVE and ESM1v, with variation within the human population (UK Biobank), using a joint gaussian process to learn the relationship between evolutionary scores and missense constraint. b. Minimum, i.e. the most deleterious, popEVE score per gene can be used as a measure of gene constraint to distinguish between ClinGen haploinsufficient genes (n=186) and homozygous LoF tolerant genes (n=263) (ks=0.59, p=3e-40) (15,16). c. Minimum popEVE scores for genes with dominant (n=621) and recessive (n=1043) inheritance. Genes with dominant inheritance patterns have more pathogenic scores than genes with recessive inheritance (ks=0.32, p=1e-36) (17,18). d. To illustrate the effect of population adjustment, we compare the distribution of scores in a disease gene, MEF2C, and a non-essential gene, ORF2A14: the bulk of the evolutionary scores overlap for both EVE (top) and ESM1v (middle), with the most deleterious variants in the non-essential gene being equivalent to the moderately deleterious scores in the disease gene. This overlap no longer exists after adjustment (bottom), with the deleterious end of ORF2A14 no longer falling in the likely disease-causing score range. To achieve missense resolution predictions, popEVE incorporates two classes of models that learn from the observed universe of protein sequences: alignment-based models, EVE(8), and large language models, ESM1v(19). Despite comparable performance on numerous tasks (Supp. Fig. 3, 4), variant scores from these two types of models are not highly correlated, indicating that they learn different properties and constraints from the same type of data. As such, combining the two should improve variant effect prediction. To achieve a score which reflects the constraint on missense variants in humans, we train a model to predict the presence of a variant in the UK Biobank, conditioned on the scores from EVE or ESM1v. We model the functional dependence of observing a variant on the underlying EVE/ESM1v score using a latent Gaussian process prior. The inferred non-linear function maps the scores from EVE and ESM1v onto a new scale which, by virtue of training on whole exome data, means that variant scores are now calibrated across proteins to reflect the degree of human specific constraint acting on that variant. Additionally, we employ a zero mean- function to minimize the risk of over-predicting pathogenicity. This pushes variant scores towards neutrality unless there is sufficient evidence to infer otherwise. The model has two properties which are designed to minimize sensitivity to population structure. First, we model presence of variants in the UK biobank, as opposed to frequency information. Second, the latent Gaussian process is solely a function of the score from EVE/ESM1v and hence lacks the freedom to adjust the score for a single variant in isolation. The contrast between the popEVE score distributions of the well-known oncogene MEF2C and the non- essential olfactory receptor ORF2A14, illustrates the benefit of population adjustment (Fig. 1d). With EVE alone, the scores of ORF2A14 and MEF2C overlap at the deleterious end of the distribution, which is unexpected due to their strikingly different phenotypic effects in humans. After incorporating population data, the bottom 50% of substitutions no longer overlap. popEVE, in particular the most pathogenic popEVE score per gene, captures disease gene characteristics. This popEVE summary metric significantly distinguishes between ClinGen haploinsufficient genes(16) and homozygous loss-of-function-tolerant genes(15), and, genes with autosomal dominant or autosomal recessive inheritance patterns(17,18) (Fig. 1b & c, Supp. Table 1). View this table: [Table 1.](http://medrxiv.org/content/early/2023/11/28/2023.11.27.23299062/T1) Table 1. Top 20 most pathogenic novel discoveries. Finally, we note that popEVE preserves, or improves on, its underlying EVE and ESM1v models at protein level tasks, including distinguishing Benign and Pathogenic labels from ClinVar, and correlation with deep mutational functional scans (Supp. Fig. 3 & 4, Supp. Table 2). These tasks are only mildly affected by the score transformation inferred from population data but are sensitive to the benefits of ensembling EVE and ESM1v. Thus, while the primary objective of this method development relates to proteome-wide prediction (next section), we conclude that popEVE achieves a new state-of-the-art performance at these tasks as well. ### Low popEVE scores are enriched in developmental disorders We applied popEVE to a set of de novo missense mutations from 31k individuals with severe developmental disorders, a metacohort combining trios from the Deciphering Developmental Disorders Study(3), GeneDx, and the Radboud Medical Center(6), to prioritize causal variants and discover novel disease gene candidates (Fig. 2a). For further comparison, we include a set of controls – unaffected siblings from four separate autism spectrum disorder cohorts(20). After reannotation with VEP(21), cases and controls and 19,821 and 3,045 unique missense variants covered by popEVE (Supp. Table 3). ![Figure 2.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2023/11/28/2023.11.27.23299062/F2.medium.gif) [Figure 2.](http://medrxiv.org/content/early/2023/11/28/2023.11.27.23299062/F2) Figure 2. 123 new popEVE genes identified in severe developmental disorder cohorts. a. Number of individuals in the severe developmental disorder (SDD) metacohort(6) and controls unaffected siblings from autism spectrum disorder cohorts(20). b. The distribution of popEVE scores for de novo variants in SDD cases and unaffected controls (black) is skewed towards pathogenic scores while the bulk are in the benign range. A two-component gaussian mixture model is used to fit a pathogenic distribution and a benign distribution to calculate a threshold of severe pathogenicity at 99.99% likelihood of being in the pathogenic distribution at -5.056 and a moderately pathogenic threshold at 99% likelihood at -4.617. See Supp. Fig. 5a for distributions for cases and controls separately. c. With increasingly pathogenic thresholds, de novo variants in the SDD metacohort below this line are significantly enriched (left). At our severely pathogenic threshold, popEVE pathogenic variants exhibit over 15-fold enrichment while popEVE benign variants are in line with expectation (right). Moderately pathogenic variants are enriched 5-fold. Expected number of variants are quantified using a background mutation rate based on the number of individuals in the metacohort. d. popEVE is better at separating SDD cases whose disorder is likely to be caused by a de novo missense variant (cases with at least one missense variant in a known developmental disorder gene) from controls than other state of art variant effect predictors with an average precision of 88%. e. Both popEVE gene and variant-association methods achieve an 80% recall when compared to the DeNovoWEST analysis of the SDD metacohort and a 95% recall of the genes discoverable by DNW with solely missense variation. popEVE was able to discover 31 genes solely with missense variation that DNW needed the full set of variants to find significant. There is a greater overlap between popEVE gene-collapsing and DNW missense than the thresholding approach, as expected as the thresholding approach discovers 67 and 46 genes with variants present solely in a one or two patients respectively while the collapsing approach found genes with a minimum of 3 variants. f. More genes are previously discovered in the SDD by DNW or elsewhere in the DDG2P at higher levels of significance, either by p-value in gene collapsing (top) or likelihood of pathogenicity for variant thresholding (bottom). To establish a score threshold for classifying de novo variants as candidates for causing disease, we fit a two- component Gaussian mixture model to the distribution of popEVE scores across all cases and controls without using their labels (Fig. 2b and Methods). We selected a high confidence threshold (-5.056) where 99.99% of the variant scores are in the low fitness distribution. These 1163 variants are over 15-fold enriched in the SDD cohort versus the expected number of pathogenic DNMs given the background mutation rate (Fig. 2c), a five times higher fold enrichment than other state-of-art methods, e.g. primateAI-3D at 2-fold(22). Furthermore, even variants we define as moderately pathogenic are five times enriched in the developmental disorder cohorts, again outperforming previous methods. popEVE also differentiates cases from controls over a range of recall fraction (average precision 0.88), better than any other state-of-the-art variant effect predictors, even including those methods that train on clinical data or minimally use the clinical data to draw thresholds (Fig. 2d, Supp. Fig. 5 b, Supp. Table 2). Taken together this initial analysis of popEVE of the three developmental disease cohorts analyzed here demonstrates state-of-the-art performance without risking lack of generalizability. ### 119 novel candidate genes at variant resolution We used a two-pronged approach to discover associations: (1) thresholding the scores for more than a 99.99% likelihood of falling within the low fitness distribution (2) gene collapsing, comparing variant scores seen in the cohort to what is expected given the background mutation rate and the spectrum of popEVE scores within and across proteins (Methods). This results in 442 genes including 183 that were identified by previous study of same cohort(6) (Fig. 2e&f, Supp. Table 4). popEVE recalls 94% of genes previously identified in the three cohorts and over half (135) of the novel discovery gene set have been associated with developmental disorders from other studies in the Development Disorder Genotype - Phenotype Database(23) and the distribution of scores of the variants in the remaining 124 novel genes is similar to the distribution of those from known genes. Interestingly, we recover 31 genes using missense variants alone where previous work only identified the gene for patients with loss of function annotation. Of the 50 previously known genes that we missed by variant alone but recalled with gene collapsing, many have moderately pathogenic scores. which motivates using the two-pronged approach. Taken together we provide evidence that variant score thresholding alone can provide accurate results but that the modeling allows both methods to be used in practice. Through score thresholding, we identified variants in 119 novel genes (Supp. Table 5) associated with severe developmental disorders in these cohorts and explored whether there is independent functional and structural evidence for our results. First, we looked at the functional convergence of our discoveries with known developmental disease genes. Most of the top significant functional annotations for the novel genes that are non-trivial are shared with known genes (using DAVID(24), Supp. Table 6 & 7). These include annotations such as chromatin organization (n=15), DNA binding and ATP binding (n=29), metal ion binding (n=32), and histone binding (n=7). Since the functional overlap was so striking, we then asked whether the new genes interact directly with those previously known. We found evidence that for 67 of the 130 new discoveries have a known direct interaction with the 285 previously identified genes based on experimental data(25). Taking the whole interaction network, the density of interactions doubles compared to adding random sets of genes when the newly discovered set is added (1.6 on average to 3.1 p=0 for direct interactions; Fig. 3, Sup Fig. 7, Supp. Table 8). An example of this increased density is the chromatin-associated complex, NuRD – crucial in embryonic development. This complex contains several genes associated with developmental disorders, including CHD3/4 and MTA. We discover four new genes in NuRD complex including HDAC2, RBBP4, RBBP7 and IKZF1 (Fig. 3c) and five in another chromatin associated complex, Sin3 complex (Supp. Table 8). HDAC2 itself interacts with 8 previously known developmental disorder-associated genes and it’s top scoring variant, M31R, lies in the ‘foot pocket’ of the acetylase active site(26). ![Figure 3.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2023/11/28/2023.11.27.23299062/F3.medium.gif) [Figure 3.](http://medrxiv.org/content/early/2023/11/28/2023.11.27.23299062/F3) Figure 3. Structure and function analysis supports accuracy of new discoveries. a. Novel genes discovered with popEVE (by variant thresholding alone) have many known biochemical interactions (defined using STRING(25)) with genes previously associated with disease from the three cohorts(6), forming a dense network of previously known and newly discovered genes, see also Supp. Fig. 6 (left top), including genes involved in chromatin modeling complexes (middle) and with an 80% increase in node degree as compared to random sets of the same number of genes which saw an average of 14% (with p=0, t-test (left bottom)) see also Supp. Table 8. The densest portion of the subnetwork includes many of the genes involved in the NuRD complex (right) b. The top scoring variants Arg68Leu and Arg192Cys in ETF1/ erF1( a translation termination factor) are contacting the anticodon site and the peptidyl transferase site in the ribosomal RNA, ternary complex (PDB:6d90(27) c. the novel discovery HDAC2 interacts with many genes known in severe developmental disorders including those in the NuRD complex where the variant Met31Arg is proximal to the foot-pocket of the active site (PDB:3max(26)) d. novel discoveries KCNN2 and CALM1 both contain highs scoring variants in functional sites - Ile637Phe in the highly conserved T(V/I)GYG pore motif and Asp24Tyr in CALM1 which chelates the Ca2+ in the wild type (homologous complex structure PDB: 6cnn(28)) see Table 1. Structural analysis revealed the variants in the 16 novel genes with a resolved crystal structure have mutations in areas that interact with a protein binding partner, form a disulfide bond, or are ion- or ligand-binding (Table 1). For example, the amine of R192 and R68 in ETF1 (eRF1) are close (3.2Å) to the phosphate backbone of RNA in the eRF1-eRF3-GTP ternary complex that mediates translation termination (6d90(27); In the calcium gated potassium ion channel, KCNN2 (modeled on KCNN1, PDB: 6cnn(28)). Ile637 is part of the T(V/I)GYG pore motif that is essential for ion transport. Another top variant, D24Y in CALM1 (PDB: 6cnn(28)) has a mutation that is 2.4 angstroms from the activating Ca2+.While these structural analyses are somewhat anecdotal, it seems unlikely that 80% of these top novel discoveries would be randomly in these functional sites. Taken together, (1) the recall of genes identified in previous analyses of the same cohorts, (2) the functional overlap with known developmental genes and (3) the structural evidence supports the popEVE discovery variants and genes. We then asked whether our results can be computed directly from the child genome alone without parental genetic information. To test our model’s ability to identify causal mutations without *de novo* labels, we investigated rare variants, both inherited and *de novo* (MAF<0.01), from a subset of the severe developmental disorder meta-cohort, almost 10k individuals from the Deciphering Developmental Disorders study(3). If we take the most pathogenic variant per patient, we still recover 95% of the variants and genes identified by variant thresholding of the *de novo* variants alone, demonstrating popEVE’s power to identify the likely most deleterious mutation. We also identify a set of variants in 298 new genes and, although these variants are likely to be inherited, over a quarter are known in some capacity (either in the DDG2P or our analysis of the three cohorts) and may contribute to the observed phenotypes in more complex genotypes, suggesting further investigation. ### popEVE predicts a sparse distribution of severe pathogenic variants Approaches to clinical variant annotation to date place great emphasis on segregating variants as either (Likely) Benign or (Likely) Pathogenic. While this “binary” approach to variant interpretation has some benefit for clinical decision making, it obscures the fact that some variants will lead to more severe disease phenotypes than others. popEVE predicts a spectrum of pathogenicity, reflecting variant level constraint in the human population, and thus presents a novel perspective of the distribution of disease-causing variants across the proteome. Based on these predictions, we explored the distribution of predicted severe and moderately pathogenic variants across the proteome, across UK biobank participants, as well as the relation of this score to known disease causing variants and notions of severity such as age of onset and death. popEVE predicts 39% of genes have at least one high-confidence pathogenic missense variant; a little over a quarter of these genes have known disease associations according to OMIM(29) or DDG2P, indicating there are many disease-gene associations yet to be discovered. However, these variants are sparse, constituting only 3% of possible missense variants (Fig. 4a). 4% are predicted moderately pathogenic, with the remainder predicted to be ambiguous or benign. This sparsity of missense pathogenicity may make methods such as burden testing challenging as they are likely to be underpowered even in large cohorts. ![Figure 4.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2023/11/28/2023.11.27.23299062/F4.medium.gif) [Figure 4.](http://medrxiv.org/content/early/2023/11/28/2023.11.27.23299062/F4) Figure 4. popEVE predicts a spectrum of disease severity with severely pathogenic variants found in roughly a third of the proteome. Predictions are robust and applicable across populations. a. In the UKbiobank, individuals have at most one homozygous and up to three heterozygous severely pathogenic variants – 96% of the 500k individuals have no severely pathogenic missense variants (left). About 72% of UKBB individuals have no severely or moderately pathogenic variants and at most five moderately pathogenic variants. On average, individuals have 0.222 and 0.434 severely and moderately pathogenic variants respectively. As the score moves past our moderately pathogenic threshold of -4.617, the average number of variants per person plummets to below 1 on average per person. b. A little over half of autosomal genes harbor at least one severely pathogenic variant or at least one moderately pathogenic variant (left). Only a small number of all possible mutations in these genes are pathogenic – on average 5% and 6% severely or moderately pathogenic respectively (right). c. The distribution of popEVE scores for rare variants (AF<0.01) is consistent across populations found in gnomAD, indicating that despite using primarily non-Finnish European subjects for score adjustment there is no population bias. Variants not seen any gnomAD population are in grey. The 99.9% percentile for each distribution is marked with an arrow. d. ClinVar pathogenic variants (with at least 1 star curation rating) in phenotypes associated with early onset and premature death in childhood have more deleterious popEVE scores than those associated with later onset and death after maturation. There is a greater separation between the distribution of variant scores for age of death (ks=0.34, pvalue=7e-41) than onset (ks=0.19, pvalue=2e- 10). Onset and death labels were acquired from OrphaNet Only 4% of UK Biobank participants have at least one high-confidence pathogenic variant (or 0.04 per person) while 31% (0.31 per person) have at least a moderate or higher-confidence variant (Fig. 4b). For comparison, observed participants of the Regeneron Genetics Center Million Exome dataset(30) carry an average of 1.6 high-confidence ClinVar pathogenic variants. This suggests that our definition of pathogenicity is more heavily selected against in the population than ClinVar Pathogenic variants. The average number of variants per person plummets around our moderately pathogenic threshold, indicating that the threshold is generalizable across cohorts. Variant effect predictors must be able to distinguish benign but recent variants from those that are rare due to purification of deleterious mutations. Distributions of popEVE scores for rare variants are strikingly similar across gnomAD(31) populations (Fig. 4c), suggesting popEVE is robust to population structure, with no indication that training on predominantly European cohort imparted bias in the variant scores. To further investigate the spectrum of severity, we compared the distribution of popEVE scores for ClinVar pathogenic variants in genes which have also been associated with early onset or premature death in childhood to diseases, with later onset or death during adulthood(32). The distribution of scores of ClinVar pathogenic variants seen in genes associated with these early onset/death phenotypes show a significant shift in the deleterious-end of popEVE scores (Fig. 4d). However, the majority of variants fall within the ambiguous/benign range of popEVE, likely due to differences in inheritance, penetrance and severity, and, as expected, these variants are primarily involved in diseases with recessive inheritance patterns (Supp. Fig. 7). This difference is particularly striking for premature death, with dominant diseases significantly separating from recessive diseases no matter the age of death. ## Discussion Patient sequencing has become standard for many diseases in several countries, with growing accessibility worldwide. Hence, there is an urgent need for variant interpretation strategies that are broadly applicable and can provide guidance even in cases where just one individual is suspected to have the disease. Studies seeking to enroll individuals with rare diseases allow them to become aggregate in common, and, as such, standard methods of genetic burden and enrichment become viable for discovering novel gene-disease associations. However, there remains a long tail of cases so rare they may be unique. In this work we developed a model to aid in the genetic diagnosis of these patients. In recent years, there has been a surge of models capable of predicting whether variants are benign or pathogenic. However, in this area, consideration for the heterogeneity of severity and penetrance of disease- causing variants has been largely absent. Here, we explored the possibility that, in some situations, it may be beneficial to consider variants as lying on a spectrum of pathogenicity. To capture this spectrum, a model must be capable of ranking variants both within and across distinct genes, i.e., a model of the whole proteome. While several models provide proteome-scale predictions, to our knowledge, popEVE is the first to be built specifically to calibrate scores to be comparable across genes, and hence, may be regarded as the first, albeit simple, model of the human proteome. To advance whole proteome modeling, there is a long road of necessary future developments. The next, perhaps most obvious, step is to account for protein-protein interactions, analogous to the development of protein-level models. Where early models considered each position in the sequence as statistically independent (e.g. column conservation models using MSAs), only later did models account for epistatic and higher-order interactions. Another clear limitation of this model as a representation of the whole proteome is the inability to assess loss of function variants, such as nonsense or truncation mutations, and, thus, are unable to compare their severity to missense variation. To the best of our knowledge, no unified model of loss of function and missense variants with sufficient predictive power currently exists. We note, however, that due to the modular nature of the model, it would be straightforward to incorporate such a model, should one become available in the future. In other words, the human proteome-calibration underlying popEVE is independent of the form of genetic variation and can easily be expanded. Despite the simplicity of popEVE, it presents multiple opportunities for diagnosis and studying the genetic underpinnings of disease more broadly. When applied to the severe developmental disorder metacohort, we found evidence of 104 genetic disorders that burden testing was underpowered to detect. Through complementary gene enrichment and network analysis, we find many of these genes are intimately related to genes whose role in developmental disorders is already established, providing further evidence that these genes do indeed indicate novel genetic disorders. More broadly, the model predicts that a large number of genes are capable of giving rise to severe phenotypes, implying that there are still many genetic disorders yet to be identified or even seen. A similar conclusion is reached in Kaplanis et al(6) but via a distinct analysis. Here we clarify this forecast by predicting which genes and variants are most likely to be involved. Finally, we must note the detrimental impact of building large-scale proteome or genome models; we are reaching a point where energy and computational consumption of developing and training models is costly both financially and environmentally(33). In this work, we sought to use a modular approach, enabling us to repurpose previous models, as well as easily update components of the model with future developments at a minimal computational cost. Deep learning strategies with these properties are currently scarce, and we urgently need more techniques that lend themselves to reducing computational costs or have components that can be readily reused or recycled. ## Supporting information Methods [[supplements/299062_file03.pdf]](pending:yes) Supplementary Figures [[supplements/299062_file04.pdf]](pending:yes) Supplemental Table 1 [[supplements/299062_file05.xlsx]](pending:yes) Supplemental Table 2 [[supplements/299062_file06.xlsx]](pending:yes) Supplemental Table 3 [[supplements/299062_file07.xlsx]](pending:yes) Supplemental Table 4 [[supplements/299062_file08.xlsx]](pending:yes) Supplemental Table 5 [[supplements/299062_file09.xlsx]](pending:yes) Supplemental Table 6 [[supplements/299062_file10.xlsx]](pending:yes) Supplemental Table 7 [[supplements/299062_file11.xlsx]](pending:yes) Supplemental Table 8 [[supplements/299062_file12.tsv]](pending:yes) Supplemental Table 9 [[supplements/299062_file13.xlsx]](pending:yes) ## Data Availability All data produced is available online at pop.evemodel.org or is contained in the supplementary material in the manuscript. [https://pop.evemodel.org](https://pop.evemodel.org) ## Data and Code Availability Interactive web viewer and downloads for popEVE scores available at [pop.evemodel.org](http://pop.evemodel.org). Code will be available at [github.com/debbiemarkslab/popEVE](http://github.com/debbiemarkslab/popEVE). ## Acknowledgements We thank all members of the Marks Lab and Dias & Frazer Group for valuable discussions. R.O, A.K, C.S, M.F, J.F, and D.S.M. are supported by a Chan Zuckerberg Initiative Award (Neurodegeneration Challenge Network, CZI2018-191853). H.S., and D.S.M. are supported by an NIH Transformational Research Award (TR01 1R01CA260415). C.S. is supported by the National Science Foundation Graduate Research Fellowship under Grant No. M.D and J.F. are supported by the Spanish Ministry of Science and Innovation (PID2022-140793NA- I00). * Received November 27, 2023. * Revision received November 27, 2023. * Accepted November 28, 2023. * © 2023, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/) ## References 1. 1.Veltman JA, Brunner HG. De novo mutations in human genetic disease. Nat Rev Genet. 2012 Jul 18;13(8):565–75. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/nrg3241&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22805709&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F11%2F28%2F2023.11.27.23299062.atom) 2. 2.Wright CF, Fitzgerald TW, Jones WD, Clayton S, McRae JF, van Kogelenberg M, et al. Genetic diagnosis of developmental disorders in the DDD study: a scalable analysis of genome-wide research data. Lancet. 2015 Apr;385(9975):1305–14. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S0140-6736(14)61705-0&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25529582&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F11%2F28%2F2023.11.27.23299062.atom) 3. 3.Deciphering Developmental Disorders Study. Large-scale discovery of novel genetic causes of developmental disorders. Nature. 2015 Mar 12;519(7542):223–8. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/nature14135&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25533962&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F11%2F28%2F2023.11.27.23299062.atom) 4. 4.Deciphering Developmental Disorders Study. Prevalence and architecture of de novo mutations in developmental disorders. Nature. 2017 Feb 23;542(7642):433–8. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/nature21062&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=28135719&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F11%2F28%2F2023.11.27.23299062.atom) 5. 5.Wright CF, Campbell P, Eberhardt RY, Aitken S, Perrett D, Brent S, et al. Genomic diagnosis of rare pediatric disease in the United Kingdom and Ireland. N Engl J Med. 2023 Apr 27;388(17):1559–71. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa2209046&link_type=DOI) 6. 6.Kaplanis J, Samocha KE, Wiel L, Zhang Z, Arvai KJ, Eberhardt RY, et al. Evidence for 28 genetic disorders discovered by combining healthcare and research data. Nature. 2020 Oct;586(7831):757–62. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41586-020-2832-5&link_type=DOI) 7. 7.100,000 Genomes Project Pilot Investigators, Smedley D, Smith KR, Martin A, Thomas EA, McDonagh EM, et al. 100,000 Genomes Pilot on Rare-Disease Diagnosis in Health Care - Preliminary Report. N Engl J Med. 2021 Nov 11;385(20):1868–80. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa2035790&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F11%2F28%2F2023.11.27.23299062.atom) 8. 8.Frazer J, Notin P, Dias M, Gomez A, Min JK, Brock K, et al. Disease variant prediction with deep generative models of evolutionary data. Nature. 2021 Nov;599(7883):91–5. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41586-021-04043-8&link_type=DOI) 9. 9.Riesselman AJ, Ingraham JB, Marks DS. Deep generative models of genetic variation capture the effects of mutations. Nat Methods. 2018 Oct;15(10):816–22. 10. 10.Notin P, Dias M, Frazer J, Hurtado JM, Gomez AN, Marks D, et al. Tranception: Protein Fitness Prediction with Autoregressive Transformers and Inference-time Retrieval. In: Chaudhuri K, Jegelka S, Song L, Szepesvari C, Niu G, Sabato S, editors. Proceedings of the 39th International Conference on Machine Learning. PMLR; 17--23 Jul 2022. p. 16990–7017. (Proceedings of Machine Learning Research; vol. 162). 11. 11.Notin P, Van Niekerk L, Kollasch AW, Ritter D, Gal Y, Marks DS. TranceptEVE: Combining family- specific and family-agnostic models of protein sequences for improved fitness prediction [Internet]. bioRxiv. 2022. Available from: doi:10.1101/2022.12.07.519495 [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYmlvcnhpdiI7czo1OiJyZXNpZCI7czoxOToiMjAyMi4xMi4wNy41MTk0OTV2MiI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIzLzExLzI4LzIwMjMuMTEuMjcuMjMyOTkwNjIuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 12. 12.Brandes N, Goldman G, Wang CH, Ye CJ, Ntranos V. Genome-wide prediction of disease variant effects with a deep protein language model. Nat Genet [Internet]. 2023 Aug 10; Available from: doi:10.1038/s41588-023-01465-0 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41588-023-01465-0&link_type=DOI) 13. 13.Shin J-E, Riesselman AJ, Kollasch AW, McMahon C, Simon E, Sander C, et al. Protein design and variant prediction using autoregressive generative models. Nat Commun. 2021 Apr 23;12(1):2403. 14. 14.Sudlow C, Gallacher J, Allen N, Beral V, Burton P, Danesh J, et al. UK biobank: an open access resource for identifying the causes of a wide range of complex diseases of middle and old age. PLoS Med. 2015 Mar;12(3):e1001779. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pmed.1001779&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25826379&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F11%2F28%2F2023.11.27.23299062.atom) 15. 15.Lek M, Exome Aggregation Consortium, Karczewski KJ, Minikel EV, Samocha KE, Banks E, et al. Analysis of protein-coding genetic variation in 60,706 humans. Nature. 2016 Aug;536(7616):285–91. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/nature19057&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=27535533&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F11%2F28%2F2023.11.27.23299062.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000381804900026&link_type=ISI) 16. 16.Rehm HL, Berg JS, Brooks LD, Bustamante CD, Evans JP, Landrum MJ, et al. ClinGen--the clinical genome resource. N Engl J Med. 2015 Jun 4;372(23):2235–42. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMsr1406261&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=26014595&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F11%2F28%2F2023.11.27.23299062.atom) 17. 17.Berg JS, Adams M, Nassar N, Bizon C, Lee K, Schmitt CP, et al. An informatics approach to analyzing the incidentalome. Genet Med. 2013 Jan;15(1):36–44. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/gim.2012.112&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22995991&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F11%2F28%2F2023.11.27.23299062.atom) 18. 18.Blekhman R, Man O, Herrmann L, Boyko AR, Indap A, Kosiol C, et al. Natural selection on genes that underlie human disease susceptibility. Curr Biol. 2008 Jun 24;18(12):883–9. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.cub.2008.04.074&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=18571414&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F11%2F28%2F2023.11.27.23299062.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000257151900026&link_type=ISI) 19. 19.Meier J, Rao R, Verkuil R, Liu J, Sercu T, Rives A. Language models enable zero-shot prediction of the effects of mutations on protein function [Internet]. bioRxiv. 2021. p. 2021.07.09.450648. Available from: [https://www.biorxiv.org/content/10.1101/2021.07.09.450648v1](https://www.biorxiv.org/content/10.1101/2021.07.09.450648v1) 20. 20.Zhou X, Feliciano P, Shu C, Wang T, Astrovskaya I, Hall JB, et al. Integrating de novo and inherited variants in 42,607 autism cases identifies mutations in new moderate-risk genes. Nat Genet. 2022 Sep;54(9):1305–19. 21. 21.McLaren W, Gil L, Hunt SE, Riat HS, Ritchie GRS, Thormann A, et al. The ensembl variant effect predictor. Genome Biol [Internet]. 2016 Dec;17(1). Available from: doi:10.1186/s13059-016-0974-4 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/s13059-016-0974-4&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=27268795&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F11%2F28%2F2023.11.27.23299062.atom) 22. 22.Gao H, Hamp T, Ede J, Schraiber JG, McRae J, Singer-Berk M, et al. The landscape of tolerated genetic variation in humans and primates. Science. 2023 Jun 2;380(6648):eabn8153. 23. 23.Firth HV, Richards SM, Bevan AP, Clayton S, Corpas M, Rajan D, et al. DECIPHER: Database of Chromosomal Imbalance and phenotype in Humans Using Ensembl Resources. Am J Hum Genet. 2009 Apr;84(4):524–33. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.ajhg.2009.03.010&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19344873&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F11%2F28%2F2023.11.27.23299062.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000265232800013&link_type=ISI) 24. 24.Sherman BT, Hao M, Qiu J, Jiao X, Baseler MW, Lane HC, et al. DAVID: a web server for functional enrichment analysis and functional annotation of gene lists (2021 update). Nucleic Acids Res. 2022 Jul 5;50(W1):W216–21. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/NAR/GKAC194&link_type=DOI) 25. 25.Szklarczyk D, Kirsch R, Koutrouli M, Nastou K, Mehryary F, Hachilif R, et al. The STRING database in 2023: protein-protein association networks and functional enrichment analyses for any sequenced genome of interest. Nucleic Acids Res. 2023 Jan 6;51(D1):D638–46. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/NAR/GKAC1000&link_type=DOI) 26. 26.Bressi JC, Jennings AJ, Skene R, Wu Y, Melkus R, De Jong R, et al. Exploration of the HDAC2 foot pocket: Synthesis and SAR of substituted N-(2-aminophenyl)benzamides. Bioorg Med Chem Lett. 2010 May 15;20(10):3142–5. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.bmcl.2010.03.091&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=20392638&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F11%2F28%2F2023.11.27.23299062.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000277246300027&link_type=ISI) 27. 27.Pisareva VP, Pisarev AV, Fernández IS. Dual tRNA mimicry in the Cricket Paralysis Virus IRES uncovers an unexpected similarity with the Hepatitis C Virus IRES. Elife [Internet]. 2018 Jun 1;7. Available from: doi:10.7554/eLife.34062 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.7554/eLife.34062&link_type=DOI) 28. 28.Lee C-H, MacKinnon R. Activation mechanism of a human SK-calmodulin channel complex elucidated by cryo-EM structures. Science. 2018 May 4;360(6388):508–13. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6Mzoic2NpIjtzOjU6InJlc2lkIjtzOjEyOiIzNjAvNjM4OC81MDgiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMy8xMS8yOC8yMDIzLjExLjI3LjIzMjk5MDYyLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 29. 29.McKusick VA. Mendelian Inheritance in Man and its online version, OMIM. Am J Hum Genet. 2007 Apr;80(4):588–604. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1086/514346&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=17357067&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F11%2F28%2F2023.11.27.23299062.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000245465200002&link_type=ISI) 30. 30.Sun KY, Bai X, Chen S, Bao S, Kapoor M, Backman J, et al. A deep catalog of protein-coding variation in 985,830 individuals. bioRxivorg [Internet]. 2023 May 10; Available from: doi:10.1101/2023.05.09.539329 [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYmlvcnhpdiI7czo1OiJyZXNpZCI7czoxOToiMjAyMy4wNS4wOS41MzkzMjl2MiI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIzLzExLzI4LzIwMjMuMTEuMjcuMjMyOTkwNjIuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 31. 31.Karczewski KJ, Francioli LC, Tiao G, Cummings BB, Alföldi J, Wang Q, et al. The mutational constraint spectrum quantified from variation in 141,456 humans. Nature. 2020 May;581(7809):434–43. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41586-020-2308-7&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32461654&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F11%2F28%2F2023.11.27.23299062.atom) 32. 32.Inserm. Orphanet: an online database of rare diseases and orphan drugs. Copyright, INSERM. 1997; 33. 33.Lannelongue L, Aronson H-EG, Bateman A, Birney E, Caplan T, Juckes M, et al. GREENER principles for environmentally sustainable computational science. Nature Computational Science. 2023 Jun 26;3(6):514–21.