Treatment nonresponse in children receiving silver diamine fluoride for caries: A pilot study
=============================================================================================

* Ryan Richard Ruff
* Bidisha Paul
* Maria A Sierra
* Fangxi Xu
* Yasmi Crystal
* Xin Li
* Deepak Saxena

## Abstract

*Objectives*: Silver diamine fluoride (SDF) is a nonsurgical therapy for the arrest and prevention of dental caries with demonstrated clinical efficacy. Approximately 20% of children receiving SDF fail to respond to treatment. The objective of this study was to develop a predictive model of treatment nonresponse using machine learning. *Methods*: An observational pilot study (N=20) consisting of children with and without active decay and who did and did not respond to silver diamine fluoride provided salivary samples and plaque from infected and contralateral sites. 16S rRNA genes from samples were amplified and sequenced on an Illumina Miseq and analyzed using QIIME. The association between operational taxonomic units and treatment nonresponse was assessed using lasso regression and artificial neural networks. *Results*: Bivariate group comparisons of bacterial abundance indicate a number of genera were significantly different between nonresponders and those who responded to SDF therapy. No differences were found between nonresponders and caries-active subjects. Prevotella pallens and Veillonella denticariosi were retained in full lasso models and combined with clinical variables in a six-input multilayer perceptron. *Discussion*: The acidogenic and acid-tolerant nature of retained bacterial species may overcome the antimicrobial effects of SDF. Further research to validate the model in larger external samples is needed.

## 1 Introduction

Dental caries, a polymicrobial disease caused by a diverse bacterial ecosystem where acid produced by acidogenic and aciduric bacteria in direct contact with tooth surfaces erodes the enamel and dentin of the tooth [1], is the most prevalent childhood disease in the world [2, 3]. Untreated dental caries affects more than 20% of children in the United States and over 50% of children have ever experienced caries, higher amongst low-income and minority children [4, 5, 6], populations typically characterized by lower dental service utilization [7]. To address this unmet need, school-based caries prevention programs can supplement traditional care, increasing access to dental services and reducing oral health inequities [8, 9].

Silver diamine fluoride (SDF) is a liquid therapeutic agent that combines the antibacterial effects of silver and the re-mineralizing effects of fluoride [10] with proven clinical efficacy in arresting approximately 80% of caries lesions in enamel and dentin [11]. The use of SDF for arresting cavitated caries lesions in primary teeth is recommended by the American Association of Pediatric Dentists and the American Dental Association [12] with growing utilization in pediatric dental programs across the United States.

The mechanisms associated with refractory growth of caries initially treated using SDF remain unclear. In pragmatic studies, this phenomenon of nonresponse to the therapeutic effect of SDF has been observed in children with and without prior caries experience, in those living in both fluoridated and non-fluoridated communities, and was not related to sex or age [13]. The presence of plaque in lesions resistant to the caries arresting action of SDF suggests that the microbiome composition of the individual oral cavity and/or the specific caries site may be a strong determinant in the preventive action of SDF [11, 14]. Silver ions have demonstrated an antimicrobial effect against specific bacteria and the development of new biofilms [15, 16]. However, most studies with cariogenic bacteria have been conducted in in-vitro biofilm models with one or more species while the human biofilm is composed of multitude of species, the interaction of which may influence the effect of SDF in preventing caries.

We conducted a pilot study to explore the innate commonalities between the microbiomes of children that may increase susceptibility or resistance to caries and impact the effectiveness of SDF therapy. Study objectives included determining whether (1) caries prone or resistant children harbor significantly different oral microbiota; (2) microbiomes are more or less resistant to preventive agents; and (3) these data can be used to predict treatment nonresponse. Results for objectives (1) and (2) were previously reported. In this paper, we present preliminary results supporting objective (3).

## 2 Methods

This study received approval from the New York University School of Medicine Institutional Review Board (#s19-00692, “The role of the oral microbiome in predicting disparities in caries and responsiveness to caries prevention: An observational pilot study”, 23 June 2019) and is reported according to STROBE checklist.

### 2.1 Design and participants

This was an observational pilot study conducted from June to November 2019. Twenty children aged 5-13 years were recruited from the New York University College of Dentistry dental clinic at the time of their routine visit. Healthy subjects were enrolled if they had untreated dental caries (N=5), were caries free (N=5), were scheduled to receive silver diamine fluoride during their current visit (N=5), or had previously received SDF and presented with re-occurrence of caries (N=5). Children in each group were unique and did not crossover. Excluded subjects were those who had antibiotic therapy in the previous two months or those who could not follow the instructions to collect the saliva samples due to mis-behavior. All study participants were of Hispanic/Latino origin. Each subject provided parental informed consent and child assent.

### 2.2 Sample collection

Untreated dental caries or re-occurrence of caries was determined by subjects presenting with visible cavitated lesions corresponding to an International Caries Detection and Assessment System (ICDAS) score of 3 or higher. Patients received silver diamine fluoride if they presented with visual cavitated lesions consisting of an ICDAS score of 4 or higher. Biological samples were collected once from each of the twenty study participants in a single visit. All subjects received a visual-tactile oral examination and provided unstimulated saliva. For children with caries, plaque samples were taken from caries sites and from the buccal surface of the second primary molar on the opposite side of the treated or untreated cavity. Children without caries provided supragingival plaque samples from the buccal surface of the second maxillary molar on both sides of the mouth. Supragingival plaque was collected with a single stroke using a sterile Gracey mini curette. Samples were placed in separate pre-barcoded micro centrifuge tubes with transport buffer and placed in a portable freezer. All biological samples were collected by a licensed dentist.

Sociodemographic and other clinical data for participants were obtained using pre-study questionnaires or were extracted from electronic health records. Data included subject age, sex, ethnicity, the number of hours since the last meal was consumed and since the last time the subject brushed his or her teeth, visible plaque index score, and caries history. While there was no control over the time of the last meal or their last brushing, however this data were collected and both were at least one hour in all subjects.

### 2.3 Microbiome analysis

Bacterial genomic DNA was extracted using QIAamp PowerFecal kit (Qiagen). DNA purity was verified using NanoDrop 2000 spectrophotometer (Thermo scientific) and quantified fluorometrically using Quant-iT PicoGreen assay (Invitrogen). Each of the samples were further diluted or concentrated to 10ng/ul. The variable V4 region of the bacterial rRNA gene was amplified in duplicates using barcoded forward and reverse primers 341F (5-CCTACGGGNGGCWGCAG-3) and 805R (5-GACTACHVGGGTATCTAATCC-3), each with overhang adapter sequences (IDT). PCR was done using 2x Kapa HiFi Hotstart ReadyMix DNA polymerase (KapaBiosystems). Reactions were verified by agarose-gel electrophoresis and amplicons were purified using AMPure XP beads. A second PCR was performed using dual indices from Illumina Nextera XT index kits (Illumina) followed by second purification with AMPure XP beads. The amplicons were further quantified by PicoGreen assay and diluted to 4nm. The samples were then pooled together, denatured, and sequenced on Illumina MiSeq platform (paired end, 2*300 bp).

### 2.4 Data analysis

Descriptive statistics (means, standard deviations, and proportions) were calculated for clinical and sociodemographic data. Any differences across study groups were assessed using *χ*2 tests for categorical variables and analysis of variance for continuous variables. T-tests with multiple comparison adjustments were used to detect any simple bivariate differences across the relative abundance of OTUs. Adjusted models for the association between taxonomic units and treatment nonresponse was then assessed using lasso regression [17, 18]. Study groups were collapsed into those who were nonresponders to SDF and all other subjects (caries active, caries free, and responders) due to small sample sizes in the pilot. All available OTUs were used as potential predictors with a single outcome consisting of two classes (non-responder versus all other study participants). Analysis used k-fold cross-validation to produce values for *λ*, after which a logistic lasso was performed. Coefficients of retained variables were saved and plots were produced for coefficient change across *λ* values.

Retained OTUs and clinical indicators for time elapsed since prior meal and brushing, age, and VPI were used as input variables for an artificial neural network. The included OTUs were first normalized using the function (*x – min*(*x*))*/*(*max*(*x*) – *min*(*x*)). A multilayer perceptron consisting of five hidden nodes, six inputs, and one output was constructed and computed using backpropagation. Predictions were compared to observed values but due to the small sample size no test set was used for validation.

Analysis was conducted in R v3.6.3 ([http://www.r-project.org](http://www.r-project.org)) using the glmnet and neuralnet packages. Statistical significance was set at 0.05.

## 3 Results

The average age of study participants was 9.1 (SD=2.15) with approximately 55% of the sample consisting of females (Table 1). Sex was unequally distributed across treatment groups (e.g., 20% female in caries active and 80% in SDF groups). The average elapsed time since the previous meal and the last toothbrushing was 4.35 (SD=3.62) and 3.25 (SD=1.97) hours, respectively. The average visible plaque index (VPI) score across the study sample was 2 (SD=0.56).

View this table:
[Table 1:](http://medrxiv.org/content/early/2020/10/05/2020.10.02.20204743/T1)

Table 1: 
Clinical and sociodemographic data (N=20)

Bivariate group comparisons for abundance of specific genera in non-responders (Table 2) indicates that Oribacterium, Prevotella, Aggregatibacter, Fusobacterium, Peptostreptococcaceae, and Campylobacter were significantly different comparing non-responders to SDF-treated subjects. When compared to caries-free subjects, only Absconditabacteria and Peptostreptococcus were significantly different. There were no significant differences between non-responders and caries-active individuals. In full lasso models, two species were retained (Table 3) at the lambda minimum: Pallens (genus Prevotella) and Denticariosi (genus Veillonella). The coefficient path showing changes in estimates for OTUs for included lambdas is shown in Figure 1.

View this table:
[Table 2:](http://medrxiv.org/content/early/2020/10/05/2020.10.02.20204743/T2)

Table 2: 
Specific genera comparisons with non-response

View this table:
[Table 3:](http://medrxiv.org/content/early/2020/10/05/2020.10.02.20204743/T3)

Table 3: 
Retained and potentially relevant OTUs for treatment nonresponse

![Figure 1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/10/05/2020.10.02.20204743/F1.medium.gif)

[Figure 1:](http://medrxiv.org/content/early/2020/10/05/2020.10.02.20204743/F1)

Figure 1: 
Coefficient path of OTUs at different values of lambda

At smaller estimates of lambda, additional OTUs were present (species Multiformis, Dentocariosa of the Rothia genus, and the genus Leptotrichia). Given the small sample size, these OTUs may be relevant in future analyses. An interactive graph of the coefficient path is available in a public GitHub repository ([www.github.com/ryanruff/nonresponse](http://www.github.com/ryanruff/nonresponse)). The network topology map for the two retained species and clinical indicators is shown in Figure 2. Associated weights for node connections (black lines) and bias (blue lines) are available in the GitHub repository.

![Figure 2:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/10/05/2020.10.02.20204743/F2.medium.gif)

[Figure 2:](http://medrxiv.org/content/early/2020/10/05/2020.10.02.20204743/F2)

Figure 2: 
Network topology without weights

## 4 Discussion

Silver diamine fluoride combines the antibacterial behavior of silver with the remineralization properties of fluoride that creates an unfavorable environment for collagen degradation, and can inhibit the progression of dental caries [19]. We previously reported that there are distinct microbiota within plaque and saliva samples that can successfully differentiate between nonresponders to SDF and other groups, though no differences were found in microbial composition between infected or contralateral sites. In this study, our approach considered two methods to yield a predictive model for treatment nonresponse using a sample of patients who had previously received silver diamine fluoride for dental caries. While research using machine learning in oral epidemiology is limited, previous studies have successfully applied ML-approaches to predict malodor using salivary microbiota [20], hypertension from gingival inflammation [21], oral cancer [22], oral poliovirus vaccine immunogenicity [23], temporomandibular joint osteoarthritis, and radiographic detection of tooth and dental restorations [24]. Notably, a recent review concluded that artificial intelligence, particularly machine learning and deep learning, can use data from the oral microbiome to predict systemic disease [25].

Non-responders were compared to children with and without active caries, as well as those who have responded to the therapeutic effects of SDF. Interestingly, bivariate results indicate no differences in bacterial abundance between those that fail to respond to SDF and those with untreated carious lesions, and the greater number of differences were restricted to the SDF-treated group. Results using lasso regression indicated that two bacteria, Prevotella pallens and Veillonella dentocariosa, may be useful in predicting treatment nonresponse. Prevotella is proteolytic, saccharolytic and acid-tolerant [26], an overabundance of which has been associated with dental caries [27], in particular P. pallens [28]. The genus Veillonella consists of small strictly anaerobic gram-negative cocci that have been associated with severe early childhood caries [29]. Veillonella relies on lactate and other organic acid as its nutrient source and poorly adhere to host tissue. However, they are known to coaggregate with Streptococcus species such as S.mutans in biofilm formation in oral cavity [30]. These acidogenic and acid-tolerant bacterial species may overcome the antimicrobial effects of SDF, though the mechanistic action of this is still unknown.

Other species that were initially associated but were not retained at the lambda minimum included Prevotella multiformis, Rothia dentocariosa and the genus Leptotrichia. Prevotella multiformis, first isolated from oral gingival plaque, are gram-negative bacilli or cocci that produce acid from glucose, lactose, sucrose, glycerol, D-mannose, D-raffinose [31]. Rothia dentocariosa is a gram-positive bacteria with a variable morphology ranging from coccoid to branched filamentous, generally grows in aerobic and microaerophilic conditions producing acid from glucose, sucrose, maltose and glycerol [32], and has been previously associated with periodontal inflammatory disease. Notably, several gram-positive bacteria produce lipoproteins that induce TLR-2 mediated inflammation. Thus, Rothia denticariosa may be acting in concert with other gram-positive bacteria to invoke host-immune response and regulate inflammatory effects in dental caries [33]. Bacteria belonging to genus Leptotrichia are non-motile facultative anaerobe gram-negative bacilli that are found in oral cavity. Similar to streptococcus mutans, they ferment carbohydrates and produce organic acids such as lactic acid, and traces of acetic, formic and succinic acid. As S. mutans adheres to tooth surfaces and produces lactic acid causing demineralization of tooth enamel, Leptotrichia may us a similar mechanism to contribute to dental caries [34]. Further study on the potential of action of these bacteria in overcoming the effect of SDF is warranted.

The value of the coefficients from lasso models and neural networks are less important than the predictive power of the model and are thus unreported, though they can be extracted from supplementary figures. While the small sample size from this pilot study prohibited out of sample validation for testing purposes, our approach produced a restricted function for classifying whether a subject receiving silver diamine fluoride would appropriately respond to treatment. It is important to note that our results, as would be the case with any regularization approach, are only one of many possible models that could be useful in predicting nonresponse. Retained OTUs do not necessarily mean that those not included in the model are irrelevant. Regardless, this preliminary investigation has identified variables that are correlated with those predictive of treatment nonresponse, which may be useful in making predictions in larger, independent datasets.

The clinical definition of nonresponse to silver diamine fluoride is not yet fully explicated. In this study, any subject previously treated with SDF that presented with new incidence of decay was classified as a non-responder. However, an alternative classification might be to group individuals by the severity of nonresponse and the importance of individual operational taxonomic units might depend, in part, on the chosen clinical definition. Finally, independent variables for this study were limited solely to specific clinical indicators and OTUs produced by saliva and plaque samples taken from carious lesions and contralateral sites. Further research with more sophisticated data can expand upon the models and the neural network estimated in this study by incorporating data on dietary intake and hygiene behaviors, which are likely to confound the microbiome and nonresponse relationship.

### 4.1 Funding

This study was funded in part by awards from the New York University Grant Support Initiative (#RA633, Ruff PI) and the National Institute of Dental and Craniofacial Research (#R56DE028933, Ruff and Saxena PIs). The content is solely the responsibility of the authors and does not necessarily reflect the official views of the National Institutes of Health, New York University, the New York University College of Dentistry, or the New York University School of Medicine.

### 4.2 Contributions

RRR conceived and developed the study, performed statistical analysis, and wrote the manuscript. YC contributed to study development, enrolled subjects, collected samples, and wrote the manuscript. BP, MAS, and FX analyzed study samples and wrote the manuscript. DS contributed to study development and wrote the manuscript. All authors contributed equally.

## Data Availability

Code and models are available at a GitHub repository ([www.github.com/ryanruff/nonresponse](http://www.github.com/ryanruff/nonresponse)). Data available upon request and review.

[http://www.github.com/ryanruff/nonresponse](http://www.github.com/ryanruff/nonresponse) 

*   Received October 2, 2020.
*   Revision received October 2, 2020.
*   Accepted October 5, 2020.


*   © 2020, Posted by Cold Spring Harbor Laboratory

This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/)

## References

1.  [1]. Alex Mira  Aurea Simón-Soro. Solving the etiology of dental caries. Trends in Microbiology, 23(2):76–82, 2015.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.tim.2014.10.010&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25435135&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F10%2F05%2F2020.10.02.20204743.atom) 

2.  [2]. E. Bernabé  A. Flaxman  M. Naghavi  A. Lopez  C.J.L. Murray  W. Marcenes,  N.J. Kassebaum. Global burden of oral conditions in 1990-2010. Journal of Dental Research, 92(7):592–597, 2013.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/0022034513490168&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23720570&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F10%2F05%2F2020.10.02.20204743.atom) 

3.  [3]. E Fleming Tdaer  C Vos  T Murray  Cjl Marcenes  W N J Kassebaum,  Agcb Smith. Global, regional, and national prevalence, incidence, and disability-adjusted life years for oral conditions for 195 countries, 1990-2015: A systematic analysis for the global burden of diseases, injuries, and risk factors. Journal of Dental Research, 96(4):380–387, 2017.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/0022034517693566&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=28792274&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F10%2F05%2F2020.10.02.20204743.atom) 

4.  [4]. G Thornton-Evans  B Dye,  X Li. Oral health disparities as determined by selected healthy people 2020 oral health objectives for the united states. NCHS Data Brief, 104:1–8, 2009.
    
    

5.  [5]. X Li  T J Iafolla  B A Dye,  G Thornton-Evans. Dental caries and sealant prevalence in children and adolescents in the united states. NCHS Data Brief, 2015:1–8, 2011.
    
    

6.  [6].Barbara F. Gooch Katherine Weno Lorena Espinoza Susan  O. Griffin, Liang Wei. Vital signs: Dental sealant use and untreated tooth decay among u.s. school-aged children. MMWR. Morbidity and Mortality Weekly Report, 65(41):1141–1145, 2016.
    
    

7.  [7]. H M Treadwell. The nation’s oral health inequities: Who cares. Am J Public Health, 107(S1):5–5, 2017.
    
    

8.  [8].Craniofacial Research. Department of Health and Human Services PHS, Centers for Disease Control and Prevention, and the National Institutes of Health, National Institute of Dental and, 2003.
    
    

9.  [9]. V Smith  B G Lewis  L K Barker  G Thornton-Evans  B A Dye,  S Tan. Trends in oral health status: United states. Vital Health Stat 11, 11(248):1–92, 1988.
    
    

10. [10].Richard Niederman Yasmi O. Crystal. Evidence-based dentistry update on silver diamine fluoride. Dental Clinics of North America, 63(1):45–68, 2019.
    
    

11. [11]. N. Hiraishi  D. Duangthip  M.L. Mei  E.C.M. Lo  C.H. Chu  S.S. Gao,  I.S. Zhao. Clinical trials of silver diamine fluoride in arresting caries among children. JDR Clinical Translational Research, 1(3):201–210, 2016.
    
    

12. [12]. Mwb Araujo  M Fontana  S Guzman-Armstrong  M M Nascimento  R L Slayton,  O Urquhart. Evidence-based clinical practice guideline on nonrestorative treatments for carious lesions: A report from the american dental association. J Am Dent Assoc, 149(10):837–886, 2018.
    
    

13. [13].Richard Niederman Ryan Richard Ruff, Deepak Saxena. School-based caries prevention and longitudinal trends in untreated decay: an updated analysis with markov chains. BMC Research Notes, 13(1):25–25, 2020.
    
    

14. [14]. M.C.M. Wong  E.C.M. Lo  C.H. Chu  M.H.T. Fung,  D. Duangthip. Randomized clinical trial of 12treatment. Journal of Dental Research, 97(2):171–178, 2018.
    
    

15. [15]. KH. Low  CM. Che  ECM. Lo  ML. Mei,  CH. Chu. Caries arresting effect of silver diamine fluoride on dentine carious lesion with s. mutans and l. acidophilus dual-species cariogenic biofilm. Medicina Oral Patología Oral y Cirugia Bucal, 18(6):e824–e831, 2013.
    
    

16. [16]. Noriko Hiraishi  Michael Francis  Burrow-Duangporn Duangthip  May Lei  Mei Edward  Chin-Man Lo  Chun-Hung Chu  Irene Shuping Zhao,  Sherry Shiqian Gao. Mechanisms of silver diamine fluoride on arresting caries: a literature review. International Dental Journal, 68(2):67–76, 2018.
    
    

17. [17]. Robert Tibshirani. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B (Methodological), 58(1):267–288, 1996.
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=A1996TU31400017&link_type=ISI) 

18. [18]. J Friedman  T Hastie,  R Tibshirani. The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2016.
    
    

19. [19]. C H Ecm  L Ml M. Arresting dentine caries with silver diamine fluoride: What’s behind it? Journal of dental research, (7):97–97, 2018.
    
    

20. [20].Fumiyuki Kuwata Yoshio Nakano, Nao Suzuki. Predicting oral malodour based on the microbiota in saliva samples using a deep learning approach. BMC Oral Health, 18(1):128–128, 2018.
    
    

21. [21]. Francesco D’Aiuto  Eva Muñoz  Aguilera Eleonora  Ortu-Mario Giannoni  Marta Czesnikiewicz-Guzik Tomasz J.  Guzik Claudio  Ferri-Rita Del  Pinto Davide Pietropaoli,  Annalisa Monaco. Active gingival inflammation is linked to hypertension. Journal of Hypertension, 38(10):2018–2027, 2020.
    
    

22. [22]. John Adeoye  Peter Thomson  Siu-Wai Choi Chui S.  Chu, Nikki  P. Lee. Machine learning and treatment outcome prediction for oral cancer. Journal of Oral Pathology Medicine, 2020.
    
    

23. [23]. Y H Chen  N Jeyavelu  N V Jose  I Praharaj  S Babji,  P Manickavasagam. Immune predictors of oral poliovirus vaccine immunogenicity among infants in south india. NPJ Vaccines, 5:27–27, 2020.
    
    

24. [24]. D Kabla  I Leichter  C Nadler  R Abdalla-Aslan,  T Yeshua. An artificial intelligence system using machine-learning for automatic detection and classification of dental restorations in panoramic radiography. Oral Surg Oral Med Oral Pathol Oral Radiol, 2020.
    
    

25. [25]. Tanujaa Suriyanarayanan  Meiyappan Lakshmanan  Dong-Yup Lee  Mina Rho  Nicholas Jakubovics  Bernd Brandt  Wim Crielaard  Egija Zaura  Chaminda Jayampath Seneviratne,  Preethi Balan. Oral microbiome-systemic link studies: perspectives on current limitations and future artificial intelligence-based approaches. Critical Reviews in Microbiology, 46(3):288–299, 2020.
    
    

26. [26]. R. Cabrera-Rubio  L.D. Alcaraz  A. Mira  á. Simón-Soro,  P. Belda-Ferre. A tissue-dependent hypothesis of dental caries. Caries Research, 47(6):591–600, 2013.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1159/000351663&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24080530&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F10%2F05%2F2020.10.02.20204743.atom) 

27. [27]. Shi Huang  Cunpei Bo-Zhenjiang  Zech Xu  Amnon Amir  Rob Knight  Junqi Ling  Jian Xu  Fei Teng,  Fang Yang. Prediction of early childhood caries via spatial-temporal variations of oral microbiota. Cell Host Microbe, 18(3):296–306, 2015.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.chom.2015.08.005&link_type=DOI) 

28. [28]. P Zhu  Z Sun- S Li  F Li  L Zhang,  T Sun. Quantitative Analysis of Salivary oral Bacteria Associated with Severe early childhood caries and construction of caries Assessment Model, 10:1–8, 2020.
    
    

29. [29]. N.I. Chalmers  R. Kent-Jr.  A. Moore  C.V. Hughes  N. Pradhan  C.Y. Loo  A.C.R. Tanner  E. Kanasi,  F.E. Dewhirst. Clonal analysis of the microbiota of severe early childhood caries. Caries Research, 44(5):485–497, 2010.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1159/000320158&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=20861633&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F10%2F05%2F2020.10.02.20204743.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000282173600010&link_type=ISI) 

30. [30]. S. R. Dardis  A. M. Lee  I. Olsen  F. E. Dewhirst  E. J. Leys  B. J. Paster  J. A. Aas,  A. L. Griffen. Bacteria of dental caries in primary and permanent teeth in children and young adults. Journal of Clinical Microbiology, 46(4):1407–1417, 2008.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiamNtIjtzOjU6InJlc2lkIjtzOjk6IjQ2LzQvMTQwNyI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIwLzEwLzA1LzIwMjAuMTAuMDIuMjAyMDQ3NDMuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

31. [31].Makoto Umeda Isao Ishikawa Yoshimi Benno Mitsuo Sakamoto,  Yi Huang. Prevotella multi-formis sp. nov., isolated from human subgingival plaque. International Journal of Systematic and Evolutionary Microbiology, 55(2):815–819, 2005.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1099/ijs.0.63451-0&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=15774668&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F10%2F05%2F2020.10.02.20204743.atom) 

32. [32]. M Fischer  S S Long,  C G Prober. Principles and practice of pediatric infectious diseases E-Book, 2017.
    
    

33. [33].Haruka Fukamachi Takafumi Arimoto Hirobumi Morisaki Hirotaka Kuwata Hideo Kataoka, Makoto Taniguchi. Rothia dentocariosainduces tnf-alpha production in a tlr2-dependent manner. Pathogens and Disease, 71(1):65–68, 2014.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/2049-632X.12115&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24265267&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F10%2F05%2F2020.10.02.20204743.atom) 

34. [34].Ingar Olsen Emenike R.  K. Eribe. Leptotrichia species in human infections ii. Journal of Oral Microbiology, 9(1):1368848–1368848, 2017.