Time-to-event estimation of birth prevalence trends: a method to enable investigating the etiology of childhood disorders including autism
==========================================================================================================================================

* Alexander G. MacInnis

## Abstract

An unbiased, widely accepted estimate of the rate of occurrence of new cases of autism over time would facilitate progress in understanding the causes of autism. The same may also apply to other disorders. While incidence is a widely used measure of occurrence, birth prevalence—the proportion of each birth year cohort with the disorder—is the appropriate measure for disorders and diseases of early childhood. Studies of autism epidemiology commonly speculate that estimates showing strong increases in rate of autism cases result from an increase in diagnosis rates rather than a true increase in cases. Unfortunately, current methods are not sufficient to provide a definitive resolution to this controversy. Prominent experts have written that it is virtually impossible to solve.

This paper presents a novel method, time-to-event birth prevalence estimation (TTEPE), to provide accurate estimates of birth prevalence properly adjusted for changing diagnostic factors. It addresses the shortcomings of prior methods. TTEPE is based on well-known time-to-event (survival) analysis techniques. A discrete survival process models the rates of incident diagnoses by birth year and age. Diagnostic factors drive the probability of diagnosis as a function of the year of diagnosis. TTEPE models changes in diagnostic criteria, which can modify the effective birth prevalence when new criteria take effect. TTEPE incorporates the development of diagnosable symptoms with age. General-purpose optimization software estimates all parameters, forming a non-linear regression. The paper specifies all assumptions underlying the analysis and explores potential deviations from assumptions and optional additional analyses.

A simulation study shows that TTEPE produces accurate parameter estimates, including trends in both birth prevalence and the probability of diagnosis in the presence of sampling effects from finite populations. TTEPE provides high power to resolve small differences in parameter values by utilizing all available data points.

Keywords
*   Birth prevalence
*   birth year cohort prevalence
*   birth year prevalence
*   birth year cohort
*   prevalence
*   incidence
*   time-to-event
*   survival analysis
*   diagnostic factors
*   probability of diagnosis
*   non-linear regression
*   autism
*   ASD
*   intellectual disability
*   childhood disorders
*   developmental disorders

## Introduction

An unbiased, widely accepted estimate of the rate of occurrence of new cases of autism over time would facilitate progress in understanding what causes autism. It would also help answer other important questions, such as projecting future adult caseloads based on cases already born. Epidemiology relies on the rate of occurrence of new cases (occurrence rate) to investigate the risks and causes of any disorder or disease [1,2]. However, studies of autism epidemiology commonly speculate that estimates showing strong increases in the occurrence of autism are the result of an increase in rates of diagnosis rather than a true increase in cases [3-19]. Current methods are not sufficient to provide a definitive resolution to this controversy, as the Background and Literature Review section explains. Prominent experts have written that it is virtually impossible to solve [20].

This paper presents a novel analytical method called time-to-event birth prevalence estimation (TTEPE) to estimate birth prevalence trends. It quantifies the occurrence rate while avoiding the biases and ambiguity of existing methods. This paper focuses on autism, but the method may also benefit various diseases, disorders, and conditions.

There are multiple specific measures of the occurrence rate. **Birth prevalence** is the preferred measure for birth defects, congenital diseases, and disorders—including autism—where the times of occurrence events are not observable because occurrence is before or shortly after birth [2,21-25]. Birth prevalence is also known as birth year prevalence and birth year cohort prevalence. Birth prevalence is the proportion of a birth year cohort that has the disorder. A birth year cohort is the set of all individuals born in a given year. While conventional estimates of birth prevalence are based on counting diagnoses, the definition of birth prevalence does not depend on when each case was diagnosed or whether each case was ever diagnosed. **Incidence** is based on the times of occurrence of new cases and is a measure commonly used to describe the occurrence rate [1,2]. The incidence of diagnoses (i.e., the rate of occurrence of new diagnoses) is different from the incidence of cases. The difference between incident (new) diagnoses and incident (new) cases is fundamental when considering the hypothesis that increasing rates of diagnosis reflect improved ascertainment of cases rather than an increasing case occurrence rate.

There are currently very few studies that estimate the birth prevalence of autism, and there is no generally accepted estimate of this measure [3-16]. Numerous papers instead examine autism **prevalence**, which is a measure of the total number of cases at a specific time, not the occurrence rate. Prevalence is rarely useful in studying etiology [2,13,14]. Estimates of both prevalence and birth prevalence of autism remain controversial, with no known method of resolution. The next section provides essential details.

While the term “birth prevalence” contains the word “prevalence,” its meaning differs from the standalone term. “Prevalence” on its own is not specific to birth year and is specific to time. Comparison of prevalence estimates across multiple studies is generally not suitable for understanding trends in incidence or birth prevalence [2]. Different prevalence estimates may use different case definitions, case-finding procedures, and ranges of ages, among other possible differences between prevalence studies [13]. **Cumulative incidence** is the sum of events, such as incident diagnoses, as proportions of the cohort, from birth to a specified age. Cumulative incidence of diagnoses approximates birth prevalence, but the result can be biased [1,26-28,S1 text].

**Diagnostic factors** are factors that affect the probability of diagnosing cases. **Probability of diagnosis** is the probability of diagnosing individual cases with the disorder who are exhibiting diagnosable symptoms. This probability may vary with time. When the probability of diagnosis increases, a greater proportion of cases are diagnosed; that is, there is increased ascertainment of cases. Diagnostic factors include, among others: awareness, outreach efforts, screening, diagnostic practice, diagnostic substitution or accretion, availability of evaluations, diagnostic criteria, social factors, policies, and financial incentives for diagnosis. The Method section below shows that the probability of diagnosis is a function of the set of all diagnostic factors. **Diagnostic criteria** specify the set of symptoms that qualify an individual for a diagnosis [29,30] and can affect the effective birth prevalence of each birth cohort. Formal diagnostic criteria change at specific dates when new criteria take effect.

The TTEPE method is specifically designed to produce valid, accurate estimates of birth prevalence properly separated from the effects of diagnostic factors and diagnostic criteria. A suitable method to establish birth prevalence should:

*   estimate birth prevalence over a broad range of birth years;

*   adjust for the effect of the set of all diagnostic factors;

*   adjust for changes in diagnostic criteria; and

*   disentangle birth prevalence, diagnostic factors, and diagnostic criteria such that the adjustments do not introduce significant bias or uncertainty in the estimates.

The following sections give a concise review of relevant studies followed by the presentation of TTEPE. TTEPE extends established time-to-event or survival analysis to model the effects of diagnostic factors and diagnostic criteria on rates of incident diagnoses by age and year of diagnosis. It estimates birth prevalence over multiple cohorts. The method presentation depicts the assumed causal paths, derives the model’s formulas, lists the assumptions underlying the analysis, discusses potential violations of the assumptions, and presents validation of the method via simulation, followed by a discussion.

## Background and Literature Review

Broad-based literature reviews by Elsabbagh [14] and Fombonne [13] confirmed rises in reported autism prevalence over time. However, both stated that what matters is the number of new cases over time (i.e., the occurrence rate) and that rising prevalence does not necessarily imply an increase in the rate of new cases, consistent with textbooks [1,2].

A few papers provide estimates of autism birth prevalence over time, in some cases using different names. A series of reports from the US Centers for Disease Control and Prevention’s (CDC) Autism and Developmental Disabilities Monitoring Network (ADDM) [3-11] estimate what they call the prevalence of autism among children who were eight years old at each even-numbered year 2000 through 2016. These are actually birth prevalence estimates, but the reports describe the findings as simply “prevalence” with no mention of birth prevalence. The ADDM reports show a strong trend in birth prevalence by birth year and speculate that the observed increase may result from various factors other than a true increase [3-11]. Meyers [12] used a records-based review, largely similar to the ADDM approach, as well as counting community diagnoses. The authors found a sharp increase in cumulative incidence by birth year, approximating birth prevalence, and suggested that the increase may result from factors such as increasing awareness or broadening diagnostic criteria rather than a true increase [12]. Hansen [26] is a methods paper that recommends using the cumulative incidence of diagnoses of childhood psychiatric disorders for each birth cohort as a measure of risk when risk may vary by birth year. They found a strongly increasing cumulative incidence of autism by birth year cohort but made scant mention of it. Sasayama [16] found an increasing cumulative incidence of autism to age five by birth year and suggested it may have been caused by increasing awareness. None of these papers suggest methods to quantify or adjust for the effects of diagnostic factors or diagnostic criteria [3-16,20,21,26].

Supplementary file [S1 text] shows that while one can use cumulative incidence to estimate the birth prevalence trend, the result is potentially ambiguous. It is possible to explain a trend in cumulative incidence by birth year due to any of a wide range of combinations of the trends in birth prevalence and diagnostic factors; see also MacInnis [27].

Croen [31] examined birth prevalence trends in autism and mental retardation in California over birth years 1987 to 1994. The authors concluded that the data and methods available were insufficient to determine how much of the observed increase reflected a true increase in birth prevalence. Nevison [32] presented California Department of Developmental Services data showing a sharp rise in the birth prevalence of autism over several decades. They discuss various non-causal hypotheses that others have suggested to explain the observed trend but did not discuss methods to quantify or adjust for the hypothesized factors.

Various papers have tried to adjust or control for diagnostic factors or diagnostic criteria to estimate case trends using one of two closely related methods. One approach adjusts for variables representing the effects of diagnostic factors, diagnostic criteria or both when estimating time trends in case rates. The other is age-period-cohort analysis, which typically uses regression with a linear predictor containing terms for age (at diagnosis), period (year of diagnosis), and cohort (birth year). Neither method is suitable; both methods either introduce bias or produce unreliable results, as explained here. Campbell [15] and McKenzie [33] both point out that various factors could potentially affect the rate of diagnoses without affecting the true case rate. Elsabbagh, Campbell, and Baxter [14,15,34] suggest controlling for changes in diagnostic factors or diagnostic criteria to enable the comparison of prevalence estimates to estimate time trends. Elsabbagh [14] wrote: “Time trends in rates can therefore only be gauged in investigations that hold these parameters under strict control over time,” referring to case definition (diagnostic criteria) and case ascertainment (probability of diagnosis). However, none of the papers we have found proposes a method that avoids introducing bias while controlling for the indicated parameters. All three variables—the probability of diagnosis, diagnostic criteria, and birth prevalence—are functions of time, so none of them remain constant when any of them changes, creating a fundamental problem with attempting to control for any of these variables. Baxter [34] adjusted for dichotomous variables representing the most recent diagnostic criteria, each of which took effect at a specific date, assuming that these variables introduced bias. However, such adjustment is problematic, and itself introduces bias. Schisterman [35] shows that controlling for variables on a causal path from the input (time, in this case) to the outcome (prevalence or incident diagnoses) constitutes inappropriate adjustment and biases the estimate of the primary effect (i.e., of time on the outcome) towards zero. Similarly, Rothman [2] states that controlling for intermediate variables typically causes a bias towards finding no effect.

Other papers used age-period-cohort analysis to attempt to separate the effects of diagnostic factors from either birth prevalence trends or changes in prevalence. Examples include Keyes [17], King [18], and MacInnis [27]. However, this approach cannot produce valid estimates except in very special circumstances [27,36,37,S1 text]. The root of the problem is the exact collinearity (i.e., cohort + age = period) which violates a basic assumption of regression and causes the model to be unidentified. That is, there is an infinite number of parameter set values such that estimation could produce any arbitrary one of them [38]. One can constrain the analysis to make the model identified; however, the constraint imposes an a priori assumption on the solution [27,36,37,S1 text]. Keyes [17] used the constraint approach, and Spiers [39] pointed out that the method used could as easily have reached the opposite conclusion. King [18] assumed that period effects are dominant and controlled for birth year, forming a constrained age-period-cohort analysis. Analysis that implicitly assumes little to no trend in birth prevalence causes the estimate to fit the assumption [27,37]. Analyses that omit one or two of the age, period, and cohort variables implicitly assume that the coefficients of the omitted variables are equal to zero, which might not be valid. That approach does not solve the problems of age-period-cohort analysis [36,37,S1 text]. It is not suitable to estimate the age trend directly from the data because such estimates make implicit assumptions about either the period or cohort trends and result in conclusions that follow the assumptions [27].

We did not find any papers that use survival or time-to-event analysis in ways that are directly relevant to this paper. The Discussion section gives details.

This paper follows advice from Schisterman [35], who recommends “clearly stating a causal question to be addressed, depicting the possible data generating mechanisms using causal diagrams, and measuring indicated confounders.”

## Method of time-to-event birth prevalence estimation (TTEPE)

### Description of the method

TTEPE estimates birth prevalence over a range of birth years, properly adjusted for the effects of diagnostic factors and changes in diagnostic criteria, in a way that solves the problems of previous methods. TTEPE input data provides either the ages or years of initial diagnoses; this information exists in some datasets [12,16,19,28,40-43]. One key element is recognizing that the probability of diagnosis at the year of each initial diagnosis (diagnostic year) represents the effect expressed in the data of the set of all diagnostic factors, as shown in the next section and introduced in [27]. The problem is then one of separating the effects of birth year and diagnostic year, called cohort and period, respectively, in age-period-cohort analysis. Age-period-cohort analysis inherently involves age (at diagnosis), and we must properly account for the effect of age without using a linear predictor in age, period, and cohort. Therefore, another fundamental element of TTEPE is modeling the distribution of initial diagnoses with age—the age distribution—as a separate, non-linear process. The age distribution may differ between birth cohorts. The age distribution may ramp up from age zero to a peak at some age and fall approximately exponentially with further increasing age. TTEPE models the rising distribution from age zero as cases developing diagnosable symptoms with age, called eligibility. It models the falling distribution of initial diagnoses with age using a survival process defined below. TTEPE incorporates variables that model the effect of changes in diagnostic criteria. Optimization software finds the parameter values that result in the model best fitting the observed data, thereby estimating birth prevalence and the other variables of interest. This paper explains all of these in detail.

In TTEPE’s survival process, “survival” refers to cases that have not yet been diagnosed. In each cohort, there is some unknown proportion that are cases—the birth prevalence. As the cases develop diagnosable symptoms—become eligible—they join the pool of cases at risk of initial diagnosis, called the risk set. The size of the risk set as a proportion of the cohort is called *R*. At each age, some portion of the cohort’s cases become eligible, thereby increasing *R*, and some portion of the risk set is diagnosed, reducing *R*. At each age, *R* multiplied by the probability of diagnosis gives the proportion of the cohort receiving an initial diagnosis. The reduction of *R* due to these diagnoses results in fewer cases being diagnosed at the next age. Thus, this process inherently produces a falling number of diagnoses with increasing age once most or all cases are old enough to be eligible.

The birth prevalence *BP* of each cohort determines the magnitude, not the shape, of the age distribution. The shape of the age distribution at each cohort is determined by the probability of diagnosis *PD* and eligibility *E**A*, which is a function of age. Greater values of *PD* cause a greater proportion of the risk set to be diagnosed at each age, leaving a smaller proportion of cases at risk at the next age. Eligibility *E**A* is the proportion of cases exhibiting diagnosable symptoms at age *A*. Few, or no cases may be eligible at birth, and cases may develop diagnosable symptoms with increasing age, thereby increasing *E**A* up to a maximum value of 1. If the disorder’s definition requires that all cases exhibit diagnosable symptoms by a certain age, then *E**A* becomes equal to 1 at that age.

Fig 1 illustrates an example of the survival process that models the age distribution. It shows two scenarios with different values of the probability of diagnosis: *PD* = 0.1 and *PD* = 0.25. In this example, birth prevalence *BP* is 0.01 (1%) in both scenarios and eligibility *E**A* increases from 0 at age 0 to 1 at age 3. The model produces predicted values of the proportion *D* of the cohort receiving initial diagnoses at each age, corresponding to the input data. The figure shows the survival function *S*, which is the proportion of the cohort consisting of undiagnosed cases at each age, regardless of their eligibility, unlike *R*, which incorporates eligibility. *S* >*R* at ages where some cases are not yet eligible (*E**A* < 1) and *S* = *R* at ages where all cases are eligible (*E**A* = 1). Cases not yet eligible are surviving (not yet diagnosed), but they are not yet in the risk set. For clarity, the figure shows *S* rather than *E**A* and *R*. The shape of *R* (not shown) tracks the shape of *D*, which is determined by *PD* and *E**A*, however, *R* is at a different scale. Cumulative incidence *CI* shows how many cases have been diagnosed by each age. Note that greater values of *PD* result in both a left shift of the curve of initial diagnoses towards younger ages and a greater cumulative incidence at the end of follow-up, which in this example is age 10. While generally, *PD* varies as a function of diagnostic year, this example uses constant values of *PD* for clarity.

![Fig 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/09/30/2020.08.05.20169151/F1.medium.gif)

[Fig 1.](http://medrxiv.org/content/early/2021/09/30/2020.08.05.20169151/F1)

Fig 1. 
Example of a survival process for two values of probability of diagnosis *PD*. The green lines *S* denote survival, the blue lines *D* denote the rate of diagnoses, and the red lines *CI* denote cumulative incidence. The solid lines represent *PD*=0.1, and the dashed lines represent *PD*=0.25.

Later sections explain details of the method, including eligibility and the effect of changes in diagnostic criteria.

TTEPE is particularly applicable to disorders where case status is either present or predetermined by birth or a known age. Diagnosable symptoms may be present by some consistent age, or cases may develop diagnosable symptoms gradually over a range of ages, depending on the disorder.

### Method details

Input data comprises rates of initial diagnoses *D* by age or diagnostic year for each birth year cohort. Since birth year + age = diagnostic year, these variables are interchangeable, subject to truncation or rounding. The rate is the count of initial diagnoses divided by the cohort’s population at the respective diagnostic year or age. TTEPE models the rate of initial diagnoses as a function of birth year, diagnostic year, and age. *D(BY, DY, A)* = *fModel*(*BP**BY*, *PD**DY*, *CF**DY*,*E**A*) where *D* is the proportion of the birth cohort that receives a diagnosis, *BY* is birth year, *DY* is diagnostic year, *A* is age, *BP* is birth prevalence, *PD* is the probability of diagnosis, *CF* is the criteria factor, and *E* is eligibility. The non-linear function *fModel* is specified below. Importantly, *BP**BY* comprises all cases in cohort *BY* regardless of when or whether they have been diagnosed. The probability of diagnosis *PD**DY* is the probability of diagnosing eligible, undiagnosed cases. *PD**DY* is the effect of the set of all diagnostic factors on the data, as explained below. The criteria factor *CF**DY* modifies the proportion of each cohort that qualifies as cases according to each new criteria set that takes effect at diagnostic year *DY. CF* = 1 for the criteria in effect at the first *DY*. Eligibility *E**A* is the proportion of cases that have developed diagnosable symptoms at age *A*. The following text and causal directed acyclic graph (DAG) in Fig 2 explain and illustrate the paths from *BY, DY* and *A* to new diagnoses, the model outcome. The model can either specify or estimate the eligibility function *E**A*.

![Fig 2.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/09/30/2020.08.05.20169151/F2.medium.gif)

[Fig 2.](http://medrxiv.org/content/early/2021/09/30/2020.08.05.20169151/F2)

Fig 2. 
Directed Acyclic Graph (DAG) showing the effects of birth year, diagnostic year and age on rates of diagnoses

Diagnostic factors are those that affect the diagnosis of eligible cases. Any factor that affects the probability of diagnosis is a diagnostic factor; the introduction lists examples. *PD* is equivalent to the hazard *h* in discrete time-to-event or survival analysis. For each case of the disorder, the information resulting from *PD**DY* consists of the time (diagnostic year) of initial diagnosis. *PD**DY* has no effect on the data before diagnosing each case, none after the initial diagnosis since TTEPE considers only initial diagnoses, and none if the case is not diagnosed by the end of follow-up. Hence, *PD**DY* is the effect of the set of diagnostic factors on the model outcome and is a function of diagnostic year.

The directed acyclic graph (DAG) in Fig 2 illustrates the causal paths from birth year *BY*, diagnostic year *DY*, and age *A* to initial diagnosis *D*. Birth year is the independent variable in birth prevalence *BP*. Birth year *BY* drives variable etiologic (causal) factors, which produce the disorder. Eligibility *E* represents the development of diagnosable symptoms with age. Diagnostic criteria determine whether each individual’s symptoms qualify them as a case. Changes in diagnostic criteria at specific years can change the proportion of the cohort classified as cases, i.e., the effective birth prevalence, by modifying the threshold of symptoms that qualify case status. This effect is represented by the criteria factor *CF*, which is a function of diagnostic year *DY*. Symptoms combined with diagnostic criteria form diagnosable case status. *DY* is the independent variable in the effects of diagnostic factors, which manifest as the probability of diagnosis *PD*. Diagnosable case status and probability of diagnosis operate jointly to produce each initial diagnosis.

### TTEPE time-to-event analysis model

TTEPE is based on the DAG of Fig 2 and the survival process described above. For each birth cohort, undiagnosed eligible cases form the risk set, the size of which is denoted *R. BP* is the proportion of the cohort that consists of cases, which is unknown and is the primary target of estimation, in contrast to known prior uses of survival analysis. *R* is a function of *BP*, eligibility *E*, and the survival process. A later section describes using the effective birth prevalence *EBP* instead of *BP* to incorporate the criteria factor *CF*.

A portion of the risk set is diagnosed at each age *A* according to the probability of diagnosis *PD*. The value of *PD* at each age, or equivalently each diagnostic year, for each cohort, is the number of newly diagnosed cases divided by *R*. This formulation applies because TTEPE uses a discrete-time model; see Kalbfleisch [44]. At each age, newly eligible cases are added to the risk set, and newly diagnosed cases are removed from the risk set. For any given value of *PD*, as *R* decreases or increases, the population proportion of initial diagnoses *D* changes accordingly. This process generates the age distribution of diagnoses.

Let *D**BY,A* be the population-based rate of incident (first) diagnoses. The model generates predicted values ![Graphic][1]</img>. Modeling proportions rather than counts accommodates changes in each cohort’s population size over time, e.g., due to in- and out-migration and deaths. Alternatively, the analysis could model counts directly.

Let *PD**DY* be the probability of diagnosis at diagnostic year *DY. PD**DY* is equivalent to *PD**BY,A* because *DY* = *BY* + *A*, subject to truncation or rounding. Let *BP**BY* be the birth prevalence of cohort *BY*, i.e., the proportion of the cohort consisting of cases regardless of how many have been diagnosed. *BP**BY* does not depend on eligibility. Let *R**BY,A* be the discrete risk set, which is the proportion of birth year cohort *BY* consisting of eligible cases at risk of initial diagnosis at age *A*. Let *E**A* be the discrete eligibility function, the proportion of cases that are eligible at age *A*, bounded by 0 ≤ *E* ≤ 1. At each age *A* ≥ 1, *BP* × *(E**A* *-E**A-1**)* is the incremental portion of *BP* added to *R* due to increases in eligibility. For simplicity, assume *E**A* increases monotonically (non-decreasing), meaning that cases do not lose eligibility before diagnosis. At each age *A* for each cohort *BY*, the rate of incident diagnoses *D**BY,A* = *R**BY,A* × *PD**DY* from the definition of *PD* above. We write *PD**DY* as *PD**BY,A* to specify the model in terms of *BY*, noting that *DY* = *BY* + *A*, subject to truncation or rounding. Kalbfleisch [44] gives background on general time-to-event theory and equations.

### Derivation of formulas

First, consider the simplest scenario, where all cases are eligible for diagnosis from birth (constant *E**A* = 1 for all values of *A*), and the diagnostic criteria do not change the effective birth prevalence over the interval of interest. In the second scenario, *E**A* increases monotonically, and in the third scenario, *E**A* increases until it plateaus at *E**A* = 1 for *A* ≥ *AE*, where *AE* is the **age of complete eligibility**. A later section adds the effect of changes in diagnostic criteria.

#### Constant *E**A* = 1

For *A* ≥ 1, *E**A* *-E**A-*1 = 0. For the first year of age, *A* = 0, the risk set *R**BY*,0 = *BP**BY**E* = *BP**BY* and *D**BY*,0 = *R**BY*,0*PD**BY*,0 = *BP**BY**PD**BY*,0. In other words, at age 0, all cases are eligible and in the risk set, and the proportion of the cohort (not the proportion of cases) that is diagnosed is the birth prevalence *BP* times the probability of diagnosis *PD* at age 0. ![Formula][2]</img>  

That is, the size of the risk set decreases from age 0 to age 1 by the proportion of the cohort diagnosed at age 0. The proportion of the cohort diagnosed at age 1 is the size of the risk set at age 1 times the probability of diagnosis at age 1. ![Formula][3]</img>  

Similarly for *A* = 3, ![Formula][4]</img>  

Combine these expressions and generalize to, for *A* ≥ 1, ![Formula][5]</img>  and ![Formula][6]</img>  

In all three scenarios in this section, the survival function is: ![Formula][7]</img>  

*S**BY,A* is the portion of *BP**BY* that has not been diagnosed by age *A*. As noted above, *S* differs from *R* because of eligibility. The summation term is the cumulative incidence of initial diagnoses through age *A* − 1.

#### Increasing *E**A*

In this scenario, *E* < 1 and *E**A* increases monotonically with *A*. For *A* = 0, *R**BY*, 0 = *E**BP**BY* and *D**BY*,0 = *E**BP**BY**PD**BY*,0. For each *A* ≥ 1, *R**BY,A* = *R**BY,A*−1 − *D**BY,A*−1 + *(E**A* − *E**A*−1*)BP**BY*. The last term represents the increase in *R**BY,A* due to the incremental increase of *E**A*. Then, ![Formula][8]</img>  

Equation (3) serves as a procedural definition for software implementing *fModel* where *E**A* may increase from A = 0 to the maximum age of follow-up *A* = *M. E**M* should be set to 1 to avoid creating an unidentified model. Equivalent expressions for *R**BY,A* and *D**BY,A* similar to equation (1) follow, where each expression in the summations describes the portion of *BP**BY* that becomes eligible at each age according to incremental increases in *E**A*. For *A* ≥ 1, ![Formula][9]</img>  ![Formula][10]</img>  where *E*−1 is defined to be 0. *E**A* can be defined parametrically or non-parametrically.

#### Plateau *E**A*

In this scenario, *E**A* increases with age from *E* < 1 and plateaus at *E**A* = 1 for *A* ≥ *AE, AE* < *M*, and *M* is the maximum age of follow-up. External information, such as the disorder’s definition, may indicate the value of *AE*, or investigators may specify *AE* based on estimates of *E**A* found using equations (3) or (4). For *A* ≤ *AE*, equation (3) applies as does the formula for *R**BY,A* preceding it. For *A* > *AE, (E**A* *-E**A-1**)* = 0, and ![Formula][11]</img>  

Alternatively, combine equation (2) with the fact that *E**AE* = 1 to obtain ![Graphic][12]</img>. Then, ![Formula][13]</img>  

And for *A* > *AE*, ![Formula][14]</img>  

The form in equations (6) and (7) uses empirical values of *D**BY,A* for *A* < *AE* rather than modeling *D**BY,A* from *BP**BY*, *E**A* and *PD**BY,A* using equation (3). Equations (6) and (5) serve as procedural definitions in models that assume *AE* and do not estimate *E**A*, while equations (3) and (5) serve as procedural definitions in models that do estimate *E**A*.

The scenario of increasing *E**A* is a general formulation. The scenario of plateauing *E**A* may be appropriate when investigators have reason to specify *AE*. For example, for disorders where diagnosable symptoms are present by age three by definition, the plateau *E**A* scenario applies, and the age of complete eligibility *AE* = 3.

### Birth prevalence, cumulative incidence and censoring

The birth prevalence *BP* of each cohort *BY* is equivalent to the sum of the cumulative incidence of diagnoses through the last age of follow-up plus the portion of cases that were not diagnosed by the end of follow-up, i.e., the right-censored portion.

In all three scenarios above of *E**A*, we can express *BP* as a function of the survival function *S**A* and the cumulative incidence *CI**A-*1 for *A* > 0, by rearranging equation (2) as *BP* = *S**A* + *CI**A*−1. Assuming eligibility *E**M* = 1 at the last age of follow-up *M*, then *S**M* = *R**M*. Then, *BP* = *R**M* + *CI**M*−1 and *D**M* = *R**M**PD**M*. The censored proportion is *S**M*+1 = *S**M* − *D**M*, which is equivalent to *S**M*+1 = *R**M* − *R**M**PD**M* = *R**M**(*1 − *PD**M**)*. After estimating the model parameters, the estimated censored proportion — the proportion of the cohort consisting of cases that have not been diagnosed by the last age of follow-up *M* — is ![Graphic][15]</img> is an internal variable in the model. Diagnoses are counted from birth, so there is no left censoring.

### Assumptions

The TTEPE method relies on several baseline assumptions. If some assumptions are not met, there could be bias in estimation results. Investigators can accommodate deviations from assumptions in many cases, as discussed in a later section. The TTEPE method does not assume any particular relationship between parameter values, nor does it require assuming the values of any explicit or implicit variables. The TTEPE method’s baseline assumptions are:

1.  The eligibility function *E**A* is consistent across cohorts.

2.  The probability of diagnosis *PD* applies equally to all eligible undiagnosed cases at any given diagnostic year.

3.  The birth prevalence within each cohort under consistent diagnostic criteria is constant over the range of ages included in the analysis.

4.  Data represent truly initial diagnoses.

5.  Case status is binary according to the applicable diagnostic criteria.

6.  The discrete-time interval (e.g., one year) is small enough that the error introduced by treating the variable values as constant within each interval is negligible.

7.  There are no false positives in the dataset.

8.  Any difference in competing risks between cases and non-cases in the range of ages analyzed is small enough to be ignored. Competing risk is a term of art in survival analysis. An example competing risk is death before initial diagnosis.

The assumption of a consistent eligibility function means that cases develop diagnosable symptoms as a function of age, and that function is the same for all cohorts. In other words, the value of *E**A* at age *A* is the same for all cohorts *BY*, while *E**A* varies with *A*. The section Changes in diagnostic criteria affecting birth prevalence discusses a separate effect that might make the eligibility function appear to be inconsistent even if it is not. A later section explores potential violations of assumptions.

### Estimating parameters

TTEPE performs a non-linear regression that estimates the parameters of the model of *D**BY,A* using general-purpose non-linear optimization software. The model is based on one or more of equations (3), (5) and (6) selected based on the eligibility scenario. The model produces estimated values of ![Graphic][16]</img> from the parameters and independent variables, and the software finds the parameter values that minimize a cost function cost![Graphic][17]</img>. One suitable implementation of optimization software in the Python language is the curve_fit() function in the SciPy package (scipy.optimize.curve_fit in SciPy v1.7). Its default cost function is ![Graphic][18]</img>, so it minimizes the sum of squared errors. Python software to perform this regression and the simulations described below is available at OSF [45].

Investigators should choose which model equation to use based on knowledge or estimates of the eligibility function *E**A*. Non-parametric estimates ![Graphic][19]</img> can inform a choice of a parametric form of *E**A*. If *E**A* = 1 for all *A* ≥ *AE*, that fact and the value of *AE* should be apparent from estimates ![Graphic][20]</img>, and the plateau *E**A* scenario applies.

Investigators should choose forms of *BP**BY* and *PD**BY,A* appropriate to the dataset. Linear, first-order exponential, second-order exponential or non-parametric models may be appropriate. Graphical and numeric model fit combined with degrees of freedom can guide the optimum choice of a well-fitting parsimonious model.

If the population proportion of cases represented in the data is unknown for all cohorts, then absolute birth prevalence, or the intercept, may be underestimated by an unknown scale factor. Proportional changes in birth prevalence between cohorts are unaffected by underestimation of the intercept. Changes over time in the proportion of cases included in the sample reflect changing diagnostic factors, and the parameter estimates of *PD* automatically represent such changes. If the proportion of cases represented in the data is known for at least one cohort, one can use that knowledge to determine the intercept.

### Changes in diagnostic criteria affecting birth prevalence

Changes in criteria may change the effective birth prevalence *EBP* within a cohort, without affecting symptoms or etiology, by including or excluding as cases some portion of the cohort population compared to prior criteria. This mechanism is distinct from a changing probability of diagnosis. A criteria change that changes the effective birth prevalence affects the entirety of any birth cohort where the birth year is greater than or equal to the year the change took effect. For birth years before the year of criteria change, a change in criteria affects *EBP* and the size of the risk set *R* starting at the diagnostic year the change took effect. Generally, diagnostic criteria should be given in published documents specifying the effective dates of new or revised criteria.

Let {*CFcy*} be the set of **criteria factors** that induce a multiplicative effect on *EBP* due to criteria changes that occurred at criteria years {*cy*}. *CF*, the value in effect before the first *DY*, equals 1. *BP**BY* is the birth prevalence of cohort *BY* before the effect of any criteria changes. For each cohort *BY, EBP**BY,A* at age *A* is ![Formula][21]</img>  

The combination of *BP**BY* and the effects of all {*CF**cy*|*cy* ≤ *BY* + *A*} determines the *EBP* at age *A* of cohort *BY*.

For a given *BY* and increasing *A, BY* + *A* crossing any criteria year *cy* causes a step-change in *EBP*. Using a general formulation supporting increasing eligibility *E**A* based on equation (3) we obtain the following. For *A* = 0, *R**BY*,0 = *E**EBP**BY*,0 and *D**BY*,0 = *E**EBP**BY*,0*PD**BY*,0. For *A* ≥ 1, ![Formula][22]</img>  and ![Formula][23]</img>  

The term *EBP**BY,A* − *EBP**BY,A*−1 represents the change in *EBP* when *BY* + *A* crosses one of {*cy*}. As each *CFcy* takes effect at *cy* = *DY* = *BY* + *A*, the newly effective *CFcy* changes *EBP**BY,A* and *R**BY,A* in all *BY* cohorts where *cy* corresponds to an age *A* in the range of ages included in the analysis. These changes in *R**BY,A* affect the rates of initial diagnoses *D*. For cohorts born after *cy, CFcy* applies to all ages.

The parameters of *BP**BY* quantify the birth prevalence controlled for diagnostic criteria changes, which are represented by {*CFcy*}. In other words, *BP**BY* is the effective birth prevalence that would have occurred if the initial criteria had been applied at all diagnostic years included in the study.

To estimate the parameters, use a software model of equation (9) with optimization software as described above.

### Potential violations of assumptions

Suppose a dataset represents a non-homogeneous set of cases with different effective values of *PD* applying to different unidentified subgroups at the same *DY*. That would violate the assumption that *PD* applies equally to all eligible undiagnosed cases at any given *DY*. Cases may have differing degrees of symptom severity, and more severe symptoms may result in earlier diagnosis [28,41-43], implying greater values of *PD*. Fig 3 illustrates this situation. (The figure illustrates constant values of *PD* vs. age purely for clarity, not as an assumption nor a limitation.) If the data represent a combination of unidentified subgroups with different values of *PD*, the distribution of diagnoses is a sum of distributions with different values of *PD*. Such a sum may impair fit with a model that assumes homogeneous *PD*. For data where *E* = 1 for *A* ≥ *AE* (plateau *E**A*), slightly increasing the assumed value *AE** of the age of complete eligibility *AE* used in estimation may mitigate such estimation errors, as shown in the simulation study below. If subgroup data are available representing groups according to symptom severity or other characteristics that may affect *PD*, stratified estimation using subgroups may avoid the issue of unidentified non-homogeneous subgroups. If one suspects non-homogeneity tied to geographic location, such as differences in diagnostic practices or health disparities, stratification by geographic location can elucidate such differences. The same applies to suspected non-homogeneity tied to characteristics such as race, ethnicity or socio-economic status.

![Fig 3.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/09/30/2020.08.05.20169151/F3.medium.gif)

[Fig 3.](http://medrxiv.org/content/early/2021/09/30/2020.08.05.20169151/F3)

Fig 3. 
Example where observed diagnosis rates represent two unidentified subgroups with different values of probability of diagnosis *PD*. The red and green lines represent rates of diagnosis of the two subgroups. Group 1 (red line) has greater *PD* than group 2 (green line). The solid black line shows the aggregate diagnosis rates. The dotted line shows the exponential fit to the aggregate diagnosis rates. The age of complete eligibility *AE* = 3 in this example.

If there is a difference in *BP* between the populations migrating into and out of the study region, that would change the *BP* of individual cohorts over time. If some cases of the disorder are caused by exposures after birth, and those exposures vary by year, that would also change *BP* over time. Either effect would violate the assumption of constant birth prevalence within each cohort. If post-natal exposures caused increased *BP* before age *AE*, then estimates from analyses that use empirical values of *D* for ages less than *AE* would represent values of *BP* that include the post-natal effect.

It is theoretically possible for *PD* to have different effective values for cases of different ages with the same symptom severity at the same *DY*. Such an effect would represent an age bias in *PD* independent of symptom severity. Investigators can examine this possibility by adding an age term to *PD* in the model and estimating its parameters. One form of a potential age bias in *PD* would be age-specific screening for the disorder. In 2006, the American Academy of Pediatrics [46] recommended screening tests for developmental disorders be administered at 9-, 18- and 30- (or 24-) month visits. In 2011, Al-Qabandi [47] concluded that autism screening programs were generally ineffective. Screening in the USA starting approximately 2006 might plausibly have increased the effective *PD* for ages 0 to 2 or 3. An analysis could test for a screening-related increase in *PD* by including a variable for increased *PD* at ages 0 through 3 starting in 2006. For models that use empirical rates of diagnoses for ages less than *AE*, the probability of diagnosis at those ages is not part of the model and does not affect parameter estimates. Analysis could include a parameter specifying increased *PD* at age *AE*, such as age 3. Alternatively, analysis could specify *AE* = 4 such that the probability of diagnosis is estimated for ages ≥ 4, thereby avoiding any potential bias associated with increased probability of diagnosis specific to age 3.

If some in-migrating cases were diagnosed before in-migration and their subsequent re-diagnoses in the study region were labeled as initial diagnoses, that would violate the assumption of truly first diagnoses. Such an effect would be most evident at greater ages after the diagnosis of most cases. Bounding the maximum age studied *M* to a modest value, sufficient to capture most initial diagnoses, can minimize any resulting bias.

For datasets where diagnosis follows best practices using gold-standard criteria, the lack of false positives may be a fair assumption, but they might occur nevertheless. It may be difficult to discover any false positives produced from best practice diagnoses. Where diagnosis uses a less precise process, false positives might occur. For example, diagnosticians might produce a diagnosis of individuals who do not meet formal diagnostic criteria, perhaps under pressure from the patient or parents, or to facilitate services for the individual. Meyers [12] noted the risk of false positives in record-based approaches in contrast to clinical diagnoses. Lord [48] stated that what are sometimes called autism spectrum disorder symptoms that appear at later ages are not always related to autism spectrum disorder. Suppose the pool of individuals subject to false-positive diagnoses is substantially larger than the birth prevalence of true cases. In that case, false-positive diagnoses deplete the pool of such individuals slowly relative to the survival function of true cases. That may result in an approximately uniform age distribution of false-positive diagnoses, causing a nearly constant additive offset to the rates of diagnoses across ages. True case diagnoses should be more common at younger ages, and less common as the risk pool is depleted, so false positives may be more evident at older ages. Setting the maximum age of follow-up *M* to a moderate value, such as age 8 or 10 for autism, may help reduce the impact of false positives on estimates while enabling accurate estimation.

The assumption that case status is binary may not be completely valid, at least in the case of autism or ASD. Different diagnostic assessment tools, assessments by different professionals, and applying different cut-off thresholds within a tool can produce somewhat different results [49].

The formulation that birth prevalence equals the cumulative incidence to age *M* plus the right-censored portion assumes that any difference in competing risks between cases and non-cases in the age range analyzed is small enough to be ignored. This assumption is consistent with Hansen [26]. In contrast, if the rate of deaths of cases before initial diagnosis exceeds the rate in the cohort’s overall population at the same ages, that excess would constitute a competing risk and would reduce the estimated birth prevalence accordingly.

### Model fit

To ensure robust conclusions, investigators should test the model fit to ascertain both model correctness and parameter estimation accuracy. The model fits well if summary measures of the error are small and individual point errors are unsystematic and small [50]. One can examine the fit both graphically and numerically. Plots of *D**BY,A* vs. ![Graphic][24]</img> at all ages for individual cohorts and separately at single ages across all cohorts can illuminate any issues with fit, which might occur at only some cohorts or ages. Visualization of the model vs. data can expose aspects of the data that might not fit well in a model with few parameters, suggesting a higher-order model or semi-parametric specifications.

Suppose the model uses an assumed age of complete eligibility *AE** that differs from the true value of *AE* underlying the data. That mismatch may impair model fit. The simulation study section shows that setting *AE**<*AE* can result in estimation errors. However, setting *AE** >*AE* tends not to impair model fit and may improve it in the case of non-homogeneous subgroups; see Fig 3. The presence of non-homogeneous subgroups may be evident from examining model fit.

The chi-square test statistic is a numerical approach to assess absolute model fit. Investigators can apply it to the overall model, individual cohorts, and single ages across cohorts. The p-value associated with the chi-square statistic uses observed and expected count values rather than proportions. The p-value incorporates the effect of the number of parameters in the model via the degrees of freedom.

### Simulation study

This section presents a simulation study to measure the performance and accuracy of the TTEPE method, following the recommendations in Morris [51]. Simulation studies evaluate performance by generating pseudo-random synthetic data according to known parameters over a broad range of parameter values, estimating parameters from that data using the method under evaluation, and comparing the estimates to the known true parameter values. Simulation studies can detect potential problems such as ambiguity or bias [51].

The simulation study described here uses a model with first-order exponential forms of birth prevalence *BP* and probability of diagnosis *PD*. It uses plateau eligibility *E* with the age of complete eligibility *AE* = 3. There are 20 successive cohorts, and the last age of follow-up is *M* = 10. The parameters of primary interest are the exponential coefficients of birth prevalence *β**BP* and probability of diagnosis *β**PD*. The study tested six pairs of values of *β**BP* and *β**PD*, each ranging from 0 to 0.1 in steps of 0.02, where each pair sums to 0.1. In one parameter set, *BP* increases as *e*0.1×*BY* (10.5% per year) and *PD* is constant. In another parameter set, *BP* is constant and *PD* increases as *e*0.1×*DY* (10.5% per year). The other four parameter sets represent various rates of change of both variables. In all cases, *BP* = 0.01 at the final *BY* and *PD* = 0.25 at the final *DY*. These simulations assume the investigators chose the correct value of the age of complete eligibility *AE* = 3, following the plateau *E**A* model, from either knowledge of the disorder or estimation of the eligibility function *E**A*. The study synthesized each data model in two ways: real-valued proportions without sampling, and a Monte Carlo model with binomial random sample generation. The use of real-valued proportions tests the estimation method’s accuracy (bias) in the absence of sampling effects in the data. It is logically equivalent to testing estimation bias in an infinitely large population. Monte Carlo simulation generated data sets using binomial sampling of case counts for each birth cohort and counts of initial diagnoses at each age within each cohort, with 1000 iterations of random data set generation for each parameter set. The population of each synthetic cohort is a constant of 500,000. TTEPE analysis estimated the parameters for each iteration. The results show the parameter estimation bias and model standard error (SE) for each parameter set over all iterations. The study estimated the parameters using the method described above, implemented using the Python SciPy curve_fit() function. The software that performed this study is publicly available [45].

Table 1 shows results using real-valued proportions without sampling, which isolates the estimation process from random sampling variations. It shows the bias in estimating each of the four model parameters for each of the six synthesis parameter sets. The biases are minimal and may be caused by finite precision arithmetic in the computer. The greatest bias magnitude in ![Graphic][25]</img> occurs with *β*BP = 0 and *β*PD = 0.1 and is on the order of 10−10. This result shows that the parameter estimation is extremely accurate in the absence of sampling effects.

View this table:
[Table 1.](http://medrxiv.org/content/early/2021/09/30/2020.08.05.20169151/T1)

Table 1. Simulation results of parameter optimization using real-valued proportions with no sampling.

Table 2 shows the Monte Carlo analysis of the same parameter sets where the data use binomial sampling. It shows the bias and model standard error (SE) of each parameter for each parameter set. The bias of the primary parameter ![Graphic][26]</img> remains small, on the order of 10−5 or 10−6. The SE is relevant when there is sampling, and it shows the effect of sampling, in contrast to Table 1.

View this table:
[Table 2.](http://medrxiv.org/content/early/2021/09/30/2020.08.05.20169151/T2)

Table 2. Simulation results of parameter optimization using Monte Carlo binomial sampling, 1000 iterations.

Table 3 gives results where estimation uses an assumed value *AE** of the age of complete eligibility *AE* that, in some cases, does not match the true value of *AE* = 3 used to synthesize the data. Synthesis uses one homogeneous group with consistent *PD* at each value of *DY*. Estimation used various assumed values of *AE** to test the effect of the choice of *AE**. Estimation using *AE** = 2 results in substantial estimation errors and model misfit that is obvious from plots of data vs. model (not shown). Estimation using *AE** = 3, *AE** = 4, or *AE** = 5 produces accurate results, with slightly more error where *AE** = 5. Plots show that the model fits well in all three cases (not shown). Thus, the choice of *AE** is not critical as long as *AE** ≥ *AE*. These data use real-valued proportions rather than binomial sampling to avoid confusion of model mismatch with sampling effects.

View this table:
[Table 3.](http://medrxiv.org/content/early/2021/09/30/2020.08.05.20169151/T3)

Table 3. Comparison of the effect of the choice of assumed *AE**** vs. true value of *AE* = 3, with one homogeneous group of cases.

Table 4 shows results with an intentional mismatch between estimation that assumes one homogeneous group and data that comprises two unlabeled subgroups with different values of *PD*, illustrated in Fig 3. Fig 3 shows the visible error of the exponential fit to the data at age = 3 and a good fit for age > 3. In this synthetic dataset, the two subgroups are of equal size, and the true value of *PD* in one group is twice that of the other. This information is unknown to the estimation, and the data does not indicate subgroup size or membership. In the worst case, estimation uses *AE** = *AE* = 3, and the ![Graphic][27]</img> bias is 0.001, which is 1% of the actual value of 0.1. This error is due to the model misfit at age three resulting from subgroups having different values of *PD*, illustrated in Fig 3, and the estimation does not account for the inconsistent values of *PD*. When using *AE** = 4 or *AE** = 5, the biases in ![Graphic][28]</img>, final ![Graphic][29]</img>, and ![Graphic][30]</img> are reduced while the bias in final ![Graphic][31]</img> is increased, all by small amounts.

View this table:
[Table 4.](http://medrxiv.org/content/early/2021/09/30/2020.08.05.20169151/T4)

Table 4. Comparison of the effect of the choice of assumed *AE** vs. true value of *AE* = 3, with two unidentified subgroups with different values of probability of diagnosis, mismatched to analysis.

## Discussion

The TTEPE method solves the previously intractable problem of accurately estimating birth prevalence properly adjusted for diagnostic factors and changes in diagnostic criteria. It addresses the requirements stated in the introduction. The simulation study shows that TTEPE produces accurate estimates of the true parameter values across a broad range of values and in the presence of random sampling effects. This performance implies that TTEPE is suitable for estimating birth prevalence.

TTEPE is novel. Apparently, no previous papers use time-to-event or survival analysis to estimate birth prevalence. In typical survival or time-to-event analysis, including Cox proportional hazards analysis [52], the initial size of the risk set is assumed to have a known value, such as an entire population, group, or sample, in contrast to the problem addressed here. For models where the risk set at all ages consists of the entire population without subtracting diagnosed cases, the estimated hazard function of time ![Graphic][32]</img> is simply the population-based rate of diagnoses *D* at time *t* [19,28,42]. Such models to not apply a survival process to the size *R* of the risk set; see above and Kalbfleisch [44]. For methods using the entire population as the initial risk set, if the disorder is rare, it makes little difference whether the risk set at subsequent ages is the entire population or the undiagnosed portion since the size of the risk set decreases only slightly as cases are diagnosed. Some papers use survival analysis methods to estimate other measures, such as the median age at first diagnosis [28,42,43]. That usage is not directly relevant to this paper. Szklo [1] describes the use of survival analysis to calculate cumulative incidence. That approach does not apply here because it depends on two assumptions that are not valid for the present problem. One is a lack of a birth cohort trend, and the other is independence between censoring and survival, which conflicts with a varying probability of diagnosis.

TTEPE avoids the problems of methods that assume, ignore, or inappropriately estimate the age distribution, including age-period-cohort methods. It achieves this by directly modeling the age distribution of first diagnoses via a non-linear function derived from first principles. A figure in [S1 text] illustrates why fitting the age distribution of diagnoses via a survival model enables identifying correct parameter values. As noted in the background section, some analytic methods adjust for variables on the causal path, which leads to biased estimates. The TTEPE method likewise avoids that problem.

This paper states the assumptions that underlie TTEPE analysis and discusses potential violations of those assumptions. The DAG of Fig 2 illustrates the assumed causal paths from birth year, diagnostic year, and age, including the effect of the set of time-varying diagnostic factors on the probability of diagnosis and the effect of changes in diagnostic criteria on effective birth prevalence. The DAG and associated analysis appear to cover all plausible mechanisms to explain observed trends in rates of initial diagnoses.

The simulation study presented above shows that TTEPE produces estimates with minimal bias and strong power to resolve parameter values from input data with sampling effects. The results in Table 2 show a magnitude of bias of the birth prevalence exponential coefficient ![Graphic][33]</img> not exceeding 6.5 × 10−5, i.e., 0.0065% per year. The model standard error (SE) of ![Graphic][34]</img> ranges from 0.0012 to 0.0017, where the true *β*BP ranges from 0 to 0.1. Using the largest observed SE and 1.96 × SE as the 95% confidence interval threshold, the simulated model can resolve differences in *β*BP of 0.0033, i.e., 0.33% per year. Investigators can expect similar performance for real-world datasets that meet the baseline assumptions and have characteristics comparable to the simulated data. The population size and birth prevalence affect the numbers of incident diagnoses and hence the SE. Note that there are 20 cohorts and 11 ages (0 through 10) in the simulation study, so there are 220 data points. Each data point is an independent binomial random sample. The analysis estimates four parameters that define the curves that fit the data. The relatively large number of independent data points and the small number of model parameters help produce the small bias and model SE. If each cohort’s population or the birth prevalence had been substantially smaller, or the number of parameters had been greater, we would expect the SE and possibly the bias to be larger. These could occur with small geographic regions or rare disorders, or higher-order or semi-parametric models, respectively.

It is possible but challenging to prove mathematically that a model is identifiable [38], and we have not done that. We have not found any evidence that the models described here are unidentified. Investigators can construct a wide variety of TTEPE models with various parametric or non-parametric forms of the variables described here and potentially additional variables. As such, it is possible to construct models with collinearities and resulting non-identification. Simultaneously estimating the parameters across multiple birth cohorts helps discriminate between parameter sets that might interact within one cohort. As with any regression, investigators using TTEPE should ensure there are enough data points to estimate parameters with sufficient precision.

Logically, the eligibility function *E**A* should be an attribute of the disorder under study. Specifically regarding autism or ASD, the literature shows that cases begin to show predictive symptoms well before age three, and some are diagnosed at age two [49]. According to some but not all diagnostic criteria for autism and ASD, symptoms must be present by age three [29]. There is evidence that some cases with milder symptoms who do not meet diagnostic criteria at age three do meet criteria at a later age [53]. Most of those diagnosed at an early age develop more severe symptoms over time [54]. There is also evidence that some individuals who meet or appear to meet case criteria before three years of age no longer meet criteria at some later age [55]. These phenomena are consistent with the discussion above of non-homogeneous subgroups with different effective values of the probability of diagnosis. The phenomenon of late development of diagnosable symptoms may be worthwhile to investigate, particularly with datasets representing initial diagnoses over a broad range of ages. One way to model that phenomenon is the eligibility function continuing to increase over many years of age. It may also be worthwhile to investigate the proportion of cases diagnosed after childhood that do not meet formal criteria, i.e., false positives. As Table 3 and Table 4 show, some errors in estimating the eligibility function and erroneously assuming the homogeneity of the severity of cases have only a minor effect on parameter estimates when the assumed age of complete eligibility *AE** is chosen carefully.

Investigators can use TTEPE to answer important questions beyond the overall trend in birth prevalence. For example, where datasets include appropriate covariates, stratified analysis can determine whether observed trends in the rates of diagnoses in specified subgroups are due to actual changes in birth prevalence or diagnostic factors. Example covariates include sex, race, ethnicity, socio-economic status, geographic region, parental age, environmental exposure, genetic profile, and other factors of interest.

Investigators may use domain knowledge to inform specialized analyses. For example, they may incorporate knowledge of mortality rates and standardized mortality ratios, rates of recovery from the condition before diagnosis, or the characteristics of migration in and out of the study region.

It may be feasible to extend TTEPE to disorders, diseases and conditions where the time scale starts at some event other than birth. For example, the time origin might be the time of completion of a sufficient cause. Various outcomes may serve as events of interest. It is important to ensure that the eligibility function with respect to the time origin is consistent across cohorts.

## Data Availability

Data for this paper are generated by simulation software, which is available at [https://doi.org/10.17605/OSF.IO/WPNKU](https://doi.org/10.17605/OSF.IO/WPNKU)

[https://doi.org/10.17605/OSF.IO/WPNKU](https://doi.org/10.17605/OSF.IO/WPNKU) 

## Supplementary information

S1 text. TTEPE additional analyses and explanations. Contains figures.

### S1 text. TTEPE additional analyses and explanations

#### Problems with age-period-cohort analysis

Rodgers [1] states about constraints added to enable identification “in fact [it] is exquisitely precise and has effects that are multiplied so that even a slight inconsistency between the constraint and reality, or small measurement errors, can have very large effects on estimates.” O’Brien [2], in a book devoted to this topic, states, regarding the relationships of age, period and cohort to the dependent variable, “There is no way to decide except by making an assumption about the relationship between these three variables.” MacInnis [3] showed that the effect of the set of diagnostic factors is represented by the years of first diagnoses, formulates the problem as one of separating birth year from diagnostic year, and shows that age-period-cohort approaches are not suitable for such analyses. In particular, implicit assumptions to make the model estimable cause the resulting estimates to conform to the assumptions, forming circular logic.

#### Ambiguity in estimation

To motivate the development of TTEPE, consider the ambiguity inherent in analyzing birth prevalence trends using cumulative incidence. How should one interpret a dataset that produces any one of the cumulative incidence curves illustrated in Fig 4? The figure represents synthetic data; some real-world data may be similar. Observed data might produce a curve resembling any one of the curves in the figure. An exponential curve with a coefficient of 0.1 fits all three plotted lines reasonably well. Does this represent a true increase in birth prevalence with a coefficient of 0.1? Does it result from an exponential increase in the effects of diagnostic factors, called diagnostic probability, with no increase in birth prevalence? Perhaps a combination of both? The three similar cumulative incidence curves represent quite different possible explanations. The information shown in Fig 1 is not sufficient to decide which explanation most closely represents reality.

![Fig 4.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/09/30/2020.08.05.20169151/F4.medium.gif)

[Fig 4.](http://medrxiv.org/content/early/2021/09/30/2020.08.05.20169151/F4)

Fig 4. 
Example of cumulative incidence under three models. *β**BP* is the coefficient for birth prevalence; *β**PD* is the coefficient for the probability of diagnosis. Red line with circles represents *β**BP* = 0.1, *β**PD* = 0; green line with squares represents *β**BP* = 0.08, *β**PD* = 0.05; blue line with crosses represents *β**BP* = 0, *β**PD* = 0.134.

Fig 4 illustrates a hypothetical example of cumulative incidence of diagnoses to age ten over 20 consecutive cohorts using synthetic data. The legend lists the parameter sets for the three cases. *β**BP* is the exponential coefficient of birth prevalence *BP* by birth year and *β**PD* is the exponential coefficient of the probability of diagnosis *PD* by diagnostic year. In the case where *β**BP* = 0.1 and *β**PD* = 0, birth prevalence increases at *e*0.1 − 1 = 10.5% per year while the probability of diagnosis is constant over time. Where *β**BP* = 0 and *β**PD* = 0.134, birth prevalence is constant while the probability of diagnosis increases by *e*0.134 − 1 = 14.3% per year. Where *β**BP* = 0.08 and *β**PD* = 0.05, birth prevalence increases at 8.3% per year and the probability of diagnosis increases at 5.1% per year. The data generating process producing these data uses a survival process as detailed in the main paper. An Excel spreadsheet to generate all plots in this paper is available at OSF [4]. The variable *PD* represents the probability of diagnosis, which is the effect of diagnostic factors. The values and trends of cumulative incidence do not provide enough information to discern the relative contributions of the trends in birth prevalence and the probability of diagnosis. While the three cumulative incidence curves appear similar, the age distributions of diagnoses are strikingly different for different parameter sets, as Fig 5 illustrates.

![Fig 5.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/09/30/2020.08.05.20169151/F5.medium.gif)

[Fig 5.](http://medrxiv.org/content/early/2021/09/30/2020.08.05.20169151/F5)

Fig 5. 
Distribution of diagnoses in the first and last cohorts under three models. *β**BP* is the coefficient for birth prevalence; *β**PD* is the coefficient for the probability of diagnosis. Red lines with circles represent *β**BP* = 0.1, *β**PD* = 0; green lines with squares represent *β**BP* = 0.08, *β**PD* = 0.5; blue lines with crosses represent *β**BP* = 0, *β**PD* = 0.134.

Fig 2 shows the age distributions of diagnoses in the first and last cohorts of Fig 1, with separate plot lines for each of the three parameter sets. For each cohort, the cumulative incidence to age 10 is very similar across all three parameter sets, despite the very different distributions of diagnoses by age between the parameter sets. The different values and trends in the probability of diagnosis *PD* have a dramatic effect on the age distribution. The distinct age distributions associated with the different parameter sets are sufficient to ascertain the parameter values specifying the trends in Fig 2. The main paper explains how modeling the age distribution of first diagnoses enables accurate and unambiguous estimation of the coefficients for birth prevalence and diagnostic pressure.

## Acknowledgments

The author thanks Dr. Lu Tian for his expert advice on survival analysis methods; Dr. Lorene Nelson and Dr. Kristin Sainani for guidance on my thesis, which was the genesis of this project and for comments on this paper; Dr. Michael Sigman, Dr. Larry Tang and Dr. Walter Zahorodny for their thoughtful reviews of the paper; the Stanford Biomedical Data Science team for their project reviews and insightful comments; and Anne Goff for invaluable editorial assistance.

## Footnotes

*   Revised to be clearer and easier to read, per reviewer comments. Clarifies terms and uses them consistently.

*   Received August 5, 2020.
*   Revision received September 30, 2021.
*   Accepted September 30, 2021.


*   © 2021, Posted by Cold Spring Harbor Laboratory

This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/)

## References

1.  1.Szklo M, Nieto FJ. Epidemiology Beyond the Basics. 1st ed. Burlington (MA): Jones & Bartlett; 2014.
    
    

2.  2.Rothman KJ, Greenland S, Lash TL. Modern Epidemiology. 3rd ed. Philadelphia: Wolters Kluwer; 2008.
    
    

3.  3.Centers for Disease Control. Prevalence of Autism Spectrum Disorders — Autism and Developmental Disabilities Monitoring Network, Six Sites, United States, 2000. MMWR Surveillance Summaries. 2007; 56(SS01);1–11. Available from: [https://www.cdc.gov/mmwr/index.html](https://www.cdc.gov/mmwr/index.html).
    
    

4.  4.Centers for Disease Control. Prevalence of Autism Spectrum Disorders — Autism and Developmental Disabilities Monitoring Network, Six Sites, United States, 2002. MMWR Surveillance Summaries. 2007; 56(SS01);12–28.
    
    

5.  5.Centers for Disease Control. Brief Update: Prevalence of Autism Spectrum Disorders — Autism and Developmental Disabilities Monitoring Network, United States, 2004. MMWR Surveillance Summaries. 2009; 58(SS-10);21–24.
    
    

6.  6.Centers for Disease Control. Prevalence of Autism Spectrum Disorders — Autism and Developmental Disabilities Monitoring Network, United States, 2006. MMWR Surveillance Summaries. 2009; 58(SS-10);1–20.
    
    

7.  7.Centers for Disease Control. Prevalence of Autism Spectrum Disorders — Autism and Developmental Disabilities Monitoring Network, 14 Sites, United States, 2008. MMWR Surveillance Summaries. 2012;61(SS-3):1–19.
    
    

8.  8.Centers for Disease Control. Prevalence of Autism Spectrum Disorders — Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2010. MMWR Surveillance Summaries. 2014;63(SS-2):1–21.
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000330627600001&link_type=ISI) 

9.  9.Centers for Disease Control. Prevalence of Autism Spectrum Disorders — Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2012. MMWR Surveillance Summaries. 2018;65(13):1–23.
    
    

10. 10.Centers for Disease Control. Prevalence of Autism Spectrum Disorders — Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2014. MMWR Surveillance Summaries. 2018;67(6):1–23.
    
    

11. 11.Centers for Disease Control. Prevalence of Autism Spectrum Disorders — Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2016. MMWR Surveillance Summaries. 2020;69(4):1–12.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.15585/MMWR.SS6904A1&link_type=DOI) 

12. 12.Myers SM, Voigt RG, Colligan RC, Weaver AL, Storlie CB, Stoeckel RE et al. Autism Spectrum Disorder: Incidence and Time Trends Over Two Decades in a Population-Based Birth Cohort. J Autism Dev Disord 2019;49:1455–1474. Available from: [https://doi.org/10.1007/s10803-018-3834-0](https://doi.org/10.1007/s10803-018-3834-0)
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s10803-018-3834-0&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=30519787&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2020.08.05.20169151.atom) 

13. 13.Fombonne E. Epidemiology of pervasive developmental disorders. Pediatr Res. 2009;65(6):591–598.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1203/PDR.0b013e31819e7203&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19218885&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2020.08.05.20169151.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000266271800001&link_type=ISI) 

14. 14.Elsabbagh M, Divan G, Koh Y-J, Kim YS, Kauchali S, Marcin C, et al. Global prevalence of autism and other pervasive developmental disorders. Autism Research. 2012;5:160–179.
    
    

15. 15.1.  Matson JL, 
    2.  Sturmey P
    
    Campbell CA, Davarya S, Elsabbagh M, Madden L, Fombonne E. Prevalence and the Controversy. In: Matson JL, Sturmey P, editors. International Handbook of Autism and Pervasive Developmental Disorders. New York: Springer; 2011 pp. 25–35.
    
    

16. 16.Sasayama D, Kuge A, Toiban Y, Honda H. Tends in Autism Spectrum Disorder Diagnoses in Japan, 2009-2019. JAMA Network Open. 2021;4(5):e219234. doi:10.1001/jamanetworkopen.2021.9234
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jamanetworkopen.2021.9234&link_type=DOI) 

17. 17.Keyes KM, Susser E, Cheslack-Postava K, Fountain C, Liu K, Bearman PS. Cohort effects explain the increase in autism diagnosis among children born from 1992 to 2003 in California. Int J Epidemiol. 2012;41(2):495–503
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/ije/dyr193&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22253308&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2020.08.05.20169151.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000302500200028&link_type=ISI) 

18. 18.King M, Bearman P. Diagnostic change and the increased prevalence of autism. Int J Epidemiol. 2009; 38:1224–1234.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/ije/dyp261&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19737791&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2020.08.05.20169151.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000271101800011&link_type=ISI) 

19. 19.Hansen SN, Schendel DE, Parner ET. Explaining the Increase in the Prevalence of Autism Spectrum Disorders: The Proportion Attributable to Changes in Reporting Practices. JAMA Pediatr. 2015;169(1):56–62. doi:10.1001/jamapediatrics.2014.1893
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jamapediatrics.2014.1893&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25365033&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2020.08.05.20169151.atom) 

20. 20.Newschaffer CJ, Croen LA, Daniels J, Giarelli E, Grether JK, Levy LA, et al. The Epidemiology of Autism Spectrum Disorders. Annu Rev Public Health. 2007;28:235–258.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1146/annurev.publhealth.28.021406.144007&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=17367287&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2020.08.05.20169151.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000246436700015&link_type=ISI) 

21. 21.GBD 2017 Disease and Injury Incidence and Prevalence Collaborators. Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990–2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet. 2018;392:1789–858. Suppl 1.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S0140-6736(18)32279-7&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=30496104&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2020.08.05.20169151.atom) 

22. 22.National Birth Defects Prevention Network. Guidelines for Conducting Birth Defects Surveillance: Chapter 8, Statistical Methods. 2004. Available at: [https://www.nbdpn.org/docs/Ch\_8\_Statistics6-04\_2016DEC14.pdf](https://www.nbdpn.org/docs/Ch_8_Statistics6-04_2016DEC14.pdf)
    
    

23. 23.Centers for Disease Control. Birth Defects Surveillance Toolkit: 3.2 Population Coverage. Available at: [https://www.cdc.gov/ncbddd/birthdefects/surveillancemanual/facilitators-guide/module-3/mod3-2.html](https://www.cdc.gov/ncbddd/birthdefects/surveillancemanual/facilitators-guide/module-3/mod3-2.html). Accessed August 10, 2021.
    
    

24. 24.Larsson HJ, Eaton WW, Madsen KM, Vestergaard M, Olesen AV, Agerbo E, et al. Risk Factors for Autism: Perinatal Factors, Parental Psychiatric History, and Socioeconomic Status. Am J Epidemiol. 2005;161:916–925
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/aje/kwi123&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=15870155&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2020.08.05.20169151.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000228930000002&link_type=ISI) 

25. 25.Wolff JJ, Piven J. Predicting Autism in Infancy. J Am Acad Child Adolesc Psychiatry. 2021;60(8):958–967
    
    

26. 26.Hansen SN, Overgaard M, Andersen PK, Parner ET. Estimating a population cumulative incidence under calendar time trends. BMC Med Res Methodol. 2017;17:7.
    
    

27. 27.MacInnis AG. Autism Prevalence Trends by Birth Year and Diagnostic Year: Indicators of Etiologic and Non-Etiologic Factors – an Age Period Cohort Problem [thesis]. Stanford (CA): Stanford University; 2017 DOI: 10.13140/RG.2.2.11821.59360. Available from: [https://purl.stanford.edu/kz506jj7466](https://purl.stanford.edu/kz506jj7466)
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.13140/RG.2.2.11821.59360&link_type=DOI) 

28. 28.Sheldrick RD, Maye MP, Carter AS. Age at First Identification of Autism Spectrum Disorder: An Analysis of Two US Surveys. J Am Acad Child Adolesc Psychiatry. 2017;65(4):313:320
    
    

29. 29.American Psychiatric Association. DSM History. Accessed August 3, 2021. Available from: [https://www.psychiatry.org/psychiatrists/practice/dsm/history-of-the-dsm](https://www.psychiatry.org/psychiatrists/practice/dsm/history-of-the-dsm)
    
    

30. 30.Morris-Rosendahl DJ, Crocq MA. Neurodevelopmental disorders—the history and future of a diagnostic concept. Dialogues Clin Neurosci. 2020;22(1):65–72. doi:10.31887/DCNS.2020.22.1/macrocq
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.31887/DCNS.2020.22.1/macrocq&link_type=DOI) 

31. 31.Croen LA, Grether JK, Hoogstrate J, Selvin S. The Changing Prevalence of Autism in California. J Autism Dev Disord. 2002;32(3):207–215.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1023/A:1015453830880&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=12108622&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2020.08.05.20169151.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000175593800008&link_type=ISI) 

32. 32.Nevison C, Blaxill M, Zahorodny W. California Autism Prevalence Trends from 1931 to 2014 and Comparison to National ASD data from IDEA and ADDM. J Autism Dev Disord. 2018; (doi.org/10.1007/s10803-018-3670-2). Suppl S1.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s10803-018-3670-2&link_type=DOI) 

33. 33.McKenzie K, Milton M, Smith G, Ouellete-Kuntz H. Systematic Review of the Prevalence and Incidence of Intellectual Disabilities: Current Trends and Issues. Cur Dev Disord Rep. 2016;3:104–115.
    
    

34. 34.Baxter AJ, Brugha TS, Erskine HE, Scheurer RW, Vos T, Scott JG. The epidemiology and global burden of autism spectrum disorders. Psychol Med. 2015;45(3):601–613.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1017/S003329171400172X&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25108395&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2020.08.05.20169151.atom) 

35. 35.Schisterman EF, Cole SR, Platt RW. Overadjustment Bias and Unnecessary Adjustment in Epidemiologic Studies. Epidemiology. 2009;20(4):488–495.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1097/EDE.0b013e3181a819a1&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19525685&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2020.08.05.20169151.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000267065500003&link_type=ISI) 

36. 36.Rodgers WL. Estimable Functions of Age, Period, and Cohort Effects. Am Sociol Rev. 1982;47(6):774–787.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.2307/2095213&link_type=DOI) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=A1982PU66600007&link_type=ISI) 

37. 37.O’Brien RM. Age-Period-Cohort Models. Boca Raton (FL): CRC Press; 2015.
    
    

38. 38.Ljung J, Glad T. On Global Identifiability for Arbitrary Model Parameterizations. Automatica. 1994;30(2):256–276.
    
    

39. 39.Spiers N. Cohort effects explain the increase in autism diagnosis among children born from 1992 to 2003 in California [letter]. Int J Epidemiol. 2013;42:1520–1521.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/ije/dyt029&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24159079&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2020.08.05.20169151.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000326726000045&link_type=ISI) 

40. 40.Hertz-Picciotto I, Delwiche L. The Rise in Autism and the Role of Age at Diagnosis. Epidemiology. 2009;20(1):84–90.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1097/EDE.0b013e3181902d15&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19234401&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2020.08.05.20169151.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000261930800016&link_type=ISI) 

41. 41.Hyman SL, Levy SE, Myers SM, AAP Council on Children with Disabilities, Section on Developmental and Behavioral Pediatrics. Identification, Evaluation, and Management of Children With Autism Spectrum Disorder. Pediatrics. 2020;145(1):e20193447. DOI: 10.1542/peds.2019-3447.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTA6InBlZGlhdHJpY3MiO3M6NToicmVzaWQiO3M6MTU6IjE0NS8xL2UyMDE5MzQ0NyI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIxLzA5LzMwLzIwMjAuMDguMDUuMjAxNjkxNTEuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

42. 42.Shattuck PT, Durkin M, Maenner M, Newschaffer C, Mandell DS, Wiggins L, et al. Timing of Identification Among Children With an Autism Spectrum Disorder: Findings From a Population-Based Surveillance Study. J Am Acad Child Adolesc Psychiatry. 2009;48(45):474–483.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1097/CHI.0b013e31819b3848&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19318992&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2020.08.05.20169151.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000265461000005&link_type=ISI) 

43. 43.Maenner MJ, Schieve LA, Rice CE, Cuniff C, Giarelli E, Kirby RS, et al. Frequency and Pattern of Documented Diagnostic Features and the Age of Autism Identification. J Am Acad Child Adol Psychiatry. 2013;52(4):401–413
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jaac.2013.01.014&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23582871&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2020.08.05.20169151.atom) 

44. 44.Kalbfleisch JD, Prentice RL. The Statistical Analysis of Failure Time Data. 2nd ed. Hoboken (NJ): Wiley; 2002.
    
    

45. 45.MacInnis AG. Time-to-event Prevalence Estimation TTEPE [software]. 2020. OSF repository. Available from: [https://doi.org/10.17605/OSF.IO/WPNKU](https://doi.org/10.17605/OSF.IO/WPNKU).
    
    

46. 46.American Academy of Pediatrics Council on Children with Disabilities. Identifying Infants and Young Children with Developmental Disorders in the Medical Home: An Algorithm for Developmental Surveillance and Screening. Pediatrics. 2006;118;405. DOI: 10.1542/peds.2006-1231
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTA6InBlZGlhdHJpY3MiO3M6NToicmVzaWQiO3M6OToiMTE4LzEvNDA1IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDkvMzAvMjAyMC4wOC4wNS4yMDE2OTE1MS5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

47. 47.Al-Qabandi M, Gorter JW, Rosenbaum P. Early Autism Detection: Are We Ready for Routine Screening? Pediatrics. 2011;128;e211. DOI: 10.1542/peds.2010-1881.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTA6InBlZGlhdHJpY3MiO3M6NToicmVzaWQiO3M6MTA6IjEyOC8xL2UyMTEiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMS8wOS8zMC8yMDIwLjA4LjA1LjIwMTY5MTUxLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

48. 48.Lord C, Bishop SL. “Let’s Be Clear That “Autism Spectrum Disorder Symptoms” Are Not Always Related to Autism Spectrum Disorder”. Am J Psychiatry. 2021;178(8).
    
    

49. 49.Zwaigenbaum L, Penner M. Autism spectrum disorder: advances in diagnosis and evaluation. BMJ. 2018;361:k1674.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE3OiIzNjEvbWF5MjFfNS9rMTY3NCI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIxLzA5LzMwLzIwMjAuMDguMDUuMjAxNjkxNTEuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

50. 50.Hosmer DW, Lemeshow S, Sturdivant RX. Applied Logistic Regression. 3rd ed. Hoboken (NJ): Wiley; 2013.
    
    

51. 51.Morris TP, White IR, Crowther MJ. Using simulation studies to evaluate statistical methods. Stat Med. 2019;38:2074–2102.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/sim.8086&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2020.08.05.20169151.atom) 

52. 52.Cox DR. Regression Models and Life Tables. J R Stat Soc Series B Stat Methodol. 1972;34(2):187–220.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/j.2517-6161.1972.tb00899.x&link_type=DOI) 

53. 53.Ozonoff S, Young GS, Brian J, Charman T, Shephard E, Solish A, Zwaigenbaum L. Diagnosis of Autism Spectrum Disorder After Age 5 in Children Evaluated Longitudinally Since Infancy. J Am Acad Child Adolesc Psychiatry. 2018; 57(11):849–857.
    
    

54. 54.Szatmari P, Georgiades S, Duku E, et al. Pathways in ASD Study Team. Developmental trajectories of symptom severity and adaptive functioning in an inception cohort of preschool children with autism spectrum disorder. JAMA Psychiatry 2015;72:276–83. doi:10.1001/jamapsychiatry.2014.2463 pmid:25629657.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jamapsychiatry.2014.2463&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25629657&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2020.08.05.20169151.atom) 

55. 55.Giserman-Kiss I, Carter AS. Stability of Autism Spectrum Disorder in Young Children with Diverse Backgrounds. Journal of Autism and Developmental Disorders. 2020;50:3263–3275 doi:10.1007/s10803-019-04138-2.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s10803-019-04138-2&link_type=DOI) 

## References

1.  1.Rodgers WL. Estimable Functions of Age, Period, and Cohort Effects. Am Sociol Rev. 1982;47(6):774–787.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.2307/2095213&link_type=DOI) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=A1982PU66600007&link_type=ISI) 

2.  2.O’Brien RM. Age-Period-Cohort Models. Boca Raton (FL): CRC Press; 2015.
    
    

3.  3.MacInnis AG. Autism Prevalence Trends by Birth Year and Diagnostic Year: Indicators of Etiologic and Non-Etiologic Factors – an Age Period Cohort Problem [thesis]. Stanford (CA): Stanford University; 2017 DOI: 10.13140/RG.2.2.11821.59360. Available from: [https://purl.stanford.edu/kz506jj7466](https://purl.stanford.edu/kz506jj7466)
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.13140/RG.2.2.11821.59360&link_type=DOI) 

4.  4.MacInnis AG. Time-to-event Prevalence Estimation TTEPE software and spreadsheet. DOI 10.17605/OSF.IO/WPNKU. Available from: [https://osf.io/wpnku/](https://osf.io/wpnku/)
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.17605/OSF.IO/WPNKU&link_type=DOI)

 [1]: /embed/inline-graphic-1.gif
 [2]: /embed/graphic-3.gif
 [3]: /embed/graphic-4.gif
 [4]: /embed/graphic-5.gif
 [5]: /embed/graphic-6.gif
 [6]: /embed/graphic-7.gif
 [7]: /embed/graphic-8.gif
 [8]: /embed/graphic-9.gif
 [9]: /embed/graphic-10.gif
 [10]: /embed/graphic-11.gif
 [11]: /embed/graphic-12.gif
 [12]: /embed/inline-graphic-2.gif
 [13]: /embed/graphic-13.gif
 [14]: /embed/graphic-14.gif
 [15]: /embed/inline-graphic-3.gif
 [16]: /embed/inline-graphic-4.gif
 [17]: /embed/inline-graphic-5.gif
 [18]: /embed/inline-graphic-6.gif
 [19]: /embed/inline-graphic-7.gif
 [20]: /embed/inline-graphic-8.gif
 [21]: /embed/graphic-15.gif
 [22]: /embed/graphic-16.gif
 [23]: /embed/graphic-17.gif
 [24]: /embed/inline-graphic-9.gif
 [25]: /embed/inline-graphic-10.gif
 [26]: /embed/inline-graphic-11.gif
 [27]: /embed/inline-graphic-12.gif
 [28]: /embed/inline-graphic-13.gif
 [29]: /embed/inline-graphic-14.gif
 [30]: /embed/inline-graphic-15.gif
 [31]: /embed/inline-graphic-16.gif
 [32]: /embed/inline-graphic-17.gif
 [33]: /embed/inline-graphic-18.gif
 [34]: /embed/inline-graphic-19.gif