Cognitive, emotional, and social functioning of preschoolers with attention deficit hyperactivity problems
==========================================================================================================

* Guido Biele
* Kristin R. Overgaard
* Svein Friis
* Pal Zeiner
* Heidi Aase

## Abstract

Attention Deficit Hyperactivity Disorder (ADHD) is associated with deficits in a number of functional domains, which have been described both as causes and effects of ADHD. It remains unclear if deficits in different domains are equally strong in early childhood, and which deficits are specific to ADHD. Here, we describe functional domains in preschoolers and assess deficits in children with ADHD problems, by comparing them to preschoolers who have other mental health problems or who develop typically. The ADHD Study assessed 1195 ca. 3.5 years old preschoolers through a semi-structured parent interview, parent questionnaires, and with neuropsychological tests. We determined functional domains by applying factor analytic methods to a broad set of questionnaire- and test-scales. Using resulting factor scores, we employed a Bayesian hierarchical regression to estimate functional deficits in children with ADHD. We found that preschoolers’ functioning could be described along the seven relatively independent dimensions activity level and regulation, executive function, cognition, language, emotion regulation, introversion, and sociability. Compared to typically developing preschoolers, those with ADHD had deficits in all domains except introversion and sociability. Only deficits in activity level and regulation and executive functions were larger than 0.5 standardized mean deviations and larger than deficits of children with other mental health problems. Preschoolers with ADHD have deficits in multiple functional domains, but only impairments in activity level and regulation and executive functions are specific for ADHD and large enough to be clinically significant. Research on functioning in these domains will likely be central for understanding the development of ADHD in later the childhood, and for improving treatment and prevention approaches.

Keywords
*   ADHD
*   Activity level
*   Cognition
*   Affect
*   Emotion
*   Social
*   RDoC
*   Impairment
*   Anxiety
*   Behavior problems
*   Language problems
*   Functions

Attention Deficit Hyperactivity Disorder (ADHD) is a neurodevelopmental disorder characterized by symptoms of inattention, impulsivity, and hyperactivity (Thapar and Cooper, 2016). Children with ADHD have difficulties in a number of functional domains, including cognition, language, and social behavior (Willcutt et al., 2008; Larson et al., 2011). While ADHD symptoms have been described as a cause of functional deficits (e.g. Rommel et al., 2015), a review of prominent ADHD theories shows that functions such as executive cognition or reward processing are also seen as causes for the development of ADHD symptoms (Ziegler et al., 2016). Whereas there is a general agreement that children with ADHD have difficulties in several domains, the relative strength and specificity of functional deficits in different domains remains unclear, especially in early childhood.

The current Diagnostic and Statistical Manual of Mental Disorders (DSM 5, American Psychiatric Association, 2013) prescribes assessment of functioning in the domains Cognition, Mobility, Self-care, Getting along, Life activities and Participation with the WHO Disability Assessment Schedule 2.0 (Ustun et al., 2010). The DSM-5 also defines five neurocognitive domains for the diagnosis of neurocognitive disorders (Sachdev et al., 2014), which are closer to how functional domains are described in basic research about ADHD (Nikolas and Nigg, 2013; Mueller et al., 2017). For this article, we define functional domains as groups of mental processes that are more closely related to each other than to mental processes from other domains.

Investigating deficits in different functional domains has been proposed to improve the understanding of mental health disorders. The Research Domain Criteria framework (RDoC, Insel et al., 2010) seeks to understand and explain mental health disorders as a combination of deficits across the domains negative valence systems, positive valence systems, cognitive systems, systems for social processes, and arousal/regulatory systems. Because many ADHD characteristics are thought to be extreme expressions of traits present in the general population, a dimensional approach should be especially useful for understanding ADHD (Baroni and Castellanos, 2015). While researchers have investigated neuropsychological profiles (e.g., Fair et al., 2012; Hulst et al., 2015; Lambek et al., 2018) or temperamental aspects of ADHD (Karalunas et al., 2014), there is a lack of ADHD research that examines psychological functioning across a broad range of domains. Moreover, even though early functional deficits likely play an important role in the development of ADHD symptoms, there is to date little research on functional profiles of preschoolers.

The ADHD Study, a sub-study of the Norwegian Mother and Child Birth Cohort Study (MoBa, Magnus et al., 2006), documented functional deficits in language, executive functions, affect and emotion regulation, and social behavior in preschoolers with ADHD (Skogan et al., 2014, 2015; Overgaard et al., 2016, 2018; Rohrer-Baumgartner et al., 2016; Bendiksen et al., 2017). While these studies demonstrate functional deficits in preschoolers with ADHD and related disorders in a number of domains, the picture remains incomplete. It is unclear if these domains are independent, if deficits compared to typically developing children are equally large in all domains, and which deficits are especially strong in ADHD compared to preschool age children with other mental health or developmental problems. Lastly, the inherent uncertainty of mental health diagnoses in preschoolers (McClellan and Speltz, 2003) raises the question if children who fulfill diagnostic criteria for symptoms *and* impairments have different functional profiles than children who only fulfill symptom criteria.

Hence, the aim of this article is to describe functional domains in preschoolers, and to explore how functional profiles of preschoolers with ADHD problems differ from profiles of children with other mental health problems and typically developing controls. We hypothesize that the broad set of measures collected in the ADHD study is organized in domains similar to those described in the RDoC approach, and that preschoolers with ADHD have the greatest impairments in domains that are related to core ADHD symptoms.

## Methods

### Study design and recruitment of participants

The Norwegian Mother and Child Cohort Study (MoBa) is an ongoing prospective population-based cohort study of Norwegian-speaking women that is conducted by the Norwegian Institute of Public Health (Magnus et al., 2006). The current article is from a clinical sub-study on ADHD, for which Figure S1 shows the recruitment procedure. This study oversampled children at risk for ADHD, by using data from the MoBa questionnaire that was administered to mothers at child age 3 years (Overgaard et al., 2014). The questionnaire included 11 items about ADHD, including six items from the Child Behavior Checklist/1.5-5 (CBCL, Achenbach and Rescorla, 2000) and five items from the DSM-IV-TR criteria for ADHD (American Psychiatric Association, 2000). Children were identified as at risk for ADHD when their sum score from the 11 ADHD symptom questions was at or above the 90th percentile of scores from children in MoBa who were born before 2004, or when the mother indicated hyperactivity-related health problems. In addition to 2801 preschoolers at risk for ADHD, 651 control participants were invited to participate. In total, about 35% agreed to participate in the ADHD Study, and from 2007 to 2011, 1195 children (mean age: 3.5 years, age range: 3.1 to 3.8 years) took part in a 1-day clinical assessment.

## Material

The study used the semi-structured clinical parent-interview “Preschool Age Psychiatric Assessment” (PAPA, Egger and Angold, 2004) to assess mental health symptoms. The PAPA interview elicits, based on DSM IV diagnostic classifications, information about symptoms and impairments for many mental health disorders of the childhood. This includes ADHD, conduct disorder, oppositional defiant disorder, and anxiety disorders. In the ADHD study, only symptoms lasting longer than 3 months were counted as present. The ADHD Study modified the PAPA by adding a section about impairments for each mental health problem (details in the supplementary materials). As an inter-rater reliability check, a separate rater who was blind to the parent and teacher screen ratings re-scored audiotapes of 79 randomly selected assessment interviews. The average intra-class correlations (ICCs) were .97 for HI symptoms, .99 for IA symptoms, and .98 for the total number of ADHD symptoms.

This research used data from following parent questionnaires: The Behavior Rating Inventory of Executive Function–preschool version (BRIEF–P, Gioia et al., 2002, 2007) assesses functional deficits on the sub-scales *inhibit, shift, emotional control, working memory*, and *plan and organize*. From the language section of the Child Development Inventory (CDI, Ireton and Glascoe, 1992, 1995) we used 50 items to score expressive language. The Children’s Behavior Questionnaire (CBQ, Putnam and Rothbart, 2006) is a temperament questionnaire with 50 items grouped into the sub scales *activity level, anger, attention focusing, discomfort, fear, high intensity pleasure, low intensity pleasure, impulsivity, inhibitory control, perceptual sensitivity, sadness*, and *soothability*. The Emotionality, Activity and Shyness temperament questionnaire (EAS, Buss and Plomin, 1984; Mathiesen and Tambs, 1999) uses 12 items to score preschoolers on the sub-scales *activity, emotion, shyness*, and *sociability*.

The ADHD Study used a sub-set of the NEuroPSYchological Assessment Battery tests (NEPSY, Korkman et al., 1998, 2000), including those to assess *inhibition, visual attention, visuospatial processing*, and *language*. The Norwegian version of the Boston Naming Test (BNT, Kaplan et al., 1983) assess expressive language. From the Stanford-Binet Intelligence Scales 5th ed. (Roid, 2003) the ADHD study used the Verbal Memory for Sentences test (VMS) as an indicator of *verbal working memory*, the Delayed Response task/Block Span test (DR/BS) as an indicator of *nonverbal working memory*, the Object series, Pattern analysis/Matrices tests (OS/PAM) as an indicator of *nonverbal IQ* and the Comprehension/Vocabulary tests (CM) as an indicator for *verbal IQ*. Finally, the ADHD study used a version of the Cookie Delay Task (CDT) to assess delay aversion. See the supplementary information for further details about the instruments.

### Procedure

Parents who had consented to participate received questionnaires around 4 weeks before the assessment day. For the clinical assessment, all participants traveled to Oslo University Hospital. At the assessment day clinical psychologists or psychiatrist conducted neuropsychological tests and medical examinations in dedicated rooms. Trained graduate students in psychology conducted the PAPA parent interview under supervision of clinical experts. The assessment day concluded with a debriefing for parents.

The present study was approved by the Norwegian Regional Ethics Committee for Medical and Health related Research.

### Data analysis

All analyses were performed with R (R Core Team, 2019) or Mplus (Muthen and Muthen, 2017). The supplementary information contains additional analysis details.

### Classification of participants into problem groups

Classifications were determined by an algorithm that applied DSM IV symptom and impairment criteria to PAPA data. Children were classified as having ADHD, behavioral (Oppositional Defiant or Conduct Disorder) or anxiety (Social, Separation, or Generalized Anxiety, Phobia) problems with impairment, if they fulfilled DSM IV symptom and impairment criteria. They were classified as having problems without impairment, if they fulfilled only symptom criteria. We also used clinicians’ global evaluation of the presence and impairing nature of language problems. Preschoolers who had multiple but only one impairing problem, were classified based on this problem. Children with multiple impairing problems were classified into the first of the following problem-groups for which they fulfilled diagnostic criteria: 1. ADHD, 2. behavior, 3. anxiety, and 4. language problems. Children without a mental health problem were categorized as typically developing. (See also Figures S3 and S4.)

### Choice and scoring of tests and scales

We included scales and tests that measure psychological functioning and for which data from at least 70% of the children was available. These are the abbreviated sub-scales of the Stanford Binet test, NEPSY, CDT, BNT, the language section of the CDI, and all sub-scales from the BRIEF-P, CBQ, EAS questionnaires.

All tests except the BNT were scored based on the published test manuals. BNT and questionnaire sub-scales were scored by estimating Rasch Item Response Theory models (Rasch, 1960) for each sub-scale of a questionnaire.

### Identification of functional domains through Exploratory Structural Equation Modeling

This step used test- and trait-scores calculated in the previous step. An initial analysis used a confirmatory factor analysis to examine if a theory-based assignment of scales to RDoC domains fitted the data well. For the data driven identification of functional domains we estimated exploratory structural equation models (ESEM). Lastly, we used CFA to explore if the model structure of the best ESEM factor model could be simplified by setting weak cross loadings to zero. Factor scores from the final model capture individual functioning in the different domains and were basis for further analyses.

### Comparison of functioning across functional domains and groups

We employed a Bayesian hierarchical linear regression model to examine associations of mental health problems and functioning in all domains simultaneously, while also taking into account that associations might vary across gender and groups with different problems and degrees of impairment. By estimating the model in a Bayesian framework with weakly informative priors, one can reliably estimate variation in effect sizes between groups, and automatically control the multiple comparison problem (Gelman et al., 2012).

Consistent with recent recommendations about statistical practice (Sullivan and Feinn, 2012; Wasserstein et al., 2019) we report effect size means and the 90% credible intervals instead of p-values. To communicate the probability of clinically significant impairments or differences between groups, we report posterior probabilities that a difference is larger than 0.5 standardized mean differences (SMD).

### The study sample

Parents of 40% of at risk for ADHD and 25% of control children consented to participate. Altogether 1195 children participated in the assessment, of which 1184 children had less than 50% of missing data on tests and scales of interest. Of these participants, 219 fulfilled DSM IV ADHD symptom criteria (168 with and 51 without impairment). Table 1 describes the study sample.

View this table:
[Table 1](http://medrxiv.org/content/early/2021/02/20/2021.02.18.21251985/T1)

Table 1 
Study sample

## Results

### Dimensions of functioning

Initial CFAs, for which sub-scales were on theoretical grounds assigned to RDoC domains, did not describe the data sufficiently well (see Table S1). The final ESEM analysis showed that a 7-factor model was the simplest model that could adequately describe the data (RMSEA = 0.03 (0.028, 0.037), CFI = 0.96). Because follow up CFA analyses that constrained small cross-loadings to 0 resulted in unsatisfactory RMSEA and CFI statistics, we retained the final ESEM model as the best model of functional domains.

Table S2 and Figure S5 show the factor loadings from the best ESEM model. This suggests following factors: *activity level and regulation* (AL, the ability to down-regulate physical activity), *executive functions* (EF, the ability to regulate behavior and cognitive functions), *cognition* (CO, working memory and cognitive flexibility), *language* (LA), *emotion regulation* (ER, the ability to control emotions), *introversion* (IN, the preference for calm activities), and *sociability* (SO, the ability to get into contact with others).

The average of the unsigned factor correlations was 0.15. Following factor correlations were larger than 0.30: r(LA,CO) = 0.39, r(EF,AL) = 0.32, r(ER,EF) = 0.32 (c.f. Table S3).

### Functional profiles of preschoolers with ADHD problems

Across all domains, functioning of preschoolers with ADHD was −0.42 standardized mean differences (SMD) below the functioning of typically developing preschoolers. The average SMDs for preschoolers with ADHD with and without impairment were −0.55 and −0.30, respectively. Preschoolers with language problems had functioning deficits similar to preschoolers with ADHD, whereas children with behavior or anxiety problems had milder deficits (c.f. Table S4).

Figure 1 and Table 2 show functional profiles. Preschoolers with ADHD were particularly impaired in the domains EF and AL, where their functioning was around −0.90 SMD below that of typically developing controls (*P* (*SMD < −*0.5)=1). In comparison, functioning levels of preschoolers with ADHD in the domains CO, LA and ER was only around −0.50 SMD below typically developing controls (*P* (*SMD < −*0.5)=0.56).

![Figure 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/02/20/2021.02.18.21251985/F1.medium.gif)

[Figure 1.](http://medrxiv.org/content/early/2021/02/20/2021.02.18.21251985/F1)

Figure 1. 
Comparison of preschoolers with ADHD with typically developing preschoolers (TDC). Values below zero indicate deficits in preschoolers with ADHD. Boxes cover 50% highest density intervals (HDIs), thin vertical lines cover 90% HDIs. The two solid horizontal lines enclose a range from −0.5 to 0.5 SMD.

View this table:
[Table 2](http://medrxiv.org/content/early/2021/02/20/2021.02.18.21251985/T2)

Table 2 
Differences in functioning between preschoolers with ADHD and preschoolers with no or other problems.

Functioning in the domains SO and IN did not differ substantially from typically developing controls (average SMD=0; *P* (*SMD < −*0.5)=0). Preschoolers with ADHD with and without impairment had similar functioning patterns. However, with exception of the domains CO and SO, those with impairment had around 0.30 SMD larger deficits than those without. We found overall small gender differences. Only in SO did boys with ADHD show somewhat weaker deficits than girls.

Figure 2 and Tables 2 and S7 report comparisons between preschoolers with ADHD and those with other mental health or developmental problems. Only deficits in AL (with impairment: SMD = −1.04 (−1.23, −0.86; P(SMD<-.5)=1.00), without impairment: SMD = −0.74 (−0.98, −0.49; P(SMD<-.5)=0.94)) and EF (with impairment: SMD = −0.61 (−0.79, −0.42; P(SMD<-.5)=0.84)), without impairment: SMD = −0.35 (−0.59, −0.11; P(SMD<-.5)=0.15)) were larger in preschoolers with ADHD, compared to preschoolers with other mental health problems. Preschoolers with ADHD had only moderately more difficulties in CO (with impairment: SMD = −1.04 (−1.23, −0.86; P(SMD<-.5)=1.00), without impairment: SMD = −0.74 (−0.98, −0.49; P(SMD<-.5)=0.94)) compared to preschoolers with other mental health problems, and similar or fewer difficulties in the domains LA, ER, IN, or SO (with impairment: SMD = 0.14 (0.04, 0.25; P(SMD<-.5)=0.00)), without impairment: SMD = 0.28 (0.15, 0.41; P(SMD<-.5)=0.00)). In particular, children with ADHD had much weaker LA deficits than preschoolers with impairing language problems (with impairment: SMD = 1.20 (0.89, 1.53; P(SMD<-.5)=0.00), without impairment: SMD = 0.86 (0.58, 1.14; P(SMD<-.5)=0.00)), and were more sociable than children with impairing anxiety problems (with impairment: SMD = 1.12 (0.87, 1.38; P(SMD<-.5)=0.00), without impairment: SMD = 0.82 (0.52, 1.13; P(SMD<-.5)=0.00)). Figure 3 summarises the comparisons and highlights that, whereas preschoolers with ADHD are impaired compared to TDC in most functional domains, only impairments of AL and EF are specific to ADHD in that they are larger than 0.5 SMD compared to TDC and also larger than deficits of preschoolers with other mental health problems. See Table S6 for more details.

![Figure 2.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/02/20/2021.02.18.21251985/F2.medium.gif)

[Figure 2.](http://medrxiv.org/content/early/2021/02/20/2021.02.18.21251985/F2)

Figure 2. 
Comparison of preschoolers with ADHD with preschoolers with other mental health problems. Relative functioning is calculated as the factor score difference between ADHD group and comparison group. Values below zero indicate that the comparison group has less problems than preschoolers with ADHD.

![Figure 3.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/02/20/2021.02.18.21251985/F3.medium.gif)

[Figure 3.](http://medrxiv.org/content/early/2021/02/20/2021.02.18.21251985/F3)

Figure 3. 
Joint comparison of factor scores for preschoolers with ADHD with typically devel-oping preschoolers (TDC, on the x-axis) and those with other mental health problems (MHP, on the y-axis). Differences are averaged across preschoolers with and without impairment. Values below zero indicate that preschoolers with ADHD have stronger problems than the comparison group. Ellipses cover 90% highest density intervals. Labels in ellipses indicate functional domains. Domains in the lower left rectangle are those where preschoolers with ADHD have a 0.5 SMD large deficit compared to TDC and children with other MHPs. SeeFigure S10 for comparisons with specific other MHPs.

## Discussion

The aim of the current study was to describe domains of functioning in preschoolers and to compare functioning of preschoolers with ADHD problems with that of preschoolers with other or no problems. We identified seven weakly correlated functional domains: Executive functioning (EF), activity level and regulation (AL), cognition (CO), language (LA), introversion (IN), emotion regulation (ER) and sociability (SO). Compared to typically developing children, functional deficits of preschoolers with ADHD were especially pronounced in AL and EF, less pronounced in CO, LA, and ER, and absent in SO and IN. Compared to children with anxiety, behavior or language problems, children with ADHD had similar or weaker deficits in all domains except AL and EF, where they had substantially greater impairments. Therefore, only EF and AL impairments appear specific to children with ADHD problems.

To identify functional domains, we used results from a broad range of instruments, including neuropsychological and performance tasks, and parent-questionnaires about cognitive functioning and temperament (personality traits). We chose this range of measures, because both performance-based and temperamental traits can contribute to mental health problems (Fair et al., 2012; Karalunas et al., 2014). More generally, temperamental and performance-based traits of individuals are relatively stable over time and correlated with each other (Ackerman and Heggestad, 1997). Therefore, we reason that joint examination of temperament and performance based aspects of behavior are important for understanding ADHD and its development. This view is also supported by our finding that that preschoolers with ADHD have deficits in the temperamental (Activity level and regulation) and the performance domain (executive functions).

A likely reason for divergences between our and the RDoC domains is that the set of instruments used influences the what domains a study recovers. The use of many instruments to assess language and cognition likely contributed to our identification of two domains in this area, whereas the sparse assessment of reward processing likely impeded us from identifying such a domain or even specific concepts within reward processing like reinforcement learning of delay aversion. Still, we view the domains identified in the ADHD Study data as broadly consistent with the RDoC domains.

Similar to earlier investigation, we observed only small correlations between assessments of the same construct with parent-questionnaires and tests. Toplak et al. (2013) hypothesized that the low correlation could be explained by the fact that tests primarily measure the ability to perform a task, whereas questionnaires in addition measure the ability to independently focus energy in a goal-oriented manner. This interpretation assumes that both instrument types reliably measure traits and abilities. The low correlations could also be due to unsystematic and systematic errors in both instrument types. For example, tests can measure state in addition to trait, and questionnaires suffer from response biases or varying understanding fo parents about what behavior is normative. Repeated administration of tests would provide the most reliable information and should if possible be used in the assessment of children.

As expected, we found the largest deficits of children with ADHD in the domains of activity level and regulation and executive functions. The prominence of EF and AL impairments is consistent with a dual pathways view of the development of ADHD, which suggests that ADHD can be caused by earlier functional deficits (Sonuga-Barke, 2003). While the original formulation of the dual pathway hypothesis highlights deficits in EF and reward processing as key causes for the development of ADHD symptoms, we only find direct evidence for early EF deficits, likely due to the sparse assessment of reward processing in the ADHD study. Still, our results provide indirect evidence for the early reward processing deficits, if one considers that some ADHD theories suggest that a heightened activity level is an indicator for impaired reward processing (Sagvolden et al., 2005; Ziegler et al., 2016). Still, future studies should put more emphasis on the assessment of reward processing in early childhood, in order to improve the understanding of its role on the development of ADHD symptoms. The prominence of AL and EF deficits in early childhood raises the likelihood that they are causes of later deficits in the other domains.

While the broadness of functions investigated in the ADHD Study and the large sample size set this study apart, some aspects of the study suggest caution when generalizing results to the broader population. The sample composition, which is characterized by self-selection into the study based on high parental education, high parental ratings of preschool ADHD symptoms, and absence of children with ASD (which were recruited into a sister study on ASD, (Stoltenberg et al., 2010)), does not fully reflect the population of preschoolers with ADHD problems. Regarding the absences of children with ASD, additional comparisons based on the ABC study sample shown in the supplementary materials (Figures S11 and following) suggest that the differences between children with and without ADHD we found are not unique to the ADHD Study sample. Still, given the sample characteristics, the presented results generalize most readily to a population of preschoolers at risk to develop ADHD and with relatively well-educated parents.

The current study is of exploratory nature and reports only cross-sectional associations between different functional domains. Nevertheless, the presented results suggest that because impairments in AL and EF are much stronger and central than other deficits, first choice treatment of preschoolers with ADHD from populations similar to the study sample should focus on these areas, because other functional deficits will typically be less severe. Future research on cross-lagged associations between functioning in different domains (c.f. Arnett et al., 2012) is needed to investigate the causal role of EF and AL for later development, and to inform if focus of treatment in these domains is indicated.

In sum, the current study identified functional domains similar to, but not identical with the RDoC framework. Preschoolers with ADHD have deficits in most functional domains, but only deficits in activity level and regulation and executive functions were clinically significant (SMD > 0.5) and more expressed in preschoolers with ADHD compared to those with other problems. Future longitudinal research on the development of functioning in domains over time will be important to investigate a causal role of early functional deficits in the development of ADHD, and for the further development of effective early interventions for ADHD.

## Supporting information

Supplementary methods and results [[supplements/251985_file02.pdf]](pending:yes)

## Data Availability

Data can be obtain through application to the Norwegian Mother, Father and Child Cohort Study (MoBa) [https://www.fhi.no/en/studies/moba/](http://www.fhi.no/en/studies/moba/)

*   Received February 18, 2021.
*   Revision received February 18, 2021.
*   Accepted February 20, 2021.


*   © 2021, Posted by Cold Spring Harbor Laboratory

The copyright holder for this pre-print is the author. All rights reserved. The material may not be redistributed, re-used or adapted without the author's permission.

## References

1.  Achenbach T, Rescorla L (2000) ASEBA preschool forms & profiles : an integrated system of multi-informant assessment. Burlington, VT: University of Vermont Department of Psychiatry.
    
    

2.  Ackerman PL, Heggestad ED (1997) Intelligence, personality, and interests: evidence for overlapping traits. Psychological bulletin 121, 219–245.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1037/0033-2909.121.2.219&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=9100487&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F20%2F2021.02.18.21251985.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=A1997WL69200004&link_type=ISI) 

3.  American Psychiatric Association (2000) Diagnostic and statistical manual of mental disorders (4th ed., Text Revision). Washington, DC: American Psychiatric Association.
    
    

4.  American Psychiatric Association (2013) Diagnostic and statistical manual of mental disorders: DSM-5. 5th ed. Washington, DC: Autor.
    
    

5.  Arnett AB, Pennington BF, Willcutt E, Dmitrieva J, Byrne B, Samuelsson S, Olson RK (2012) A cross-lagged model of the development of ADHD inattention symptoms and rapid naming speed. Journal of abnormal child psychology 40, 1313–1326.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s10802-012-9644-5&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22581405&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F20%2F2021.02.18.21251985.atom) 

6.  Baroni A, Castellanos FX (2015) Neuroanatomic and cognitive abnormalities in attention-deficit/hyperactivity disorder in the era of ‘high definition’ neuroimaging. Current Opinion in Neurobiology 30, 1–8.
    
    

7.  Bendiksen B, Svensson E, Aase H, Reichborn-Kjennerud T, Friis S, Myhre AM, Zeiner P (2017) Co-Occurrence of ODD and CD in Preschool Children With Symptoms of ADHD. Journal of Attention Disorders 21, 741–752.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/1087054714538655&link_type=DOI) 

8.  Buss AH, Plomin R (1984) Temperament: Early Developing Personality Traits. Psychology Press.
    
    

9.  1.   R. DelCarmen-Wiggins
    
    Egger HL, Angold A (2004) The Preschool Age Psychiatric Assessment (PAPA): A Structured Parent Interview for Diagnosing Psychiatric Disorders in Preschool Children. In Handbook of infant, toddler, and preschool mental health assessment (ed.  R. DelCarmen-Wiggins) vol 538, pp 223–243 New York, NY, US: Oxford University Press, xiv.
    
    

10. Fair DA, Bathula D, Nikolas MA, Nigg JT (2012) Distinct neuropsychological subgroups in typically developing youth inform heterogeneity in children with ADHD. National Academy of Sciences Proceedings of the National Academy of Sciences of the United States of America 109, 6769–6774.
    
    

11. Gelman A, Hill J, Yajima M (2012) Why We (Usually) Don’t Have to Worry About Multiple Comparisons. Routledge Journal of research on educational effectiveness 5, 189–211.
    
    

12. Gioia GA, Isquith PK, Retzlaff PD, Espy KA (2002) Confirmatory factor analysis of the Behavior Rating Inventory of Executive Function (BRIEF) in a clinical sample. Child Neuropsychology: A Journal on Normal and Abnormal Development in Childhood and Adolescence 8, 249–257.
    
    

13. Gioia GA, Isquith PK, Retzlaff PD, Espy KA (2007) Behavior rating inventory of executive functionpreschool version. Norwegian manual supplement. Lutz, FL: Psychological Assessment Resources.
    
    

14.  Hulst BM van, Zeeuw P de Durston S (2015) Distinct neuropsychological profiles within ADHD: a latent class analysis of cognitive control, reward sensitivity and timing. Psychological Medicine 45, 735–745.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1017/S0033291714001792&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25099923&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F20%2F2021.02.18.21251985.atom) 

15. Insel T, Cuthbert B, Garvey M, Heinssen R, Pine DS, Quinn K, Sanislow C, Wang P (2010) Research domain criteria (RDoC): toward a new classification framework for research on mental disorders. The American Journal of Psychiatry 167, 748–751.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1176/appi.ajp.2010.09091379&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=20595427&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F20%2F2021.02.18.21251985.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000279429300006&link_type=ISI) 

16. Ireton H, Glascoe FP (1992) Child Development Inventory Manual. Mn: Behavior Science Systems, Inc.
    
    

17. Ireton H, Glascoe FP (1995) Assessing children’s development using parents’ reports. The Child Development Inventory. Clinical Pediatrics 34, 248–255.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/000992289503400504&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=7543037&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F20%2F2021.02.18.21251985.atom) 

18. Kaplan E, Goodglass H, Weintraub S, Brand S (1983) Boston Naming Test. Lea & Febiger.
    
    

19. Karalunas SL, Fair DA, Musser ED, Aykes K, Iyer SP, Nigg JT (2014) Subtyping attention-deficit/hyperactivity disorder using temperament dimensions: toward biologically based nosologic criteria. JAMA Psychiatry 71, 1015–1024.
    
    

20. Korkman M, Kemp S, Kirk U (1998) NEPSY: A Developmental Neuropsychological Assessment. PsychCorp.
    
    

21. Korkman M, Kemp S, Kirk U (2000) NEPSY. Handbok [Handbook]. Stockholm, Sweden: Psykologiforlaget AB.
    
    

22. Lambek R, Sonuga-Barke E, Tannock R, Sørensen AV, Damm D, Thomsen PH (2018) Are there distinct cognitive and motivational sub-groups of children with ADHD? Cambridge University Press Psychological medicine 48, 1722–1730.
    
    

23. Larson K, Russ SA, Kahn RS, Halfon N (2011) Patterns of comorbidity, functioning, and service use for US children with ADHD, 2007. Pediatrics 127, 462–470.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTA6InBlZGlhdHJpY3MiO3M6NToicmVzaWQiO3M6OToiMTI3LzMvNDYyIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDIvMjAvMjAyMS4wMi4xOC4yMTI1MTk4NS5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

24. Magnus P, Irgens LM, Haug K, Nystad W, Skjaerven R, Stoltenberg C, MoBa Study Group (2006) Cohort profile: the Norwegian Mother and Child Cohort Study (MoBa). International Journal of Epidemiology 35, 1146–1150.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/ije/dyl170&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=16926217&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F20%2F2021.02.18.21251985.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000241429200008&link_type=ISI) 

25. Mathiesen KS, Tambs K (1999) The EAS temperament questionnaire–factor structure, age trends, reliability, and stability in a Norwegian sample. Journal of Child Psychology and Psychiatry, and Allied Disciplines 40, 431–439.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1017/S0021963098003680&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=10190344&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F20%2F2021.02.18.21251985.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000079621500013&link_type=ISI) 

26. McClellan JM, Speltz ML (2003) Psychiatric diagnosis in preschool children. Journal of the American Academy of Child and Adolescent Psychiatry 42, 127–8; author reply 128-30.
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=12544169&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F20%2F2021.02.18.21251985.atom) 

27. Mueller A, Hong DS, Shepard S, Moore T (2017) Linking ADHD to the Neural Circuitry of Attention. Trends in cognitive sciences 21, 474–488.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.tics.2017.03.009&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=28483638&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F20%2F2021.02.18.21251985.atom) 

28. Muthen LK, Muthen BO (2017) Mplus User’s Guide. Eighth Edition. Los Angeles, CA: Muthen & Muthen.
    
    

29. Nikolas MA, Nigg JT (2013) Neuropsychological performance and attention-deficit hyperactivity disorder subtypes and symptom dimensions. Neuropsychology 27, 107–120.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1037/a0030685&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23148496&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F20%2F2021.02.18.21251985.atom) 

30. Overgaard KR, Aase H, Torgersen S, Reichborn-Kjennerud T, Oerbeck B, Myhre A, Zeiner P (2014) Continuity in features of anxiety and attention deficit/hyperactivity disorder in young preschool children. European Child & Adolescent Psychiatry 23, 743–752.
    
    

31. Overgaard KR, Aase H, Torgersen S, Zeiner P (2016) Co-Occurrence of ADHD and Anxiety in Preschool Children. Journal of attention disorders 20, 573–580.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/1087054712463063&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23160487&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F20%2F2021.02.18.21251985.atom) 

32. Overgaard KR, Oerbeck B, Aase H, Torgersen S, Reichborn-Kjennerud T, Zeiner P (2018) Emotional Lability in Preschoolers With Symptoms of ADHD. Journal of Attention Disorders 22, 787–795.
    
    

33. Putnam SP, Rothbart MK (2006) Development of short and very short forms of the Children’s Behavior Questionnaire. Journal of Personality Assessment 87, 102–112.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1207/s15327752jpa8701_09&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=16856791&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F20%2F2021.02.18.21251985.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000239880400009&link_type=ISI) 

34. R Core Team (2019) R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.
    
    

35. Rasch G (1960) Probabilistic models for some intelligence and attainment tests. MESA Press.
    
    

36. Rohrer-Baumgartner N, Zeiner P, Eadie P, Egeland J, Gustavson K, Reichborn-Kjennerud T, Aase H (2016) Language Delay in 3-Year-Old Children With ADHD Symptoms. Journal of Attention Disorders 20, 867–878.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/1087054713497253&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23942041&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F20%2F2021.02.18.21251985.atom) 

37. Roid GH (2003) Stanford Binet intelligence scales. Itasca, IL : Riverside Pub.
    
    

38. Rommel AS, Rijsdijk F, Greven CU, Asherson P, Kuntsi J (2015) A longitudinal twin study of the direction of effects between ADHD symptoms and IQ. PloS one 10, e0124357.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0124357&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25875897&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F20%2F2021.02.18.21251985.atom) 

39. Sachdev PS, Blacker D, Blazer DG, Ganguli M, Jeste DV, Paulsen JS, Petersen RC (2014) Classifying neurocognitive disorders: the DSM-5 approach. Nature reviews. Neurology 10, 634–642.
    
    

40. Sagvolden T, Johansen EB, Aase H, Russell VA (2005) A dynamic developmental theory of attention-deficit/hyperactivity disorder (ADHD) predominantly hyperactive/impulsive and combined subtypes. The Behavioral and brain sciences 28, 397-419; discussion 419-68.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1017/S0140525X05000075&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=16209748&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F20%2F2021.02.18.21251985.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000231970200024&link_type=ISI) 

41. Skogan AH, Zeiner P, Egeland J, Rohrer-Baumgartner N, Urnes A-G, Reichborn-Kjennerud T, Aase H (2014) Inhibition and working memory in young preschool children with symptoms of ADHD and/or oppositional-defiant disorder. Child Neuropsychology: A Journal on Normal and Abnormal Development in Childhood and Adolescence 20, 607–624.
    
    

42. Skogan AH, Zeiner P, Egeland J, Urnes A-G, Reichborn-Kjennerud T, Aase H (2015) Parent ratings of executive function in young preschool children with symptoms of attention-deficit/-hyperactivity disorder. Behavioral and brain functions: BBF 11, 16.
    
    

43. Sonuga-Barke EJS (2003) The dual pathway model of AD/HD: an elaboration of neuro-developmental characteristics. Neuroscience and biobehavioral reviews 27, 593–604.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.neubiorev.2003.08.005&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=14624804&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F20%2F2021.02.18.21251985.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000186810900003&link_type=ISI) 

44. Stoltenberg C, Schjolberg S, Bresnahan M, Hornig M, Hirtz D, Dahl C, Lie KK, Reichborn-Kjennerud T, Schreuder P, Alsaker E, Oyen A-S, Magnus P, Suren P, Susser E, Lipkin WI, ABC Study Group (2010) The Autism Birth Cohort: a paradigm for gene-environment-timing research. Molecular psychiatry 15, 676–680.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/mp.2009.143&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=20571529&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F20%2F2021.02.18.21251985.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000279059400003&link_type=ISI) 

45. Sullivan GM, Feinn R (2012) Using Effect Size-or Why the P Value Is Not Enough. Journal of graduate medical education 4, 279–282.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.4300/JGME-D-12-00156.1&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23997866&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F20%2F2021.02.18.21251985.atom) 

46. Thapar A, Cooper M (2016) Attention deficit hyperactivity disorder. The Lancet 378, 1240–1250.
    
    

47. Toplak ME, West RF, Stanovich KE (2013) Practitioner review: do performance-based measures and ratings of executive function assess the same construct? Journal of child psychology and psychiatry, and allied disciplines 54, 131–143.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/jcpp.12001&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23057693&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F20%2F2021.02.18.21251985.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000313868700003&link_type=ISI) 

48. 1.   T.B. Üstün, 
    2.   N. Kostanjsek, 
    3.   S. Chatterji, 
    4.   J. Rehm
    
    Ustun TB, Kostanjesek N, Chatterji S, Rehm J, World Health Organization (2010) Measuring health and disability : manual for WHO Disability Assessment Schedule (WHODAS 2.0) / edited by  T.B. Üstün,  N. Kostanjsek,  S. Chatterji,  J. Rehm. Geneva : World Health Organization.
    
    

49. Wasserstein RL, Schirm AL, Lazar NA (2019) Moving to a World Beyond ‘p < 0.05’. Taylor & Francis The American statistician 73, 1–19.
    
    

50. Willcutt E, Sonuga-Barke E, Nigg J, Sergeant J (2008) Recent Developments in Neuropsychological Models of Childhood Psychiatric Disorders. In Biological Child Psychiatry, pp 195–226 Karger Publishers.
    
    

51. Ziegler S, Pedersen ML, Mowinckel AM, Biele G (2016) Modelling ADHD: a review of ADHD theories through their predictions for computational models of decision-making and reinforcement learning. Neuroscience and Biobehavioral Reviews 71, 633–656.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.neubiorev.2016.09.002&link_type=DOI)