Skip to main content
  • Research article
  • Open access
  • Published:

Internal structure and reliability of the Attachment Insecurity Screening Inventory (AISI) for children age 6 to 12

Abstract

Background

The aim of the present study was to examine the internal structure and reliability of the Attachment Insecurity Screening Inventory (AISI) 6–12. The AISI 6–12 years is a parent-report questionnaire for assessing the parents’ perspective on the quality of the attachment relationship with their child aged between 6 and 12 years.

Methods

The sample consisted of 681 mothers and fathers reporting on 372 children (72.3% adoption parents, 14.9% non-biological primary care takers including foster parents, and 12.8% biological parents). The internal structure was assessed with multilevel confirmatory factor analyses (CFA) and the reliability of the scores with Cronbach’s and ordinal alphas.

Results

Multilevel CFA confirmed a three-factor model of avoidant, ambivalent/resistant and disorganized attachment. Multi-group CFA indicated full configural and metric measurement invariance, and partial scalar and strict measurement invariance across mothers and fathers. Reliability coefficients were found to be sufficient.

Conclusions

This study showed the potential of using parental reports in the initial screening of attachment related problems, especially considering the practical approach of parental reports. However, further development of the AISI 6–12 years seems important to increase the validity of the AISI 6–12 years. In addition, future studies are necessary to replicate the current findings, and to strengthen the evidence that the AISI 6–12 years is appropriate for the use in middle childhood and validly assesses the parents’ perspective on attachment insecurities in their child.

Peer Review reports

Background

How we attach to significant others is a life-course developmental phenomenon of stability and change, which not only shapes who we are in our relationships with others, in particular those with whom we have an enduring emotional bond, but also shapes social development [1, 2]. In general population samples, approximately two-thirds of young children derive major support from relationships with their parents who are perceived as both a secure haven and secure base, and are therefore designated as securely attached children [2, 3]. Children with insecure attachments are children who do not perceive their caregiver(s) as a secure haven and secure base and cannot find the balance between proximity and distance to an attachment figure, or even have no strategy at all to keep such a balance (i.e., disorganized attachment) because the attachment figure is a source of fear and discomfort that should be controlled. These insecurely attached children have a greater risk for psychopathology, such as internalizing problems (anxiety, depression) or externalizing problems (aggression, delinquency) [4,5,6]. Therefore, it is of great clinical and scientific importance that insecure child-parent attachment relationships be validly and reliably measured.

Even though attachment is considered to be a life-course phenomenon, most researchers on attachment have focused their attention on early childhood, adolescence or (young) adulthood, but less on middle childhood [7]. Several valid and reliable instruments, of which some are even considered to be golden standards, have been developed to assess attachment in the first years of life and beyond the age of 12, such as the Strange Situation procedure in infancy [8], the Attachment Q-Sort in toddlerhood [9], and the Adult Attachment Interview in adolescence and (young) adulthood [10]. Scholars have developed instruments to assess attachment in middle childhood (i.e., children from age 6 to 12), such as the self-report People in My Life-scale [11, 12], narrative storytelling assessments, and observational instruments [13]. While it is often assumed that attachment is best assessed by means of behavioral observation in early childhood, or alternatively projective measures in toddlerhood (e.g., doll play), and in-depth interviewing during adolescence and (young) adulthood by means of representational measures, it is not yet clear how attachment in middle childhood should be assessed [7].

Recently, it has been argued that there should not be a dominant measurement approach, and the question should not be “what is the golden standard”, but “which component or aspect of the attachment construct is measured” ([7], p. 9). We would like to add ‘for which purpose’, for instance, scientific research on attachment-related developmental processes, clinical practice to guide attachment-based intervention targeting insecurely attached children and their parents, or both. Attachment may not only be assessed in terms of secure or insecure attachment behaviors or representations, focusing on the internal working model of attachment [13], but also from the perspective of the child or parent. It is important that instruments are specific about the attachment components they measure, and about the purposes for use.

Additionally, we feel the need for straightforward, practical, and economical instruments to assess the quality of attachment relationships between parents and their child. Currently available instruments, such as observational instruments, projective doll play interviews, and self-report interviews are rather time consuming, require extensive training, or are less suitable for children who have limited self-refection abilities [14]. In clinical and scientific practice, where money and time are important factors, the lack of straightforward instruments could lead to the decision to not assess the attachment relationships of children. It is interesting to test whether parental reports on attachment relationships could fill this gap.

Polderman and Kellaert-Knol [15] developed the Attachment Insecurity Screening Inventory (AISI) 2–5 years as a clinical tool to be used in attachment-based intervention, and it has also been used for scientific purposes [16]. The AISI 2–5 years is a brief 20-item parent self-report measure in Dutch, assessing the parents’ perception of the quality of the attachment relationship with their child, in particular focusing on insecurity, which was recently validated [17]. The AISI 2–5 years has not been validated in other countries. The AISI 2–5 years [15] showed a sufficient 3-factor model fit, measurement invariance across mothers and fathers and across the general and clinical population, good internal consistency, and indicators of concurrent and convergent validity [17]. This instrument can be used for the initial screening of attachment related developmental problems in children. The current study examined the internal structure and reliability of the middle childhood version of the AISI [18] in a clinical sample of children aged 6 to 12, primarily from adoptive or foster care families, as these children are at risk of experiencing attachment-related problems [19,20,21].

The AISI 2–5 years [15] assesses parents’ perception of Insecure-Avoidant (Type A), Insecure-Ambivalent or resistant (Type C), and Insecure-Disorganized (Type D) attachment relationships with their child. Insecure-Avoidant children (Type A) minimize their attachment behaviors, which is an insecure but still organized strategy to keep proximity to a consistently insensitive and possibly rejecting parent [8]. Insecure-Ambivalent children, also designated as Resistant or Preoccupied children (Type C), maximize their attachment behaviors, which is an insecure-organized strategy to keep proximity to a parent who is inconsistently sensitive [8]. Insecure-Disorganized children (Type D) do not have an organized strategy to keep proximity to their caregiver, and they may use controlling strategies, such as disorientation, withdrawal, and high intrusiveness, in response to harsh parenting or disrupted parental behaviors [22]. These controlling behaviors may be punitive and aggressive or care giving (being overly solicitous and nurturing with the parent) in order to guide the parent’s behavior [23, 24].

The AISI 6–12 years [18] assesses the same insecure attachment dimensions as its precursor, the AISI 2–5 years, with the same set of 20 items, although some items have been slightly changed for reasons of age-appropriateness [18]. Although social networks, involving peers and teachers, become significantly larger for children during middle childhood compared to early childhood, parents remain the primary attachment figures [25, 26], which legitimates the idea that (the measurement of) attachment to parents is still an important issue at this age. However, the literature also points at qualitative differences in attachment of children in the age of 6 to 12, compared to 2 to 5 year olds. Bosmans and Kerns [7], for instance, note that short separations from parents become less stressful and problematic in middle childhood, and no longer elicit the immediate need for proximity. They emphasize that the goal of the attachment system gradually changes from proximity to the attachment figure to availability of the attachment figure in the transition from early to middle childhood [7]. In addition, new situations that may elicit support-seeking behavior emerge in late middle childhood, such as academic failure and social conflict [7, 27]. Moreover, the attachment behavioral system becomes more sophisticated, as children are becoming increasingly able to regulate emotions and communicate about emotions, plan and organize behavior, and understand the difference between their own perspective and that of others [28]. Therefore, it is important to examine whether the AISI validly and reliably assesses the parent’s perception of the quality of attachment relationships for 6 to 12 year olds.

The aim of the present study is to examine the internal structure and reliability of the AISI 6–12 years in a clinical sample of adoptive, foster care, and biological families with children aged 6 to 12, by means of a (multilevel) Confirmatory Factor Analysis (CFA) and the computation of ordinal and Cronbach’s alpha coefficients as measures of internal consistency reliability. A three-factor structure consisting of avoidant, ambivalent and disorganized attachment was expected. Psychometric characteristics of the AISI 6–12 years have not been evaluated before. In addition, we aim to test the measurement invariance (i.e., whether the perception of the attachment relationship is measured the same for parents of different sexes) of the AISI 6–12 years for mothers and fathers raising the same child.

Method

Participants

Participants were 681 Dutch parents (72.3% adoption parents, 14.9% non-biological primary care takers including foster parents, and 12.8% biological parents) of 372 children (57.4% boys and 42.6% girls) aged 6 to 12 (M = 9.04; SD = 1.89). The sample consisted of 309 mother-father dyads in which both parents reported on their child, and 51 mothers and 12 fathers who solely reported on their child. The mean number of children per family was 2.35 (SD = 1.25, range 1 to 8). The children in the study were first children in 50.3% of the cases, and 30.7% second children, 8.5% third children, and the remaining 10.5% the fourth, fifth, sixth, seventh or eighth child. Mean age of the mothers was 43.43 years (SD = 5.88, range 23 to 62) and fathers 45.31 years (SD = 5.08, range 22 to 66). A total of 5.8% of the mothers had lower levels of educational attainment (i.e., low vocational training), 34.9% had middle levels of educational attainment (i.e., middle vocational training), and 59.3% had higher levels of educational attainment (i.e., higher vocational training or university). For fathers, this was 9.0, 34.1, and 56.9% respectively.

Procedure

The families were referred to the attachment-based Basic Trust intervention (see [16]), because of children’s emotional and conduct problems, and the suspicion of underlying attachment problems. Basic Trust is a group practice with therapists providing attachment-based intervention by means of videofeedback and parenting advice, designated as the Basic Trust Method [16]. Attachment Insecurity Screening Inventory 6–12 years [18] was filled in by both parents as part of the intake procedure (before the start of the intervention), and provided informed consent for the present study. The parents did not receive a reward for their participation in the study.

Measures

Attachment insecurity screening inventory 6–12 years

The AISI 6–12 years [18] contains 20 items in Dutch, asking parents how they perceive the attachment behaviors of their child, with a 6-point Likert-type response format: never, sometimes, regularly, often, very often, and always (with scores ranging between 1 and 6). The items belong to three subscales assessing: avoidant (range 8–48), ambivalent (i.e., resistant, dependent; range 7–42) and disorganized attachment (range 5–30) child-parent attachment relationships (see the Additional file 1: Supplementary file AISI 6–12). Subscale scores represent the sum scores of all items of the scale. The AISI 6–12 years is an adaptation of the AISI 2–5 years [15, 17]. Four items have been rephrased to better represent insecure child-parent relationships in middle childhood. Item 6 ‘Does your child cling to you?’ was changed into ‘Does your child always stay close to you?’. Item 11 ‘Is it easy for your child to resume contact with you after you have been separated?’ was changed into ‘Does your child make good contact with you after you have been away for a short period of time?’. Item 13 ‘Is your child excessively emotional when you leave him/her for a short period of time?’ was changed into ‘Does separation from you cause overly strong emotional reactions in your child?’. Finally, item 15 ‘Does your child want to be put down and then immediately picked up again?’ was changed into ‘Does your child want to be left alone and simultaneously seeks contact with you?’ [18].

Analyses

We first tested the internal structure of the AISI 6–12 years by means of a multilevel Confirmatory Factor Analysis (CFA) in Mplus [29] and R [30], as children from the same family (level 1) were nested in father-mother dyads reporting on the same child (level 2), implying a multilevel structure of the data. In addition, multilevel models have the advantage of using all the available data (including those from participants with missing data, in this study, the families with single parents) [31]. To examine the factor structure of the AISI 6–12 years, we followed the stepwise procedure of Muthén [32]. In the first step (model 1a and 1b), we provided initial information on the factor structure of the AISI, without taking the multilevel structure into account: model 1a tested the baseline model, while model 1b tested whether the model can be improved by removing problematic items (e.g., not allowing correlated measurement errors). In this adjusted model, items were removed when the factor loadings were below .30, if they did not significantly contribute to the factor solution (i.e., low R2 and/or high error variances), and if they showed many significant correlated errors with other items that could not be explained by (for instance) specific item content or similar wording [33, 34]. In the second step (model 2a and 2b), we examined the factor structure of the AISI by means of a multilevel CFA: model 2a was the (best fitting) model after having applied criteria for improvement of model fit based on modification indices (see below); model 2b examined whether further improvement of model fit could be obtained by allowing within factor measurement error correlations of items with comparable item content [33, 34].

Then, we tested the measurement invariance of the best fitting AISI 6–12 years model for mothers and fathers raising the same child in Mplus [29]. It was not possible to apply a multilevel model in the multiple group CFA to test measurement invariance across fathers and mothers, because the second level (father-mother dyad) identification number is not allowed to appear in both sex-groups in multilevel analysis. Therefore, when testing the measurement invariance across fathers and mothers, we proceeded with step 3 to 6, without taking into account the nested structure of the data. In step 3 to 6, we tested for configural (model 3), metric (model 4), scalar (model 5a), and strict (model 6a) measurement invariance of the best fitting factor model in a standard multi group CFA. If necessary, additional models could be tested to test partial measurement invariance, accounting for the possibility that only one or two (but not all) factors prove to be fully invariant [32, 35, 36]. The descriptives of the AISI 6–12 and the paired t-tests were calculated in SPSS [37].

Fit indices were used to test model fit in all models. The following cut-off values are indicative of good model fit: CFI > .95, TLI > .95, SRMR < .08, and RMSEA < .07 [38, 39]. A non-significant Chi-Square indicates exact model fit, and a ratio between the X2 statistic and the degrees of freedom (df) that is lower than 3:1 indicates a close fit to the data [38, 39]. Any significant decrease of model fit (based on a Χ2 difference test or a drop in CFI greater than .005) indicates that the more stringent condition of measurement invariance for that model has not been met [40, 41]. Reliability of the scores was tested by computing ordinal and Cronbach’s alphas for each subscale of the AISI 6–12 years in R [30], because of the ordinal 6-point response format [42].

Results

Internal structure

Table 1 presents the fit statistics of the different models that were examined. In the first step, we tested the baseline model (model 1a) including all 20 items of the AISI, which did not yield a satisfactory factor solution. However, model 1a could be significantly improved (X2(111) = 658.284, p < .001, Δ CFI = .087) by removing eight items reflecting ambivalent attachment (item 2, 13, and 15), disorganized attachment (item 4), and avoidant attachment (item 3, 5, 17 and 19). This resulted in model 1b, which yielded a good fit (see Fig. 1). The analyses were conducted on the entire sample (N = 681).

Table 1 Fit Statistics CFA Models (N = 681)
Fig. 1
figure 1

Model 1b: Correlations and Factor Structure

In the second step, we tested whether the factor structure of model 1b would hold when taking the multilevel structure of the data into account. We examined all 20 AISI items by means of a multi-level CFA, which after model improvement resulted in the same set of 12 items as in model 1b, with substantial individual ICC ranging between .266 (item 16) and .562 (item 12), which supports the CFA multi-level approach. This more stringent test of the model yielded a good model fit on all the fit indices, except for the TLI and the between dyad level SRMR. Model 2b did significantly improve model fit (X2(5) = 43.635, p < .001, Δ CFI = .017) by allowing correlated measurement errors between the following pairs of items in the within dyad model (7 and 12, 8 and 9) and between dyad model (6 and 20, 7 and 18, 10 and 16). The results of the second step indicate that the factor structure presented in Fig. 1 holded in the multilevel analyses.

The subscale scores of the 12-item AISI 6–12 years correlated highly and significantly with the subscale scores of the 20-item AISI 6–12 years. For the Ambivalent scale, this was .924, for the Avoidant scale .935, and for the Disorganized scale .973. Table 2 presents the descriptives of the scales of the 12-item AISI 6–12 years.

Table 2 Descriptives of subscales of 12-item AISI 6–12 years

Mothers reported significantly more attachment difficulties on the Ambivalent, Disorganized, and Total Insecurity scales than fathers. Biological parents reported significantly more attachment difficulties on the Ambivalent and Total Insecurity scales than non-biological parents.

Measurement invariance

The next steps tested measurement invariance between fathers (N = 320) and mothers (N = 361) of the 12-item model that was empirically derived from the previous steps. Each step had more stringent requirements for measurement invariance. Interpretations of the results are based on the description of the different types of factorial measurement invariance provided by Gregorich [36].

Model 3 tested configural invariance and showed a good fit to the data. This indicates that the three common factors (i.e., the three attachment types) are associated with the same items across groups, that is, fathers and mothers. Model 4 tested metric invariance, which showed a good fit to the data, and no worse fit than the previous model, X2 (9) = 7.405, p = .595, ΔCFI = .000, indicating that the three common factors have the same meaning across fathers and mothers, and are not differentially affected by extreme response styles (i.e., never-always), or the tendency to avoid extreme answers. Model 5a tested scalar invariance, and had a significantly worse fit than the previous model, X2 (9) = 32.228, p < .001, Δ CFI = .009. This result implies systematically higher- or lower-valued item response between the groups, causing different group means for fathers and mothers (see Table 3). Consequently, mothers and fathers cannot be compared on their mean scores on the three attachment types. Model 5b is a test of partial scalar invariance, which shows that the model did not fit the data worse than model 4, X2(4) = 2.717, p = .606, Δ CFI = .001, if the intercepts of 5 items were free to vary: disorganization (7 and 18), avoidance (14) and ambivalence (10 and 16). This implicates that the scores on the other items can be compared between fathers and mothers. Model 6a of strict invariance did fit the data significantly worse than model 5a (X2(12) = 25.310, p = .013, Δ CFI = .005). This indicates that the observed variances of mothers and fathers are not equal, and cannot be compared in a meaningful way. Finally, model 6b provides a test of partial strict invariance, which did not fit the data worse than model 5b (X2 (11) = 14.750, p = .194, Δ CFI = .002), if the residual variance of item 7 was free to vary. This implies that the observed variances of mothers and fathers can be compared on the other items.

Table 3 Means and SDs of Fathers (n = 320) and Mothers (n = 361) on the items of the AISI 6–12 years

Reliability of the scales

We have tested the Ordinal and Cronbach’s alphas for the 12-item version of the AISI. Ordinal alpha was .67 (Cronbach’s α = .65) for ambivalent attachment, for avoidant attachment .82 (Cronbach’s α = .80), and for disorganized attachment .86 (Cronbach’s α = .85). For fathers, the ordinal alpha for ambivalent attachment was .66 (Cronbach’s α = .63), for avoidant attachment .77 (Cronbach’s α = .77), and for disorganized attachment .81 (Cronbach’s α = .82). For mothers, the ordinal alpha was .67 (Cronbach’s α = .6), .83 (Cronbach’s α = .82), and .87 (Cronbach’s α = .87), respectively. The internal consistency of the ambivalent scale was therefore marginal; the other two scales had a good internal consistency.

Discussion

The present study aimed to examine the internal structure and reliability of the AISI 6–12 years [18] in a clinical sample of primarily Dutch adoptive and foster care families with children aged 6 to 12. Multilevel CFA resulted in a 12-item instrument that purports to measure the parents’ perception of the quality of attachment relationships with their children. The three subscales Avoidant (Type A), Ambivalent (Type C), and Disorganized (Type D) attachment relationships each consist of four items. The 12-item instrument has the same factor structure (configural invariance) and the same meaning (metric invariance) for fathers and mothers. Further, evidence was found for partial scalar and strict invariance, which means that mothers and fathers showed similar mean scores and observed variances for most items, but not for all. Mothers tended to report systematically more problems on certain items than did fathers. The internal consistency was good for the Avoidant (Type A) and Disorganized (Type D) subscales, and marginally sufficient for the Ambivalent (Type C) scale.

In total, we have removed eight items of the original 20-item scale. The 12-item AISI 6–12 years had improved factor structure, similar reliability estimates, and a high correlation with the original 20-item scale. In addition, we believe that the face validity of the AISI 6–12 years has been improved by removing eight items. For example, the four removed items of the Avoidant (Type A) subscale all focused on whether a child is relaxed in the presence of the parent or in physical contact with the parent (e.g., Is your child happy and playful in your presence (R)? Does your child enjoy being cuddled by you (R)? Does your child respond well and remain relaxed when you touch him/her (R)?). Tension or stress experiences by the child in contact with the parent are not exclusively characteristic of avoidant attachment, but may also be present in ambivalent or resistant [43], and especially disorganized attachment relationships [44]. Therefore, it makes sense that these items had to be removed from the avoidant subscale. In addition, the Disorganized item Does your child stay in control when playing with you? was removed. Possibly, there is a shift in middle childhood from play with parents to play with peers, and therefore it is harder for parents to answer. Moreover, the formulation of the item is rather abstract, and therefore harder for parents to recognize.

It is remarkable that in the Ambivalent (Type C) subscale the two most “basic” items that should represent ambivalent attachment patterns (i.e., Does your child want to be left alone and simultaneously seeks contact with you? and Does separation from you cause overly strong emotional reactions in your child?) had to be removed in the multilevel CFA steps in order to obtain a satisfactory model fit. There are several explanations for this result. First, it is possible that the items from the factor solution do not provide a good representation of ambivalent attachment patterns, and that the subscale Ambivalent (Type C) does not have sufficient construct and/or content validity. A second explanation may be that parents find it difficult to detect ambivalence in the interactions with their child. The ambivalence of resistance and proximity-seeking at the same time makes it very difficult to correctly interpret the intentions of behaviors. Parents may notice the resistance (which may in fact cause an emotional response in the parents as well), but fail to notice the simultaneously occurring contact-seeking behaviors. More extensive research on the expression of (insecure) attachment behaviors in middle aged children may shed light on this issue. Finally, it may be that ambivalent attachment is expressed differently in middle childhood compared to early childhood [7]. Ainsworth, Blehar, Waters and Wall [8] described extreme distress during separation from the mother and simultaneous occurrence of resistance and contact-seeking behavior in ambivalently attached young children and infants. However, Bosmans and Kerns [7] note that it is not so much the proximity that middle school aged children need, but the availability of the attachment figure. Separation from the attachment figure would then not necessarily cause distress in children with ambivalent attachment patterns if the caregiver is still psychologically available in alternative ways in the child’s perception, or perhaps physically available, for instance by means of mobile phones or other devices. Also, ambivalently attached middle school children have been shown to rather display their distress in a more regulated, passive-aggressive and manipulative way rather than through an overly emotional reaction [28, 43].

This study showed that the AISI 6–12 years meets the demands of the most important types of measurement invariance across fathers and mothers. The factor structure (configural invariance) and meaning (metric invariance) was similar for fathers and mothers, implicating that based on the internal structure, the AISI 6–12 years can be filled in by both fathers and mothers. However, we found that for certain items mothers reported structurally more attachment problems then fathers, implicating only partial scaler invariance. To our knowledge, there are almost no indications from previous studies that children have a less secure attachment relationship with their mothers than with their fathers [45], although George, Cummings and Davies [46] showed that children can exhibit a different pattern of attachment with their father and mother and the relation between sensitivity and attachment is somewhat stronger in mothers than in fathers [47]. Moreover, fathers may show differences in the way they express their (play) sensitivity towards the child, which has been shown to be related to their child’s development of attachment over time [48]. Literature on the interparental agreement of behavior showed that mothers reported systematically more internalizing, externalizing and total problem behaviors than did fathers [49], possibly because mothers perceive similar behavior as more problematic than fathers and feel more responsible for developmental problems in their children [50]. As the AISI 6–12 years intents to measure the parental perception of the attachment relationship with the child, this seems to be a valid explanation for differences between fathers and mothers. Because we only found partial scaler and strict invariance, mean scale scores and observed variances cannot be compared across mothers and fathers in a meaningful manner. For both scientific and clinical use, it is important to include the father’s perspective on the attachment relationship with his child. In order to make the AISI 6–12 years suitable for both parents, it seems therefore important to create different cut-off scores for fathers and mothers.

The reliability of the Ambivalent (Type C) subscale was questionable for use in clinical practice (α = .65). The reliability of the scores could be underestimated because the scale only consists of 4 items [51]. Moreover, the items of the scale appear to measure multiple dimensions of ambivalent attachment patters. The items relate to both the need for proximity/availability and self-efficacy of ambivalent attachment (i.e., Does your child need you to reassure him/her that he/she is doing something right?) [52]. This may explain the marginal reliability of the Ambivalent (Type C) subscale. Future studies could test this explanation.

This study has several limitations that need to be mentioned. First, this study assessed only the internal structure and reliability of the AISI 6–12 years. Other dimensions of validity (such as concurrent, predictive and convergent validity) have not been tested. Second, in the analyses to test measurement invariance across fathers and mothers, it was not possible to account for the multilevel structure of the data (i.e., children of the same family were nested within the same mother-father dyads) at the same time. We therefore followed a hierarchical procedure to examine the internal structure of the AISI, first accounting for dependency by means of taking the nested structure of the data into account, and subsequently testing measurement invariance of the best fitting multi-level factor model. Finally, the internal structure and measurement invariance of the AISI 6–12 years was tested in a clinical sample, which consisted mostly of adoptive and foster care families. The findings of the current study may therefore be limited generalizable to other samples, such as non-clinical samples. Moreover, the sample consisted of at risk children of biological parents, next to non-biological parents. Including biological parents made the sample more heterogeneous, but also increased external validity.

Taking the limitations of the current study into consideration, this study contributes to the literature on attachment in middle childhood, and offers interesting implications for future research and clinical practice. First, the current study provides suggestions for further studies on (the expression of) attachment in middle childhood. That is, there are some clues from previous studies that the expression of insecure attachment problems in middle childhood is different than the expression in early childhood [28, 43, 53], and therefore, taking measurements of attachment in younger children as a starting point of measurements of attachment for middle childhood may not be appropriate. However, we did find evidence for the three factor structure of insecure attachment (Type A, C, and D) in middle childhood, which implicates that the insecure attachment classifications that are used in infancy, early childhood, and adolescence have also meaning in middle childhood. The literature on attachment insecurity in middle childhood is somewhat underdeveloped, in particular due to lack of reliable and valid measurement instruments [7, 14]. We therefore follow the suggestion of Bosmans and Kerns [7] that future research should focus on identifying age-related changes in insecure attachment patterns in order to create instruments that can measure the quality of attachment relationships in middle childhood.

A second implication is that the current study paves the way for the assessment of parental perceptions of the quality of the attachment relationship with the child. Based on the internal structure and reliability of the AISI 6–12 years, it seems that parental reports can be a valuable source of information in assessing attachment problems in middle childhood. Using questionnaires for parents is a rather practical approach, with yields outcomes that are easy to interpret. Other measures that are currently used to assess attachment patterns in middle childhood (such as observations, projective doll play interviews, and self-report interviews) are rather time consuming, require extensive training, or are less suitable for children in the early stages of middle childhood or children with learning disabilities [14]. Especially for child protective services, primary care providers, or in intake procedures the AISI 6–12 years is potentially useful in the initial screening of attachment related problems from the perspective of parents themselves. Instruments assessing the parents’ perspective on the attachment relationship with their child can offer interesting clinical information, but cannot (solely) be used as a diagnostic instrument. So, if scores on the AISI 6–12 years are elevated, and after additional evidence of attachment related problems in a standard clinical interview or based on case file information, families could be referred to specialists in diagnosing attachment problems for a more comprehensive observation-based assessment of attachment problems and, if necessary, to attachment-based interventions (see for example [16, 53, 54]). Moreover, the AISI 6–12 years can be used as a point of engagement to discuss attachment experiences of parents with their children in diagnostics and treatment, which could strengthen the possibilities for attachment-based interventions.

The final implication of this study is that the AISI 6–12 years needs further research and improvement before it can be validly and reliably used in scientific studies and clinical practice. The AISI 6–12 years [18] was based on the AISI 2–5 years [14, 17], although items were slightly changed on account of age-appropriateness. The AISI 6–12 years may need even further alterations to make it more appropriate for middle childhood, for example, by including items on passive-aggressive, self-determining, and manipulative behavior in the Ambivalent (Type C) scale [43], and items on role reversal in the Disorganized (Type D) scale [23].

Future studies should examine other sources of validity indications of the AISI 6–12 years, such as convergent and concurrent validity by comparing scores of the AISI 6–12 years with other measures that examine attachment patterns in middle childhood, and with measures that assess psychopathology and adjustment problems [5, 53, 55]. Although, Bosmans and Kerns [7] argue that different measurement strategies tap into different components or aspects of the child-parent attachment relationship, and therefore do not necessarily have to correlate in order to be valid (see also [56]). The AISI 6–12 years aims to measure the parents’ perspective on the quality of the attachment relationship with their child. Therefore, it is valuable to compare results of the AISI 6–12 years with classifications of the Adult Attachment Interview (AAI [10]), an instrument aimed at assessing attachment representations of parents and other caregivers. The AAI is a strong predictor of the quality of the attachment relationships between parents and children [57]. The pathway of intergenerational transmission of attachment goes from parents’ attachment representations, through parental sensitivity [58] and parents’ mentalizing abilities to understand the internal states of their child (i.e., mind mindedness [59]). The AISI might cover a component relevant for the intergenerational transmission of attachment, that is, the parents’ interpretation of their child’s behavior from an attachment perspective. However, cut-off scores and the power of the AISI 6–12 years to discriminate between children with and without attachment insecurity need to be known before this instrument can be used in clinical practice.

Conclusions

In conclusion, this study showed that the internal structure of parent reports on the perception of the quality of the relationship with their child can be sufficient and largely measurement invariant across mothers and fathers. Even though the AISI 6–12 years needs further development and more research on (insecure) attachment patterns in middle childhood and the validity of the AISI 6–12 years is necessary, we pledge for the use of parent reports of the attachment relationships apart from other assessment methods. Parent reports offer valuable insights into parental representations and the behavior of children. In the end, parents do not rely on a single observation, but know their children’s behavior in different contexts and for an extended period of time. Additionally, the parent’s perception of their child may influence their parenting behavior, which impacts on the way a child develops, including the child’s attachment. Insecure attachment relationships are predictive of all types of developmental problems in life [4, 5, 53, 55]. Therefore, parental reports provide in the need of clinical practice for straightforward instruments that can be used in the screening of attachment related problems and the ability to include parental perceptions in attachment research.

Abbreviations

AAI:

Adult Attachment Interview

AISI:

Attachment Insecurity Screening Inventory

CFA:

Confirmatory Factor Analyses

References

  1. Bowlby J. Attachment and loss: attachment. John Bowlby: Basic Books; 1969.

    Google Scholar 

  2. Bowlby J. A secure base: clinical applications of attachment theory: Taylor & Francis; 1988.

  3. Van Ijzendoorn MH, Schuengel C, Bakermans-Kranenburg MJ. Disorganized attachment in early childhood: meta-analysis of precursors, concomitants, and sequelae. Dev Psychopathol. 1999;11(02):225–50.

    Article  CAS  PubMed  Google Scholar 

  4. Colonnesi C, Draijer EM, Jan JM, Stams G, Van der Bruggen CO, Bögels SM, Noom MJ. The relation between insecure attachment and child anxiety: a meta-analytic review. J Clin Child Adolesc Psychol. 2011;40(4):630–45.

    Article  PubMed  Google Scholar 

  5. Groh AM, Narayan AJ, Bakermans-Kranenburg MJ, Roisman GI, Vaughn BE, Fearon R, et al. Attachment and temperament in the early life course: a meta-analytic review. Child Dev. 2016;

  6. Hoeve M, Stams GJJ, van der Put, Claudia E, Dubas JS, van der Laan PH, Gerris JR. A meta-analysis of attachment to parents and delinquency. J Abnorm Child Psychol. 2012;40(5):771–85.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Bosmans G, Kerns KA. Attachment in middle childhood: progress and prospects. New Dir Child Adolesc Dev. 2015;2015(148):1–14.

    Article  PubMed  Google Scholar 

  8. Ainsworth MDS, Blehar MC, Waters E, Wall SN. Patterns of attachment: a psychological study of the strange situation: Psychology Press; 1978.

  9. Waters E, Deane KE. Defining and assessing individual differences in attachment relationships: Q-methodology and the organization of behavior in infancy and early childhood. Monogr Soc Res Child Dev. 1985:41–65.

  10. George C, Kaplan N, Main M. Attachment interview for adults. Unpublished manuscript. Berkeley: University of California; 1985.

    Google Scholar 

  11. Moreira H, Fonseca A, Canavarro MC. Assessing attachment to parents and peers in middle childhood: psychometric studies of the Portuguese version of the people in my life questionnaire. J Child Fam Stud. 2017;26(5):1318–33.

    Article  Google Scholar 

  12. Ridenour TA, Greenberg MT, Cook ET. Structure and validity of people in my life: a self-report measure of attachment in late childhood. Journal of Youth and Adolescence. 2006;35(6):1037–53.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  13. Bureau J, Moss E. Behavioural precursors of attachment representations in middle childhood and links with child social adaptation. Br J Dev Psychol. 2010;28(3):657–77.

    Article  PubMed  Google Scholar 

  14. Dwyer KM. The meaning and measurement of attachment in middle and late childhood. Hum Dev. 2005;48(3):155–82.

    Article  Google Scholar 

  15. Polderman N, Kellaert-Knoll MG. Manual of the attachment insecurity screening inventory 2–5 years (AISI 2–5 years). Haarlem: Basic Trust; 2008.

    Google Scholar 

  16. Colonnesi C, Wissink IB, Noom MJ, Asscher JJ, Hoeve M, GJJ S, et al. Basic trust: an attachment-oriented intervention based on mind-mindedness in adoptive families. Res Soc Work Pract. 2013;23(2):179–88.

    Article  Google Scholar 

  17. Wissink I, Colonnesi C, Stams G, Hoeve M, Asscher J, Noom M, et al. Validity and reliability of the attachment insecurity screening inventory (AISI) 2–5 years. Child indicators research. 2016;9(2):533–50.

    Article  CAS  PubMed  Google Scholar 

  18. Polderman N, Kellaert-Knol MG. Handleiding attachment insecurity screening inventory 6–12 jaar (AISI 6–12 jaar). Haarlem: Basic Trust; 2012.

    Google Scholar 

  19. Stovall-Mcclough KC, Dozier M. Forming attachments in foster care: infant attachment behaviors during the first 2 months of placement. Dev Psychopathol. 2004;16(02):253–71.

    Article  PubMed  Google Scholar 

  20. Van den Dries L, Juffer F, van Ijzendoorn MH, Bakermans-Kranenburg MJ. Fostering security? A meta-analysis of attachment in adopted children. Child Youth Serv Rev. 2009;31(3):410–21.

    Article  Google Scholar 

  21. Vasileva M, Petermann F. Attachment, development, and mental health in abused and neglected preschool children in Foster Care: a meta-analysis. Trauma Violence Abuse. 2016;

  22. Main M, Solomon J. Procedures for identifying infants as disorganized/disoriented during the Ainsworth strange situation. Attachment in the preschool years: Theory, research, and intervention. 1990;1:121–60.

    Google Scholar 

  23. Bureau JF, Ann Easlerbrooks M, Lyons-Ruth K. Attachment disorganization and controlling behavior in middle childhood: maternal and child precursors and correlates. Attach Hum Dev. 2009;11(3):265–84.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Vallance DD. Using theory and research on controlling attachments to inform the clinical assessment of pre-school children. Clinical Child Psychology and Psychiatry. 2004;9(2):227–40.

    Article  Google Scholar 

  25. Kerns KA, Tomich PL, Kim P. Normative trends in children's perceptions of availability and utilization of attachment figures in middle childhood. Soc Dev. 2006;15(1):1–22.

    Article  Google Scholar 

  26. Seibert AC, Kerns KA. Attachment figures in middle childhood. Int J Behav Dev. 2009;33(4):347–55.

    Article  Google Scholar 

  27. Vandevivere E, Braet C, Bosmans G. Under which conditions do early adolescents need maternal support? The Journal of Early Adolescence. 2015;35(2):162–9.

    Article  Google Scholar 

  28. Mayseless O, Kerns K, Richardson R. Ontogeny of attachment in middle childhood: conceptualization of normative changes. Attachment in middle. Childhood. 2005:1–23.

  29. Muthen LK, Muthen BO. Mplus User's guide sixth edition. CA: Los Angeles; 1998.

    Google Scholar 

  30. R Core Team (2013). R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3–900051–07-0, URL. http://www.R-project.org/.

  31. Hox J, Roberts JK. Handbook of advanced multilevel analysis: Psychology Press; 2011.

  32. Muthén BO. Multilevel covariance structure analysis. Sociol Methods Res. 1994;22(3):376–98.

    Article  Google Scholar 

  33. Brown T. Methodology in the social sciences. New York, NY: Guilford Publications; 2015.

    Google Scholar 

  34. Gerbing DW, Anderson JC. On the meaning of within-factor correlated measurement errors. J Consum Res. 1984;11(1):572–80.

    Article  Google Scholar 

  35. Byrne BM, Shavelson RJ, Muthén B. Testing for the equivalence of factor covariance and mean structures: the issue of partial measurement invariance. Psychol Bull. 1989;105(3):456.

    Article  Google Scholar 

  36. Gregorich SE. Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework. Med Care. 2006;44(11 Suppl 3):S78–94.

    Article  PubMed  PubMed Central  Google Scholar 

  37. IBM Corp. IBM SPSS statistics for windows, version 22.0. Armonk, NY: IBM Corp. Released 2013.

  38. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model Multidiscip J. 1999;6(1):1–55.

    Article  Google Scholar 

  39. Kline RB. Principles and practice of structural equation modeling: Guilford publications; 2015.

  40. Chen FF. Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct Equ Model. 2007;14(3):464–504.

    Article  Google Scholar 

  41. Cheung GW, Rensvold RB. Evaluating goodness-of-fit indexes for testing measurement invariance. Struct Equ Model. 2002;9(2):233–55.

    Article  Google Scholar 

  42. Gadermann AM, Guhn M, Zumbo BD. Estimating ordinal reliability for Likert-type and ordinal item response data: a conceptual, empirical, and practical guide. Practical Assessment, Research & Evaluation. 2012;17(3).

  43. Hans S, Bernstein V, Sims BE, Crittenden P, Claussen A. Change and continuity in ambivalent attachment relationships from infancy through adolescence. The organization of attachment relationships: Maturation, culture, and context. 2000:277–99.

  44. Hesse E, Main M. Frightened, threatening, and dissociative parental behavior in low-risk samples: description, discussion, and interpretations. Dev Psychopathol. 2006;18(2):309–43.

    Article  PubMed  Google Scholar 

  45. Goodsell TL, Meldrum JT. Nurturing fathers: a qualitative examination of child–father attachment. Early Child Dev Care. 2010;180(1–2):249–62.

    Article  Google Scholar 

  46. George MR, Cummings EM, Davies PT. Positive aspects of fathering and mothering, and children's attachment in kindergarten. Early Child Dev Care. 2010;180(1–2):107–19.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Lucassen N, Tharner A, Van IJzendoorn MH, Bakermans-Kranenburg MJ, Volling BL, Verhulst FC, et al. The association between paternal sensitivity and infant–father attachment security: a meta-analysis of three decades of research. 2011.

    Google Scholar 

  48. Grossmann K, Grossmann KE, Fremmer-Bombik E, Kindler H, Scheuerer-Englisch H. The uniqueness of the child–father attachment relationship: fathers’ sensitive and challenging play as a pivotal variable in a 16-year longitudinal study. Soc Dev. 2002;11(3):301–37.

    Article  Google Scholar 

  49. Duhig AM, Renk K, Epstein MK, Phares V. Interparental agreement on internalizing, externalizing, and total behavior problems: a meta-analysis. Clin Psychol Sci Pract. 2000;7(4):435–53.

    Article  Google Scholar 

  50. Baker BL, Heller TL. Preschool children with externalizing behaviors: experience of fathers and mothers. J Abnorm Child Psychol. 1996;24(4):513–32.

    Article  CAS  PubMed  Google Scholar 

  51. Cho E, Kim S. Cronbach’s coefficient alpha: well known but poorly understood. Organ Res Methods. 2015;18(2):207–30.

    Article  Google Scholar 

  52. Brumariu LE, Kerns KA. Parent-child attachment and internalizing symptoms in childhood and adolescence: a review of empirical findings and future directions. Dev Psychopathol. 2010;22(1):177.

    Article  PubMed  Google Scholar 

  53. Moss E, Lecompte V. Attachment and Socioemotional problems in middle childhood. New Dir Child Adolesc Dev. 2015;2015(148):63–76.

    Article  PubMed  Google Scholar 

  54. Weir KN, Lee S, Canosa P, Rodrigues N, McWilliams M, Parker L. Whole family Theraplay: integrating family systems theory and Theraplay to treat adoptive families. Adopt Q. 2013;16(3–4):175–200.

    Article  Google Scholar 

  55. Brumariu LE. Parent–child attachment and emotion regulation. New Dir Child Adolesc Dev. 2015;2015(148):31–45.

    Article  PubMed  Google Scholar 

  56. Hendriks AM, Van der Giessen D, Stams GJJM, Overbeek G. The association between parent-reported and observed parenting: a multi-level meta-analysis. Psychol Assess. In press

  57. Van IJzendoorn MH. Adult attachment representations, parental responsiveness, and infant attachment: a meta-analysis on the predictive validity of the adult attachment interview. Psychol Bull. 1995;117(3):387.

    Article  CAS  PubMed  Google Scholar 

  58. Verhage ML, Schuengel C, Madigan S, Fearon R, Oosterman M, Cassibba R, et al. Narrowing the transmission gap: a synthesis of three decades of research on intergenerational transmission of attachment. 2016.

    Google Scholar 

  59. Meins E. Sensitive attunement to infants’ internal states: Operationalizing the construct of mind-mindedness. Attach Hum Dev. 2013;15(5–6):524–44.

    Article  PubMed  Google Scholar 

  60. Vereniging van Universiteiten. De Nederlandse Gedragscode Wetenschapsbeoefening [Dutch Code of Science Practice]. 2014.

    Google Scholar 

Download references

Acknowledgements

We thank Basic Trust for providing the data of the study.

Funding

The authors did not receive funding.

Availability of data and materials

The data that support the findings of this study are available from Basic Trust but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request and with permission of Basic Trust.

Author information

Authors and Affiliations

Authors

Contributions

AS participated in its design, performed the statistical analysis, interpreted the results and drafted the manuscript. IW, CB, CC, MN, and LW critically reviewed the manuscript. GJS conceived of the study, participated in the statistical analysis and interpretation of the results, and critically reviewed the manuscript. NP provided the data and critically reviewed the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Anouk Spruit.

Ethics declarations

Ethics approval and consent to participate

All research procedures were in line with the guidelines of the Ethics Commission of the University of Amsterdam and in line with Dutch Code of Science Practice national guidelines [60]. All participants have given verbal consent to include any individual person’s data in any form.

Consent for publication

Not applicable

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1: Supplementary File AISI 6–12.

Items of the AISI 6–12 years. This file contains the items of the AISI 6–12 years. (DOCX 15 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Spruit, A., Wissink, I., Noom, M.J. et al. Internal structure and reliability of the Attachment Insecurity Screening Inventory (AISI) for children age 6 to 12. BMC Psychiatry 18, 30 (2018). https://doi.org/10.1186/s12888-018-1608-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12888-018-1608-z

Keywords