Skip to main content
  • Research article
  • Open access
  • Published:

A genetic study of autism in Costa Rica: multiple variables affecting IQ scores observed in a preliminary sample of autistic cases

Abstract

Background

Autism is a heritable developmental disorder of communication and socialization that has not been well studied in Hispanic populations. Therefore, we are collecting and evaluating all possible cases of autism from a population isolate in the Central Valley of Costa Rica (CVCR) for a clinical and genetic study.

Methods

We are assessing all subjects and parents, as appropriate, using the newly translated Spanish versions of the Autism Diagnostic Interview-Revised (ADI-R) and the Autism Diagnostic Observation Schedule (ADOS) as well as tests of intelligence and adaptive behavior. Detailed obstetric and family medical/psychiatric histories are taken. All cases are tested for Fragile X and will be extensively evaluated for cytogenetic abnormalities.

Results

To date we have obtained clinical evaluations on over 76 cases of possible autism referred to our study and report data for the initial 35 complete cases. The mean age of the probands is 6.7 years, and 31 of the 35 cases are male. Twenty-one of the cases have IQs <50 and only 6 cases have IQs ≥ 70. Over half of the mothers had complications during pregnancy and/or delivery. No cases have tested positively for Fragile X or PKU. Chromosomal G-banding is not yet complete for all cases.

Conclusion

Diagnostic data gathered on cases of autism in the CVCR using Spanish versions of the ADI-R and ADOS look similar to that generated by studies of English-speaking cases. However, only 17% of our cases have IQs within the normal range, compared to the figure of 25% seen in most studies. This result reflects an ascertainment bias in that only severe cases of autism come to treatment in the CVCR because there are no government-sponsored support programs or early intervention programs providing an incentive to diagnose autism. The severity of mental retardation seen in most of our cases may also be exaggerated by the lack of early intervention programs and the use of IQ tests without Costa Rican norms. Still, we must formally train healthcare providers and teachers to recognize and refer autistic cases with normal or near normal IQs that are not seen in treatment.

Peer Review reports

Background

Autism (MIM 209850) is a heritable neurodevelopmental disorder characterized by delayed language acquisition, impaired socialization, and repetitive or stereotyped behaviors. Frequent associated features include sensory abnormalities and lack of motor coordination. The recurrence risk for siblings is approximately 30 times that of the general population, and twin studies have documented a higher concordance rate in monozygotic (60–91%) than in dizygotic twins (0–6%) [1]. According to a summary of 32 epidemiological studies, the male:female ratio is ~4:1, and up to 75% of autistic subjects are mentally retarded to some degree [2]. Associated medical disorders were estimated to be present in ~6.4 % of autistic individuals in that review. Four studies also indicate that siblings of autistic probands are at increased risk for Pervasive Developmental Disorder Not Otherwise Specified (PDDNOS) and Asperger's Disorder, suggesting that these disorders exist on a continuum [36]. In fact, a mutation in the Neuroligin 3 gene on Xq13 has been identified in a sibship where one brother has autism and the other has Asperger's [7]. This mutation was inherited from the mother and changes a highly conserved arginine residue to cysteine (R451C), resulting in retention of the protein in the endoplasmic reticulum and reduced binding with its presynaptic partner beta neurexin-1 [8]. Although mutations in this gene may not explain a substantial portion of the population risk for autism, the finding provides definitive proof for the genetic basis of autism spectrum disorders (ASD) and encouragement for ongoing genetic studies such as ours.

Multiple genes and environmental factors likely contribute to the etiology of autism, making it difficult to isolate disease genes. There is a substantial fall-off in risk of autism for second- and third-degree relatives of autistic probands [9], and some predict that alleles of 10 to 100 or more genes, each of small effect, may underlie the autistic phenotype [10, 11]. Hirschprung's disease, or congenital megacolon, is the prototype of a complex genetic trait and displays an inheritance pattern that could well be representative of autism. To date, there are more than nine susceptibility genes for this disorder, and different combinations of alleles interact to produce the phenotype. The penetrance of Hirschprung's disease is low, and the phenotype varies widely in severity within and among families. This pattern is also seen in the family mentioned above, where a sibling with autism and a sibling with Asperger's share at least one identical genetic determinant.

Two principle strategies have been used to try to limit the genetic heterogeneity underlying such complex phenotypes. One proven method is to identify more genetically homogeneous subphenotypes. With respect to autism, language delay and obsessive compulsive behaviors are traits that segregate within both affected and unaffected members of a family [12, 13]. In practice, subsetting samples according to the presence of language delay has strengthened evidence for linkage to the same regions on chromosomes 2q and 7q in several different studies [1417].

Another, albeit less successful, means of reducing genetic heterogeneity is to study these disorders in isolated founder populations. These populations are derived from a small number of original founders and then grow exponentially, in isolation, such that the small number of disease alleles introduced by the founders will be widely distributed in the present day. For instance, genes for Hirschprung's disease have been identified in the genetically isolated population of the old order Mennonites, although some degree of heterogeneity was present even in this population [18].

The CVCR is another well known founder population widely studied by geneticists interested in neuropsychiatric disorders and other complex traits like asthma [19]. The CVCR was founded ~15 generations ago by a small number of families from southern Spain, and the local, predominantly female, Amerindians. These assertions, based largely on civil and church registries, have been confirmed at the genetic level using haplotype data from mitochondrial DNA (mtDNA), Y-chromosome, and autosomal markers [20]. Mitochondrial data indicate that the four major Native American mtDNA lineages are enriched in females from the CVCR. Data from the Y chromosome shows that the male ancestry in CVCR is about 0.86 European, with a small contribution from West African and Amerind populations. Importantly, an isolated founder population in Antioquia, Colombia shares the same demographic history as the CVCR, and autism case collection is currently underway in that region using the same study protocol as ours. The only published studies of ASD in an isolated population are ongoing in Finland [2123]. A comparison of gene diversity between Finland and the CVCR shows that they are similar at the autosomal level [20].

Previously, genetic studies of autism were not undertaken in the CVCR because the Autism Diagnostic Interview-Revised (ADI-R) [24] and the Autism Diagnostic Observation Schedule (ADOS) [25], the standard research instruments used to diagnose autism, were available only in English. Furthermore, application of the ADI-R and ADOS for research studies requires formal certification training in English. The ADI-R is a structured diagnostic interview administered to parents that evaluates social abilities, verbal and non-verbal communication, and repetitive and stereotyped behaviors in possibly autistic children. In our population, the test takes anywhere from 2 to 3.5 hours, depending upon the parent's level of awareness. The ADOS is a semi-structured standardized assessment of social interaction, communication, and play that can distinguish autism and PDDNOS from non-spectrum disorders. The test is 30 minutes long, and one of four modules is administered to the case, according to their level of expressive language. Fortunately, a Spanish-language version of the ADI-R is now available, and our group participated in the recent translation of the ADOS.

According to the National Census Register of Costa Rica, the CVCR harbors approximately 250,000 children between 0–4 years, another 250,000 between 5–9 years, and a total of one million individuals under the age of 20, with a slight preponderance of males in all age groups. (These numbers represent just under two-thirds of the totals for the entire country, as that is the estimated percentage of people living in the Central Valley). Assuming that published prevalence estimates in other countries apply to Costa Rica, as has been documented for Tourette's Syndrome and Bipolar Disorder [19], and taking a conservative value of 1 in 1,000 [2] as the prevalence estimate, there should be ~1,000 cases of autism between ages 0–20. Given that few cases will be seen before two or three years of age, and that we require Central Valley ancestry (not just birth) for entry into the study, the number of eligible cases may be anywhere from 300–500.

With the appropriate instruments and research-trained bilingual clinicians, we have begun recruiting autistic subjects and their parents from the CVCR for a genetic study. The first stage of the genetic study will be to perform highthroughput cytogenetic screening using a microarray-based Comparative Genomic Hybridization assay specially designed to detect microdeletions and duplications (microdels/dups), including sub-telomeric abnormalities, too small to be identified by standard karyotyping. Should we have a suitable sample size of cytogenetically normal cases after this evaluation, possibly augmented by samples from the genetically related population in Antioquia, we intend to perform a genome-wide single nucleotide polymorphism (SNP) screen to identify autism susceptibility genes. We also intend to use our samples to perform fine-mapping of autism loci identified by other investigators. Here we report complete clinical data gathered on a representative 35 cases recently assessed in the CVCR. Although this is a preliminary assessment, our findings related to the problems of IQ testing and recruitment in this population may be helpful to other Latin American investigators planning similar studies.

Methods

This project was approved under the guidelines of the Ministry of Health of Costa Rica, the Ethical committee of the National Children's Hospital in San Jose, and the Institutional Review Board at Mount Sinai School of Medicine. These approvals remain active. All adult participants provided written informed consent. Parents of participating minors provided written informed consent; minors who were capable also provided signed assent.

Translation of the ADOS

Dr. Valeria Nanclares completed a preliminary translation of the ADOS. She is the Autism Program Coordinator at the Pediatric Developmental Center, Advocate Illinois Masonic Medical Center, and also the translator of the ADI-R. Next, two professional translators read the document separately in English and Spanish and documented instances where the translation was weak or ambiguous. This approach avoids the introduction of synonyms and colloquialisms and is thus preferable to simple back-translation. Subsequently, native Spanish-speaking clinical experts from Latin America and Spain reviewed the document for content and accuracy of clinical terminology and achieved a final consensus with the original translator. The Latin American expert is Dr. Elina R. Manghi (ERM), who is also the lead best-estimator for this study. She is a clinical psychologist and the Clinical Service Director for the Family Clinic, Department of Disability and Human Development at the University of Illinois at Chicago. She has over 20 years of experience in the field of psychological testing and for the last 10 years has worked with developmental disorders, including autism. She is a certified off-site trainer for both the English and Spanish versions of the ADI-R and is certified for the research use of the ADOS in the United States. The expert from Spain was Dr. Amaia Hervas, who has worked extensively with Dr. Michael Rutter's group on various autism research projects.

Ascertainment of cases

The Hospital Nacional de Ninos (HNN) is located in San Jose, the capital city of Costa Rica, and is the only major hospital for children in the CVCR. The HNN has an inpatient Neurodevelopmental Unit and recently added a small special education school providing services for children with mental retardation (MR) and developmental delay but not specifically autism. All four child psychiatrists serving the CVCR are also at the HNN. The leading clinician on our study, Dr. Patricia Jimenez Gonzalez (PJG), is Chief of the inpatient Neurodevelopmental Unit at the HNN and has an extensive private practice. She also has an active relationship with the Autism Parents' Association of Costa Rica, a group that is highly motivated to participate in research and promote community education. PJG has passed Dr. Catherine Lord's certification course for research use of the ADI-R and ADOS.

A recent study showed that the number of autism and autism spectrum disorder (ASD) cases being diagnosed in the United States increased precipitously following the introduction of Federal special education laws that included autism spectrum disorders as a disability category in 1991 [26]. The diagnostic criteria for autism were also broadened in DSM III-R in 1987 and DSM IV in 1994, and one study shows that both the changes in the formal diagnosis of autism, as well as the laws providing Federal support for children with ASD, can account for the increased incidence of this disorder in Olmsted County, Minnesota [27]. Therefore, it is not surprising that awareness of autism is only a recent phenomenon in Costa Rica, as this country lacks sufficient financial support for treatment of children with ASD. As a result, we began our recruitment with a list of 245 potential cases known to Dr. Jimenez from the HNN and her outpatient practice. These cases were selected because of documented developmental delay (cognitive/language and motor) and/or extremely disruptive behaviors characteristic of autism that lead parents to seek consultation in the first place. However, we have formulated a strategy to find the cases of high functioning autism, with normal or near normal IQ, that are not being seen by clinicians or treatment providers, or are being seen but not properly diagnosed. For instance, one study recently reported that an increase in the diagnosis of ASD between 1983 and 1996 appeared to be due to greater recognition of ASD in higher functioning children initially presenting with attention deficit hyperactivity disorder (ADHD) [28]. Another study surveyed the medical and psychiatric records of 101 Swedish children of normal intelligence (mean age 9 years, 8 months) diagnosed with PDD, in order to identify cases that might actually represent high functioning autism, and found that three-quarters had symptoms compatible with mild to severe ADHD or problems with attention and motor control [29]. These children also tended to be doing poorly in school or to be in special education programs despite their normal intelligence. Therefore, we will offer training to child psychiatrists, pediatricians, and special education teachers, under the auspices of the Costa Rican Education Ministry, to help them recognize potential cases of high functioning autism. ERM is actively involved in providing this training in Illinois. She will demonstrate this training model, which can be repeated several times a year. ERM has generated a large number of referrals for evaluation of autism at her bilingual Spanish Autism Clinic, which is part of the Family Clinic, Department of Disability and Human Development, University of Illinois at Chicago. We will also invite members of the Autism Parent Association of Costa Rica to participate in this training. We anticipate this training strategy will increase the awareness of high functioning autism, resulting in referrals for the project.

Diagnosis of autism and autism spectrum disorders

Families of individuals with possible autism contact us, or are contacted by us after expressing interest in the study, and are formally asked to participate using established informed consent criteria. They are first screened by PJG using an abbreviated version of the ADI-R (Autism Screening Questionnaire) for the presence of symptoms consistent with a developmental disorder, as well as for pertinent medical information. All interviews and exams take place in the Neurodevelopmental Unit of the HNN. Possibly affected individuals and their parents are interviewed by PJG or Dr. Marietha Fallas Delgado (a pediatrician under her supervision) using the ADI-R. Either PJG or Sylvia Monge Monge, M.A., who has a master's degree in psychoeducation, administers the ADOS. Both of these assessments are videotaped for independent scoring by the best estimators.

An IQ score and an adaptive behavior score are required for the diagnosis of MR. Intelligence is assessed using age and developmentally appropriate instruments available in Spanish and currently in use in Costa Rica. However, a major problem with these IQ tests is that there are often no norms specific for individual Latin American countries. A few IQ tests have norms derived in Spain and Mexico, yet, according to Domingo Campos, Director, Instituto de Investigaciones Psicologicas de la Universidad de Costa Rica (Psychological Research Institute, University of Costa Rica), Costa Rica has no internal data of its own to assess potential scoring biases that might be introduced using foreign norms. The tests we use include the Bayley Scales of Infant Development II (1993) [30] (0–42 months developmental age), the McCarthy Scales of Children's Abilities (1972) [31] (2-1/2 to 8-1/2 years), the Leiter-R (1997) [32] (2 years to 20 years), the Wechsler Preschool and Primary Scale of Intelligence-Third Edition (2002) (WPPSI-III) [33], which is divided into two subtests for ages 2:6–3:11 years and 4:0–7:3 years, and the Wechsler Intelligence Scale for Children, Third Edition (1991) (WISC III) [34]. The IQ reflects how children answer verbal reasoning questions and respond to visual-spatial reasoning tasks. Because language and attention are impaired in children with autism, assessments of their IQs are notoriously unreliable. Therefore, we also administer the Vineland Adaptive Behavior Scales/VABS [35] to each proband. The VABS is a structured interview of the parent concerning observed communication and social and daily living skills at home and in the community. Both the IQ and VABS are administered by our psychologist, Licenciada Marcela Esquivel Pla., who was trained in these instruments by ERM.

Physical examination and laboratory testing

Each autistic proband undergoes a complete physical examination, including a neurological examination, an assessment for dysmorphic features, and a dermatological evaluation. Skin is carefully examined to look for signs of neurocutaneous disorders, including tuberous sclerosis (using a Wood's lamp) and hypomelanosis of Ito, as these disorders are strongly associated with autistic symptomatology. (Of note, one of the world's experts on hypomelanosis of Ito is doing a study at the HNN). Probands with gastrointestinal problems are sent to Internal Medicine for evaluation as at least one study has shown that an unusual complement-mediated lymphocytic colitis may be unique to severely affected autistic subjects [36]. All probands are karyotyped. Testing of auditory brainstem-evoked responses is requested in some cases, and computerized tomography scans are also available on some probands. Fragile X testing is done on all cases. Phenylketonuria (PKU) testing is also performed when required, as it was not instituted as a routine procedure in the CVCR until ~10 years ago.

Medical and social history

Please see the Clinical History form [see Additional file 1] for complete details of this evaluation. Sources of information for medical and social history include parents and medical records. In brief, we record parental occupational and educational history, followed by family neuropsychiatric history, obstetric data, including any adverse events during pregnancy and APGAR scores, the developmental and medical history of the proband, any medication and/or education the proband has received, and results of the physical exam and laboratory testing. As the family history of psychiatric disorders relies on parental report, it cannot be regarded as fully reliable. Therefore, we try to validate the diagnoses by asking about hospitalizations and medication treatments when possible.

In both the immediate and extended family we also specifically ask about the presence of language delay and learning deficits, which could be manifestations of the broader autism phenotype. We also ask about autoimmune disorders, as data suggests that at least some of the autistic phenotype may be induced by autoimmune mechanisms operating during pregnancy [37].

Verification of genealogy

Don Eduardo Fournier is a Costa Rican historian with extensive experience in tracing genealogies who collaborates on a majority of the genetic studies in Costa Rica. He screens the Civil Registry and, if necessary, birth, marriage, and death records in churches and civic centers to determine the birthplace of all grandparents and great-grandparents. Previous genetic studies in the CVCR have shown that probands whose great-grandparents were born in the CVCR will most probably be descendants of the original Spanish founder population. We require that cases have six of eight great grandparents born in the CVCR for inclusion in the study.

Best estimate diagnostic process

The ADI-R and ADOS are independently scored by our bilingual best-estimators, ERM or Pamela Bondy, M.S./CCC-L (PB). PB is a bilingual speech and language therapist with over 10 years of experience in the field of developmental disabilities. She was trained in the use of the ADI-R and ADOS by ERM. Discrepancies, if any, were resolved and final diagnoses reached after review of collateral historical information, clinical exam, and laboratory testing, according to standard best-estimate diagnostic procedure [38].

Results

To date we have ascertained 76 subjects and enrolled 70 families in our study. One family later declined to participate because of the mother's health, two cases have been excluded by genealogy, one case was too retarded to determine a diagnosis, one case has RETT syndrome (AU043), and the other excluded case is an autistic child with Moebius syndrome (AU044). We are screening the RETT syndrome case for mutations in the MECP2 gene. The Moebius syndrome case offers fascinating insights into the etiological basis of autism and will be reported in detail in a subsequent publication. Extrapolating from the entire data set of 70 cases, the male to female ratio appears to be ~6:1. Our goal is to collect over 200 trios, with no major or minor cytogenetic abnormalities, suitable for genetic mapping.

As the diagnostic evaluation takes two to three appointments, we have only complete best-estimated data on 35 cases to date. Karyotypes ordered for cases AU025, AU031, and AU040, with family histories of MR, and for case AU001, who has a cleft palate, were all negative at ≥ 550 bands. Interestingly, case AU025 and case AU031 are related to each other by a distance of seven generations, and a connection with case AU040 has not been ruled out. Case AU008, suspected of Angelman's syndrome, had one normal karyotype, and testing for a chromosomal 15q11-q13 abnormality will be performed. The rest of the karyotypes are pending.

Table 1 in the text contains abbreviated descriptive statistics on the first complete 35 cases [see Additional file 2]. Ages range from 3 years to 13 years of age, and 31 of the 35 cases are male. Mothers and fathers of the autistic children have at least some high school on average. The average mother is a homemaker and the fathers are skilled laborers; overall, the socioeconomic status of the parents is low. The mean total score for the social domain of the ADI-R is 25.3 ± 5.4 in our sample; the nonverbal and verbal communication domain mean scores are 12.6 ± 1.8 and 17.8 ± 3.4, respectively; and the mean score for the repetitive behaviors and stereotyped patterns domain is 6.6 ± 2.3. The ADOS module scores reflect the severity of the ADI-R scores in all cases. Vineland adaptive behavioral profile composite scores range from 20–80, excluding the value of 127 for case AU029 with Asperger's, and the mean score is 48.5 ± 19.4. The majority of full-scale IQ scores are less than 50. Delayed onset of phrase speech is present in 24 of the 35 cases.

Table 1 is an abbreviated version of descriptive data obtained for each proband, including their sex and age at interview. Scores for each domain of the ADI-R are provided, as well as the full-scale IQ score and the Vineland Adaptive Behavior composite score. The superscript numerals next to the IQ score indicate the specific IQ test that was used.

The Family History of Medical Disorders chart is available in the supplementary data [see Additional file 3]. AU033 developed epilepsy at the age of 2 years and 9 months, but is the only proband with this condition. Six of the cases have minor congenital defects, including a cleft palate, hip rotation, visual problems, megacisterna magna, and esophageal reflux/cardiomyopathy. Twelve of the cases have first- or second-degree relatives with language delay or learning deficits. Developmental delay or autism is present in the first-degree or second-degree relatives of four cases. Four of the cases have a second-degree relative with non-specific MR, one case has a second-degree relative with Down's syndrome, five cases have a second-degree relative with epilepsy, and one case has a sister with a minor congenital defect (cleft palate). Six cases have first-degree relatives with a major psychiatric disorder, including schizophrenia and major depression. No cases have tested positively for Fragile X or phenylketonuria, and no history of autoimmune disorder was documented for any case.

We have obtained extensive obstetric data on our cases and will be reporting it in full in a subsequent publication. In brief, although only 4 of the mothers were older than 35, 21 of them had obstetric complications and/or the infant had an APGAR score less than 6 at one minute. Fully twenty of the cases were the product of difficult labor, resulting in fetal distress and a caesarean section in eight instances.

Discussion

On the whole, our first cases have mean ADI-R scores comparable in severity to those of other autism genetic studies, including a sample from the Autism Genetic Resource Exchange (AGRE) (N = 364 cases from 212 sibships) [12] and a sample of 43 sibships from the International Molecular Genetic Study of Autism Consortium [16]. IQ and adaptive behavioral scores were not reported for the AGRE cases, but our mean VABS composite score is 48.5 ± 19.4 versus a mean of 47.44 ± 16.15 for the IMGSAC cases. However, it is clear that the cases of autism known to the HNN are more severe than those seen in other non-Hispanic populations studied recently, although perhaps not before 1991.

Eighty-three percent of our cases are mentally retarded, while 60% have IQs <50. In contrast, epidemiological data from a range of countries, although none of them Latin American, estimate that 75% of autistic individuals have IQs <70 and 40% have IQs <50 [2]. However, a closer look at all the major epidemiological studies to date, reviewed by Fombonne in 2003, shows that the median prevalence of autism was only 4.4/10,000, and the reported percentages of normal IQs were, in general, lower in studies done before 1991 when there was also less awareness of autism. In contrast, the median prevalence of autism is 12.7/10,000, and the percentages of normal IQs is increasingly higher, in studies done more recently. This is in part due to a broader definition and recognition of autism, but also, at least in the United States, it is possible that early intervention services, instituted over 15 years ago, have improved the cognitive performance of autistic children. For instance, some studies report that cases of autism with low IQs can achieve marked improvements in intelligence, language, learning, or visuo-spatial skills [39, 40] with a minimum of two years of intervention [41], although others feel that outcome measures have not been properly evaluated [42]. Costa Rica now provides some special education services; however, these are not specific to children with autism and are not offered to children more than once weekly. Moreover, teachers are not trained in autism interventions, and many children complete only primary education.

We must also consider the possibility that the IQs of our cases are underestimated due to the use of psychometric tests without Costa Rican norms. A recent study done in Argentina illustrates the effects of low socioeconomic status and lack of internal norms on IQ testing results. This group set out to perform a longitudinal study of the effects of poverty and malnutrition on the psychological development of children in a province of Buenos Aires [43]. The study took place from 1984 to 1995 and followed 100 children of low socioeconomic status with or without malnutrition. Cases between ages 0–2 with malnutrition but without other neurological or medical deficits were ascertained from an ambulatory Nutritional Rehabilitation Unit of a local hospital and matched with well-nourished cases of the same age and sex from the same socioeconomic background. A pediatrician, a pediatric neurologist, a psychologist, and an anthropologist performed the evaluations. Ninety-two children were reassessed at 2 years, and 44 were reassessed at the 10-year point. Malnutrition was rectified in that group during the two-year interval between assessments. For the initial evaluation, the group used the Escala de O. Brunet-I. Lezine, which is used to assess global psychomotor development of 0–2 year olds. At the next two time points, they used the Terman-Merril (Forma L-M) intelligence test to obtain IQs. This test was normed on children in the United States, and there were no norms available for Argentina.

At the first evaluation, the malnourished children did have significantly lower developmental quotients than the well nourished group, the majority of which had normal ratings. However, at time point 2, after which the malnourished children had been treated, there was no difference between groups, but both were lower than the standard. At time point 3, when the children were ~10 years of age, there was again no difference in IQ between groups, but ~50% of both groups had IQs = 70. The authors of the study drew two major conclusions from these results. The first was that poverty and lack of early intellectual stimulation had profound effects on IQ, even without malnutrition, and that these effects became more prominent with time. The second conclusion concerned the use of IQ tests without norms reflecting the general population of Argentina. The raters felt that the IQ scores of both groups were probably somewhat underestimated because the norms they were comparing them to were derived from children with much higher socioeconomic status. The raters were very experienced in administration of the IQ tests, which were commonly used at universities and elsewhere in Argentina, so misuse of the tests was not an issue. Unfortunately, Latin American governments do not invest in psychological research, and the corporations that sell tests in the United States don't see Latin America as a strong market and thus put no money into norming translated tests. (We wish to note that Argentina now has its own norms for some IQ tests but not all.)

As further evidence of problems with IQ testing, and perhaps ascertainment bias, in the CVCR, we note that in genetic studies of Tourette's Syndrome and ADHD ongoing in the CVCR, 20–25% of cases evaluated for either phenotype have been excluded because of MR (PJG, unpublished data). In contrast, 3.9 % of children with Tourette's Syndrome (TS) had MR (range 1–14%) in a large-scale analysis of this disorder in 22 countries (no specific data for Spanish-speaking countries) [44]. Additionally, although children with ADHD have, on average, IQs 7–12 points lower than comparison children, the rate of MR observed in the CVCR is certainly not characteristic of ADHD in North America [45, 46]. Of course, an ascertainment bias towards severe cases could also explain the CVCR IQ data for ADHD and TS. However, data concerning the prevalence of epilepsy in autism and ASD also suggests that the IQs of our subjects may be underestimated. For example, severe MR is often seen in cases of autism with a comorbid medical disorder. Early seizures, before two years of age, were present in 60% of this population in one study, and 20% of autistic subjects with severe MR but no comorbid medical disorders experienced seizures before the age of five [47]. As the mean age of our probands is 6.8 years and only one of them has experienced seizures, it seems less likely that autism is secondary to other medical factors in the majority of our cases. Finally, the median male to female sex ratio of 11 previous epidemiological studies, wherein the majority of cases were moderately to severely retarded, was 1.9:1, versus 5.75:1 for studies of predominantly normal IQ probands [2]. We also observe a family history of MR in 4 of our cases, but our male to female sex ratio is ~6:1 (also true for the 70 cases collected to date).

Accurate assessment of IQ is important, as data suggests that that there may be different genetic and environmental determinants for autism based on level of cognition, although cases of autism with low IQ may still have a strong genetic basis. For instance, Baird & August [48] observed a familial loading in cognitive impairment confined to autistic probands with severe or profound MR. To determine if autism with severe MR was a distinctly different autistic endophenotype associated with increased familial cognitive impairment, another group [49] studied 47 autistic probands with an IQ <50 and contrasted their findings with a sample of 99 autistic subjects, the majority of whom had IQs >50 [6]. Importantly, they found that increased loading for ASD was comparable in both samples, supporting prior evidence that the same genetic liability applies to autism and ASD within families, regardless of IQ level. Interestingly, a recent study also shows that co-occurrence of lower IQ and ADHD reflect common genetic determinants and not necessarily the presence of a primary medical or neurological disorder [46].

We do note frequent obstetric complications in our sample and are researching the rates of these complications in the CVCR hospitals for comparison. We are also looking at factors such as geographic distance from a hospital, which might contribute to suboptimal labor and delivery. However, recent data suggests that these complications are commonly associated with autism and ASD. A large-scale epidemiological study of autism in Western Australia found that cases diagnosed with autism, as well as their unaffected siblings, had more obstetric complications than a control group [50]. The authors suggest that the increased prevalence of obstetric complications among autism cases is most likely due to underlying genetic factors, possibly exacerbated by environmental stressors.

There are many possible underlying cytogenetic or other medical disorders that may be accompanied by autistic behavior, and the presence of severe MR can make those cases suspect even if karyotypes are normal. Disturbingly, a group of investigators recently reported that they found microdups/dels, as well as other genetic abnormalities, in 272 cases from the Paris Autism Research International Sibpair (PARIS) sample that had already been included in genetic linkage and association studies [51]. These include a 22q11 deletion without the associated features of DiGeorge/Velocardiofacial syndrome in two autistic brothers with severe MR, and their mother, as well as duplications of 15q11-13 (in two different singletons) and of 17p11.2 and 7q11.2. Therefore, we have developed a collaboration to screen our cases using microarray-based Comparative Genomic Hybridization technology. We will hybridize our samples to a whole genome array containing 2632 BAC (bacterial artificial chromosome) clones at a resolution of ~1 Mb spanning the 22 autosomes and the X and Y chromosomes. In this way we will find any known and novel microdups/dels, as well as subtelomeric abnormalities, in our cases before we proceed with any genetic association analyses. Thus, we feel confident that our cases, regardless of IQ, will be as free of genetic abnormalities as can be determined given current technology.

Conclusion

We have successfully used the Spanish versions of the ADI-R and ADOS to diagnose autism for genetic study in the CVCR. The majority of the cases reported here have IQ <50. This reflects an ascertainment bias, yet it is also possible that these scores are artificially low. Nevertheless, we are most likely missing cases of autism with normal or near normal IQ due to a lack of government-sponsored services. Therefore, we are implementing a strategy, used successfully by one of our clinical experts to find both English-speaking and Spanish-speaking higher functioning autistic subjects in the United States, to ascertain these cases. We believe that similar problems with IQ testing and the need for specific strategies to find high functioning autism cases will be important issues to address for studies of autism planned or ongoing in other Latin American countries.

References

  1. Folstein SE, Rosen-Sheidley B: Genetics of autism: Complex aetiology for a heterogeneous disorder. Nat Rev Genet. 2001, 2: 943-955. 10.1038/35103559.

    Article  CAS  PubMed  Google Scholar 

  2. Fombonne E: Epidemiological surveys of autism and other pervasive developmental disorders: an update. J Autism Dev Disord. 2003, 33: 365-382. 10.1023/A:1025054610557.

    Article  PubMed  Google Scholar 

  3. DeLong GR, Dwyer JT: Correlation of family history with specific autistic subgroups: Asperger's syndrome and bipolar affective disease. J Autism Dev Disord. 1988, 18: 593-600.

    Article  CAS  PubMed  Google Scholar 

  4. Gillberg C, Gillberg IC, Steffenburg S: Siblings and parents of children with autism: A controlled population-based study. Dev Med Child Neurol. 1992, 34: 389-398.

    Article  CAS  PubMed  Google Scholar 

  5. Szatmari P, Boyle MH, Offord DR: Familial aggregation of emotional and behavioral problems of childhood in the general population. Am J Psychiatry. 1993, 150: 1398-1403.

    Article  CAS  PubMed  Google Scholar 

  6. Bolton P, Macdonald H, Pickles A, Rios P, Goode S, Crowson M, Bailey A, Rutter M: A case-control family history study of autism. J Child Psychol Psychiatry. 1994, 35: 877-900.

    Article  CAS  PubMed  Google Scholar 

  7. Jamain S, Quach H, Betancur C, Rastam M, Colineaux C, Gillberg IC, Soderstrom H, Giros B, Leboyer M, Gillberg C, Bourgeron T, Paris Autism Research International Sibpair Study: Mutations of the X-linked genes encoding neuroligins NLGN3 and NLGN4 are associated with autism. Nat Genet. 2003, 34: 27-29. 10.1038/ng1136.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  8. Comoletti D, De Jaco A, Jennings LL, Flynn RE, Gaietta G, Tsigelny I, Ellisman MH, Taylor P: The Arg451Cys-neuroligin-3 mutation associated with autism reveals a defect in protein processing. J Neurosci. 2004, 24: 4889-4893. 10.1523/JNEUROSCI.0468-04.2004.

    Article  CAS  PubMed  Google Scholar 

  9. Szatmari P, Jones MB, Zwaigenbaum L, MacLean JE: Genetics of autism: Overview and new directions. J Autism Dev Disord. 1998, 28: 351-368. 10.1023/A:1026096203946.

    Article  CAS  PubMed  Google Scholar 

  10. Risch N, Spiker D, Lotspeich L, Nouri N, Hinds D, Hallmayer J, Kalaydjieva L, McCague P, Dimiceli S, Pitts T, Nguyen L, Yang J, Harper C, Thorpe D, Vermeer S, Young H, Hebert J, Lin A, Ferguson J, Chiotti C, Wiese-Slater S, Rogers T, Salmon B, Nicholas P, Myers RM: A genomic screen of autism: Evidence for a multilocus etiology. Am J Hum Genet. 1999, 65: 493-507. 10.1086/302497.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  11. Pritchard JK: Are rare variants responsible for susceptibility to complex diseases?. Am J Hum Genet. 2001, 69: 124-137. 10.1086/321272.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Silverman JM, Smith CJ, Schmeidler J, Hollander E, Lawlor BA, Fitzgerald M, Buxbaum JD, Delaney K, Galvin P, Autism Genetic Research Exchange Consortium: Symptom domains in autism and related conditions: Evidence for familiality. Am J Med Genet. 2002, 114: 64-73. 10.1002/ajmg.10048.

    Article  PubMed  Google Scholar 

  13. Buxbaum JD, Silverman J, Keddache M, Smith CJ, Hollander E, Ramoz N, Reichert JG: Linkage analysis for autism in a subset families with obsessive-compulsive behaviors: Evidence for an autism susceptibility gene on chromosome 1 and further support for susceptibility genes on chromosome 6 and 19. Mol Psychiatry. 2004, 9: 144-150. 10.1038/sj.mp.4001465.

    Article  CAS  PubMed  Google Scholar 

  14. Bradford Y, Haines J, Hutcheson H, Gardiner M, Braun T, Sheffield V, Cassavant T, Huang W, Wang K, Vieland V, Folstein S, Santangelo S, Piven J: Incorporating language phenotypes strengthens evidence of linkage to autism. Am J Med Genet. 2001, 105: 539-547. 10.1002/ajmg.1497.

    Article  CAS  PubMed  Google Scholar 

  15. Buxbaum JD, Silverman JM, Smith CJ, Kilifarski M, Reichert J, Hollander E, Lawlor BA, Fitzgerald M, Greenberg DA, Davis KL: Evidence for a susceptibility gene for autism on chromosome 2 and for genetic heterogeneity. Am J Hum Genet. 2001, 68: 1514-1520. 10.1086/320588.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  16. International Molecular Genetic Study of Autism Consortium (IMGSAC): A genomewide screen for autism: Strong evidence for linkage to chromosomes 2q, 7q, and 16p. Am J Hum Genet. 2001, 69: 570-581. 10.1086/323264.

    Article  Google Scholar 

  17. Alarcon M, Cantor RM, Liu J, Gilliam TC, Geschwind DH, Autism Genetic Research Exchange Consortium: Evidence for a language quantitative trait locus on chromosome 7q in multiplex autism families. Am J Hum Genet. 2002, 70: 60-71. 10.1086/338241.

    Article  CAS  PubMed  Google Scholar 

  18. Puffenberger EG, Hosoda K, Washington SS, Nakao K, deWit D, Yanagisawa M, Chakravart A: A missense mutation of the endothelin-B receptor gene in multigenic hirschsprung's disease. Cell. 1994, 79: 1257-1266. 10.1016/0092-8674(94)90016-7.

    Article  CAS  PubMed  Google Scholar 

  19. Mathews CA, Reus VI, Bejarano J, Escamilla MA, Fournier E, Herrera LD, Lowe TL, McInnes LA, Molina J, Ophoff RA, Raventos H, Sandkuijl LA, Service SK, Spesny M, Leon PE, Freimer NB: Genetic studies of neuropsychiatric disorders in costa rica: A model for the use of isolated populations. Psychiatr Genet. 2004, 14: 13-23. 10.1097/00041444-200403000-00003.

    Article  PubMed  Google Scholar 

  20. Carvajal-Carmona LG, Ophoff R, Service S, Hartiala J, Molina J, Leon P, Ospina J, Bedoya G, Freimer N, Ruiz-Linares A: Genetic demography of antioquia (colombia) and the central valley of costa rica. Hum Genet. 2003, 112: 534-541.

    CAS  PubMed  Google Scholar 

  21. Auranen M, Nieminen T, Majuri S, Vanhala R, Peltonen L, Jarvela I: Analysis of autism susceptibility gene loci on chromosomes 1p, 4p, 6q, 7q, 13q, 15q, 16p, 17q, 19q and 22q in finnish multiplex families. Mol Psychiatry. 2000, 5: 320-322. 10.1038/sj.mp.4000708.

    Article  CAS  PubMed  Google Scholar 

  22. Auranen M, Varilo T, Alen R, Vanhala R, Ayers K, Kempas E, Ylisaukko-Oja T, Peltonen L, Jarvela I: Evidence for allelic association on chromosome 3q25-27 in families with autism spectrum disorders originating from a subisolate of finland. Mol Psychiatry. 2003, 8: 879-884. 10.1038/sj.mp.4001299.

    Article  CAS  PubMed  Google Scholar 

  23. Ylisaukko-oja T, Nieminen-von Wendt T, Kempas E, Sarenius S, Varilo T, von Wendt L, Peltonen L, Jarvela I: Genome-wide scan for loci of asperger syndrome. Mol Psychiatry. 2004, 9: 161-168. 10.1038/sj.mp.4001385.

    Article  CAS  PubMed  Google Scholar 

  24. Lord C, Rutter M, Le Couteur A: Autism diagnostic interview-revised: A revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. J Autism Dev Disord. 1994, 24: 659-685.

    Article  CAS  PubMed  Google Scholar 

  25. Lord C, Risi S, Lambrecht L, Cook EH, Leventhal BL, DiLavore PC, Pickles A, Rutter M: The autism diagnostic observation schedule-generic: A standard measure of social and communication deficits associated with the spectrum of autism. J Autism Dev Disord. 2000, 30: 205-223. 10.1023/A:1005592401947.

    Article  CAS  PubMed  Google Scholar 

  26. Gurney JG, Fritz MS, Ness KK, Sievers P, Newschaffer CJ, Shapiro EG: Analysis of prevalence trends of autism spectrum disorder in Minnesota. Arch Pediatr Adolesc Med. 2003, 157: 622-627. 10.1001/archpedi.157.7.622.

    Article  PubMed  Google Scholar 

  27. Barbaresi WJ, Katusic SK, Colligan RC, Weaver AL, Jacobsen SJ: The incidence of autism in Olmsted County, Minnesota, 1976–1997: results from a population-based study. Arch Pediatr Adolesc Med. 2005, 159: 37-44. 10.1001/archpedi.159.1.37.

    Article  PubMed  Google Scholar 

  28. Keen D, Ward S: Autistic spectrum disorder: a child population profile. Autism. 2004, 8: 39-48. 10.1177/1362361304040637.

    Article  PubMed  Google Scholar 

  29. Sturm H, Fernell E, Gillberg C: Autism spectrum disorders in children with normal intellectual levels: associated impairments and subgroups. Dev Med Child Neurol. 2004, 46: 444-447. 10.1017/S0012162204000738.

    Article  PubMed  Google Scholar 

  30. Bayley N: The Bayley Scales of Infant Development. 1993, San Antonio, TX: The Psychological Corp

    Google Scholar 

  31. McCarthy D: The McCarthy Scales of Children's Abilities. 1972, San Antonio, TX: The Psychological Corp

    Google Scholar 

  32. Roid GH, Miller LJ: Leiter International Performance Scale-Revised:Examiner's Manual. 1997, Wood Dale, IL: Stoelting Company

    Google Scholar 

  33. Wechsler D: Wechsler Preschool and Primary Scale of intelligence. 2002, San Antonio, TX: Harcourt Assessment, Inc, third

    Google Scholar 

  34. Wechsler D: Wechsler Intelligence Scale for Children, Third Edition (WISC-III). 1991, San Antonio, TX: The Psychological Corporation

    Google Scholar 

  35. Sparrow SS, Balla DA, Cicchetti DV: Vineland Adaptive Behavior Scales. 1984, UNITED STATES: American Guidance Service

    Google Scholar 

  36. Torrente F, Ashwood P, Day R, Machado N, Furlano RI, Anthony A, Davies SE, Wakefield AJ, Thomson MA, Walker-Smith JA, Murch SH: Small intestinal enteropathy with epithelial IgG and complement deposition in children with regressive autism. Mol Psychiatry. 2002, 7: 375-82. 10.1038/sj.mp.4001077. 334.

    Article  CAS  PubMed  Google Scholar 

  37. Sweeten TL, Bowyer SL, Posey DJ, Halberstadt GM, McDougle CJ: Increased prevalence of familial autoimmunity in probands with pervasive developmental disorders. Pediatrics. 2003, 112: e420-10.1542/peds.112.5.e420.

    Article  PubMed  Google Scholar 

  38. Leckman JF, Sholomskas D, Thompson WD, Belanger A, Weissman MM: Best estimate of lifetime psychiatric diagnosis: A methodological study. Arch Gen Psychiatry. 1982, 39: 879-883.

    Article  CAS  PubMed  Google Scholar 

  39. Smith T, Groen AD, Wynn JW: Randomized trial of intensive early intervention for children with pervasive developmental disorder. Am J Ment Retard. 2000, 105: 269-285. 10.1352/0895-8017(2000)105<0269:RTOIEI>2.0.CO;2.

    Article  CAS  PubMed  Google Scholar 

  40. Harris SL, Handleman JS: Age and IQ at intake as predictors of placement for young children with autism: A four- to six-year follow-up. J Autism Dev Disord. 2000, 30: 137-142. 10.1023/A:1005459606120.

    Article  CAS  PubMed  Google Scholar 

  41. Filipek PA, Accardo PJ, Ashwal S, et al: Practice parameter: screening and diagnosis of autism: report of the Quality Standards Subcommittee of the American Academy of Neurology and the Child Neurology Society. Neurology. 2000, 55: 468-479.

    Article  CAS  PubMed  Google Scholar 

  42. Gresham FM, MacMillan DL: Early intervention project: Can its claims be substantiated and its effects replicated?. J Autism Dev Disord. 1998, 28: 5-13. 10.1023/A:1026002717402.

    Article  CAS  PubMed  Google Scholar 

  43. Di Iorio S, Urrutia MI, Rodrigo MA: Desarrollo psicológico, nutrición y pobreza (Argentina). Rev chil pediatr. 2000, 71: 263-274.

    Article  Google Scholar 

  44. Freeman RD, Fast DK, Burd L, Kerbeshian J, Robertson MM, Sandor P: An international perspective on Tourette syndrome: selected findings from 3,500 individuals in 22 countries. Dev Med Child Neurol. 2000, 42: 436-447. 10.1017/S0012162200000839.

    Article  CAS  PubMed  Google Scholar 

  45. Frazier TW, Demaree HA, Youngstrom EA: Meta-analysis of intellectual and neuropsychological test performance in attention-deficit/hyperactivity disorder. Neuropsychology. 2004, 18: 543-555. 10.1037/0894-4105.18.3.543.

    Article  PubMed  Google Scholar 

  46. Kuntsi J, Eley TC, Taylor A, et al: Co-occurrence of ADHD and low IQ has genetic origins. Am J Med Genet B Neuropsychiatr Genet. 2004, 124: 41-47. 10.1002/ajmg.b.20076.

    Article  Google Scholar 

  47. Pavone P, Incorpora G, Fiumara A, Parano E, Trifiletti RR, Ruggieri M: Epilepsy is not a prominent feature of primary autism. Neuropediatrics. 2004, 35: 207-210. 10.1055/s-2004-821079.

    Article  CAS  PubMed  Google Scholar 

  48. Baird TD, August GJ: Familial heterogeneity in infantile autism. J Autism Dev Disord. 1985, 15: 315-321.

    Article  CAS  PubMed  Google Scholar 

  49. Starr E, Berument SK, Pickles A, Tomlins M, Bailey A, Papanikolaou K, Rutter M: A family genetic study of autism associated with profound MR. J Autism Dev Disord. 2001, 31: 89-96. 10.1023/A:1005669915105.

    Article  CAS  PubMed  Google Scholar 

  50. Glasson EJ, Bower C, Petterson B, de Klerk N, Chaney G, Hallmayer JF: Perinatal factors and the development of autism: A population study. Arch Gen Psychiatry. 2004, 61: 618-627. 10.1001/archpsyc.61.6.618.

    Article  PubMed  Google Scholar 

  51. Betancur C, Heron D, Verloes A, Phillippe A, Munnich A, Depienne C, Brice A, Leboyer M: Etiological heterogeneity in autism: Implications for linkage and association studies. World Congress of Psychiatric Genetics, Dublin, Ireland. 2004

    Google Scholar 

  52. Gener B, Cusco I, Del Campo M, Gonzlez E, Sumoy L, Vilella M, Infante A, Munoz JAM, Salido M, Villa O, Perez Jurado LA: Clinical andmolecular studies in Spanish Autistic patients. American Society of Human Genetics Meeting. October 26–30, 2004

Pre-publication history

Download references

Acknowledgements

LAM is supported by NINDS grant number R01 043540.

We would like to thank Andrea Vargas and Haya Wasserstein for help with recording subject interviews, the physicians at the HNN who served as consultants for this project, including the dermatologist Dr. Mario Sancho, and the audiologist Dr. Juan José Madriz, Dr. Olga Arguedas from the Bioethical Board, Drs. Isabel Castro and Patricia Cuenca for performing chromosomal testing, and Dr. Abdon Castro, Presidente de la Fundación Pro Hospital Nacional de Ninos "Dr Carlos Sáenz Herrera". We also thank Safiana Katz, Eric Mesh, and Zhan Liu for their careful processing of DNA samples and immortalized cell lines.

Above all, we are grateful to the families who have participated in the study and to the Autism Parents' Association of San José, Costa Rica.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to L Alison McInnes.

Additional information

Competing interests

The author(s) declare that they have no competing interests.

Authors' contributions

LAM secured the funding for the study, played a major role in designing the study, contributed to the data analysis, and wrote the manuscript.

PJG is the leading clinician in Costa Rica and performed the majority of the diagnostic interviews using the ADI-R and ADOS, as well as the neurological and medical evaluations. She contributed to the study design and to the data analysis and ensures compliance with the Bioethics Committee at the HNN.

ME coordinated the study in Costa Rica and contributed to the data analysis. She administered informed consents and IQ tests, arranged appointments with subjects.

ERM is the lead best estimator for our study and performed the majority of data evaluations. She trained the Costa Rican team in the use of current psychological instruments. She also contributed to the manuscript.

MFD performed diagnostic interviews using the ADI-R and contributed to the data analysis.

SSM assisted PJG in performing the ADOS and contributed to the data analysis.

EF traced the genealogies of the probands and is responsible for establishing familial relationships between the cases as well as providing population data for the CVCR essential to the manuscript.

PB performed best-estimate data evaluations and contributed to the data analysis.

KC coordinated the study in the USA, entered diagnostic information into a database for future statistical analysis, contributed to the manuscript and ensured compliance with the Institutional Review Board at Mount Sinai School of Medicine.

All authors read and approved the final manuscript.

Electronic supplementary material

12888_2004_97_MOESM1_ESM.xls

Additional File 1: Formulario de historia clinica This is the clinical history form that we designed in Spanish. The table begins with parental occupational and educational history followed by family neuropsychiatric history, obstetric data, including APGAR scores, the developmental and medical history of the proband, education the proband has received and results of the physical exam and laboratory testing. (XLS 153 KB)

12888_2004_97_MOESM2_ESM.xls

Additional File 2: Results of Diagnostic Evaluations for Autism This table contains scores for the individual scores subdomains of the ADI-R, the ADOS scores, the IQ scores and information regarding the parents' occupations and education. (XLS 34 KB)

12888_2004_97_MOESM3_ESM.xls

Additional File 3: Family History of Medical Disorders This table contains details of the family and personal medical history for each proband. We specifically asked about the presence of autism, language delay, learning deficits, MR, epilepsy or other neurological abnormality, cerebral palsy, major psychiatric disorders and deafness. For instance, if a first cousin on the maternal side had epilepsy, we typed 'M first cousin' in the appropriate box. The letters 'M' or 'P' indicate whether the relative is on the maternal or paternal side, respectively. If the mother had a complication during pregnancy such as bleeding or a urinary tract infection, this is noted with an x in the appropriate box. APGAR scores are recorded, as well as the presence of any congenital defects in the proband. (XLS 38 KB)

Rights and permissions

Reprints and permissions

About this article

Cite this article

McInnes, L.A., González, P.J., Manghi, E.R. et al. A genetic study of autism in Costa Rica: multiple variables affecting IQ scores observed in a preliminary sample of autistic cases. BMC Psychiatry 5, 15 (2005). https://doi.org/10.1186/1471-244X-5-15

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-244X-5-15

Keywords