A controlled trial of implementing a complex mental health intervention for carers of vulnerable young people living in out-of-home care: the ripple project
BMC Psychiatry volume 16, Article number: 436 (2016)
Out-of-home care (OoHC) refers to young people removed from their families by the state because of abuse, neglect or other adversities. Many of the young people experience poor mental health and social function before, during and after leaving care. Rigorously evaluated interventions are urgently required.
This publication describes the protocol for the Ripple project and notes early findings from a controlled trial demonstrating the feasibility of the work. The Ripple project is implementing and evaluating a complex mental health intervention that aims to strengthen the therapeutic capacities of carers and case managers of young people (12-17 years) in OoHC.
The study is conducted in partnership with mental health, substance abuse and social services in Melbourne, with young people as participants. It has three parts:
1. Needs assessment and implementation of a complex mental health intervention; 2. A 3-year controlled trial of the mental health, social and economic outcomes; and 3. Nested process evaluation of the intervention.
Early findings characterising the young people, their carers and case managers and implementing the intervention are available. The trial Wave 1 includes interviews with 176 young people, 52% of those eligible in the study population, 104 carers and 79 case managers.
Implementing and researching an affordable service system intervention appears feasible and likely to be applicable in other places and countries. Success of the intervention will potentially contribute to reducing mental ill-health among these young people, including suicide attempts, self-harm and substance abuse, as well as reducing homelessness, social isolation and contact with the criminal justice system.
Australian New Zealand Clinical Trials Registry ACTRN12615000501549. Retrospectively registered 19 May 2015.
More than eight million young people worldwide who have been abandoned, orphaned, neglected or are otherwise unsafe at home live in large institutions or orphanages, under adverse conditions including strict routines, lack of personal relationships and isolation from wider society . Many countries promote foster-care programs as a solution to better care for these vulnerable children. Foster care programs need to be well designed and support stable placements, given unstable placements are likely to be as harmful as institutionalisation to a child’s future mental health and function .
In Australia, foster care and similar programs are known as ‘out of home care’ (OoHC). OoHC is provided to young people up to 18 years old who are removed from home by the state because of significant risk of harm from abuse, neglect or other adversity. Many have multiple and complex needs, with poor mental health and social function before, during and after care [2, 3].
Young people in OoHC
The three main types of OoHC are: foster care, in the private home of a substitute family receiving payment for the child's living expenses; kinship care, with a family member or approved custodian (both constitute home-based care); and residential care, in a house with up to four young people supported by paid staff . Each week in the Australian state of Victoria (population 6 million) over 60 young people are placed in OoHC. On any single day approximately 7700 are in OoHC placements, about one-third of whom are aged 12-17 years . Around 90% live in home-based care and the remainder in residential care .
The number of children and young people in OoHC in Australia is escalating, as more stay longer in care . In 2013-14, there were 43,000 living in OoHC, more than double the national numbers in 2001 . Aboriginal and Torres Strait Islander (ATSI) young people are living in OoHC at almost ten times the rate of their non-ATSI counterparts . The Australian Productivity Commission estimated direct national expenditure on child protection services in 2009-10 as $2.5 billion dollars, of which OoHC accounted for 65% or $1.7 billion . A similar situation exists in other countries including the USA , and the UK .
Problems with mental health and social function in OoHC recipients
The risk of mental ill-health for young people living in OoHC is notably higher than in the general population. There are high rates of emotional and behavioural disorders among children in foster care in the USA, UK and Denmark, as determined on rating scales such as the Child Behaviour Checklist and Strengths and Difficulties Questionnaire (SDQ) [8–10]. In an English national prevalence study,  45% of ‘looked-after children’ had a diagnosable mental disorder, compared with 10% in the general population. Those with mental health problems and disorders were also more likely to have educational, health and social problems [9, 11]. As well as disrupted families and exposure to emotional, physical and sexual trauma, poverty and other adversities, young people in OoHC commonly experience problems with alcohol and other drugs, suicidal ideation and self-harm, delinquency, and truancy [12–14]. These findings are consistent across studies in Australia, USA, UK and Denmark [8–10, 12–14]. The young people are also less likely to have timely access to mental health care [9, 15–17]. Proactive, regular and voluntary help-seeking is infrequent among vulnerable young people [17, 18].
Young people are legally required to leave the state protection of OoHC at the age of 18 in Australia. They then encounter limited opportunities for work or further education and are at significant risk of homelessness . A longitudinal study of young people leaving care in Australia reported that nearly 50% had attempted suicide within four years . One in three young women had become pregnant or given birth within 12 months of leaving care . Thirty five percent of young people in state care in another study had become homeless within 12 months of leaving care .
International research confirms that foster care children who experience placement disruption and instability are at heightened risk of a range of poor outcomes . Young people in Australia who were settled in one placement for at least 75% of their time in care had better outcomes a year later than those with multiple placements .
Therapeutic mental health care in the OoHC system
The OoHC system needs to be based on therapeutic care principles. A therapeutic response is defined as: appropriate to the background of abuse and neglect and the problems related to emotions, behaviour and functioning common to many young people in the sector. All forms of OoHC risk re-traumatising young people by failing to respond to their needs [2, 22–25]. Improvements in mental health services are unlikely to have much effect unless OoHC systems become more therapeutic ; and simply providing day-to-day care for children and young people in OoHC is no longer an adequate approach [2, 24]. A recent international review identified one intervention that met review criteria for adolescents in OoHC, the Multidimensional Treatment Foster Care for Adolescents (MTFC-A; ). MTFC trains foster carers to deal with young people with high behavioural and mental health needs enabling those young people to stay out of residential care and receive individual, intensive support . Carers are supported by a team of professionals who aim to work proactively with the young person and prevent behavioural and mental health problems and subsequent placement breakdowns. The review of MTFC-A described the existing evidence for its effectiveness as weak, and recommended that rigorous evaluation studies, while difficult to conduct, are sorely needed in this field .
Australia’s National Standards for OoHC  recommend that children and young people have their physical, developmental, psychosocial and mental health needs assessed and addressed in a timely way. Cross-service practice models offer integrated and trauma-informed mental health support in Victoria and elsewhere [22, 30]. These reach approximately 10% of all young people in OoHC in Victoria. There is evidence that cross-service models can be successfully implemented  and are associated with improved placement stability for adolescents . However, child and youth services generally have tenuous links with health services and have been slow to implement evidence-based practices in mental health [33, 34]. These young people require innovative approaches to delivering evidence-based mental health practice, including cross-sector collaboration. The common approaches do not reach most of them nor provide appropriate responses to their needs .
Australian National Standards for OoHC  note the importance of maintaining cultural links for the young people, including Aboriginal and Torres Strait Islander (ATSI) young people. There is little information in Australia about young people in OoHC either from ATSI or other culturally and linguistically diverse (CALD) groups, including those with refugee backgrounds [2, 35] and associated experiences of trauma, dislocation and loss .
Carers supporting young people’
The environment and individual relationships with the young person are both crucial in the therapeutic and recovery process . Those caring for young people need an understanding of trauma and its impact and the capacity to respond in an attuned way to promote mental health [20, 30]. Most carers are helped by basic theoretical knowledge, familiarity with evidence-based techniques, and a trusted adviser with whom to discuss instances of disturbed behaviour and emotional responses. Specific techniques can help the young person learn to regulate emotions, accept painful feelings, promote direct expression of feelings appropriately rather than withdrawing or behaving destructively, desensitise traumatic memories and promote unified thoughts, feelings and behaviours .
There are calls for greater attention to the training and support needs of carers, their wellbeing and retention to caring [36, 37]. Many carers report high levels of stress and poor coping [36–38]. Irrespective of their capacity to identify mental ill-health, many do not gain access to mental health care for the young person [39, 40]. When they do have access, carers often feel excluded from treatment planning and implementation . Mental health training and consultation improve carer wellbeing, and increase the likelihood of access, when warranted, to mental health services [42, 43].
Working in collaboration across the service systems
Collaboration is essential for tackling complex problems with roots in multiple sectors of society . Poor mental health among young people in OoHC is one such complex problem. Tackling this problem requires collaboration between mental health and social services, and is most likely to succeed when the partners are clear about their respective roles [45, 46] and understand the differences in their viewpoints about therapeutic approaches for young people with multiple and complex needs [18, 22]. Australian studies suggest that a prominent barrier to collaboration in OoHC is frustration among professionals related to a lack of common understanding of the young person’s situation arising from differing professional frameworks for addressing problem behaviours. Other barriers to collaboration include power imbalances within and between professional groups, along with insufficient resources to actually address problems .
Implementing evidence-based mental health practice – EBP – for vulnerable young people
Several different therapeutic approaches are effective in reducing emotional and behavioural problems and improving mental health for adolescents with multiple and complex needs [48, 49]. These include: motivational interviewing (MI), cognitive behaviour therapy (CBT), and adolescent community reinforcement approach (ACRA) . A modular practice elements approach to selecting and designing EBP (‘EBP elements’) is a flexible option for young people with multiple and complex needs [34, 48–50]. Mental health services in a variety of locations and contexts have adopted this approach effectively [51, 52]. Common problems for young people in OoHC and amenable to treatment through EBP elements include: (i) emotional dysregulation (manifesting as anger, deliberate self-harm, and suicidal ideation); (ii) insecure attachment (manifesting as difficulties forming stable emotional bonds with others); (iii) low self-efficacy and expectations for the future; and (iv) limited social problem-solving skills [48–50].
A complementary approach to addressing the needs of young people is training for carers in emotional responsiveness. The Tuning into Teens (TINT) program  is an emotion-coaching program for parents that reduces emotional and behavioural problems in young people. The TINT program has been adapted for use in OoHC.
Implementing and evaluating an innovative mental health intervention
We found no studies of a systematic approach to improving mental health for adolescents in ‘usual care’ OoHC in Australia. US and UK studies focus on the complexity of integrating EBP into therapeutic foster care programs run by child welfare agencies [54, 55]. Implementation science indicates that the changes needed to embed evidence-informed practice into complex systems occur in stages . The first or exploration stage involves sustained work to establish readiness for change. Interested parties engage in mobilising support, establishing feasibility and developing commitment to the innovations . The Ripple study design reflects the understanding that when shifting practice to focus on improving mental health of young people in OoHC, this early stage in implementation is critical.
The Ripple project
The project concerns young people in Melbourne (capital city of the Australian state of Victoria) living in all types of statutory OoHC. The Victorian government’s department of Children, Youth and Family Service contracts with community service organisations (CSOs) to provide OoHC. The project investigates the implementation of an innovative mental health intervention in OoHC settings managed by CSOs. A recent mental health policy initiative in Victoria prescribes priority access to state-funded mental health services for young people in OoHC and emphasises support for carers and case managers . Design of the Ripple intervention draws on this and other observations: improving coordination between mental health and OoHC services and increasing capacities of staff and carers in both sectors to work together are prerequisites to improving mental health and social functioning for vulnerable young people .
The intervention is described in Table 1. Its features include collaboration between OoHC and mental health organisations and tailored delivery of. evidence-based mental health support using skilled mental health and alcohol and other drug (AOD) knowledge and skills. Senior mental health or AOD practitioners schedule regular visits (2-4weekly) to CSO program sites. Practitioners are trained and supervised in using community development and adult-learning principles to develop one or more six-session intervention plans collaboratively with CSO workers. All CSO programs are offered a choice in delivery modes (such as practice group discussions - See Table 1 - “modes”) and topics (see Table 1 - “content section”). The tailored approach to planning the mode and content of the intervention is responsive to the learning styles and interests of each CSO program, and it allows for changes based on the groups’ evolving needs and experience of the intervention. Participation of young people with experience of OoHC is likely to improve the chances of a successful intervention by creating a positive climate, generating useful ideas and links to decision makers. This is likely to improve the young peoples’ engagement, health and social outcomes and the quality of services and professional work [59–62].
The four Community Sector Organisations (CSOs) involved in the project are large, multi-functional, not for profit organisations. The Victorian Aboriginal Child Care Agency (VACCA) has a focus on Aboriginal families. Like the other organisations (Anglicare Victoria, Mackillop and Westcare), they cross the spectrum of programs to respond to vulnerable families providing early intervention, intensive family support services, and services for children, families and carers in out of home care. The staff in all organisations include highly qualified social workers and psychologists, as well as those with baseline qualifications at Certificate level. Aside from VACCA, the organisations hold strong religious affiliations though the employment of staff is not based on professional rather than religious affiliation. Most of the programs the CSOs provide are funded by government.
The paper aims to describe the protocol for the Ripple project and to note early findings from a controlled trial demonstrating the feasibility of the work. The Ripple project is implementing and evaluating the complex mental health intervention described above that aims to strengthen the therapeutic capacities of carers and case managers of young people (12-17 years) in OoHC.
The overall aims of the Ripple project are to assess whether a mental health intervention that enhances therapeutic care roles and capacities of carers in OoHC will improve (i) consistency and quality of OoHC for all young people (12-17 years) in the sector, and (ii) access to early intervention, when indicated, for prevention and treatment of mental illness in a cost-effective manner. Both outcomes will likely contribute to improving the mental health of young people in OoHC.
After three years, young people in OoHC in a region in which the intervention is delivered (intervention group) will have better mental health, and better social functioning than those receiving care as usual (comparison group), on the outcome measures of i) emotional distress, harmful use of substances, and disturbed conduct; and ii) social relationships, education and occupation.
In the intervention group compared with the comparison group, after three years: (i) young people in OoHC will receive more evidence-based psychosocial interventions, have fewer placement changes, and report more community connections and greater sense of empowerment; (ii) foster and kinship carers and residential care workers (carers), and child protection and CSO workers (case managers) will have greater satisfaction with their work, less stress, improved health-related quality of life, improved attitudes towards EBP and provide a higher quality care environment; (iii) services will operate with more effective collaborative arrangements; and (iv) the intervention will be a more cost-effective approach than treatment as usual to improving the mental health of young people in OoHC.
The Ripple project has several components: 1) Needs assessment and implementation of a complex mental health intervention; 2) Controlled intervention trial to determine the impact on mental health, social and economic outcomes; and 3) Nested process evaluation of the intervention.
The project is conducted with four major CSOs in Melbourne: Anglicare, MacKillop Family Services, the Victorian Aboriginal Child Care Agency (VACCA) and Westcare (Salvation Army). A complex health and community service system in Victoria surrounds CSOs and the young people in OoHC (see Fig. 1). Specialist mental health services are provided by community-based state-funded mental health services . Their contact with young people in OoHC is typically ad hoc rather than organised systematically. Foundation House (the Victorian Foundation for Survivors of Torture and Trauma), the Centre for Multicultural Youth (CMY) and Take Two (state-provided psychological services for children and young people in OoHC) provide services relevant to some or all of these young people and are consulting study partners. These organisations interact with primary health care, hospital emergency and inpatient services, police, justice, educational and vocational services.
The intervention region is Melbourne’s North and West Metropolitan Health Region (NWMR). NMWR has a culturally diverse population of 1.7 million people, including 24% of Victoria’s Aboriginal people (0.58% of the region’s population). It comprises Melbourne’s central business district and inner, middle and outer urban areas. Specialist mental health services for young people aged 12-17 are provided by Orygen Youth Health (OYH), the Royal Children’s Hospital (RCH), and the Youth Support and Advocacy Service (YSAS). The four CSOs each provide OoHC in the south or east regions of metropolitan Melbourne that comprise the region from which the comparison group is drawn. Youth mental health services not linked to the study are responsible for mental health service delivery in these regions.
Youth and Carer Participation. The research team is collaborating with the CREATE Foundation office in Victoria (www.create.org.au; a national not-for-profit organisation representing the interests of young people in OoHC) to train and engage young people in the study in roles including co-delivery of training sessions, participating in research project meetings and co-delivery of research presentations. Young people are involved in all three study components. Carers have been recruited into a nested qualitative study to comment on current training and support and recommend improvements.
1. Needs assessment and implementation of a complex mental health intervention.
Before implementation of the intervention in NWMR, young people, carers and case managers participated in focus groups and interviews to assess mental health needs and experiences of service delivery. Mental health services, child protection services, CSOs and advocacy organisations consulted with researchers about service delivery, policy and training in OoHC and mental health services. Three meetings of stakeholders were convened. Aboriginal and Torres Strait Islander and culturally and linguistically diverse young people contributed to additional studies of their needs.
The intervention design is informed by this assessment of needs. The intervention aims to work with CSO case managers to support carers of the young people aged 12-17 living in OOHC in the intervention region and thereby: promote mental health and prevent mental ill-health and associated behavioural problems for the young people; and encourage early access for the young people, when needed, for treatment and support for mental illnesses and behavioural problems. Ripple practitioners and trained young leaders conduct the intervention. The Ripple practitioners are experienced youth mental health clinicians or AOD workers, seconded to work part-time with the study partners following a process of internal recruitment, and are subsequently trained and supervised by senior colleagues. The young leaders are aged 18-25 years, have experience in OoHC and are trained in leadership in mental health in a parallel study conducted in association with CREATE (the Bounce study).
The intervention is implemented in collaboration with the CSOs and statutory child protection services. It provides flexible delivery of evidence-based, trauma-informed reflection, education and training for case managers in home-based and residential care teams in the CSOs. It includes training and support for case managers in the use of EBP elements, in emotional responsiveness, and in practical ways to support carers in: responding therapeutically to young people in their care; and gaining appropriate access to primary health care and specialist mental health support. The involvement of educational and vocational services is promoted. More effective collaborative arrangements are operationalized through the tailored component of the intervention design (see Table 2). That is, by tailoring the mode and delivery of the intervention to the individual needs of services, more effective collaboration between mental health services and CSOs should result.
The agencies in comparison regions are provided with descriptive information about the characteristics of young people in their care following baseline study assessments (see below). This includes information about the mental health and function of the young people in their care. At the end of the study all components of the research intervention (see Table 1) will be freely shared with all involved.
2. A controlled trial of mental health, social and economic outcomes of the intervention
The trial is designed to answer the question: What is the effectiveness and cost-effectiveness of the Ripple mental health intervention for young people in OoHC, their carers, case managers and the CSOs compared with the current care situation? Outcomes of the intervention at individual and service levels are assessed through two waves of measurements in intervention and comparison regions; first at baseline as implementation begins, and then three years later (see Fig. 2). While there are challenges associated with this trial design, comparing local regions is the most pragmatic test of effectiveness in a real-world context, particularly if long-term or external influences on the settings are accounted for. [63, 64] A preliminary test of the comparability of the populations and settings is reported in the census data below.
Each assessment wave comprises: (i) A census of young people aged 12-17 years in OoHC settings managed by partner CSOs in intervention and comparison regions, to establish the study population at each time point; and (ii) interviews to collect information on the variables defined in the hypotheses using qualitative and quantitative measures conducted on: young people enumerated in the census and identified in the post-census period, the foster, kinship and residential carers and the case managers of these young people (see Fig. 2). Outcomes are measured on three levels: for young people in OoHC; their carers and case managers; and the services (see Table 2). The trial has been developed in accordance with the STROBE statement for cross-sectional studies . According to EQUATOR, STROBE is the appropriate guideline for observational studies, including cross-sectional trials (see http://www.equator-network.org/reporting-guidelines/strobe/)."
Primary outcome variables will assess changes to young people’s emotional distress (assessed by K10 ; SDQ Emotional Symptoms Subscale ), harmful use of substances (assessed by the ASSIST-Y ), disturbed conduct (assessed by the SDQ Conduct Problems & Hyperactivity subscales ), social relationships (assessed by the Friendship Scale , SDQ peer problems & prosocial subscales ) and education and occupation (assessed by measures adapted from the Pathways Longitudinal Study , Beyond 18 Study ).
Procedures: Approval for the trial was obtained from research ethics committees of The University of Melbourne (No. 1340674), Deakin University (No. 2014-046) and Anglicare Victoria (No. 2014-02) and ratified by research review committees of the other CSOs. The Victorian Department of Human Services Research Coordinating Committee approved the study. The Commonwealth Department of Health Australia (No. 14/2014) agreed to release Medicare and Pharmaceutical Benefits data for the economic evaluation (see below). Informed consent to participate in the study was obtained from participants, and in the case of children under 16 consent was obtained from their parents or legal guardian. The trial is registered with the Australian New Zealand Clinical Trials Registry (No. ACTRN12615000501549).
Conduct of the census and recruitment of participants (See Fig. 3):
The Wave 1 census was conducted in August 2014. Research assistants visited CSO offices and supported by CSO staff completed a census questionnaire from file audit for each young person aged 12-17 in care during the designated two-week period. As many as possible of the young people identified in the census and eligible for interview, and their carers and case managers, were subsequently interviewed in Wave 1. Protocols were established for: (1) contacting and following up those enumerated in the census; and (2) risk management. Each young person and his or her carer or carers was contacted first by the young person’s case manager as identified by each agency. Recruitment was originally scheduled for completion in three months. In order to complete the agreed number of contacts and re-contacts for each potential participant to establish an appointment for the interview, the recruitment period extended to seven months. During this period an additional 41 young people who entered care during the recruitment period were identified and approached for interview using the same procedures.
To determine group differences over time on outcome measures, a range of statistical techniques will be used: for categorical outcome measures, chi-square analysis (χ2), loglinear analysis, and logistic regression; and for continuous outcome measures, general linear models will be adopted. More sophisticated models will be considered to manage the hierarchical nature of the data obtained from the CSOs, case managers, carers and young people such as multilevel mixed (hierarchical) models.
Power calculation: During the study design, partner CSOs provided estimates of the numbers of young people aged 12-17 in OoHC settings managed by them in the intervention and comparison regions in any one month. Ultimately, the Wave 1 census revealed fewer young people in these settings than originally estimated. This meant that we did not need to select samples among the young people enumerated and their carers and case managers and instead aimed to interview all available. Given the lack of EBP research or sources of centralised information in OoHC, it is difficult to base power calculations on a priori measures of effect size.
Economic evaluation design
Formal economic evaluation of the Ripple intervention compared with current practice will assess incremental cost-effectiveness from a societal perspective. This approach is useful to decision makers . By including the health-related quality of life assessment of young people and their carers before and following the intervention, a cost-utility analysis can be undertaken also, allowing practical judgments about value for money of the intervention. The costs and cost offsets of the Ripple intervention are being measured using multiple data sources (see Table 2).
The economic analysis will include costs borne by several different sectors (health, education, justice). Secondary analyses can be undertaken from narrower perspectives, such as health or education, as relevant to the different stakeholders. If the Ripple intervention is found to be effective (in the short term, trial-based evaluation), the predicted future lifetime and wider population cost-effectiveness of the intervention will be determined using modelling techniques [73, 74].
3. Process evaluation of the intervention throughout the study is using multiple data sources and qualitative and quantitative data collection methods. Data is collected from all intervention sites in order to assess quality of implementation, clarify causal mechanisms and identify contextual factors associated with variation in outcomes . Annual ‘Stocktake’ meetings and interviews with representative stakeholders from each CSO are conducted to assess implementation through documenting the activities, who carried them out, and the effort required . The intervention team uses a participatory action research approach to continuous development of the method and content of their practice . They engage in regular reviews at each intervention site through formal and informal verbal and written processes. Assessment of the effectiveness of collaborative arrangements is addressed through focus groups and a question in the OLCS.
Progress and early results
The Wave 1 census identified the study population of young people for the first wave of assessments and provided information about culture, language and other variables among the young people. Nearly one in five young people enumerated in the census identified as Aboriginal or Torres Strait Islander. One in ten had a registered disability.
A total of 176 of 335 (52%) eligible young people identified in the census and during the interview period were interviewed (see Fig. 3). Interviews were obtained with 104 of 265 (39%) carers and 79 of 160 (49%) case managers, identified as linked with them.
Observations of implementing the intervention indicate that: (1) specialist mental health practitioners have been recruited and trained and their supervision established; and (2) their deployment to the OoHC settings is in progress and evolving in particular ways in different OOHC settings (see Table 1). ‘Stocktake’ meetings with each CSO have shared the results of the data collection, engaged CSO staff in the intervention and documented recommendations for improvement.
The Ripple intervention was originally conceived to strengthen the therapeutic capacities of the carers of young people in the Victorian OoHC system. This paper describes the intervention, co-designed with the participants and expert consultants from health and social service sectors, and early findings from Wave 1 of the controlled trial designed to evaluate the cost-effectiveness of the intervention. The context includes different practice models and approaches to mental health problems across the social service and mental health sectors [77, 78], and the limited mental health support for the carers and young people in OoHC . Together these create areas in which there are broader implications for policy, practice and further research.
Preliminary observations from the implementation endorse the original broad conception for the intervention. The work to date suggests that it is feasible to implement a complex mental health intervention across sectors with relatively modest resources. The success of the intervention appears likely to depend on the strength of partnerships between organisations within and across service sectors. This is consistent with the emphasis in implementation science on ‘context’ [80, 81]. The implication of these findings attest to the policy imperative for a specialist mental health intervention of this type to support home-based and residential carers in their work with young people in care, and a readiness to work together to achieve this [80–82].
Early results from the field studies indicate that the research design can provide much needed information in this challenging field. Half of the eligible young people agreed to participate in the first wave of assessment interviews, despite coming from a vulnerable and hard to engage population, as did a third of their carers and half of their case managers. This rate of recruitment is considerably higher than that achieved in other studies of similar populations , implying that with appropriate resources and engagement at every level by the organisations involved, that quantitative research with this ‘hard to reach’ population is possible.
The census has been a useful source of information for partner CSOs, providing comparative data on the age, gender patterns and other characteristics of young people engaged by their services and the patterns of placement changes. These findings highlight the lack of routinely available information about the number, characteristics and circumstances of young people living in OoHC in Victoria. It is a situation that is reportedly similar in other Australian states and in other countries  and has significant implications for policy development to support more accurate and consistent data collection and analysis to inform practice in this area.
The census reveals 20 times more Aboriginal or Torres Strait Islander young people than their proportion in the population of Melbourne. This in part reflects involvement of VACCA as study partner. However 35% of identified Aboriginal or Torres Strait Islander young people were living in settings managed by other CSOs. There are profound implications for policy and practice to address this inequity. The recent report by the Aboriginal Children’s Commissioner points to some clear direction which include amongst other recommendations, more consistent and extensive exploration of safe placement within the extended family networks .
The reported rate of those with a registered disability (10%) among the young people enumerated in the census was lower than our original expectations. The expectations were based on impressions conveyed by CSO partners and other reports that 42% young people living in OOHC have a registered disability . This discrepancy may reflect a lack of access to assessment and diagnosis of disabling conditions in community settings. It may also reflect the focus of the question on disability registered with state agencies, rather than the broader assessments including ‘suspected’ disability reported in other studies, a limitation with clear implications for future research in this area .
The early findings from participant interviews suggest that the data collection is acceptable and feasible. All young people, carers and case managers completed a minimum of demographic questions and the SDQ. We recruited lower than expected numbers into the study as a result of enumerating fewer young people in the census than originally estimated. This first interview wave represents, however, one of the largest groups of young people ever included in a mental health intervention study in OoHC, and Ripple is one of the few such studies conducted worldwide .
The higher estimates of sample size made initially with our partner CSOs reflect, at least in part, the limitations mentioned above in the routine information available to the CSOs. Calculations of the study’s power indicates that with the second cross-sectional wave of assessments we will be able to test main effects of the evaluation and will gain valuable information from economic and process evaluations. The limitations of the study provide directions for future research in the OoHC area. These limitations include the threat to generalisation of the results through the rate of recruitment from the study population, notwithstanding that the rate is relatively high for a study of this type as mentioned above. Analysing the characteristics of those recruited and not recruited will help us assess this risk. Another limitation is the focus on metropolitan youth in OoHC. Providing mental health services and OoHC in regional and rural settings is different in several respects from doing so in metropolitan areas (city and suburbs). The usefulness of these findings outside the metropolitan area cannot be assumed. However we anticipate that successful implementation will guide and encourage similar interventions and their evaluation elsewhere.
The design of the study followed the opportunities provided in the specific context of needs, political factors and organisational alliances and readiness in the authors’ setting. The concepts and processes used in this protocol are, however, potentially adaptable to other settings. They may be relevant in countries where resources are scarce and in any setting where efficiency of resource use is valued.
A feature of the controlled trial is its design with two cross-sectional waves. Although the absence of longitudinal data is a limitation of the study, the current design is a useful way to evaluate a complex intervention . We anticipate that future studies will build on this foundation to develop cohort studies (to identify modifiable factors important to the mental health of young women and men of different ages) and more complex designs such as stepped-wedge cluster RCTs (to test the implementation and adaptation of mental health interventions in various types of OOHC and for specific groups of young people).
We predict in the meantime that the Ripple service model will result in case managers and carers in OoHC environments being more attuned to the emotional state and experiences of young people, and gaining better access to early intervention to prevent and treat mental illness. We can expect that both these changes will contribute to better mental health among young people in OoHC. We expect this will contribute in the longer term to improved quality of life and better productivity for the young people, and reduction among them in negative psychosocial outcomes.
The central features of the Ripple intervention include youth participation and a modest allocation of specialist mental health staff to collaborate in providing a complex evidence-based mental health intervention. It responds to needs identified in a critical government inquiry in the Australian state of Victoria  similar to those identified in other states of Australia and in other countries. The approach is potentially adaptable to the needs elsewhere. In contrast to and complementary to other interventions trialled among vulnerable young people , it is a universal intervention that requires less intensive support from skilled mental health professionals. It is sensitive to context and culture and responds to the strengths of the young people and the adversities in their lives, using a service model that is designed to be sustainable and increase capacity across the broader service system. The evaluation of this intervention is continuing with the process evaluation and the second cross-sectional wave of assessments.
Adolescent community reinforcement approach
Aboriginal and Torres strait islander
Culturally and linguistically diverse
Cognitive behaviour therapy
Centre for multicultural youth
Community Service Organisations
Evidence-based mental health practice
Multidimensional treatment foster care for adolescents
Melbourne’s North and West Metropolitan Health Region
Orygen youth health
Royal Children’s Hospital
Strengths and difficulties questionnaire
Tuning into teens
Victorian aboriginal child care agency
Youth support and advocacy service
Humphreys KL, et al. Effects of institutional rearing and foster care on psychopathology at age 12 years in Romania: follow-up of an open, randomised controlled trial. Lancet Psychiatry. 2015;2(7):625–34.
Cummins P, Scott D, Scales B. Report of the Protecting Victoria’s Vulnerable Children Inquiry. Melbourne: Department of Premier and Cabinet; 2012.
Mendes P, Johnson G, Moslehuddin B. Young People Leaving State Out-of-Home Care: Australian Policy and Practice. North Melbourne: Australian Scholarly Publishing; 2011.
AIHW. Child protection Australia 2013–14. Canberra: AIHW; 2015.
Bromfield L, Holzer P, Lamont A. The economic costs of child abuse and neglect. Canberra: Australian Government, Australian Institute of Family Studies; 2011.
U.S. Department of Health and Human Services, The AFCARS Report, A.f.C.a.F. U.S. Department of Health and Human Services, Administration on Children, Youth and Families, Editor. 2014.
Education U.D.f. In: D.f. Education, editor. Children looked after in England (including adoption and care leavers) year ending 31 March 2014. London: UK government; 2014.
Pecora PJ, et al. Mental health services for children placed in foster care: an overview of current challenges. Child Welfare. 2009;88(1):5–26.
McAuley C, Davis T. Emotional well-being and mental health of looked after children in England. Child Fam Soc Work. 2009;14:147–55.
Egelund T, Lausten M. Prevalence of mental health problems among children placed in out-of-home care in Denmark. Child Fam Soc Work. 2009;14(2):156–65.
Mendes P, Moslehuddin B. From dependence to interdependence: towards better outcomes for young people leaving state care. Child Abuse Rev. 2006;15(2):110–26.
Cashmore J, Paxman M. Predicting after-care outcomes: The importance of “felt” security. Child Fam Soc Work. 2006;11(3):232–41.
Osborn A, Bromfield L. Young People Leaving Care. Melbourne: Australian Institute of Family Studies; 2007.
Wise S, Egger S. The Looking After Children Outcomes Data Project, Final Report. Melbourne: Australian Institute of Family Studies; 2007.
Rahamim A, Mendes P. Mental Health Supports and Young People Transitioning from Out-of-home Care in Victoria. Children Australia. 2016;41(01):59–68.
Dworsky A, Courtney M. Addressing the mental health service needs of foster youth during the transition to adulthood: How big Is the problem and what can States do? J Adolesc Health. 2009;44(1):1–2.
Ryall V, et al. Intensive youth outreach in mental health: An integrated framework for understanding and intervention. Soc Work Ment Health. 2008;1–3:153–75.
Schley C, et al. Does engagement with an intensive outreach service predict better treatment outcomes in 'high-risk' youth? Early Intervention in Psychiatry. 2012;6(2):176–84.
Cashmore J, Paxman M. Longitudinal Study of Wards Leaving Care. 2007; Available from: http://www.community.nsw.gov.au/__data/assets/pdf_file/0005/321728/research_wards_leavingcare2.pdf. Accessed 4 Dec 2016.
Barton S, Gonzalez R, Tomlinson P. Therapeutic Residential Care for Children and Young People. London: Jesica Kingsley; 2012.
Fallesen P. Identifying divergent foster care careers for Danish children. Child Abuse Neglect. 2014;38(11):1860–71.
Jackson A, et al. Exploring outcomes in a therapeutic service response to the emotional and mental health needs of children who have experiences abuse and neglect in Victoria Australia. Child Fam Soc Work. 2009;14:198–212.
Pecora P, et al. Mental health of current and former recipients of foster care: a review of recent studies in the USA. Child Fam Soc Work. 2009;14:132–46.
Morton J, Clark R, Pead J. When care is not enough. Victoria: Department of Human Services; 1999.
Chamberlain P, Reid JB. Comparison of two community alternatives to incarceration for chronic juvenile offenders. J Consult Clin Psychol. 1998;66(4):624–33.
Westermark PK, Hansson K, Olsson M. Multidimensional treatment foster care (MTFC): results from an independent replication. J Fam Ther. 2011;33(1):20–41.
Fisher PA, Gilliam KS. Multidimensional treatment foster care: an alternative to residential treatment for high risk children and adolescents. Psychosoc Intervent. 2012;21(2):195–203.
Fisher PA. Review: Adoption, fostering, and the needs of looked-after and adopted children. Child Adolesc Ment Health. 2015;20(1):5–12.
FACSIA. An outline of National Standards for out-of-home care. Canberra: Commonwealth of Australia, Department of Families, Housing, Community Services and Indigenous Affairs; 2011.
Anglin J. A theoretical framework for understanding group home life and work. Child Youth Serv. 2002;24(1):49–59.
Hurlburt M, et al. Interagency collaborative team model for capacity building to scale-up evidence-based practice. Child Youth Serv Rev. 2014;39:160–8.
Wells R, Chuang E. Does formal integration between child welfare and behavioral health agencies result in improved placement stability for adolescents engaged with both systems? Child Welfare. 2012;91(1):79–100.
Aarons GA, et al. Implementing evidence-based practice in community mental health agencies: a multiple stakeholder analysis. Am J Public Health. 2009;99:2087–95.
Mitchell P. Evidence-based practice in real-world services for young people with complex needs: New opportunities suggested by recent implementation science. Child Youth Serv Rev. 2011;33(2):207–16.
Paxton G, et al. Refugee status report: A report on how refugee children and young people in Victoria are faring. Melbourne: Dept Education and Early Childhood Devel; 2011.
Osmond J, Scott T, Clark J. The knowledge of caring: revisiting the need for knowledge and support of carers. Child Fam Soc Work. 2008;13:262–73.
Whenan R, Oxlad M, Lushington K. Factors associated with foster carer well-being, satisfaction and intention to continue providing out-of-home care. Child Youth Serv Rev. 2009;31:752–60.
Murray L, Tarren-Sweeney M, France K. Foster carer perceptions of support and training in the context of high burden of care. Child Fam Soc Work. 2011;16:149–58.
Bonfield S, et al. Help-seeking by foster-carers for their ‘looked after’ children: The role of mental health literacy and treatment attitudes. Br J Soc Work. 2010;40:1335–52.
Mount J, Lister A, Bennun I. Dentifying the mental health needs of looked after young people. Clin Child Psychol Psychiat. 2004;9:363–82.
Callaghan J, et al. Evaluation of a new mental health service for looked after children. Clin Child Psychol Psychiat. 2004;9(1):130–48.
Golding K. Providing specialist psychological support to foster carers: a consultation model. Child Adolesc Ment Health. 2004;9(2):71–6.
Hibbert G. Frankl J. A psychology consultation service for social workers and foster carers in a child and adolescent mental health service. Educ Child Psychol. 2011. 28(3):63–72.
Agranoff R, McGuire M. Big questions in public network management research. J Public Adm Res Theory. 2001;11:295–326.
Mitchell P. Mental health care roles of non-medical primary health and social care services. Health Soc Care Community. 2008;17(1):71–82.
Mitchell PF. A discourse analysis on how service providers in non-medical primary health and social care services understand their roles in mental health care. Soc Sci Med. 2009;68(7):1213–20.
McLean S. Barriers to collaboration on behalf of children with challenging behaviours: a large qualitative study of five constituent groups. Child Fam Soc Work. 2012;17(4):478–86.
Chorpita B, Daleiden E, Weisz J. Identifying and selecting the common elements of evidence based interventions: A distillation and matching model. Ment Health Serv Res. 2005;7:5–20.
Bruun A, Mitchell P. A resource for strenghtening therapeutic practice frameworks in youth AOD services. Melbourne: Youth Support and Advocacy Service; 2012.
Garland A, et al. Identifying common elements of evidence-based psychosocial treatments for children’s disruptive behavior problems. J Am Acad Child Adolesc Psychiatry. 2008;47:505–14.
Mitchell PF. Designing evidence-based treatments for youth with multiple and complex needs: a modular practice elements approach. Adv Dual Diagn. 2012;5(3):122–36.
Weisz JR, et al. Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: a randomized effectiveness trial. Arch Gen Psychiatry. 2012;69(3):274–82.
Havighurst SS, Kehoe CE, Harley AE. Tuning in to teens: Improving parental responses to anger and reducing youth externalizing behavior problems. J Adolesc. 2015;42:148–58.
Murray M, et al. Enhancing and adapting treatment foster care: Lessons learned in trying to change practice. J Child Fam Stud. 2010;19:393–403.
Green JM, et al. Multidimensional Treatment Foster Care for Adolescents in English care: randomised trial and observational cohort evaluation. Br J Psychiatry. 2014;204(3):214–21.
Fixsen D, et al. Core implementation components. Res Soc Work Pract. 2009;19(5):531–40.
Fixsen D, Blase K. Implementation: The missing link between research and practice. NIRN Implementation Brief #1. Chapel Hill: The University of North Carolina; 2009.
Victorian Government. Chief Psychiatrist' s Guideline: Priority access for out-of-home care. 2011; Available from: http://www.dhs.vic.gov.au/__data/assets/pdf_file/0009/661437/Chief-Psychiatrists-guideline-priority-access-for-out-of-home-care_WEB.pdf
French R, Reardon M, Smith P. Engaging with a mental health service: Perspectives of at-risk youth. Child Adolesc Soc Work J. 2003;20(6):529–48.
Lee MSWB, et al. Experiences of and attitudes toward mental health services among older youths in foster care. Psychiatr Serv. 2006;57(4):487–92.
Davidson M, et al. For youth by youth: innovative mental health promotion at Youth Net/Reseau Ado. Vulnerable Child Youth Stud. 2006;1(3):269–73.
Wallcraft J, et al. Partnerships for better mental health worldwide: WPA recommendations on best practices in working with service users and family carers. World Psychiatry. 2011;10(3):229–36.
Portela MC, et al. How to study improvement interventions: a brief overview of possible study types. Postgrad Med J. 2015;91(1076):343–54.
Crawford MJ, et al. Negative results in phase III trials of complex interventions: cause for concern or just good science? Br J Psychiatry. 2016;209(1):6–8.
von Elm E, et al. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Lancet. 2007;370(9596):1453–7.
Spies G, et al. Validity of the Kessler 10 (K-10) in detecting DSM-IV defined mood and anxiety disorders among pregnant women. Arch Womens Ment Health. 2009;12(2):69–74.
Goodman A, Lamping D, Ploubidis G. When to use broader internalising and externalising subscales instead of the hypothesised five subscales on the Strengths and Difficulties Questionnaire (SDQ): data from British parents, teachers and children. J Abnorm Child Psychol. 2010;38:1179–91.
Humeniuk R, Holmwood C, Kambala A. Developing the WHO Alcohol, Smoking and Substance Involvement Screening Test (ASSIST) for Young people (ASSIST-Y). Drug Alcohol Rev. 2011;30(Supp 1, Paper 59):42.
Hawthorne G. Perceived social isolation in a community sample: its prevalence and correlates with aspects of peoples’ lives. Soc Psychiatry Psychiatr Epidemiol. 2008;43(2):140–50.
Paxman M, Tully L, Burke S, Watson J. Evidence to Inform Out-of-Home Care Policy and Practice in New South Wales: An overview of the Pathways of Care Longitudinal Study. Develop Pract. 2014;39:56–73.
Australian Institute of Family Studies. Beyond 18: The Longitudinal Study on Leaving Care. 2015 21/12/2015. http://www.beyond18.com.au/.
Drummond M, et al. Methods for the Economic Evaluation of Health Care Programmes. 3rd ed. Oxford: Oxford University Press; 2005.
Mihalopoulos C, et al. The economic analysis of prevention in mental health programs. Annu Rev Clin Psychol. 2011;7:169–201.
Carter R, et al. Priority setting in health: origins, description and application of the Australian Assessing Cost-Effectiveness initiative. Exp Rev Pharmacoecon Outcomes Res. 2008;8(6):593–617.
Oakley A, Strange V, Bonell C. Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006;18(7538):413–6.
Graham K, Chandler-coutts M. Community action research: who does what to whom and why? lessons learned from local prevention efforts (international experiences). Subst Use Misuse. 2000;35(1-2):87–110.
Victorian Department of Health and Human Services. Roadmap for Reform: strong families, safe children. The first steps. Melbourne: Victorian Government; 2016.
Moeller-Saxone K, et al. Meeting the primary care needs of young people in residential care. Aust Fam Physician. 2016;45(10):706–11.
Webster S. In: Victorian Parliamentary Library and Information Service, editor. Children and Young People in Statutory Out-of-Home Care: Health Needs and Health Care in the 21st Century. Melbourne: Victorian Government; 2016.
Damschroder LJ, et al. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):50.
Greenhalgh T, et al. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629.
Monson, K., et al., "It’s not about white walls, it’s about real life": understanding the mental health needs of young people living in Out of Home Care. Journal of Mental Health, in press.
Australian Institute of Family Studies, C.H.C.f.C.U.o. and N.S.W.D.o.F.a.C.S. Chicago, Pathways of Care Longitudinal Study: Outcomes of children and young people in Out-of-Home care in NSW. Wave 1 baseline statistical report. N.S.W: NSW Department of Family and Community Services Sydney; 2015.
Stein M, Dumaret A-C. The mental health of young people aging out of care and entering adulthood: Exploring the evidence from England and France. Child Youth Serv Rev. 2011;33(12):2504–11.
Commission for Children and Young People. Always was, always will be Koori children’: Systemic inquiry into services provided to Aboriginal children and young people in out-of home care in Victoria. Melbourne: Commission for Children and Young People; 2016.
Mitchell G. Children with Disabilities using Child and Family Welfare Services. Melbourne: OzChild; 2013.
Stevens K. Valuation of the child health utility 9D Index. PharmacoEconomics. 2012;30(8):729–47.
Richardson J, et al. Validity and reliability of the Assessment of Quality of Life (AQoL-8D) multi attribute utility instrument. The Patient: Patient-Centered Outcomes Research. 2014;7(1):85–96.
Quirk A, et al. Development of the carer well-being and support (CWS) questionnaire. Ment Health Rev J. 2012;17(3):128–38.
Miller IW, et al. The McMaster Family Assessment Device: reliability and validity. J Marital Fam Ther. 1985;11:345–56.
O’NEAL CR, MAGAI C. ‘Do parents respond in different ways when children feel different emotions? The emotional context of parenting’. Develop Psychopathol. 2005;17(2):467–87. doi:10.1017/S0954579405050224.
Bess KD, Perkins DD, McCown DL. Testing a measure of organizational learning capacity and readiness for transformational change in human services. J Prev Interv Community. 2010;39(1):35–49.
The following research, community service and government organizations are collaborating in the study: Orygen, The National Centre of Excellence in Youth Mental Health; Orygen Youth Health; School of Social Work, The University of Melbourne; Royal Children’s Hospital Melbourne; Youth Support and Advocacy Service; Foundation House – The Victorian Foundation for the Survivors of Torture; Deakin Population Health, Faculty of Health, Deakin University; MacKillop Family Services; Anglicare Victoria; The Salvation Army Westcare SalvoCare Eastern Services; Take Two – Berry Street; Victorian Aboriginal Child Care Agency (VACCA); Mindful, Centre for Multicultural Youth; CREATE Foundation; Victorian Commission for Children and Young People; Victorian Department of Health and Human Services.
We are grateful for the contribution of the contribution of the members of the Ripple Project Aboriginal Advisory Group including Connie Salamone, Peter Lewis, Sue Anne Hunter and Andrew Jackomos, Victorian Commissioner for Aboriginal Children and Young People.
Special thanks to Professor Simon Davidson (University of Toronto and Ontario Centre of Excellence for Child and Youth Mental Health for his insights and advice on the central role of youth participation, and for the work of Simon Malcolm, coordinator of the Bounce Project 2014-2016; Larry Hendricks in database construction; Dr Angela Scheppokat in database management; Dr Margaret Kertesz in convening and reporting focus and working group activities, and evaluation and qualitative analysis.
We acknowledge with gratitude the personal and creative contributions of numerous people in collaborating organisations including eg Bernadette Marantelli, Centre for Multicultural Youth; Micaela Cronin and Dr Nick Halfpenny, MacKillop Family Services; Jacki Buchbinder, The Salvation Army – Westcare; Dr Tatiana Corrales, Anglicare Victoria; Annette Jackson, Take Two; Bernie Geary and colleagues at Victorian Commission for Children and Young People, Josh Fergeus, Dr Ric Haslam, Royal Children’s Hospital; Arry Valastro, Andrew Bruun and Peter Wearne, YSAS; Robyn Miller and Jan Snell and colleagues from Victorian Department of Health and Human Services central, & north and east regions; Deb Tsorbaris and colleagues from Centre of Excellence in Child and Family Welfare.
The Ripple Study is funded by the National Health and Medical Research Council of Australia, Targeted Call for Research grant number 1046692. The Bounce project is funded by Australian Rotary Health; and the Bounce co-design study that preceded it was funded by the Melbourne Social Equity Institute at The University of Melbourne.
Availability of data and materials
The data that support the findings of this study are available from the Victorian Department of Health and Human Services but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request and with permission of the Victorian Department of Health and Human Services.
HH, SC, PM, CHu, SH, KM, LM, CHa, CM, AM, SR, SH, PM, TG, JS, ED, ST, IK, all involved in concept, design and conduct of study and manuscript writing. SC and SR involved in data collection, analysis and interpretation. KMS involved in management of study, data collection and analysis, manuscript writing and editing. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
Approval for the trial was obtained from research ethics committees of The University of Melbourne (No. 1340674), Deakin University (No. 2014-046) and Anglicare Victoria (No. 2014-02) and ratified by research review committees of the other CSOs. The Victorian Department of Human Services Research Coordinating Committee approved the study. The Commonwealth Department of Health Australia (No. 14/2014) agreed to release Medicare and Pharmaceutical Benefits data for the economic evaluation (see below). Informed consent to participate in the study was obtained from participants, and in the case of children under 16 consent was obtained from their parents or legal guardian.
About this article
Cite this article
Herrman, H., Humphreys, C., Halperin, S. et al. A controlled trial of implementing a complex mental health intervention for carers of vulnerable young people living in out-of-home care: the ripple project. BMC Psychiatry 16, 436 (2016). https://doi.org/10.1186/s12888-016-1145-6