Skip to main content

Identifying multilevel and multisectoral strategies to develop a Theory of Change for improving child and adolescent mental health services in a case-study district in South Africa

Abstract

Background

The lack of child and adolescent mental health (CAMH) policies and implementation plans constitute major barriers to CAMH services in low resource settings. Engaging with on-the-ground stakeholders to identify possible contextually appropriate strategies for developing a CAMH collaborative system and inform CAMH plans and policies is important to ensure that resultant policies and plans are feasible and appropriate. Together with key stakeholders across multiple sectors, this study aims to (i) co-identify causal factors and potential strategies to overcome bottlenecks in one district in SA as a case study; and (ii) Co-develop a Theory of Change (ToC) for increasing access to CAMH services within the resource constraints of a remote resource-scarce district as a case study.

Methods

A participatory workshop was held with key stakeholders (n = 40) from the Departments of Health (DoH), Basic Education (DBE), and Social Development (DSD) and three community-based organisations offering CAMH services in the district. The stakeholders identified context-specific causal factors and possible strategies to address the bottlenecks in the workshop. All the factors identified in the workshop were compared and consolidated. A ToC map was developed based on the data obtained from the workshop. The ToC was further refined by conducting a follow-up virtual workshop with stakeholders (n = 15).

Results

Mapping out the strategies identified in the workshop facilitated the development of a ToC model for the resource-scarce context. Key multilevel and multisectoral task-sharing strategies emerged in support of the development of a collaborative system of care that includes the development of (i) community awareness programs and user-friendly CAMH psychoeducation and screening tools to strengthen mental health literacy and facilitate early identification at the community level; (ii) an intersectoral working group to facilitate intersectoral collaboration (iii) a functional district CAMH referral system, (iv) youth-friendly CAMH care packages.

Conclusions

In scarce-resource contexts, it is feasible to work collaboratively with key stakeholders across multiple sectors to identify feasible multilevel and multisectoral strategies that can be used to develop a ToC for improved access to CAMH services within a task-sharing approach.

Background

Child and adolescent mental health (CAMH) services and interventions remain underdeveloped in many low- and middle-income countries (LMICs). The available CAMH services in many of these countries are marked by the lack of polices, low political priority, low financial investment, shortage of human resources and infrastructure, lack of adequate coordination and intersectoral collaboration [24, 26, 29, 33]. To address these issues, it is important to integrate CAMH services into primary health care and different community platforms such as schools and homes [6, 27]. Also, consistent engagement between stakeholders from the different sectors providing CAMH services is equally imperative to ensure a well-coordinated and effective system of CAMH care [4].

According to Guise et al. (2013), researchers must engage with stakeholders within key sectors and other community organisations in participatory planning to identify contextually appropriate strategies that could be used to develop a collaborative system of care. Haldane et al. [20] also stated that the optimisation of health interventions and effective collaboration or partnership between key sectors (health, education, and social development), community-based organisations, and the community at large could be facilitated through a community participatory approach. This approach has proven effective in addressing challenges encountered when planning and implementing health interventions. These challenges include power relations, trust-building, and understanding the socio-economic, and political contexts of the proposed initiatives [20]. This is also necessary to ensure adequate mobilisation and utilisation of the available resources and obtain stakeholders' buy-in [20, 25]. Hence, a participatory approach is fundamental to developing a collaborative system of care to improve CAMH services due to the range and characteristics of the key role players, service providers, and service users.

Theory of Change

Theory of Change (ToC) is a highly recommended theory-based participatory approach that has recently been used in designing and evaluating complex mental health interventions globally [12, 14]. It provides detailed descriptions of how specific interventions contribute to the desired outcomes by presenting the causal pathways, the link between inputs, outputs, and activities and how they produce the expected impact [18, 40]. It helps reveal fundamental factors that predict the success and failure of the interventions [11], and the participatory process assists stakeholders to articulate their ideas and identify their different priorities. Also, De Silva et al. (2014) highlighted that the ToC process provides ways of identifying and addressing challenges that emerge while designing interventions.

If a ToC is effectively developed, it can serve as a framework for service planning and implementation [42]. According to Hernandez & Hodges [21], ToC provides a context for incorporating a community's shared beliefs that informs the expected outcomes and the strategies suitable for achieving the desired outcomes. Therefore, a ToC map is usually developed by consulting with a wide range of stakeholders across different sectors through workshops and meetings to ensure all underlying community factors and the different sectors' goals, routines, strategies, budget, and resources are adequately incorporated [13]. Moreover, the inability to achieve consistent impacts from community interventions often stems from the failure to establish the connection between the target population, their shared beliefs, desired outcomes, and strategies to achieve them [43]. ToC has been used in designing mental health interventions in some low and middle-income countries (LMICs), including Ethiopia, Nepal and South Africa [1, 12, 14, 37]. In this study, we used ToC as a framework underpinning the development and evaluation of a district child and adolescent mental health care plan.

Using one district in the province of KwaZulu-Natal as a case study for the development of an integrated multisectoral system of CAMH care, formative work initially involved a situational analysis of existing CAMH resources and services and key stakeholder interviews, reported elsewhere [5, 7]. This study revealed six major bottlenecks (presented to CAMH services that cut across all the different sectors in the district. They included: poor governance structures (lack of intersectoral collaboration/liaison forum); poor identification, screening, and assessment procedures; poor referral pathways; specialist vertical services; limited community-based CAMH interventions, and limited CAMH promotion and awareness. Building on these findings, the present study aimed to i) Co-identify causal factors and potential strategies with key stakeholders that could be feasibly implemented to effectively address bottlenecks identified during the formative phase; and ii) Co-develop a Theory of Change (ToC) to feasibly increase access to CAMH services based on the identified strategies that could be used for the development of a district mental health care plan.

Methods

Study context/site

The study site was the Amajuba District Municipality, a district in the northwest part of the KwaZulu-Natal province and serves as a gateway into the Mpumalanga and Free Stae provinces. It is a small district covering about 7102 km2 which is only 8% of the province's geographical area. The district has a population estimate of about 556,580, and about 51% of the population are children and adolescents (Amajuba district profile, 2020). The district comprises mainly rural and peri-urban communities, including Charlestown, Newcastle, Madadeni, Osizweni, Dannhauser, Hattingspruit, Utrecht and Kingsley, within three sub-districts: Newcastle, eMadlangeni and Dannhauser (Amajuba district profile, 2020; Amajuba District Municipality, 2017; Govender et al. [45]. The district has a total number of 127,000 households, 12.3% of these households live in informal settlements (shacks), and about 788 are child-headed. About 416,000 people live in poverty due to high unemployment rates despite the documented increase in people with 'matric' or higher education in the district.

Amajuba district is resource-constrained, with few health professionals, including mental health specialists, to provide adequate health care services for the populace Govender et al. [45]. The Amajuba District was selected as a case study site, given that the study builds on existing relationships and services that have been developed through the Mental Health INTegration (MhINT) program with the KwaZulu-Natal Department of Health [38]. The MhINT program is a system strengthening intervention that provides technical support, training, and guidelines to enable the integration of mental health into primary health care for adults with common mental disorders using a task-sharing approach [38].

This study also leveraged the district's existing mental health and disability forum. The forum was headed by the district mental health coordinator and included service providers within the Department of Health, community-based organisations (CBOs) representatives, social workers from the Department of Social Development, directors from the Department of Education and some community/religious leaders. This forum met monthly to discuss mental health and disabilities issues within the community. The committee members are prominent leaders within the departments and community champions who can facilitate collaboration, allocation of resources, implement interventions and influence change within the different departments and across the different levels of care. The committee had previously requested CAMH interventions during their engagements with the MhINT team and also displayed their readiness to promote change through their active participation during the workshops.

Our situational analysis Babtunde et al., [46], which involved engagements with different stakeholders, including service providers and caregivers, revealed the commonly reported CAMH conditions in the district. They included intellectual disabilities, attention deficit hyperactivity disorder (ADHD), adjustment disorders, depressive disorders, and substance use. The situational analysis also revealed a severe shortage of specialised CAMH services in the district, poor integration of CAMH services into primary health care and the absence of clear referral pathways. During our initial engagements with some of the forum members, they mentioned that they visited schools routinely and were often consulted to address mental health-related crises such as substance abuse and suicide within schools. Despite limited resources and expertise, community based organizations (CBOs) were found to be active players in CAMH promotion and awareness in the district.

Research approach

This study employed a participatory action research (PAR) approach [8, 30]. According to Baum et al. (2006), PAR is a collective self-reflective process undertaken by researchers and participants to understand and improve health practices through specific actions to impart social change.

The study adopted a three-step process (presented in Fig. 2) which included (1) conducting an initial participatory workshop to co-identify causal factors and potential strategies to address the identified bottlenecks with key stakeholders, (2) developing a ToC model, (3) presenting the ToC model back to the stakeholders and obtaining their feedback in a follow-up workshop.

Participants

Research participants were purposively identified according to their positions in the departments of health, social development and education. Stakeholders interviewed at the earlier phase of the study were invited to attend the workshop. The first participatory workshop involved forty (40) stakeholders from the departments of Health, Basic Education, Social Development, and three CBOs providing CAMH services in the district. The participants included representatives from community-based organisations, managers including the district mental health coordinator, school directors, and service providers, including nurses, clinical psychologists, occupational therapists, pharmacists, social workers, and educators (high school and primary school teachers).

Step 1: Participatory workshop to identify causal factors and potential strategies

Prior to the first workshop, one of the researchers (GBB), made several visits (between February and September 2019) to the district to meet with key stakeholders in all the sectors providing CAMH services. Invitation letters were sent out to all stakeholders that were interviewed during the formative phase of the study. Also, follow-up visits were made prior to the workshop to remind the participants of the workshop.

We followed the workshop procedures described by Breuer et al. (2014) to ensure a reasonable degree of participation and rigor. Researchers engaged the participants' problem-solving capabilities to facilitate active involvement within the workshop, drawing on their vast knowledge and experiences of providing CAMH services in the district. The workshop was specifically organised to achieve predetermined outcomes [36], in this case, to co-identify collaborative strategies to improve CAMH services in the district.

The workshop was conducted in a private space at a venue centrally accessible to all the participants. All participants indicated they were proficient and comfortable with English language; for this reason, all discussions were held in English. The workshop facilitator, experienced with conducting participatory workshops, opened the meeting and formally introduced all the participants. The research team introduced the workshop agenda and facilitated an agreement on the length of the workshop.

Prior to the discussions, GBB, presented the findings of the formative studies to acquaint the participants (key stakeholders across multiple sectors) with an up-to-date status of CAMH services in the district as well as the identified bottlenecks. This was necessary as the workshop's goal was to co-identify causal factors and potential strategies to address the bottlenecks identified, with the view of developing a ToC model that could inform a district CAMH plan. The participants provided feedback and validated the findings of the formative study.

Participants were divided into three structured multidisciplinary groups to ensure a mix of stakeholders from the various sectors. The inclusion of different categories of stakeholders in each group to engage with the bottlenecks eliminated the tendency of power imbalance as every member was considered equal, and their contributions were valuable to identifying viable strategies in the workshop. Workshop materials (flip charts, markers, pens, and coloured papers) were given to the participants to make notes. Each group was asked to outline the causes of the bottlenecks and identify potential strategies to address them. Two bottlenecks were randomly allocated to each group, and the group discussions lasted for an hour.

Following the small group discussions, each group provided feedback to the larger group during the plenary session—which steered further large group discussions around the similarities and differences in the group discussions. The facilitator moderated the sessions and kept a tab on time. The stakeholders' participatory workshop lasted for 4 hours. Member checking was done at the end of the plenary session, where the workshop facilitator summarised the key points from the discussions and asked all the participants to confirm these. Three researchers (IP, AV, and GBB) were observers of the workshop but were not active participants in the discussions. The notes taken by participants in each group were consolidated and analysed after the workshop. The audio recordings were transcribed verbatim and compared with the notes taken by the participants and researchers. This corroborated the findings of the study.

Step 2: Development of the Theory of Change (ToC) map

In the second stage, GBB and AV drafted the ToC map for CAMH services in the district by combining the data obtained from the workshop and input from the formative study detailed elsewhere [5, 7]. The researchers used this information to identify medium- and long-term outcomes, interventions/strategies, and causal pathways that could lead to the intended outcome as well as indicators to measure the degree of change achieved—thereby creating a different approach to developing a ToC map. The two researchers (GBB, AV) met weekly to brainstorm the medium-term outcomes, the necessary strategies to achieve them, and the connecting pathways. The researchers reviewed and categorised all the field materials provided by the participants in the first workshop and also referred to the findings of the formative studies to identify all the elements of the map. GBB and AV consulted with IP to refine the initial ToC, and this provided the researchers with an opportunity to cross-examine the outcomes and strategies as well as identify key indicators to measure the change in each of the medium outcomes before agreeing on the final ToC map.

Step 3: ToC improvement and refinement

The third stage of the ToC development process involved obtaining feedback on the ToC map and narrative from the research team and a follow-up workshop with the stakeholders. All the 40 stakeholders present at the first workshop were invited through emails and phone calls. An online follow-up workshop was conducted in August 2021 due to COVID 19 restrictions to present the consolidated findings and ToC map. Fifteen stakeholders' representatives from the Health, Social Development and Education departments who were part of the first workshop attended. The remaining 25 participants could not attend due to their unavailability and limited access to the required infrastructure to attend a virtual workshop. During this workshop, GBB presented the ToC map and allowed the stakeholders to provide feedback. The stakeholders were encouraged to validate, refine or realign the draft ToC map to what is attainable in their context.

Data collection

The data for this study was obtained mainly from the workshops materials (audio recordings, participants and researcher notes). The plenary session of the first ToC workshop was audio-recorded, and notes were taken by the first author. These notes were checked against the audio file for completeness. In the second (follow-up) workshop, the first author took notes, and the virtual meeting conducted via Zoom was recorded. The first workshop lasted 5 hours, and the follow-up virtual workshop lasted for 1 hour 30 mins. Data from the ToC workshop, several drafts of the ToC maps, review from the research team and feedback from the stakeholders lead to the final ToC map.

Data analysis

The data was analysed following the structured, systematic steps of thematic analysis [10]. The first step in the analysis process involved familiarising oneself with the data set, which was done by reading through the field notes and the transcripts several times. The second step involved comparing and consolidating the field notes taken by the participants in each group and coding the relevant features of the data. The third step involved identifying themes and sub-themes. The fourth step involved reviewing and categorising all the themes. Finally, the themes were redefined, and the generated sub-themes were clustered into meaningful categories. To ensure reliability, two of the researchers (G.B.B. and AV) independently coded all the data and met regularly to discuss data interpretations and key findings to ensure consensus and saturation. All differences in coding were resolved through these consensus discussions. A third researcher (IP) was consulted if GBB and AV could not reach a consensus.

Ethics

Permission to conduct the study was received from the provincial Departments of Health and Basic Education. Also, ethical approval for the study was obtained from the Biomedical Research Ethics Committee, Faculty of Health Sciences, University of KwaZulu-Natal. Reference number BE098/18. All participants were given information sheets, and all provided written informed consent before participating in the study.

Results

As stated earlier, participants generated causal pathways focusing on system bottlenecks and potential strategies during the ToC workshop. Hence, the findings have been categorised into six sub-themes (the identified bottlenecks) that report on "Causal factors" and "Possible strategies" presented in Table 1 below. Figure 1 illustrates the link between the bottlenecks, possible strategies, and the different levels of CAMH care (community, primary health care (PHC), caregivers, and hospital). It also presents solutions specific to each level of care (within the set) and strategies that are cross-cutting (pointing out of the set).

Table 1 Summary of workshop data
Fig. 1
figure 1

Bottlenecks and multilevel interventions

Causal Factors and possible strategies for poor identification, screening and assessment procedures

Four main causal factors of poor identification, screening and assessment procedure emerged during the analysis—(i) Lack of training on CAMH for health workers and educators (ii) Lack of community mental health education programs, particularly CAMH, (iii) family factors, including mothers' lack of knowledge on CAMH and their inability to interpret red flags on their children's road to health cards, (iv) children are cared for by grandmothers with low literacy level and limited resources and (v) parental denial—many parents struggle to accept their children's conditions, (vi) Limited CAMH facilities and resources, particularly the shortage of human resources in the district and difficulties associated with the availability of screening tools, lack of training on their use, and the length and time required to administer the tools. The possible strategies highlighted by the participants included (i) educating parents on how to identify growth/ developmental deviations in their children before attaining school age and facilitate the active involvement of parents in the management of children with CAMH challenges (ii) conducting routine awareness campaigns in the community—the participants mentioned that effective community awareness campaigns could be achieved by creating outreach teams and involving the relevant non-governmental/non-profit organisations (NPOs) in the district (iii) the need to develop user-friendly screening tools and the need to train stakeholders particularly educators and health workers at the primary health care (PHC) level to use the screening tools.

Causal factors and possible strategies to address inappropriate referral pathways

Based on the preliminary studies, inappropriate referral pathways were identified as a major weakness of CAMH services in the district [5, 7].

The referral pathways illustrated in Fig. 2 described in detail elsewhere [5, 7] revealed that the majority of the CAMH cases identified in the district were referred to the two clinical psychologists based at the hospital, who provided psychological interventions and referred to other specialists such as the occupational therapists, speech therapists and the psychiatrist for further interventions. Many of the referrals to the clinical psychologists were for learning disabilities that should have ideally been referred to educational psychologists. The clinical psychologists thus reported that many of the cases were referred back to the educational psychologists at the Department of Education. This illustration reveals the shortcomings of the CAMH referral system in the district and the need to define the referral pathways clearly.

Fig. 2
figure 2

Existing referral pathways in the district

Participants reported four main factors responsible for the inappropriate referrals of CAMH cases in the district. They include poor referral systems, limited training on CAMH identification and referral, lack of knowledge on the existing referral systems and poor communication between stakeholders within each sector and between sectors. According to the participants, the lack of adequately defined multilevel/multisectoral referral pathways and lack of training on CAMH identification and referral, particularly for educators, were major challenges impeding access to CAMH services in the district. Hence, they highlighted the need for capacitation in screening and identification of cases in need of referral and clearly defined CAMH referral pathways that incorporate all the relevant departments and sites of care. Also, the need to develop referral guidelines and training to disseminate the necessary information included in the referrals guidelines was highlighted.

Causal factors and identified strategies to address limited CAMH promotion and awareness

Participants ascribed the general lack of knowledge on CAMH in the district to limited CAMH awareness programs in the community. Stakeholders from DOH reported that the lack of community dialogues around CAMH is reflective of the low priority given to mental health. Schools are visited mostly after adverse events (such as suicide) to provide therapy and educate learners in mental health literacy. Stakeholders from the NPOs mentioned that they conducted mental health campaigns in schools and communities, although inefficiently due to the lack of training and campaign materials. Also, stakeholders from DBE mentioned that campaign programs were organised on days allocated globally to the recognition of CAMH conditions. Participants suggested that CAMH awareness campaigns should be more frequent and not only according to the health calendar or immediate reaction to an unfortunate event. The need to train school health nurses, NPOs, and learner support agents in schools to create awareness among learners and organise cost-effective awareness campaigns to destigmatise mental health in the community was mentioned.

Causal factors and identified strategies to address limited community-based CAMH interventions

Participants reported that the poor working relationship between the Departments of Health, Basic Education, and Social Development contributed in a major way to the limited community-based interventions in the district. This was despite that the three departments jointly created a disability forum where representatives from the departments met monthly to discuss issues about disability in the district. Also, there was a mental health disability forum within DOH where stakeholders meet to discuss the mental health challenges in the district. However, these forums are not solely dedicated to CAMH discussions. The participants mentioned that the NPOs were part of these forums as they served as key informants and communication channels between government and communities. However, inadequate attention was paid to developing multisectoral CAMH interventions and initiating dialogues with young people in the district. Suggestions raised to address these issues during the workshop included: an improved working relationship between the departments specifically to address CAMH issues, provision of recreation facilities for young people, and the need to create awareness on the availability of youth-friendly facilities such as "chill" rooms in the clinics. The need to create dialogical spaces for young people, design mentorship programs, and involve them in decision making while designing CAMH programs were also mentioned.

Causal factors and identified strategies to address poor management structures

The preliminary studies revealed the lack of a multisectoral CAMH management structure and poor management structures for CAMH within each of the departments as major weaknesses of CAMH services in the district [5, 7]. Participants in the workshop mentioned that the causal factors include the lack of a functional CAMH management structure which results in poor planning, failure to implement adequate procedures for CAMH service delivery, and the inability to facilitate budget allocation. Therefore, the identified strategies include the need to build a functional intersectoral liaison forum to facilitate joint advocacy for budget allocation and collaborative activities for the delivery of CAMH services were suggested. The need to communicate the existing policies relevant to the delivery of CAMH services in each department was further emphasised.

Causal factors and identified strategies to address limited specialists and vertical services

The shortage of specialists, including psychiatrists, psychiatric nurses, educational and clinical psychologists and the lack of dedicated CAMH specialists were highlighted as causal factors. The suggested strategies highlighted by the participants included specialist supervision and mentoring of non-specialists. According to the participants, these strategies are necessary to reduce the workload and facilitate prompt access to CAMH services in the district. The participants further stated that increasing the number of CAMH specialists and support staff across all the departments is imperative. According to the participants, it is important to equip staff at all levels (community, school, primary healthcare, and hospitals) with basic skills and knowledge required to deliver adequate CAMH services. Additionally, the participants mentioned that managers at the different departments must ensure that staff are adequately monitored to provide effective and prompt CAMH services in the district.

Results from stage two

Development of theory of change map for CAMH services

The ToC map (Fig. 3) maps out the medium-term outcomes, the necessary activities (collaborative strategies for CAMH care) to achieve each medium-term outcome, and the causal links connecting medium-term outcomes to the long-term outcomes. The ToC map also presents multilevel and multisectoral strategies for each medium-term outcome.

Fig. 3
figure 3

ToC map: collaborative strategies for CAMH services

Medium-term outcomes include early identification of CAMH conditions, appropriate referral and prompt access to CAMH services, development of CAMH care packages (for early initiation of treatment and interventions), and intersectoral governance. The long-term outcome was identified as improved CAMH services. The medium-term outcomes cut across different levels of care, including the community (school and home environment), primary health care, and hospitals. Furthermore, interventions and strategies for each level of care were mapped out, and some cross-cutting interventions were also identified.

A detailed description of the relationship between all the variables, inputs, activities and indicators are presented in Table 2 (ToC log frame). The ToC map and log frame present possible ways through which the CAMH system in the district can be strengthened.

Table 2 Theory of Change log frame

Interventions/strategies for early identification of CAMH conditions

At the community level, proposed interventions for early identification include (i) the development of screening tools and improvement of screening quality, with service providers needing to be trained to ensure the effective use of the screening tools and to improve the quality of screening; (ii) educating the community on CAMH disorders and their symptoms through community awareness activities facilitated by NPOs. At the primary health care level, proposed interventions for early identification included efforts to (i) improve developmental screening by advocating for increased attention to developmental milestones and teaching mothers how to interpret "red flags" highlighted in the road to health cards; (ii) improving the quality of CAMH assessment by strengthening CAMH consultations with the available psychiatric nurses in the district. At the hospital level, interventions would include efforts to facilitate (v) timeous CAMH assessment and diagnosis through advocacy for prioritisation of CAMH cases to achieve prompt specialist interventions.

Appropriate referrals and prompt access to CAMH services

At the community level, interventions to improve referral would include efforts to educate the community on CAMH health-seeking and appropriate treatment sites, with PHC facilities highlighted as the first point of call for CAMH care, from where onward referral to CAMH nurses, educational psychologists, and occupational therapists could occur. The development of a psychoeducation tool was identified as being important to assist community health workers in educating the community. At the PHC level, interventions identified includes placement of trained CAMH nurses in larger PHC facilities—such as Community Health Centres, with peer consultation and specialist supervision being solicited to further strengthen CAMH nurses' consultations. At the hospital level, interventions identified included clear referral pathways to and between specialists (clinical psychologists, psychiatrists, occupational therapists, and speech therapists), including referral and back referral procedures within the hospital system. Identified cross-cutting interventions included (i) the design of a clear multisectoral CAMH referral system; and (ii) adequate communication of referral pathways within sectors.

Development of CAMH promotion, care and treatment packages

At the community level, identified efforts to develop effective CAMH care packages included designing community-based interventions such as parenting programs, family strengthening programs, awareness campaigns, school awareness and dropout prevention programs. At the primary healthcare level, interventions identified included (i) initiating psychosocial support for children/adolescents and caregivers by incorporating psychosocial support and youth-friendly services into primary health care; (ii) encouraging treatment initiation at the PHC level by capacitating clinic staff/psychiatric nurses in CAMH conditions through training and supervision; and (iii) the development of training packages for care providers to educate families and caregivers on CAMH conditions, as well as providing follow up and support services and develop treatment plans for different CAMH conditions.

Intersectoral governance

The absence of systems aimed at tackling major CAMH issues and aligning all the available policies and programmes across all the government and non-government sectors was identified as the causal factors for the lack of intersectoral collaboration. Therefore, it is imperative to develop interventions and strategies that can help establish and build relationships across all the sectors. The identified strategies include (i) initiating intersectoral CAMH provincial and district policy development; (ii) initiating intersectoral CAMH data system development; (iii) establishing a district multisectoral CAMH working group; (iv) clearly defining the roles of care providers and specialists across all sectors, and (v) encouraging joint budgeting that adequately costs CAMH packages according to each sectors' contributions.

Results from stage three

The stakeholders confirmed all the incorporated strategies as context-appropriate and highlighted strategies that could facilitate prompt identifications within the community and school environment as the first step to strengthening CAMH services in the district. The four major strategies included (i) developing CAMH community awareness programmes and psychoeducation interventions; (ii) developing a screening tool that non-specialist healthcare providers and educators can use to identify common CAMH disorders within the community; (iii) providing CAMH training for educators across the elementary, primary and secondary school phases. The training should focus on psychoeducation around CAMH disorders, appropriate use of the screening tools and the relevant referral pathways for the different conditions; (iv) defining clear pathways to care for different CAMH conditions and adequately communicating the pathways across all the sectors providing CAMH care.

The participatory workshops allowed the stakeholders to critically engage with CAMH services challenges and develop possible solutions. They acknowledged that implementing these strategies requires particular processes, including obtaining stakeholders buy-in across all the sectors, identifying strategic capabilities (existing resources within each departments) and adequately clarifying each departments’ roles to maximise resources and identifying priority intervention settings. Also, the stakeholders identified the need to promote collaboration and across all the sectors to strengthen CAMH services in the district. The stakeholders agreed to develop a dedicated forum for CAMH deliberations mainly to steer the implementation of the strategies and facilitate the development of local constituencies for change within each department.

Next steps

The purpose of conducting the participatory workshops was to identify and discuss the strategies, which is the first step towards the development of a district CAMH plan. There was no consideration of practical implications regarding relevant resources (including human resources), cost implications and relative cost-effectiveness. However, the strategies were developed to strengthen and maximise the available resources within the community, schools and the various departments to minimise cost and ensure cost-effectiveness. The next phase of the study will focus on (i) developing intervention packages, (ii) creating new positions to implement the strategies, (iii) estimating the cost of each package and conducting cost–benefit analysis, (iv) obtaining the inputs of all the stakeholders on the costs and (v) developing a district plan and economic modelling.

Discussion

Considering the lack of provincial and district CAMH policy documents and implementation plans to complement the national 2003 CAMH policy in South Africa [33], this study sought to address this problem through engaging in a three-step process in one district (Amajuba) as a case study on how to assist in the development of district CAMH plans. Informed by bottlenecks in CAMH services identified by formative studies in Amajuba [5, 7], we sought to initially facilitate the identification of strategies with key stakeholders to address these bottlenecks. The information generated by this process, as well as the formative studies, were then used to develop a Theory of Change for Amajuba of how to improve CAMH outcomes, with the view to helping the district to develop a CAMH plan.

To address the problem of poor intersectoral collaboration in CAMH services, the development of an intersectoral working group was suggested. Intersectoral collaboration is essential to clarify roles and responsibilities of different sectors in the provision of CAMH services. It is also crucial to provide multisectoral CAMH care packages and achieve joint budgeting- which is key to improving CAMH service delivery and mental health outcomes in children and adolescents [32, 39].

The design of user-friendly CAMH screening tools to facilitate early identification in the community was identified as a key strategy required to address challenges relating to poor identification and assessment. Failure to promptly detect CAMH cases in the district was directly linked to low levels of CAMH literacy and the lack of user-friendly screening tools at the community level, particularly in schools. This corroborates the findings of previous studies which establish links between early identification and the availability of valid, brief and easy to use CAMH screening tools [22, 28, 35, 44]. The development of easy-to-administer CAMH screening tools, training and supporting the Ward-based Primary Health Care Outreach Teams (WBPHCOTs), the integrated school health program (ISHP) nurses, learner support agents (L.S.A.s) and educators in the use of these tools should promote early identification and referral of children and adolescents in need of mental health services [15].

To address the inappropriate referrals and treatment delays, the participants suggested that all referral policies in each department be adequately communicated and integrated to develop a functional district multisectoral CAMH referral system that will promote appropriate referral and prompt access CAMH services. Also, the need to adequately educate all stakeholders about the consolidated referral system was emphasised. These findings are similar to that of Porras-Javier et al. [39] and a systematic review of pathways to mental health services for young people conducted by MacDonald et al. [31].

In light of the severe shortage of CAMH specialists, particularly the shortage of educational psychologists and clinical psychologists, the participants suggested the adoption of a task-sharing approach with specialist supervision and mentoring of non-specialists to equip them with the necessary skills. Several studies have highlighted the significance of task-sharing in narrowing mental health treatment gaps and facilitating access (Hanlon et al. [47]; Hoeft et al. [48]; Padmanathan & De Silva, [49] particularly for delivering CAMH services in low resource settings. A study conducted by Desta et al. showed that empowering teachers with the required CAMH skills could facilitate early identification, appropriate referral, and prompt treatment of CAMH conditions Desta et al. [50].

The possibility of addressing the scarcity of CAMH interventions at the PHC level by integrating CAMH services into primary health care was emphasised. Previous studies have identified PHC as a core site for CAMH identification and treatment [2, 3, 6]. The delivery of prevention and promotion programs were also suggested as being an important aspect of PHC, with chill rooms at the community clinics suggested as feasible sites for delivering mental health interventions such as mentorship programs to young people in the community.

It is also crucial to tackle inadequate CAMH awareness in the communities resulting in low CAMH knowledge in the district. Participants suggested that initiatives steered at increasing routine awareness campaigns in the community to sensitise parents, teachers, youths, and health professionals could improve CAMH knowledge and service outcomes in the district. A study conducted in nine countries by Hoven et al. [23] revealed improved CAMH knowledge and an increased willingness to engage in CAMH discussions among parents, teachers, and children after conducting awareness campaigns.

Limitations of the study

We acknowledge that the study was only conducted in one district—therefore, the findings are not generalisable. However, the study provides an insight into how participatory methods can be used to identify and address CAMH service bottlenecks and how local stakeholders can collaborate to develop a systematic and holistic approach to strengthen CAMH services. This participatory approach could be used in developing strategies to enhance CAMH services in other contexts within the country and LMICs. The findings and recommendations described here are very much a work-in-progress and should be read as flexible guidelines that will be regularly updated in consultation with district stakeholders.

As with any approach, ToC has its limitations. The process of developing a ToC, particularly identifying detailed preconditions required to achieve the desired impact and deciding on suitable indicators to ascertain that the preconditions will produce the desired outcomes, is complex, expensive, and time-consuming [13, 16]. Hence, for this study, the researchers developed the actual ToC model using the information obtained from the formative studies and the strategies identified by the participants in the workshop. This approach is different from the standard approach to developing a ToC, where participants are facilitated to predict all the elements of the ToC in a workshop, which can be challenging. As De Silva et al. [17] highlighted, orientating stakeholders to identify, prioritise, measure key interventions, and predict the effect of particular strategies on the medium-term outcomes could be challenging due to time constraints. Our approach addressed these challenges and provided an opportunity for the researchers to critically reflect on the required ToC elements. The strategies identified in the workshop were then incorporated in the model–providing an alternative to the standard ToC development approach that can be adopted in busy health care settings.

Our study is still in the early stages of a sequential process. We have co-developed a ToC map in collaboration with the stakeholders involved in delivering CAMH services in the case study district. The next phase will be to create an intersectoral working team to develop a district CAMH plan.

Conclusions

The findings of this study present a process of developing a ToC in low resource settings and provides insight into areas in need of immediate action to facilitate the development of a district CAMH plan. The identified causal factors and possible solutions to the bottlenecks facilitated the development of a ToC, which could ease the development of a district CAMH plan and ensure the effectiveness and sustainability of CAMH services in the district. The next step will be creating a multisectoral district task team that will engage with the findings and drive the development and implementation of a comprehensive plan to strengthen CAMH services in the district. Many of the lessons learned from this study could be applicable in other districts in South Africa and Southern African settings.

Availability of data and materials

Data and material will be made available on request.

Abbreviations

CAMH:

Child and Adolescent Mental Health

CMED:

Community Mental Health Education And Detection

DBE:

Department Of Basic Education

DOH:

Department Of Health

DSD:

Department Of Social Development

ISHP:

The Integrated School Health Program

LMICs:

Low- And Middle-Income Countries

L.S.A.s:

Learner Support Agents

MhINT:

Mental Health INTegration

NPOs:

Non-Profit Organisations

psy-OPD:

Psychiatric Outpatient Department

SANCA:

South African National Council On Alcoholism

SIAS:

Screening, Identification, Assessment, And Support

ToC:

Theory Of Change

WBPHCOTs:

Ward-Based Primary Health Care Outreach Teams

References

  1. Abayneh S, Lempp H, Alem A, Kohrt BA, Fekadu A, Hanlon C. Developing a Theory of Change model of service user and caregiver involvement in mental health system strengthening in primary health care in rural Ethiopia. Int J Ment Heal Syst. 2020;14(1):1–17.

    Article  Google Scholar 

  2. Akol A. Access to child and adolescent mental health services in uganda: investigating the role of primary health care and traditional healers. Norway: The university of Bergen; 2018.

    Google Scholar 

  3. Akol A, Nalugya J, Nshemereirwe S, Babirye JN, Engebretsen IMS. Does child and adolescent mental health in-service training result in equivalent knowledge gain among cadres of non-specialist health workers in Uganda? A pre-test post-test study. Int J Ment Heal Syst. 2017;11(1):50.

    Article  Google Scholar 

  4. Al-Obaidi A, Budosan B, Jeffrey L. Child and adolescent mental health in Iraq: current situation and scope for promotion of child and adolescent mental health policy. Intervention. 2010;8(1):40–51.

    Article  Google Scholar 

  5. Babatunde GB, Bhana A, Petersen I. Planning for child and adolescent mental health interventions in a rural district of South Africa: a situational analysis. J Child Adolesc Ment Health. 2020;32(1):45–65.

    Article  Google Scholar 

  6. Babatunde GB, van Rensburg AJ, Bhana A, Petersen I. Barriers and facilitators to child and adolescent mental health services in low-and-middle-income countries: a scoping review. Global Social Welfare. 2019;8(1):29–46.

    Article  Google Scholar 

  7. Babatunde GB, van Rensburg AJ, Bhana A, Petersen I. Stakeholders’ perceptions of child and adolescent mental health services in a South African district: a qualitative study. Int J Ment Heal Syst. 2020;14(1):1–12.

    Article  Google Scholar 

  8. Baum F, MacDougall C, Smith D. Participatory action research. J Epidemiol Community Health. 2006;60(10):854.

    Article  Google Scholar 

  9. Boddy C (2012). The nominal group technique: An aid to brainstorming ideas in research. Qualitative Market Research: An International Journal, 15(1), 6-18.

  10. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.

    Article  Google Scholar 

  11. Breuer E, De Silva MJ, Fekadu A, Luitel NP, Murhar V, Nakku J, Lund C. Using workshops to develop theories of change in five low- and middle-income countries: lessons from the programme for improving mental health care (PRIME). Int J Ment Heal Syst. 2014;8(1):15.

    Article  Google Scholar 

  12. Breuer E, De Silva M, Lund C. Theory of change for complex mental health interventions: 10 lessons from the programme for improving mental healthcare. Global Mental Health. 2018. https://doi.org/10.1017/gmh.2018.13.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Breuer E, Lee L, De Silva M, Lund C. Using Theory of Change to design and evaluate public health interventions: a systematic review. Implement Sci. 2015;11(1):63.

    Article  Google Scholar 

  14. Breuer E, Subba P, Luitel N, Jordans M, De Silva M, Marchal B, Lund C. Using qualitative comparative analysis and Theory of Change to unravel the effects of a mental health intervention on service utilisation in Nepal. BMJ Glob Health. 2018;3(6): e001023.

    Article  Google Scholar 

  15. Committee on School Health. School-based mental health services. Pediatrics. 2004;113(6):1839–45.

    Article  Google Scholar 

  16. De Silva MJ, Breuer E, Lee L, Asher L, Chowdhary N, Lund C, Patel V. Theory of change: a theory-driven approach to enhance the medical research council’s framework for complex interventions. Trials. 2014;15(1):267.

    Article  Google Scholar 

  17. De Silva, M., Lee, L., & Ryan, G. (2014). Using Theory of Change in the development, implementation and evaluation of complex health interventions. London: The Centre for Global Mental Health at the London School of Hygiene & Tropical Medicine and The Mental Health Innovation Network.https://www.mhinnovation.net/sites/default/files/downloads/resource/MHIN%20ToC%20guidelines_May_2015.pdf

    Google Scholar 

  18. Esponda GM, Ryan GK, Estrin GL, Usmani S, Lee L, Murphy J, De Silva M. Lessons from a Theory of Change-driven evaluation of a global mental health funding portfolio. Int J Ment Heal Syst. 2021;15(1):1–14.

    Article  Google Scholar 

  19. Guise JM, O’Haire C, McPheeters M, Most C, LaBrant L, Lee K, Graham E. A practice-based tool for engaging stakeholders in future research: a synthesis of current practices. J Clin Epidemiol. 2013;66(6):666–74.

    Article  Google Scholar 

  20. Haldane V, Chuah FL, Srivastava A, Singh SR, Koh GC, Seng CK, Legido-Quigley H. Community participation in health services development, implementation, and evaluation: a systematic review of empowerment, health, community, and process outcomes. PLoS ONE. 2019;14(5): e0216112.

    Article  Google Scholar 

  21. Hernandez M, Hodges S. Applying a Theory of Change approach to interagency planning in child mental health. Am J Community Psychol. 2006;38(3–4):165–73.

    PubMed  Google Scholar 

  22. Horowitz LM, Ballard ED. Suicide screening in schools, primary care and emergency departments. Curr Opin Pediatr. 2009;21(5):620.

    Article  Google Scholar 

  23. Hoven CW, Doan T, Musa GJ, Jaliashvili T, Duarte CS, Ovuga E, Yeghiyan M. Worldwide child and adolescent mental health begin with awareness: a preliminary assessment in nine countries. Int Rev Psychiatry. 2008;20(3):261–70.

    Article  Google Scholar 

  24. Juengsiragulwit D. Opportunities and obstacles in child and adolescent mental health services in low-and middle-income countries: a review of the literature. WHO South-East Asia J Public Health. 2015;4(2):110.

    Article  Google Scholar 

  25. Jull J, Giles A, Graham ID. Community-based participatory research and integrated knowledge translation: advancing the co-creation of knowledge. Implement Sci. 2017;12(1):150.

    Article  Google Scholar 

  26. Kleintjes S, Lund C, Flisher AJ. A situational analysis of child and adolescent mental health services in Ghana Uganda South Africa and Zambia. African J Psychiatry. 2010. https://doi.org/10.4314/ajpsy.v13i2.54360.

    Article  Google Scholar 

  27. Kohrt BA, Asher L, Bhardwaj A, Fazel M, Jordans MJ, Mutamba BB, Patel V. The role of communities in mental health care in low- and middle-income countries: a meta-review of components and competencies. Int J Environ Res Public Health. 2018;15(6):1279.

    Article  Google Scholar 

  28. Levitt JM, Saka N, Romanelli LH, Hoagwood K. Early identification of mental health problems in schools: the status of instrumentation. J Sch Psychol. 2007;45(2):163–91.

    Article  Google Scholar 

  29. Lund C, Boyce G, Flisher AJ, Kafaar Z, Dawes A. Scaling up child and adolescent mental health services in South Africa: human resource requirements and costs. J Child Psychol Psychiatry. 2009;50(9):1121–30.

    Article  Google Scholar 

  30. MacDonald C. Understanding participatory action research: A qualitative research methodology option. Canadian J Action Res. 2012;13(2):34–50.

    Article  Google Scholar 

  31. MacDonald K, Fainman-Adelman N, Anderson KK, Iyer SN. Pathways to mental health services for young people: a systematic review. Soc Psychiatry Psychiatr Epidemiol. 2018;53(10):1005–38.

    Article  Google Scholar 

  32. Mokitimi S, Jonas K, Schneider M, De Vries PJ. Child and adolescent mental health services in South Africa-Senior stakeholder perceptions of strengths, weaknesses, opportunities and threats in the Western Cape province. Front Psych. 2019;10:841.

    Article  Google Scholar 

  33. Mokitimi S, Schneider M, De Vries PJ. Child and adolescent mental health policy in South Africa: history, current policy development and implementation, and policy analysis. Int J Ment Heal Syst. 2018;12(1):36.

    Article  Google Scholar 

  34. Murray E, Treweek S, Pope C, MacFarlane A, Ballini L, Dowrick C, Ong BN. Normalisation process theory: a framework for developing, evaluating and implementing complex interventions. BMC Med. 2010;8(1):63.

    Article  Google Scholar 

  35. Nemeroff R, Levitt JM, Faul L, Wonpat-Borja A, Bufferd S, Setterberg S, Jensen PS. Establishing ongoing, early identification programs for mental health problems in our schools: a feasibility study. J Am Acad Child Adolesc Psychiatry. 2008;47(3):328–38.

    Article  Google Scholar 

  36. Ørngreen R, Levinsen K. Workshops as a research methodology. Electron J E-learn. 2017;15(1):70–81.

    Google Scholar 

  37. Petersen I, Fairall L, Bhana A, Kathree T, Selohilwe O, Brooke-Sumner C, Patel V. Integrating mental health into chronic care in South Africa: the development of a district mental healthcare plan. Br J Psychiatry. 2016;208(s56):s29–39.

    Article  Google Scholar 

  38. Petersen I, Rensburg A, Gigaba VSG, Luvuno ZBP, Fairall LR. Health systems strengthening to optimise scale-up in global mental health in low-and middle-income countries: lessons from the frontlines A re-appraisal. Epidemiol Psychiatr Sci. 2020. https://doi.org/10.1017/S2045796020000475.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Porras-Javier L, Bromley E, Lopez M, Coker TR. Challenges to effective primary care-specialty communication and coordination in the mental health referral and care process for publicly insured children. J Behav Health Serv Res. 2018;45(4):668–77.

    Article  Google Scholar 

  40. Reinholz DL, Andrews TC. Change theory and Theory of Change: What’s the difference anyway? Int J STEM Educ. 2020;7(1):1–12.

    Article  Google Scholar 

  41. Shaw M, Hodgkins P, Caci H, Young S, Kahle J, Woods AG, Arnold LE. A systematic review and analysis of long-term outcomes in attention deficit hyperactivity disorder: effects of treatment and non-treatment. BMC Med. 2012;10(1):99.

    Article  Google Scholar 

  42. Vogel, I. (2012). Review of the use of ‘Theory of Change’ in international development. UK: Department for International Development (DFID), 10. https://www.theoryofchange.org/pdf/DFID_ToC_Review_VogelV7.pdf

    Google Scholar 

  43. Wandersman A, Florin P. Community interventions and effective prevention. Am Psychol. 2003;58(6–7):441.

    Article  Google Scholar 

  44. Weist MD, Rubin M, Moore E, Adelsheim S, Wrobel G. Mental health screening in schools. J Sch Health. 2007;77(2):53–8.

    Article  Google Scholar 

  45. Govender K, Penning S, George G, Quinlan T (2012). Weighing up the burden of care on caregivers of orphan children: The Amajuba District Child Health and Wellbeing Project, South Africa. AIDS care, 24(6), 712-721.

    Article  Google Scholar 

  46. Babatunde GB, Bhana A, Petersen I (2020). Planning for child and adolescent mental health interventions in a rural district of South Africa: a situational analysis. Journal of Child & Adolescent Mental Health, 32(1), 45-65.

  47. Hanlon C, Alem A, Medhin G, Shibre T, Ejigu DA, Negussie H, Fekadu A (2016). Task sharing for the care of severe mental disorders in a low-income country (TaSCS): study protocol for a randomised, controlled, non-inferiority trial. Trials, 17(1), 1-14.

  48. Hoeft TJ, Fortney JC, Patel V, Unützer J (2018). Task‐sharing approaches to improve mental health care in rural and other low‐resource settings: a systematic review. The Journal of rural health, 34(1), 48-62.

  49. Padmanathan P, De Silva MJ (2013). The acceptability and feasibility of task sharing for mental healthcare in low and middle income countries: a systematic review. Social science & medicine, 97, 82-86.

  50. Desta M, Deyessa N, Fish I, Maxwell B, Zerihun T, Levine S, F Garland A (2017). Empowering preschool teachers to identify mental health problems: a task sharing intervention in Ethiopia. Mind, Brain, and Education, 11(1), 32-42.

Download references

Acknowledgements

We would like to thank all the study participants who devoted their time and insight, Mr Mercury Nzuza, Miss Patricia Ndlovu, Mr Fortune Ngubeni and Kgothalang Rethabile Khadikane, for the support provided during the data collection phase.

Funding

This study is an output of the PRogramme for Improving Mental health carE (PRIME). This work was financially supported by the South African Medical Research Council. GBB receives the University of KwaZulu-Natal, College of Health sciences scholarship. She is a recipient of the 2020 African-German Network of Excellence in Science–Programme Advocating Women in Science (AGNES-PAWS) Grant for Junior Researchers. André van Rensburg is funded by the National Institute of Mental Health of the National Institutes of Health [3U19MH113191-03S1], the National Institute for Health Research (NIHR) [GHRU 16/136/54] and the Wellcome Trust [219675/Z/19/Z].

Author information

Authors and Affiliations

Authors

Contributions

G.B.B, I.P and A.V conceptualised the study, collected and analysed data, G.B.B drafted the manuscript. A.V, A.B and I.P reviewed the manuscript and provided substantive revision. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Gbotemi B. Babatunde.

Ethics declarations

Ethics approval and consent to participate

Ethical approval for the study was obtained from the Biomedical Research Ethics Committee, Faculty of Health Sciences, University of KwaZulu-Natal. Reference number BE098/18. All the participants provided their verbal consent and also signed a consent form.

Consent for publication

The participants were informed that the study's findings would be published, and their consent was obtained.

Competing interests

The authors declare no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Babatunde, G.B., van Rensburg, A.J., Bhana, A. et al. Identifying multilevel and multisectoral strategies to develop a Theory of Change for improving child and adolescent mental health services in a case-study district in South Africa. Child Adolesc Psychiatry Ment Health 16, 45 (2022). https://doi.org/10.1186/s13034-022-00484-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13034-022-00484-9

Keywords

  • Theory of Change
  • Child and adolescent mental health
  • Mental healthcare plan
  • Collaborative planning