UNICEF Programming in Health Systems Strengthening – A Formative Evaluation
2017-18; UNICEF; Multi-Country
There is currently widespread recognition that the goal of improved health for all people cannot be achieved without stronger health systems. UNICEF believes that stronger health systems are necessary to reach the most marginalized children and women, to sustain the progress achieved and to increase the resilience of both delivery systems and communities to absorb and recover from external shocks, including public health emergencies and outbreaks. Health systems strengthening (HSS) is one of three overarching approaches of UNICEF’s Strategy for Health 2016-30.
Given the strategic importance of UNICEF’s engagement in HSS, it has contracted Itad, in partnership with Health Partners International, to undertake an evaluation of the organisation’s approach to HSS. This formative evaluation is focused on examining UNICEF’s efforts on HSS across different levels of the organization in order to facilitate learning from experience and the generation of clear recommendations for the future. To ensure that our evaluation findings and recommendations are of greatest use, we are applying a utilization-focused approach, making the most of opportunities for UNICEF staff (across headquarters, regional and country levels) to feed into the design of the evaluation and engage with interim findings.
Our evaluation design is theory-based, centred on the use of an overarching theory of change (ToC) for UNICEF’s work in HSS, which will elaborate the theoretical causal pathways through which UNICEF intends to effect change. The evaluation examines two separate but inter-related domains of UNICEF’s engagement in HSS – namely, how UNICEF as an organization is supporting the changes sought in its approach, and how program implementation is supporting HSS at country level. We see the organizational and implementation domains of the evaluation as distinct but highly inter-related and therefore have developed a common conceptual framework to underpin the design of our approach to data collection and analysis. This will allow examination of each domain in turn but facilitate a robust assessment across the piece – i.e. interfacing to examine the contribution of UNICEF as an organization to implementation at country level.
To make sure that our evaluation generates findings that are credible and of use to users – one of the key principles of utilization-focused evaluation – we are incorporating a mixed methods approach, across global, regional and country level. We are deploying case studies, structured document review, key informant interviews (KIIs) and an online survey to generate robust evidence against elements of the ToC, and robust synthesis against the EQs. This will allow a clear line of sight between the evidence, findings, conclusions and recommendations.
Image © Maamohelang kisses her son Photo Credit: USAID