Dr. Chris Barnett is Technical Director at Itad, as well as the Director of the Centre for Development Impact (CDI); a joint initiative between Institute of Development Studies (IDS), Itad, and the University of East Anglia (UEA). His work focuses on impact evaluation and other evaluative methodologies, and works particularly in the areas of civil society, governance and livelihoods.
Chris is an experienced team leader and director of a number of evaluations, and has led work on designing several performance management systems. He is currently the Project Director for the Impact Evaluation of the Millennium Villages Project in northern Ghana, working closely with the Principal Investigator, Dr. Edoardo Masset from IDS. He is also the Team Leader of the Independent Impact Evaluation Agent (IIEA) for Tilitonse (Malawi), which is a four-year assignment to measure the impact of a £12.5 million civil society fund. Chris currently provides technical support on monitoring and evaluation (M&E) and value for money (VFM) to a number of governance funds in West Africa, including: the Strengthening Transparency, Accountability and Responsiveness programme in Ghana (STAR-Ghana), as well as the State Voice and Accountability Initiative (SAVI) in Nigeria. His recent work includes being Project Director for the multi-donor evaluation of support to Conflict Prevention and Peace Building (CPPB) activities in Southern Sudan, and team leading the Sida evaluation of the Chia Se poverty alleviation programme in Vietnam (a rights-based initiative).
Chris also works on VFM. He led the team that undertook the DFID study on ‘Measuring the Impact and Value for Money of Governance Programmes’, as well as the subsequent work for Bond (the UK membership body for non-governmental organizations). He has undertaken research studies for two National Audit Office VFM reports on DFID’s bilateral assistance; the first of Malawi’s country programme, and the second of DFID’s 10-year strategy for primary education (with work in Ghana and Kenya).
He is also interested in exploring approaches to feedback loops, where rapid feedback can be used to improve downward accountability to citizens; plus, the use of innovation prizes to stimulate new ideas and solutions in international development.
|Languages:||English (mother tongue)|
Armenia, Uganda, Kenya, Thailand, Bhutan, Viet Nam, Malawi, India, Ukraine, Ireland, Tanzania, United States, Indonesia, Moldova, Japan, Netherlands, Ethiopia, Nigeria, Ghana, Liberia, Zambia,
University of Sussex, UK
University of Sussex, UK
University of Reading, UK
(DFID, Nigeria) - Project Director
The overarching objective of M4D is to help increase progress towards the MDGs in northern Nigeria - with a particular focus on supporting policymakers and service providers to become more accountable and responsive to citizens. The programme is focused especially on adolescent girls, within Kano, Kaduna and Jigawa states in northern Nigeria. The IEM is a 'developmental evaluation', with both formative and summative elements used to feed evidence and learning into the programme. The theory-based approach uses a household survey, longitudinal case studies and triangulation with other sources (including the M&E data of M4D) and is being delivered by a core team of M&E experts, data analysts and research assistants and supported by survey and case study teams as well as several peer reviewers and statisticians.
Overall design and management responsibility for the IEM. Quality assurance of key deliverables, refinement of evaluation design (including the case study approach). Representation of the IEM at the consortium steering group.
(DFID) - Project Director
Among a portfolio of programmes, DFID has commissioned a WASH Results Programme, which provides funding to three organisations / consortia to deliver water, sanitation and hygiene services across 13 countries in sub-Saharan Africa and South Asia. The WASH Results programme employs an innovative finance mechanism following principles of "Payment by Results". In this case 'payment by results' means that the three WASH suppliers will receive payment only upon independent verification of achieving a set of specific results packages agreed between each supplier and DFID. DFID appointed a consortium led by Itad to provide the Monitoring, Verification and Evaluation (MVE) services related to the programme
Activities include client relations with senior DFID Advisers; final quality assurance of verification report; and representation at consortium board meetings.
(DFID, UK, Ghana, Nepal, Kenya) - Project Director
Accelerating innovation in technologies and business models is essential to help reduce the current and long-term impacts of climate change and support green growth in developing countries. Compared to most industrialised countries, developing countries have relatively weak innovation systems and institutional capabilities to facilitate and promote innovation. The 'Ideas to Impact' programme sets out to design, establish and manage a set of innovation prizes. These prizes seek solutions to poor people's access to affordable clean energy, safe drinking water and other climate /environmental services. Itad is providing the monitoring, learning and evaluation support to both the overall programme as well as individual prizes.
Design and technical support for the framework / plans for M&E support at the programme level, as well as for specific prizes. Specific technical inputs on Value for Money (VFM) and estimating beneficiary numbers. Review and technical support for evaluation design papers for each prize.
(DFID ) - Quality Assurer
In 2011, DFID placed empowerment, especially the empowerment of girls and women, at the centre of its development agenda. This was done through the launch of DFID's Strategic Vision for Girls and Women (SV) and a revised policy framework for work on Empowerment and Accountability (E&A). At the same time, DFID committed to evaluate the effects of its planned investments in these two areas, and commissioned this macro evaluation of the SV for Girls and Women and its policy frame for Empowerment and Accountability. These two macro evaluations seek to generate evidence of what works, for whom and in what contexts in the areas of E&A and the empowerment of girls and women, and for this evidence to inform policy and practice. The evaluation takes a synthesis approach, using a mix of Qualitative Comparative Analysis (QCA) to review different causal configurations across the E&A portfolio, combined with an adapted form of meta-ethnography - to bring insights around the overall analysis.
Quality assurance and technical support on the evaluation design, technical notes, and evaluation reports - including feedback / advice to the Principal Investigator and the project manager.
(OECD) - Quality Assurer
Over the past decade there has been a considerable amount of experimentation on-going to test out results-based finance mechanisms, particularly in service delivery sectors. However, the benefits of results-based approaches (RBA) in the governance and institutional reform domains are comparatively under-explored. The objective of the assignment is to provide better knowledge on the use of RBA in the governance sector, with special emphasis on public sector reform programmes; to identify different and innovative modalities and approaches, and to make recommendations for OECD, and its Effective Institutions Platform. The assignment involves a detailed literature and evidence review encompassing the work of a range of bilateral and multilateral donors to identify what different results-based approaches are being used, with three country-based case studies.
Reviews and technical support for the literature review and overall methodological approach to the study. Peer review of draft and final papers
(DFID, Malawi) - Project Director
Project description: Tilitonse is a multi-donor pooled fund (GBP 7 million approximately) designed to support governance work conducted by civil society organisations. It is intended to help increase accountable, inclusive and responsive governance in Malawi by empowering citizens to promote social inclusion, political rights and accountability for basic services.
Activities: To lead the team and provide overall management and technical direction to assess the impact of the programme - including setting up the baseline surveys and conducting qualitative assessments. The inception phase will review a theory-based approach to the evaluation drawing on a range of methods. This will include reviewing the possibility of conducting a Randomised Control Trial (RCT) as part of the assignment.
(DFID-Ghana) - Project Director
Project description: ITAD, in collaboration with IDS, LSHTM, KPMG-Ghana and PDA Ghana, is undertaking a five-year, independent impact evaluation of a new Millennium Village (MV) in Northern Ghana. The MV project, already being implemented in sites in several countries in Africa, is based on the poverty trap theory presented by Jeffrey Sachs and collaborators. The poverty trap theory states that factors such as high transport costs, poor agricultural productivity and the burden of disease (amongst other factors) locks poor countries in a cycle of poverty. It argues that small investments are unlikely to yield significant benefits in the long term; what is needed is a 'big push' to lift poor rural communities out of poverty. A set of interventions is recommended to facilitate this 'big push', such as stimulating improved agricultural productivity and market development, enabling people in rural areas to save and accumulate wealth, and investing in health and family planning. However, the 'big push' theory and the MV approach has been the subject of considerable debate and has received much press coverage and online interest; demonstrating the clear need for a robust, methodologically rigorous, and independent impact evaluation. Therefore, this impact evaluation of MV in Northern Ghana will need to generate robust evidence on how effective the MV approach is by assessing its impact on MDGs and examining impact disaggregated by gender, its multiplier effects, long term sustainability and the cost effectiveness of the intervention.
Activities: Overall management of the impact evaluation that uses a Difference-in-Difference approach, combined with qualitative methodologies including "Reality Checks"; Managing relationships with DFID-Ghana and the Earth Institute, including helping to setup governance arrangements for the evaluation; Ensuring the independence, coordination and delivery of all elements of the work including: quantitative and qualitative methods, spot-checking and quality assurance of data collection, cost-effectiveness assessments, and communications.
(DFID, Ghana) - Technical Advisor
Project description: STAR Ghana will address the need to increase civil society and Parliamentary influence in Ghana to foster better governance of public goods and services. In doing so, it will aim to develop efficient and transparent mechanisms which can link civil society with and to the actions of government, traditional authorities, and private enterprise. It aims to achieve increased and more effective voice, accountability and responsiveness. The overall goal of the programme is "to increase the accountability and responsiveness of government, traditional authorities and private enterprises to Ghanaian citizens. Its purpose is "to increase the influence of civil society organisations (CSOs) and Parliament in the governance of public goods and service delivery.
Activities: On-going M&E support to the programme, including advisory inputs on revisions to the logical framework, developing the Results framework, rolling-out the M&E system and reporting. Plus development and rollout of the Value for Money strategy.
(GIZ, UK) - Peer Reviewer
Project description: The EITI (www.eiti.org) was founded in 2003 as a multi-stakeholder coalition of governments, companies and civil society organizations with the aim to set global transparency standards in the extractive sector. Whilst the EITI has achieved significant momentum and considerable progress in implementation, recent reviews and evaluations have questioned its impact on governance, corruption, poverty reduction, and other objectives set out in the EITI's Articles of Association. The EITI Board has accepted the need to improve approaches to measuring impact - both to maintain the credibility of the initiative and to learn lessons for future implementation.The overall aim of this assignment is to elaborate and pilot a flexible scheme on how to measure attributable change in terms of both positive and negative, intended and unintended impacts to national EITI processes - an Impact Evaluation Scheme (IES). The IES is intended to lead to evidence on change through EITI at the national level.
Activities: To provide technical support to the design of the impact evaluation, including contributions to the theoretical and methodological debate surrounding impact evaluation of this kind. In particular, the EITI scheme presents a number of challenges given that it operates at a national-level;
and so it is not possible to compare actual results with a 'counterfactual' (i.e. we do not know with any certainty what would have happened in a country if the EITI had not been implemented). The evaluation takes a theory-based approach, and adapts a 'contribution analysis' methodology to assess how much any given intervention 'caused' a particular 'effect'.
(DFID-Tanzania, UK ) - VFM Technical Support
Project description: The Climate Change Monitoring Results and Evaluation in Tanzania assignment aims to improve the monitoring of results and impact in relation to climate change both attributed directly to DFID programmes in Tanzania and in line with the Government of Tanzania climate change strategy.
Activities: Technical support for the design for the improved assessment and tracking of value for money (VFM) across climate change programmes.
(Sub Saharan Africa Transport Policy Program (SSATP) and the World Bank, UK) - Peer Reviewer and project manager
Project description: The study sets out to examine transport sector governance issues in four pilot countries (Mali, Zambia, Tanzania and Kenya), through a process of consultation with key transport sector stakeholders, in order to determine whether there is a consensus on: what transport sector governance means in practice; why it matters; how it can be measured; and in what priority ways improvements in governance might make a real difference to the sector and to its contribution to national development. The technical approach to the study draws upon the considerable literature available on governance in general and the transport sector in particular.
Activities: Managing the process, including technical advice on the study methodology, indicator development and review processes, data collection, and the final study report.
(ALINe, BMGF, UK, USA) - Technical Advisor
Project description: ALINes vision is to support changes in aid to make it more responsive to poor farmers, more inclusive and equitable. ALINe funded by the Bill & Melinda Gates Foundation (BMGF), and is hosted by the Institute of Development Studies (IDS), UK.
Activities: To provide technical support and strategic advice on monitoring, evaluation and learning (MEL), including: (i) The Rapid Response Facility/ Helpdesk (RRF); (ii) Strategic development of ALINe; (iii) Reviewing technical outputs by ALINe staff. Specific MEL inputs on:
(i) GSMA: Support to the development of the MEL framework to assess the use of mobile phone information services for smallholder farmers (the 'mfarmer initiative').
(ii) Agricultural Transformation Agency (ATA), Ethiopia: Support to scoping and development the M&E/ performance framework. The ATA aims to become a catalyst for innovation and change in the Ministry of Agriculture.
(iii) Participatory learning in Oxfam's Farmer-Led Agricultural Innovation for Resilience (FLAIR) programme in Cambodia and Vietnam: Technical support to initial scoping.
(iv) Bill and Melinda Gates Foundation: Support to the M&E team in developing a monitoring and learning framework for the foundations portfolio of agricultural grants.
(DFID, Nigeria) - Technical Advisor
Project description: The purpose of the SAVI Programme is to increase the ability of citizens to claim rights and hold State Governments accountable. SAVI will provide support to civil society organisations and media programmes intended to raise accountability over rights and service delivery, and provide support to State Houses of Assembly. Delivery will take place over six years with a budget of about 20 million. SAVI will operate in five States at first (Lagos, Enugu, Kaduna, Kano and Jigawa), expanding to operate in up to seven States. SAVI will work with a wide range of organisations including community-based organisations, non-governmental organisations, private sector organisations, think tanks, faith-based organisations, media houses and State Assemblies strengthening the ability of citizens to claim their rights and hold governments accountable. Assistance provided by SAVI will focus on: (i) advocacy projects; (ii) monitoring, research and policy analysis; and (iii) strengthening the functioning of State Houses of Assembly.
Activities: Literature review of demand-side governance, plus development of the methodology to establish a voice and accountability index. Piloting the baseline in Enugu and Kano states. Technical support to full rollout of Governance Baseline.
(HTSPE/ DFID, Nigeria) - Project Manager
Project description: SPARC is a five-year governance programme that supports State Governments to improve public financial management (PFM), conduct public sector reform (PSR) and improve their capacity to formulate, monitor and evaluate policies and strategies. As part of these reforms, the programme also supports the Federal Government to assist the states in improving their performance. SPARC has engaged in significant diagnostic work, including agreeing state-level reform priorities through the SEAT process (based on a PEFA-type approach).
Activities: On-going technical support for M&E and MIS development, including:
(i) A review of the baseline data (state-level Change Matrices, and logical frameworks), to ensure that there is adequate coverage and depth for future monitoring and annual reviews. Based on the review, the report recommends areas for supplementary support to enhance the robustness of the data set.
(ii) Development of a programme-wide Evaluation Strategy, to support internal evaluation practice as part of the performance management and review systems.
(iii) Team leading several Evaluation Studies, including on the MDG Conditional Grant Scheme, Medium Term Sector Strategies (MTSSs), and Fiscal Projection Models.
(iv) Conducting a Synthesis Study to rate the programme's performance (in terms of results and value for money), and, assess the robustness of the supporting evidence base.
(DFID, UK) - Peer Reviewer
Project description: This evidence review is an input into the Business Case for the use of prize-based approaches to stimulate innovation of low carbon and adaptation technologies. The paper considers the broad benefits and drawbacks of innovation prizes and defines the prize landscape. This is followed by findings about a number of case studies selected across the prize landscape, identifying and drawing together the existing evidence base. In particular, the paper focuses its analysis on the potential effectiveness and value for money of prizes, and their use as a tool to encourage innovation in environmental technologies for development.
Activities: Technical support, particularly focusing on the measurement of results and value for money using cost-benefit analysis.
(Institute of Development Studies (IDS), University of Sussex, UK) - Project manager
Project description: This research sets out to document the information ecosystem of decision makers, identifying where they get information and what channels they use and trust. The aim is that this will add data to the hypothesis that information ecosystems are changing, and enable intermediaries to determine how best to position themselves within that ecosystem.
Activities: Overall coordination of the data collection through interviews conducted by a researcher in Ghana.
(Channel Research, Belgium) - Co-facilitator (4-day course)
Project description: Course for donors, NGO, and military organisations on the use of methods in conflict-affected countries. The course builds on the 'OECD DAC Draft Guidance for Evaluation of Conflict Prevention and Peace-Building', and evaluations undertaken in South Sudan and DRC in testing these guidelines. The course covered topics including: theories of change, evaluation criteria, conflict analysis, transition mapping, impact assessment, and the management of evaluations.
Activities: The design and co-facilitation of the advanced training course on conducting evaluations on conflict prevention and peacebuilding interventions (attended by NGO staff, donors, military staff, consultants, and other practitioners).
(Bond - the UK membership body for NGOs working in international development, UK) - Peer Reviewer and project manager
Project description: Bond is the UK membership body for non-governmental organisations (NGOs) working in international development. The paper was written in preparation for Busan.
Activities: Managing the process, peer reviewing at key stages, and finalising the paper. The study consulted a range of NGO staff to review current practice in terms of addressing value for money as part of the aid effectiveness agenda.
(DFID, UK ) - Team Leader
Project description: This study has two objectives. Firstly to test the relevance and robustness of a draft list of suggested indicators and to assess which are the most suitable for different programming purposes. And secondly, to set out how Value for Money can best be measured within DFIDs governance and conflict programming, and whether the suggested indicators have a role in this or not.
Activities: Leading the team of consultants, and liaison with the client. Reviewing indicator lists for relevance and robustness. Editing and finalising the reports on VFM and Indicators, as well as presentations to DFID, a workshop for DFID Governance Advisors, and a presentation to the OECD-DAC GOVNET forum (Paris).
(Danida, UK) - Project Manager & QA
Project description: The purpose of the evaluation is to analyse the achievements (results, and where possible impact) and challenges from the use of programmatic approaches in the field of the environment in Danish partner countries (Egypt, Tanzania, Zambia) in Africa, during the period 1996-2009. The evaluation will focuses on two key areas. Firstly, the results, challenges and experiences linked to the implementation of programmatic approaches in the field of the environment (especially given the crosscutting nature of the sector). This includes lessons learned on the use of different modalities (basket funding, project support, use of national systems versus parallel implementation units, etc). And secondly, the evaluation focuses on capacity development, and in particular development of environment and natural resource management institutions at central, regional and local level as this has been a major component of Danish bilateral programmes in African partner countries.
Activities: Overall project management of the assignment, including quality assurance of key deliverables (inception report, country evaluation reports, and final report).
(Netherlands Ministry of Foreign Affairs, UK-based) - Project Director
Project description: In 2005 the Comprehensive Peace Agreement (CPA) was signed, officially ending the war between the Government of Sudan in the North and the Sudan People's Liberation Movement based in the South. Since then a study conducted by the Netherlands Ministry of Foreign Affairs has shown that evaluations on the impact of donor support to Southern Sudan have lacked clarity, comprehensiveness and information on actual results of field-level assistance. This evaluation seeks to redress this "knowledge gap", and ultimately determine the impact of conflict prevention and peace-building interventions and to test the validity of theories on how these interventions will bring about change.
Activities: Oversight of the evaluation, including liaising with the client, quality assurance of key deliverables and ensuring the assignment stays on track and within budget.
(DFID, Nigeria) - Technical Advisor
Project description: The SPARC programme supports State Governments to formulate, monitor and evaluate responsive and appropriate policies and strategies and to improve public financial management and civil service capability. The programme also supports Federal Government to improve incentives for better performance at state level.
Activities: To undertake a situation analysis of monitoring and evaluation in Kaduna state government, and set up subsequent reviews of Enugu and Kano states.
(National Audit Office, UK) - Project Manager & author
Project description: ITAD in association with Kadale Consultants (Malawi) undertook the qualitative research study that serves as a key input into the main NAO Value for Money report. The findings of this study are based on primary data collection undertaken in three districts in Malawi. The purpose of the study is to reality check the performance of DFID interventions in agriculture (input subsidies), social protection, and health (through the health Sector Wide Programme, or SWAP). The study also aims to provide insights into the lives of ordinary people and officials, and in doing so, highlight some of the realities faced by people on the ground. The views of beneficiaries, district officials and local service providers (NGOs, health workers, Traditional Authorities, etc) were captured through a range of semi-structured interviews and focus group discussions. Under directions from the NAO, all meetings were audio recorded alongside full transcripts or detailed notes. In total, 771 pages of transcript were analysed, with the support of software designed for qualitative data analysis (MAXQDA).
Activities: The design of the research process, overall management and quality assurance of the assignment. Liaison with the client, plus analysis of the qualitative data and writing of the final report.
(Sida, Vietnam) - Team Leader
Project description: The Chia Se programme is a five year programme that supports decentralised development and grassroots democracy in Vietnam through local development funds, capacity building and participatory planning. Under the programme, villagers are empowered to select, plan and supervise investments and training in agriculture, income-generation, local infrastructure, sanitation, health and education.
Activities: Leading a team of 6 evaluators to assess impact and performance of the programme through reviewing the evidence and interviewing national, provincial, district and commune level stakeholders. Visits were undertaken to all three provinces, plus beneficiary interviews conducted at the village level. Responsible for managing all team inputs, and writing of the final report. Presentation of evaluation findings and recommendations at the end of programme workshop.
(National Audit Office (UK), Ghana and Kenya) - Project Manager & author
Project description: ITAD in association with DeLink Services and Matrix Development Consultants undertook qualitative research study of primary education in Ghana and Kenya. This study provides a reality check of primary education from the perspective of district officials, head teachers, teachers and parents and uses these insights from local people to assess DFIDs support to the education sector (through sector-wide approaches and projects). The study also serves as an input into the main NAO Value for Money report which looks at DFIDs global strategy and investment in primary education from 2004 to 2009.
Activities: Overall management of the study, including the methodological design, supervision of sub-contracted partners, and analysis of qualitative data using MAXQDA (software designed for qualitative analysis). Visit to field teams to discuss and revise approach following the pilot. Writing and quality assurance of the final report.
(Office of the United Nations Commissioner for Human Rights, Liberia) - Country Evaluator
Project description: The purpose of the evaluation is to determine how well OHCHR is integrating gender into human rights mechanisms and promoting gender equality results at the national and global levels. The evaluation assessed the extent to which OHCHR policies, strategies, programmes and institutional arrangements have integrated gender at both the country and headquarter levels.
Activities: Jointly assessed the integration of gender by OHCHR as part of the United Nations Mission in Liberia (UNMIL). Document review, stakeholder interviews and writing the country evaluation report, plus contributions to core team meetings.
(AIDCO, European Commission, Brussels and UK) - Seminar Coordinator
Project description: The development of a bespoke seminar on topical issues in agriculture and rural development for Brussels and Delegation based staff. Topics included: the role of agriculture in development, private and public sectors, land grabs, agricultural growth and social protection, agriculture and climate change, plus innovation, research and extension services.
Activities: Preparation of the concept note for the seminar including details on key topics, plus overall coordination between support staff, guest speakers and the facilitator.
(Irish Aid and DFID, Tanzania) - Technical Advisor
Project description: Irish Aid and DFID have mandatory requirements to conduct evaluations of their respective country programmes. The purpose of this scoping visit was to investigate whether a country programme evaluation is advisable and feasible in Tanzania, and how such an evaluation might be undertaken so as to maximise compliance with Paris Declaration commitments (alignment with national priorities/ systems, harmonisation with other donors, etc).
Activities: As part of a team of senior Irish Aid and DFID headquarter staff, to consult key stakeholders and provide advice on the feasibility and approach for undertaking such an evaluation.
(Embassy of Sweden & Sida, Vietnam) - Team Leader
Project description: Advisory support to Sida and the Embassy of Sweden for the preparation and planning for the extension of the Chia Se Poverty Alleviation Programme. This is a programme aims at poverty alleviation and broad political and societal change, including the empowerment of ethnic minority groups through the use of Village Development Funds, allocated and managed at the village level.
Activities: Leading a 3-person team to assess and make recommendations on the future development for mainstreaming the Chia Se programme within the government system.
(Evaluation Department, DFID, Ethiopia) - Team Leader
Project description: The evaluation of DFIDs country programme in Ethiopia from 2003-2008, covering interventions in health (HIV/AIDS, TB and maternal mortality), governance, pro-poor policy change, humanitarian work, natural resources and forestry. The aid modalities reviewed included joint partnerships, multi-donor trust funds, bilateral programmes and a multi-donor support facility to improve harmonisation (Paris Declaration principles).
Activities: Leading a team of four experts for a 3-week visit, managing all inputs and responsibility for client feedback and writing final report.
(OHCHR, Geneva) - Project Manager
Project description: The Office of the High Commissioner for Human Rights (OHCHR) is part of the United Nations Secretariat based in Geneva. The Office aims to lead, educate and take action in order to empower individuals and assist nation states in upholding these rights. Within the context of UN reform, this assignment aims to improve the Strategic Management Plan as an effective tool to measure OHCHRs performance; to help improve accountability and result-based performance, and ultimately achieve OHCHRs vision of the full respect for human rights.
Activities: Project management of this assignment, to support the finalisation of the M&E framework for OHCHR. The framework will be used as a tool to measure OHCHRs performance, and is a necessary step in putting in place a system of collecting information for measuring results.
(DFID (Central Research Dept.), UK) - M&E Expert / core team
Project description: The Research Into Use programme (RIUP) is a 5 year, 37million DFID Central Research Dept-funded programme; working to get the best research results of past DFID supported research into widespread use in Africa and South Asia. Lessons from the programme are to be collected and shared to show how agricultural technologies and policies can help achieve growth, reduce poverty, and food security. The aim of the mid-term review is to assess the performance to date of the RIUP and to indicate adjustments that may be needed to ensure its success. The review will be used to determine the future direction and management of the programme.
Activities: Part of the 3-person core team focusing on the monitoring, learning and evaluation component of RIUP, and supervising visits to Nepal and Bangladesh. Interviews, document review and analysis, and writing sections of the inception and final reports, as well as discussing findings with the client and programme team.
(Sida, UK) - Study Tour Leader
Project description: The overall purpose of the visit is to learn from British experiences regarding decentralized development planning and relations between central and local authorities, including the cooperation between the state and civil society organisations in policy making and implementation. The delegation included high ranking representatives from both national and provincial levels.
Activities: Liaison with organisations (Defra, DFID, CPRE, Environment Agency, Natural England, EC Leader+, Commission for Rural Communities) and facilitation of discussions.
(Sida, Vietnam) - Team Leader
Project description: The Chia Se programme uses a rights-based approach to development, with local development funds used to empower villagers in participatory planning and supervision of their own activities.
Activities: To lead a four-person team to review progress against the annual workplan and budget. Visits to Quang Tri and Yen Bai provinces to discuss progress with provincial and district project management units, and government officials. Analysis and writing of final report.
(MASAF, Government of Malawi, Malawi) - Team Leader
Project description: MASAF3 is a national government programme of Community Driven Development (CDD), which provides funds for local communities and district government to undertake investments in roads, health centres, schools, income-earning activities, etc. In doing so, the programme aims to facilitate the integration of community empowerment into District Planning and service delivery, as part of Malawi's national policy of decentralisation. The aim of this assignment is to measure development impacts of MASAF3 against the MDGs, using both quantitative and qualitative tools.
Activities: Overall responsibility for writing the Inception, Design and Final reports, as well as the presentation of findings to the Peer Review Group. Team leader of a 7-person team to design the methodology, collect, analyse and report the findings. This includes: developing a retrospective baseline using national statistical data (IHS, DHS, MICS), undertaking a household survey (n=1,500), surveys of project committees (n=120), plus focus group discussions and key informant interviews. The areas covered by impact evaluation are: institutional development and governance, the access and use of services/facilities, beneficiary satisfaction, the M&E system, the cost-effectiveness of infrastructure, plus sustainability issues such as environmental mitigation.
(UNICEF, Moldova, UK) - Evaluator / Core Team
Project description: The purpose of the assignment is to evaluate UNICEFs gender policy and determine how well UNICEF is promoting and contributing to gender results at national, regional and global levels. The evaluation is seen as part of the process of institutional review and strategy development in support of gender equality within UNICEF.
Activities: Evaluator for the Moldova country study, methodological design and the design/ analysis of a web-based survey of senior and programme staff.
(DFID, Bangkok, Thailand) - Co-facilitator
Project description: This assignment has two main parts. Firstly to review monitoring and evaluation by assessing a sample of DFID programmes from the region (logical frameworks, Project Memorandum, Annual Reviews and PCRs). And secondly, to strengthen M&E capacity through a 2-day workshop with staff from the country offices of Indonesia, Vietnam, Cambodia and Burma. The workshop focused on improving the logframe design followed by modules covering key monitoring challenges around programmatic aid, measuring policy change and influence, assessing partnership working and country-level performance.
Activities: Review a sample of programme documentation, design modules and deliver the course.
(Evaluation Department, DFID, Indonesia) - Team Leader
Project description: The evaluation of DFIDs country programme in Indonesia from 2000-2006, covering interventions in health (HIV/AIDS, TB and maternal mortality), governance, pro-poor policy change, humanitarian work (Tsunami; Java earthquake), natural resources and forestry. The aid modalities reviewed included joint partnerships, multi-donor trust funds, bilateral programmes and a multi-donor support facility to improve harmonisation (Paris Declaration principles).
Activities: Inception visit with the client (DFIDs Evaluation Department), plus leading a team of four experts for a 3-week visit, managing all inputs and responsibility for client feedback and writing final report.
(Japan Social Development Fund, Japan) - Presenter
Project description: The event was an additional assignment to the evaluation undertaken by ITAD, with an explicit purpose to publicise and share the key findings with the ultimate donor: the Japanese Ministry of Finance and the Ministry of Foreign Affairs, as well as JICA and Japanese NGOs.
Activities: Stakeholder presentation of country case studies, key findings and recommendations from the Strategic Evaluation of the Japan Social Development Fund, a trust fund administered by the World Bank.
(Embassy of Sweden & Sida, Vietnam) - Evaluator / core team
Project description: Advisory support to Sida and the Embassy of Sweden, including the regular monitoring of Swedish cooperation in Vietnam. In 2006, the mid-term review of the Chia Se programme aimed at poverty alleviation and broad political and societal change, including the empowerment of ethnic minority groups through the use of Village Development Funds, allocated and managed at the village level.
Activities: Review of M&E performance including the assessment of achievements and the effectiveness of the programme. Visits to the Quang Tri provincial project, with meetings at district, commune and village levels.
(Evaluation Department, DFID, UK) - Quality Assurer
Project description: A series of five evaluations of DFID country programmes, covering all sectors (health, governance, education, natural resources, conflict and social development). These evaluations assess programme quality (strategy, relationships, portfolio of activities) and programme effectiveness (results, influence, donor harmonisation, sustainability), as well as contributions to development outcomes and the MDGs. The five country studies are: West Bengal (India), Kenya, Nepal, Indonesia and the Caribbean.
Activities: Quality assurance of reports to ensure that they adequately address comments from DFID staff, the Terms of Reference and, EVD's internal style guide.
(JSDF, India) - Lead Country Evaluator
Project description: JSDF is a mechanism to provide direct assistance to the poorest and most vulnerable groups in eligible member countries of the World Bank Group. This includes grants to build capacity, participation and empowerment of civil society, local communities and NGOs. The evaluation assessed the achievements and development impact of the Fund, making recommendations on ways in which the Fund might better achieve its objectives in the future.
Activities: Methodological design, review and quality assurance of Interim Report, plus Lead Evaluator of the JSDF-funded project in India: Empowering the Poor: A pilot IT program for rural areas of Pune District.
(WFP & BMZ (Government of Germany), Rome, Frankfurt, Berlin, Thailand & Bhutan) - Project Manager
Project description: The GQIG is a competitive grant funded by the German government to provide assistance to WFP Country Offices and Regional Bureaus to improve the quality of their operations. This review assessed the continued relevance and appropriateness of the fund, the effectiveness of its use, and managerial issues of efficiency including the tri-party agreement between BMZ, GTZ and WFP.
Activities: Negotiation and planning of the contract, liaison with the client and management of consultant inputs. Plus, responsibility for the inception phase (evaluation framework, methodological approach), main study (project reviews, telephone interviews, country visits) and final report (writing, quality assurance, and final presentation in Berlin).
(Government of Vietnam, PHRD Grant, Vietnam) - M&E Specialist (baseline design)
Project description: The objective of the Poor Communes Livelihoods and Infrastructure Program (P-CLIP) is to reduce poverty and foster secure and sustainable livelihoods for those living in the country's poorest and most disadvantaged communes. In particular, the project aims to enhance the performance of Governments Program 135-II with respect to local-level empowerment, transparency and accountability, poverty targeting, and M&E.
Activities: The assessment of baseline requirements, the sampling design and development of survey instruments to undertake the baseline at commune and household levels.
(Evaluation Department, DFID, UK) - Co-author
Project description: Synthesis of five Country Programme Evaluations undertaken in 2005/06 (Rwanda, Malawi, Ghana, Bangladesh and Mozambique). The synthesis highlights issues about: DFIDs country strategies; organisational and human resource implications; the mainstreaming of gender and HIV/AIDS; the use of new aid modalities (Budget Support, SWAps); as well as the monitoring of aid effectiveness and measuring development progress against the MDGs.
Activities: Analysing the five CPE reports for Rwanda, Malawi, Ghana, Bangladesh and Mozambique. Writing the Synthesis Report.
(European Commission (Interreg IIB), Netherlands, Ireland & UK) - Co-researcher
Project description: The study assesses the role of government in support of the small islands of Europe, the consequences of EC Directives (in Agriculture, Culture and Environment), as well as practical solutions to energy provision on small islands.
Activities: Island visits to Shetland Islands (UK), Bere Island (Ireland) and Tiengementen (Netherlands). Stakeholder interviews with local, regional and national government and non-governmental bodies, plus workshop with community members.
(DFID Evaluation Department, Malawi) - DFID Evaluation Department, Malawi
Project description: An evaluation of DFIDs country programme for the period 2000 to 2005. Part of a five-person team covering all sectors to assess programme quality (strategy, relationships, portfolio of activities) and programme effectiveness (results, influence, donor coordination & harmonisation).
Activities: Assessment of DFIDs rural livelihood portfolio in Malawi (pro-poor growth and social protection). Interventions covered agriculture, forestry, humanitarian assistance and social safety nets (starter packs, public works and cash transfers). Plus, quality assurance & editing of final CPE report, based on inputs from all team members across all sectors.
(Evaluation Department, DFID, UK) - Programme Coordinator & Quality Assurance.
Project description: Technical, managerial and logistical support to the Study Director, Team Leader and evaluation teams, to ensure consistency and continuity between the CPEs of Rwanda, Malawi, Ghana, Bangladesh and Mozambique.
Activities: Liaison with DFIDs Evaluation Department and Country Offices and quality assurance of final CPE reports.
(MIGA, World Bank, Washington, USA) - Project Manager
Project description: MIGAs aim is to stimulate the flow of overseas investment to developing countries and economies in transition by providing political risk insurance, technical assistance, and other services. This assignment was to design an M&E system based on outcome (results) -focused storylines and the Balanced Scorecard approach. The integrated M&E system linked four levels; from activities and projects (guarantees, TA, legal mediation, etc), to MIGA Units (departments) and corporate governance.
Activities: Development of the M&E framework including the design of M&E processes, indicators, templates for forms/reports and an action plan for implementation.
(Presidents Office, Government of Tanzania, Tanzania) - Consultant
Project description: A review of progress of the PSRP - a programme of reform for the public sector. The programme aims to realize service delivery improvements, strengthen management systems, including monitoring and evaluation, and, improve staff incentives given severe budgetary constraints.
Activities: Assessment of reforms focusing on increased private sector participation, the establishment of Executive Agencies and, the installation of Performance Management Systems - a system designed to make civil servants accountable for their actions, as well as make public services more responsive to citizens needs.
(European Training Foundation (ETF), Turin, Ukraine & UK) - Senior Country Evaluator
Project description: ETF contributes to human resource development, labour market reform and the development of vocational education & training (VET) systems in four regions. ETF also provides a range of expert policy advice services to support the European Commission's external policies.
Activities: Design of the evaluation approach & methodology (including semi-structured interview checklists & questionnaires), stakeholder interviews, the analysis of surveys and case studies, and contributions to inception, interim & final reports.
(HTSPE/DFID, UK-based) - Team Leader
Project description: The aim of the study is to assess the impact and uptake of research on the peri-urban interface - research undertaken as part of DFIDs Natural Resources Systems Programme (NRSP). The study is based on the sustainable livelihoods approach to assess changes in livelihood assets and outcomes as a result of research, plus the pathways of uptake and projected impact (against the MDGs) by 2015. The assessment also included an economic analysis of costs and benefits (NPV, IRR). Evidence was collected through a combination of household surveys, key informant interviews, focus group discussions and stakeholder workshops (in Kumasi, Ghana & Hubli-Dharward, India).
Activities: Overall management and quality control of the assignment at all stages (methodology through to completed report).
(Presidents Office, Government of Tanzania, Tanzania) - Team Leader
Project description: As part of the process of public sector reform, the government of Tanzania has established a number of Executive Agencies (EAs). These EAs were formerly departments or divisions within ministries, and now operate in a semi-autonomous manner with the aim of improving efficiency, customer responsiveness and service delivery. This study assessed the impact of this policy on 20 Executive Agencies, based on an analysis of routine administrative data.
Activities: Overall management and oversight from inception through to data collection and completion of the final report. Management of local consultants.
(International Fund for Agricultural Development (IFAD), Rome & Armenia) - Core team member & Senior country evaluator
Project description: A complex institutional evaluation of IFAD's performance over the past ten years, including ten randomly-sampled countries.
Activities: Desk review of IFAD project design, management and supervision in Armenia, Macedonia, Egypt and Jordan (Output: four Country Synopsis papers). Review and stakeholder interviews on IFADs partnerships including with NGOs, IFIs, Global Environment Facility (GEF) and the International Land Coalition (Output: paper on the relevance, effectiveness and impact of IFADs partnerships). Responsible for the selection, contracting and managing of a national consultancy organisation to evaluate the performance and impact of two IFAD projects consisting of 420 beneficiary surveys and over 70 semi-structured stakeholder interviews (Output: Country Working Paper on Armenia). Inputs into storyline workshop and final evaluation report (Output: chapters on Project performance and the Impact on rural poverty).
(Council of Europe, UK & Strasbourg) - Evaluation Specialist
Project description: The programme aims to promote human rights and strengthen democratic stability in Georgia, Armenia and Azerbaijan.
Activities: Design of the methodological approach and data collection tools; analysis of project performance and budget data; backstopping evaluation; analysis of country study results; final report writing and editing.
(Zambia Social Investment Fund, Zambia, Zambia) - Consultant (training design & facilitation)
Project description: The ZamSIF participatory M&E system is designed for nationwide coverage to support PM&E at both district & community levels.
Activities: Training design and training materials (Trainers Guide) for the Regional PM&E Training workshop. Plus, facilitation of training sessions at a pilot workshop held during March/April in Kabwe, Zambia
(DFID (Evaluation Department), UK & Geneva (Switzerland)) - Evaluator / core team
Project description: The evaluation focuses on DFIDs Institutional Strategy Paper (ISP), but also other aspects of the relevance, effectiveness and efficiency of the partnership between DFID and the World Health Organisation (WHO).
Activities: Key inputs into the evaluation including: the evaluation framework; inception report; two technical papers (on monitoring the partnership, and the management of the ISP); semi-structured interviews with staff in the UK and Geneva; and, final evaluation report.
(World Food Programme (WFP), UK) - World Food Programme (WFP), UK
Project description: The exercises are set in a fictional WFP operation (based on actual situations) in which a small country office has to rapidly scale-up its operations in response to an impending humanitarian disaster. The exercises underpinned by recent audit findings, which have highlighted particular weaknesses in the way Country Directors follow WFP procedures in finance, procurement, human resources, etc.
Activities: Project Manager, responsible for negotiation of contract, liaison with client and sub-contracting of independent consultant. Also technical inputs into the design of the training package including facilitator and participant guides, plus the country context and four exercises.
(HTS/ DFID, UK) - Research Assistant
Project description: The analysis looked at trends in approaches to poverty and rural space, plus aspects of project design including problem analysis, intervention strategies & performance indicators.
Activities: Reviewing Country Assistance Strategies (CAS) for 1995, 1997 & 2001, plus fifteen projects undertaken during this period using Project Appraisal Documents (PADs) & Project Status Reports (PSRs).
(Futures Group/ DFID, Kenya) - Technical Assistance (Planning)
Project description: The work formed part of the HIV/AIDS Prevention and Care programme (HAPAC 3). The assignment supports the development of the NASCOP Business Plan 2003/04, in conjunction with programme managers in Antiretroviral Therapy, PMCT, Voluntary Counselling & Testing, Blood Safety, etc.
Activities: Technical assistance included aligning the business plan with the strategic objectives of the Kenya National HIV/AIDS Strategy 2000-2005, as well as the workplan of the National AIDS Control Council (NACC). Also, responsible for facilitating a workshop for NASCOP programme managers, looking at key priorities, overlaps & linkages, monitoring & reporting issues over an annual cycle.
(World Bank, Washington, USA) - Consultant
Project description: Review of results-based management and outcome-focused support to project design & supervision for the ECA region (Europe & Central Asia).
Activities: The design of training packages (slides, handouts, resource sheets, session plans, etc) for workshops and briefings on Outcome-focused Project Design, Quality at Entry and Quality in Supervision for use by ECA staff.
(DFID, UK) - Technical Support
Project description: The training package forms part of a study into the uptake of Water for Food research outputs by universities in Kenya, Pakistan and Zimbabwe.
Activities: Preparation of lecture slides, accompanying notes and exercise on Environmental Impact Assessments (EIA), based on ICID Environmental Checklist, ENCHECK software, and EIA of Irrigation and Drainage Projects (FAO Irrigation & Drainage paper 53).
(Evaluation Department, DFID, UK) - Consultant & Co-author
Project description: An assessment of DFIDs performance scoring system and the data used to calculate the VFM indicator, as contained in the Public Service Agreement (PSA) 2003-2006.
Activities: Tasks: key informant interviews with Country Offices; analysis of data from PRISM; review of internal management & monitoring systems, including Output-to-Purpose Reviews (OPRs) & Project Completion Reports (PCRs).
(UNHCR, UK) - Author
Activities: Author of paper entitled, Mozambican Refugees in Malawi: Livelihoods and their Impact on the Natural Resource Base. The paper is based on original research undertaken as part of my doctorate. It assesses the impact of Mozambican refugees on the natural resource base of Malawi, as well as livelihood strategies and local institutions. Published on UNHCRs website.
(International HIV/AIDS Alliance, UK) - Consultant
Project description: The Alliance is an international non-governmental organisation that works in partnership with local NGOs/CBOs across the world, providing support to communities in their response to the AIDS epidemic. An ITAD team designed the new monitoring and reporting system for Alliance partners worldwide.
Activities: Key inputs have included writing sections for the new reporting guidelines, as well as a review of data management systems and the potential of using the USAID Synergy database.
(European Commission, UK) - Data Analyst
Project description: An ITAD-led contract to provide training in project cycle management (PCM), sector-wide approaches and budgetary aid to the Commission and Delegations.
Activities: Designed MS Access database for recording the survey results and analysis of the PCM training needs within EC units and delegations worldwide.
(Bicton Overseas Agricultural Trust (BOAT), UK) - Trainer
Project description: BOAT is a charity that enables men & women from developing countries to study practical agricultural techniques and skills through short programmes. Participants came from organisations in Nigeria, Tanzania and Nepal.
Activities: Trainer, responsible for the design and delivery of an introductory course on the principles of monitoring and evaluation, for the Bicton Overseas Agricultural Trust (BOAT), based in Devon, UK.
(Infrastructure and Urban Development Department, DFID, UK) - Technical support
Project description: Competitive grant funding for research in engineering for the elimination of poverty (geoscience, urban development, energy, water, ICTs and transport).
Activities: Programme and backstopping support for the application rounds of the KaR (research) programme, including assessment of concept notes/ logframes, compilation of progress reports for Urban, ICT & Transport, plus strategic advice on the management of the programme including application processes, supporting documentation, application forms, mechanisms for review and prioritisation, plus the uptake of knowledge.
(Ministry of Local Government, World Bank, Uganda) - Monitoring and Evaluation Specialist & Trainer
Project description: Design, piloting and training for a monitoring and evaluation system for local government, across all sectors (health, education, agriculture, roads, prisons, police, social services, etc).
Activities: Member of a multi-disciplinary team developing an M&E manual; compliance inspection manual; and information communication system for local government in Uganda, under LGDP. Key inputs at all stages including the inception phase, situational analysis, piloting of data collection forms, writing of M&E & One-Stop Resource Centre manuals, design and delivery of training, plus completion of training report & final report.
(Rural Livelihoods Department, DFID, UK-based) - Co-author
Project description: Technical paper for the Core Group Meeting on the Knowledge for Livelihoods Research Strategy 2005-2015. The paper explores the barriers to the dissemination and uptake of research and knowledge, particularly for the poor.
Activities: Literature review, synthesis and writing the discussion paper on communication approaches and the problems of accessibility and utilisation by the poor (and intermediaries).
Barnett, C.P. and Brown, D.A. (2002), Beyond Dissemination: Understanding Barriers to the Access and Use of Knowledge by Poor People, Discussion note for the Knowledge for Livelihoods Strategy working group, Rural Livelihoods Department, DFID, UK.
(ETF, UK) - Consultant
Project description: A 5-year institutional evaluation of the relevance, effectiveness and efficiency of the European Training Foundation.
Activities: Inputs including: (i) a portfolio analysis of ETF activities and workplans; (ii) quantitative analysis of email surveys of ETF staff/ stakeholder groups; (iii) summary analysis of past reports & internal evaluations.
(UNAIDS, UK-based) - Technical Support
Project description: Survey of international non-governmental organisations (UK, USA, Canadian), as part of a major 5-year evaluation of UNAIDS.
Activities: Tasks included undertaking the email and telephone questionnaire of NGOs working on HIV/AIDS, plus the analysis of qualitative data for the final report.
(FAO/IPTRID, UK and Rome) - Consultant
Project description: Support to the IPTRID Donor's Meeting and the development of a communication strategy.
Activities: Assistance with the preparation document for the IPTRID Donors Meeting. Plus contributions to a workshop developing a Communication Strategy that pulls together IPTRIDs work on knowledge synthesis in the area of irrigation & drainage research.
(Infrastructure and Urban Development Department, DFID, UK) - Infrastructure and Urban Development Department, DFID, UK
Project description: Competitive grant funding for research in engineering for development (ICTs, energy, geoscience, transport, urban planning, water).
Activities: Coordinator for the application process, with responsibility for handling the information management systems and working closely with DFID and all sub-contracted parties (technical assessors, poverty assessors, external technical experts). Tasks also included key inputs into the revision of the Engineering KaR application pack (concept note, final proposal), plus the final report.
(Knowledge Policy Unit, DFID, UK-based) - Consultant
Project description: Evaluation of dissemination mechanisms and approaches within DFIDs rural livelihoods, engineering, education, health & social research (KaR) programmes.
Activities: Inputs at all stages, including the design, piloting and completion of key informant interviews with programme managers, assessments of a sample project documents, and inputs into the final report.
(FAO/IPTRID, UK-based) - Consultant
Project description: Manual on the management issues faced by national research institutions in irrigation & drainage including leadership & motivation, organisational change, programme management, logframes, communication, dissemination & uptake.
Activities: Editing and developing training materials from workshops in India, Egypt and UK, including background papers, case studies, exercises and slides.
(Sociology Department (SOCS), University of Sussex, UK) - Seminar Tutor and Internal Examiner
Project description: 1st year undergraduate course in 'Sub-Saharan African Societies (Sociology), including colonialism, ethnic groups, kinship, international relations & the impact of HIV/AIDS.
Activities: Facilitation of seminars, and Internal Examiner for essays and exercises.
(University of Sussex, Malawi) - Researcher
Project description: Research into the medium to long-term impacts of Mozambican refugees on the natural resources (agriculture, forests) and poverty of Malawi.
Activities: Planning and implementation of research in five separate villages (200 household surveys, 37 oral histories and 67 group discussions). Negotiating permission with village heads, local government authorities and NGOs for access to research documentation and to undertake research and live in each village. Organising logistics (flights, vehicles, accommodation, permits, etc) to undertake research.
(African and Asian Studies Department (AFRAS), University of Sussex, UK) - African and Asian Studies Department (AFRAS), University of Sussex, UK
Project description: "Environmental Management & Sustainable Development" course, for second year undergraduates. Topics included: common property resources, population theories and climate change.
Activities: For two years (1997 and 1999): preparation and facilitation of seminars for the course, plus Second Examiner, responsible for marking coursework and end of year examinations.
(University of Sussex, Malawi) - Researcher
Activities: Interviews with academics, directors and senior managers of NG0s and government departments, to gather preliminary information on refugee issues and impacts on natural resources. Development of initial contacts and networks, plus an assessment of the risks and feasibility of the research.