Spearheaded by Professor Jeffrey Sachs, advisor to the United Nations, the Millennium Villages project stands out as a bold attempt to address extreme poverty in Africa. The project set out to achieve internationally agreed goals to address hunger and nutrition, reduce child mortality, improve maternal health, combat diseases, improve access to education, safe water and gender equality. The model was applied in 10 African countries covering all major agro-ecological zones.
The project set out to do everything at once (health, education, agriculture, etc.) to have a far greater impact than a more piecemeal approach of single, small-scale interventions. It also sought to make use of the latest scientific evidence of what works (bed nets, vaccinations, artificial fertilisers, etc.).
Controversy has however surrounded the project given its claims of success, and lack of rigorous evaluation until more recently. In 2012, DFID funded a new Millennium Village in northern Ghana but this time on the condition of a rigorous assessment of the impact.
Itad, working in close collaboration with the Institute of Development Studies and PDA-Ghana, led the impact evaluation. The evaluation uses a mix of methods: a robust quasi-experimental design (with control groups), alongside qualitative and immersion research to capture local insights and perspectives. A cost-effectiveness analysis was also undertaken.
The evaluation finds a statistically valid impact against one-quarter of the internationally agreed indicators. For example, primary school attendance improved and some intermediate health indicators got better (births attended by skilled professionals, children sleeping under bed nets).
Overall, the ambitious project goals were unrealistic. There was a tendency to focus on delivering ‘things’ (building schools, clinics, providing supplies, etc) rather than changes in behaviour that could be sustained by government, communities and individuals. The evaluation also raises serious questions about the ability of the project to create long-lasting impact and its overall cost-effectiveness.
Check out a range of resources from the MVP evaluation, including an MVP microsite.
- Thumbs up or thumbs down? Did the Millennium Villages Project work?
- Unforeseen benefits of the Millennium Villages Project in Northern Ghana
- Reflections on evaluating integrated rural development
- What else does the MVP evaluation tell us?
- Itad evaluation offers verdict on Millennium Village Project in Northern Ghana
- Itad presents Millennium Villages Impact Evaluation findings with senior policy-makers from Northern Ghana
Impact Evaluation of the SADA Millennium Villages Project in Northern Ghana
- 1: MVP and the MDGs: what did it achieve?
- 2: Did it overcome the poverty trap?
- 3: Was it cost-effective?
- 4: Did it displace other development interventions?
- 5: What was the impact on health?
- 6: What was the impact on education?
- 7: What was the impact on agriculture?
- 8: What was the evaluation design?
- 9: How is it being sustained?
- A: Preliminary Statistical Analysis
- B: Participatory Rural Appraisal
- C: Endline Reality Check Approach
- D: Institutional Assessment
- E: Financing of the Millennium Villages Project (by sector)
- F: Causal Chain Analysis
Further resources can also be found on the IDS website.