Evidence impact: informing better monitoring and measurement of interventions
Photo: Hugh Rutherford/CIP
How helpful can an evaluation be if it shows an intervention had no effects on desired outcomes? The first evaluation of a community-driven reconstruction (CDR) program called Tuungane, implemented in the Democratic Republic of Congo, is one such study. The evaluation did not show positive effects on all desired social and behavioural outcomes, but it did help the implementer, International Rescue Committee (IRC), revamp some of its systems. Here’s how.
IRC started the first phase of Tuungane, which means “let’s unite” in Kiswahili, in 2007. This phase of the CDR program took place in 1,200 conflict-affected communities in eastern DRC. Tuungane aimed to rebuild community assets while promoting, among other goals, joint problem solving, stronger local governance, trust and social cohesion. In some areas, IRC also introduced a mandate to involve women as equal partners in decision-making bodies called village development committees.
However, a 3ie-supported impact evaluation found that the program did not significantly improve social cohesion, governance or welfare even though it succeeded in completing a large number of projects.
The findings also showed that the gender parity requirement was not necessary for women’s representation in this context. Village development committees that did not have such a requirement had a similar level of women’s representation to those that did. Also, neither the attitudes around roles and responsibilities of women nor the projects selected varied significantly between villages with and without the requirement.
In a good example of using null findings, IRC and the donor checked with the field team to interpret these ‘disappointing’ findings. These meetings highlighted the need for better monitoring and evaluation to understand the challenges faced during implementation and to better capture impact. They also revealed the need to review the theory of change of CDR to strengthen the pathways to desired social outcomes.
Related content
