RAPID Projects - EngKaR Evaluation

Evaluation of the Engineering Knowledge and Research Programme (EngKaR)

The Department for International Development's (DFID's) Engineering Knowledge and Research (EngKaR) programme aims to provide technical, managerial and policy solutions in the infrastructure and urban development sectors that help enable poor people to escape from poverty on a sustainable basis. It intends to solve specific problems, build capacity and communicate the solutions to others, so that the knowledge won becomes a public good and is re-used by others to generate wider development benefits. It has run in various forms since the 1980s. Over the past 15 years, it has invested over £100m across up to seven sectors in some 600 projects, mostly undertaken in collaboration between UK research institutions and partners in developing countries.

DFID commissioned this evaluation of EngKaR to support decision-making about the future of research on pro-poor infrastructure within the Research Funding Framework it set out in 2003. The evaluation tackles the way the programme has been designed and run, its results and - as relevant - opportunities for improvement.

We found that the concept of a public good knowledge and research programme is sound and that it has high potential directly and indirectly to help alleviate poverty over time through the development of capacities and improved infrastructures. The EngKaR programme design has used a modern programme management and administration process and is well regarded by participants. It has supported a collection of good quality, relevant and generally well-conducted projects in areas of great importance to international development and poverty alleviation. The projects have generally adopted pragmatic, poverty-focused, participatory approaches in researching practical aspects of infrastructure provision, maintenance and engineering appropriate for developing countries. They have produced a significant body of information, insights and guidance.

The programme has made a valuable contribution to the available body of knowledge and to DFID's (and the UK research community's) reputation in developing countries. The major benefits of the projects in country were improved infrastructural services (such as better water supply, improved transport infrastructure and improved energy usage options), environmental management and incomes. Projects induced improved planning and management capability, improved knowledge and understanding of technical issues and understanding of poverty alleviation measures. They tended to increase the capabilities of the Southern research partners.

However, the EngKaR portfolio is thematically and geographically fragmented, making it is hard for the projects to be mutually reinforcing and for them to be communicated effectively, so that others can benefit from the knowledge they generate. DFID has vigorously addressed past dissemination deficiencies through recent communications efforts but less attention has been devoted to connecting projects to larger development strategies or managing the process of realising and assessing impacts so there is potential to increase the take-up and application of the work in developing countries.

We conclude that EngKaR is an inherently sound and valuable programme whose 'public good' character offers high 'leverage' in poverty reduction. Its performance would be improved by:

Clustering projects thematically and geographically to increase the programme's 'clout' in country, and to make capacity building more cumulative
Anchoring project design in the needs of specific beneficiaries at an earlier stage in the project life cycle
More effectively coupling the projects to strong stakeholder interests in beneficiary countries or among donors who can ensure implementation and exploitation of results. In particular, they should be better linked to DFID's own plans and activities at country level

EngKaR already has traditional areas of strength, especially in water, energy and transport, which provide solid bases for a more focused strategy that is also consistent with DFID's climate change priority. Such a strategy needs to be led 'top down' via the aggregation of needs and DFID strategies in a small number of countries, and not (as at present) determined 'bottom-up' by the (UK) research community. The UK institutional strengths and the knowledge base built up by EngKaR, together with DFID's role as a significant donor, give the programme a solid basis for making a yet stronger contribution to poverty reduction in the future than it has in the past.

We therefore recommend that the programme be continued in a modified form. It should focus on a smaller number of themes (such as its historic strengths of water, energy and transport) in fewer countries. More detailed priorities cannot be set at a distance but must be decided in negotiation with selected DFID country offices and other stakeholders with a good understanding of needs and with the power to do something with the results of the programme. Longer-term, programmatic funding is needed to build the Southern research capacity and policy networks needed, using an instrument such as the Development Resource Centres (which is already used by DFID elsewhere). A small part of the programme budget should be reserved for responsive funding of good ideas and for studies that meet DFID's policy needs. Clearer communications strategies should be adopted at both project and programme level. More attention should be paid to monitoring and evaluating needs, project progress and impacts.

In order to protect capacity and to maintain momentum, DFID should make a clear statement on the future of the programme as a matter of urgency.