Impact

The WASSIP evaluation produced the formal close-out record for the programme in the World Bank's system and the evidence base the Government of Kenya and the Bank needed to assess performance and design the next phase of water sector investment. The ICR directly informs how successor programmes are targeted, which infrastructure gaps are prioritised, and which institutional arrangements need to be strengthened for improved delivery.

For the three implementing agencies, the evaluation provided more than a performance scorecard. It produced a mapped inventory of all WASSIP infrastructure, a financial performance baseline for each agency's WSP portfolio, and a structured set of recommendations on the specific operational and institutional improvements that would raise performance in future programme cycles.

Key Takeaways

Multi-agency evaluations require institutional fluency, not only technical competence

Evaluating WASSIP meant navigating three different agency contexts simultaneously, each with its own management structure, data systems, and project implementation history. Technical evaluation competence is necessary. It is not sufficient. The evaluator needs to understand how each agency operates, what data it holds, and how to extract reliable information from operational systems that were not designed with external evaluation in mind. ACAL's team, led by a sociologist with deep institutional knowledge of Kenya's water sector, was built for exactly this requirement.

Financial evaluation of water infrastructure demands a multidisciplinary team

The cost-benefit analysis of water infrastructure cannot be reduced to a financial review. It requires field data on what was actually built and at what cost relative to original estimates, the ongoing operational cost structure of each facility, the tariff recovery rates of the Water Service Providers served by the infrastructure, and the economic value generated for beneficiary households and communities. ACAL's team brought together economists, agricultural extension specialists, institutional development experts, and environmental practitioners precisely because no single discipline can produce credible financial evaluation at this level of complexity.

ICR quality determines how much influence an evaluation has on future investment

A World Bank Implementation Completion and Results Report does more than close out a project. It shapes how the Bank's project team and country department think about the next programme. Evaluations that produce shallow findings or generic recommendations fail at this function. They satisfy the close-out requirement while contributing nothing to programme design learning. ACAL's ICR methodology is designed to produce findings specific enough to be actionable, analytically sound enough to survive Bank review, and practically focused enough to be useful to the implementing agencies and the Ministry that will design the next generation of water sector interventions.

Baseline quality at inception determines outcome quality at evaluation

End-term evaluations are only as credible as the baseline against which they assess change. The evaluation framework and M&E tools produced at inception are not administrative deliverables. They are the foundation that makes the end-term findings defensible. ACAL invests in rigorous inception design precisely because the quality of the final ICR is largely determined before the field data collection begins.

Sector: Water and Sanitation, Impact Evaluation | Client: Athi Water Services Board | Funder: World Bank | Geography: Kenya, Central, Athi, and Lake Victoria North WSB Areas | ACAL Role: Independent Monitoring and End-Term Evaluation Firm | Contract Value: KES 19,615,600