1. Background and purpose of the Oxfam programs review
Oxfam in Ethiopia has been operating for the last 17 years in various regions and in a wide spectrum of programs and projects aligned with the development priorities of the country. Oxfam US has implemented resilience building, WASH, agricultural extension, gender, GROW, coffee campaigns, peace building and humanitarian programs in various regions of Ethiopia. As of today, five Programs have been implemented in partnership with 14 partners and stakeholders including the government and reached to an estimated 30 million primary change agents (PCAs) through its long-term and short-term interventions hitherto.
In the process of implementation the agency has passed through various learning and unlearning processes. Likewise, key aspects leading to project achievements have been identified, evaluated and documented at various times both internally and externally although in a fragmented and periodic manner. Oxfam, to further enhance its operationalization, focus and impact, it is undergoing a restructuring process that aligns all programs and resources towards prioritized and country specific strategic needs and demands. In support of this process a learning review that synthesizes compiled documentation supported with limited verification would provide an input for country specific strategies and operational plans (OCS, PIP) currently via offering key implementation lessons; identification of past and current impediments, and measures taken; realizing and capitalizing on Oxfam’s strong base and shortcomings.
2. Specific object and objectives of the review
The main aim of the review is to:
· Synthesize key learnings and challenges from implementing Oxfam programs and projects in various regions and areas of Ethiopia
This leads to mainly an effectiveness focus of the review.
The main questions of the review for each of the programs are:
1. What have been the physical and soft-skill capacity achievements by program, area/regions and gender (when data permit)?
2. Based upon synthesizing available information on what are the impacts of Oxfam programs and projects? (highlighting the strength of the evidence on causation)
3. Based upon synthesis of available evidence of what sustained results (whether in activities, institutions and systems) have been achieved?
4. Based upon synthesis what is the evidence of the success of Oxfam’s policy influencing efforts?
On the basis of answering these questions Oxfam would request recommendations and guidance on:
1. What are the successful and unsuccessful processes and implementation modalities in the achievement of core Oxfam deliverables and policy wins, especially in regards to gender?
2. Which activities, systems and interventions under the four major programs demonstrate higher degrees of sustainability and institutionalization and what are the reasons for this?
3. What are drawbacks and/or shortcomings in implementing previous projects that inhibit sustainability?
4. What are the trends in the various documents that should inform future country strategies?
3. Scope of the review and approach and methods
Scope:
The time period for review is from 2006-2016 and focuses around the five long term programs (Humanitarian, Water, R4, GROW/Economic Policy and Justice and Agricultural Extension).
The focus of the review is on drawing lessons from existing documentation and synthesizing this at program and then country level. The review will be undertaken on core program/project interventions Oxfam America (OA) has made. The predominant theme of the review is to identify core learnings based upon an analysis and synthesis of claimed impacts (or outcomes) and sustainable changes.
Approach and Methods:
The study will undertake analysis of overall OA’s contribution in Ethiopia with reference made to the five programs.
This review will apply a documentary analysis approach of the major programs. It is expected that the consultant will:
· In consultation with Oxfam develop a qualitative coding scheme and rubric for the analysis for the documents.
· Conduct analysis of all supplied documents
· Synthesize information from across documents to provide a view of program and overall country success.
· Conduct verification analysis to help augment the strength of claims or better understand contradictory evidence.
· Provide a 1 page summary, 3 page executive summary and 25 page dissemination report, along with qualitative data sets and additional annexes as required.
The design of the review may vary on the nature of the program – goals of the program/project, its intervention modality, longevity and its current status, and availability of documents.
4. Schedule, budget, logistics and deliverables.
The review should be substantively completed by the end of March 2017 and will have the following deliverables from the review process:
· A methodological approach including schedule, deliverables and economic budget for undertaking the review (by Jan 27th 2017)
· An inception report with a well-designed data collection and analysis instruments (by Feb 10th 2017)
· A first draft analysis report of Oxfam programs(by March 13th 2017)
· Second and refined version document (by March 27th 2017)
· Verbal presentation and gathering inputs from key stakeholders (by March 28th 2017)
· Final submission of the document (by March 31th 2017)
Disbursement will be on installment bases as per achievement of core deliverables such as 30% upon signing of contract, 30% upon submission and approval of second draft and the last 40% upon submission of the final document and approval by Oxfam.
5. The role of the consultant
a) Review all applicable project documents, including reports and documentations, assessment reports, baseline studies, mid-term evaluations etc.,
b) Consult with project coordinators/stakeholders/partners to get clear understanding of projects and their indicators beyond the documentary evidence that help to finalize the methodology, tools and prepare a detailed time-line
c) Reaching agreement with OA over the methodology for the review and an outline
d) Produce an inception report that describes the design for analysis and synthesis from desk/document reviews, review of exiting data sets, evaluation document and outline of the final review report and present it to Oxfam
e) Prepare draft report and receive comments from Oxfam (and partners when applicable).
f) Produce a refined version after incorporating the comments from Oxfam
g) Present synthesis of the document to internal and external stakeholders
h) Produce the final version of the document after incorporating all inputs and feedback.
6. Management arrangements, Oxfam and Partners Role
The consultancy assignment will be overseen by HARO-Deputy Regional Director, LEAD and MEL Coordinator to help ensure the quality of the document through a team based review and commenting on methodological approach, initial and final submission of the document.
The final review and inception report may be submitted for external expert review, to support the quality of the product.
Oxfam and partners will avail list of key stakeholders, project documents, project locations and area maps (if available), evaluation reports, case studies, periodic reports, policy briefs, best practices that will benefit timely, appropriate and adequate review of project implementation, hitherto. Also for interviews, Oxfam with partners need to facilitate access, organize PCAs, government officials and other key stakeholder to participate in the review process.
7. Dissemination Strategy, Plan and Responsibilities (for sharing and using the findings)
o The review report will be posted on Oxfam websites and made available for wider use in order to be consistent with Oxfam’s commitment to transparency and accountability
o The report summary will also be shared with communities, partners, key stakeholders (internal and external)
o This document will particularly inform Oxfam Country Strategy and Program Implementation Plan and improves decision making in program development, organizational learning, accountability and advocacy.
8. Required Profile
The consulting firm and/or team of individual consultants should have
· A minimum of MA and above degree in project management, agriculture, development studies, and other related social science fields
· Experience in high quality document reviews related to the five program areas (Humanitarian, Water, R4, GROW/Economic Policy and Justice and Agricultural Extension), the application of rubrics and in undertaking synthesis processes of large qualitative data-sets.
· Experience in and exposure to the five main program areas (mentioned above) and the implementation context in Ethiopia. The team should also include an expert in gender.