The Communication for Health project is a five years project (2015-2020) funded by the United States Agency for International Development (USAID). The project is designed to optimize the power of health communication to save lives and transform the public health system in Ethiopia. The project envisions Ethiopians adopting healthy behaviors individually and socially and systems and structure in the country augment such change. The Project aims at measurably contributing to this vision in four regions – Amhara, Oromia, SNNPR and Tigray – by strengthening social and behavior change communication (SBCC) capacity and interventions at the national, regional and grassroots levels.
Johns Hopkins Center for Communication Programs (CCP) is implementing the project in collaboration with Johns Snow Inc. (JSI) and the Federal Ministry of Health of Ethiopia (FMOH). Since June 2015, the project has been implementing various activities including capacity strengthening and coordination support for FMOH and regional health bureaus (RHBs), design and implementation of various SBCC materials, media interventions (radio and print), social mobilization activities and assessments and surveys.
Currently the project is looking for an independent consultant to conduct the project midterm evaluation. The consultant team will be responsible for developing an evaluation strategy and methodologies that include a mix of qualitative and quantitative approaches, conduct data collection, analysis and report writing activities.
PURPOSE OF EVALUATION AND RESEARCH QUESTIONS
The purpose of the performance evaluation is to assess project progress towards expected results and to identify gaps and challenges that can be addressed over the remainder of the project period.
The evaluation has five main questions that are closely linked to the Project’s development hypothesis depicted in the Results Framework.
To what extent does the Project’s hypothesis describe the necessary and sufficient conditions to progress toward its ultimate goal?
How relevant and practical is the design and implementation approaches of the Communication for Health Project in relation to the Government of Ethiopia’s Health Sector Transformation Plan (HSTP) Priorities?
What are the early indications of the Project’s effectiveness?
What approaches is the Project using to address gender issues in Communication for Health and what evidences exist whether the Project accounts for gender considerations during implementation or not?
What are the key project implementation challenges and lessons learned?
EVALUATION METHODOLOGY
Methodology
The mid-term evaluation will use a mixed method, quantitative and qualitative approaches mainly desk review and qualitative evaluation methods that enhance participatory evaluation and learning. Considering that the project woreda level interventions (social mobilization and Radio) were rolled out phase-by-phase and the reach to rural households is only at the beginning stage, the mid-term evaluation will employ the following key methodological considerations.
Desk review: The evaluation team need to conduct a robust desk review of the various project documents:
Most significant change (MSC) story:
Selected field visits and key informant interviews:
Participatory review:
EVALUATION SCHEDULE
The estimated time period for undertaking this evaluation is 45 working days including time for review of products. The ideal available time for the evaluation team is 30 working days. The team is required to travel to selected provinces in each region where project activities are being implemented. At least 50% of the consultants’ time will be spent outside Addis Ababa to conduct interviews with project staff, government partners, and project beneficiaries.
MANAGEMENT
The consultant will be closely working with the CCP and USAID researchers. CCP will identify and hire the evaluation team, with USAID/Ethiopia’s engagement in the review of CVs, as appropriate. CCP is responsible for all logistical support required for the evaluation team. The evaluation team will officially report to CCP. CCP is responsible for all direct coordination with the USAID/Ethiopia through the evaluation process.
Job Requirement
EVALUATION TEAM COMPOSITION
The evaluation team shall consist of one independent international/local expert who serves as the team lead and four other high level Ethiopian experts. All the evaluation team members must be fluent in English and have strong writing skills. The Ethiopian experts should also be proficient in Amharic; one local expert in Afan Oromo and one in Tigrigna.