Mid-term Evaluation Consultant – DC-UGA21.01

Background and Rationale

Hoffnungszeichen | Sign of Hope e.V. (SoH) is a Christian motivated organization for human rights, humanitarian aid and development cooperation. From its base in Constance, Germany, SoH is committed to helping those in distress and exploited people worldwide.

This mid-term evaluation is commissioned under the German Federal Ministry for Economic Cooperation and Development (BMZ) budget for development projects run by private organisations.

SoH is the private German executing agency and the contracting party, while Caritas Moroto Diocese (CMD will be the local implementing partner.

The project’s goal is to contribute to the improvement of health and living conditions in disadvantaged rural communities of Karamoja. The project will directly ensure that the target population in the most vulnerable rural communities in the districts of Amudat and Nabilatuk in Karamoja use the newly constructed sanitation facilities, hand washing facilities, water points and new knowledge to improve their health. This will be achieved through 3 results areas including: 1) By the end of 2023, 3,530 vulnerable households in four target sub-districts have gained equitable access to safe, di-versified and sustain-able water sources for multiple use (including, domestic consumption, hygiene); 2) The access to hygiene measures and adequate sanitary facilities in 40 target communities (villages and clusters of Manyattas) has improved; and 3) The administrative capacities of the local authorities and water management structures are strengthened so that they can effectively advocate for sustain-able, integrative WASH services for the disadvantaged population in Karamoja. The project targets 40 villages and identifies particularly vulnerable rural households in 40 target villages. The project targets a total of 55,200 (28,366 female and 26,834 male) direct beneficiaries. In particular, it reaches out to women and girls, people with disabilities and the elderly to address their special needs regarding access to water and improved sanitation. The project anticipates a ‘spill over’ and ‘multiplicity’ of the positive effects of this action to reach out to additional 44,160 indirect beneficiaries mainly from the 32 villages surrounding the project implementation area.

The table below shows a summary of the outputs and activities this project is linked to:-

Project Outputs

Activities

Output (result) 1: By the end of 2023, 3,530 vulnerable households in four target sub-districts have gained equitable access to safe, di-versified and sustain-able water sources for multiple use (including, domestic consumption, hygiene).

Participatory technical assessment of non-functional water facilities; Training of the members of water user committees; Rehabilitation of existing non-functional hand pumps; Refresher training and equipping of hand pump mechanics; Upgrading water sources from hand pumps to motorized solar-powered pumps; Participatory assessment and drilling of hand pumps; Training of environmental management committees; Construction and management of environmentally friendly valley tanks for surface water harvesting; Construction of rain water harvesting tanks in health and education facilities

Output (Result) 2: The access to hygiene measures and adequate sanitary facilities in 40 target communities (villages and clusters of Manyattas) has improved

Facilitate “Home improvement” campaign in 40 villages; Social Behaviour Change Communication; Supporting construction of improved traditional latrines; Mobilization and capacity development of Village Health Teams; Community commemoration of model villages.

Output (Result) 3: The administrative capacities of the local authorities and water management structures are strengthened so that they can effectively advocate for sustain-able, integrative WASH services for the disadvantaged population in Kara-moja.

Refresher training and mass awareness campaigns in schools and health facilities; Training of community vulnerable groups to voice out and amplify need for inclusion; Enhancing networking, advocacy and learning among national civil society members; Training of representatives of the local government on WASH sustainability, inclusion and human-rights; Capacity development of Caritas Moroto as the local non-government organisation

Purpose, Objectives and Use

The purpose of the evaluation is to provide SoH and Caritas Moroto Diocese (CMD) with a comprehensive assessment of the project, conducted systematically and impartially, as well as analyze the progress towards the achievement of the project’s results and identify risks to sustainability, propose actions to ensure sustainability of the results, identify lessons learned and information for potential future projects. The study will provide concrete, credible and practical recommendations that will assist with the timely incorporation of the findings into the decision-making process and contribute to the organizational learning of both implementing organisations.

The study will support the project quality assurance measures implemented by SoH and meet the donor requirements towards the development projects implemented by German private organisations.

The evaluation will address evaluation questions based on the standard OECD/DAC evaluation criteria of relevance, coherence, effectiveness, efficiency, sustainability, and impact (please see https://www.oecd.org/dac/evaluation/revised-evaluation-criteria-dec-2019.pdf). The objectives of the evaluations are to:

1. Assess the extent to which the project has sustainably achieved its objectives and results (results matrix), including the extent to which the lives of the project beneficiaries have been improved,
2. To determine the pathway of change (qualitative and quantitative) in each intervention supported by the project,
3. Identify the strengths and weaknesses in terms of planning, management, implementation and monitoring of the project,
4. Identify cross-cutting issues addressed through the project, including gender equality, human rights, marginalized groups, inclusion, and other issues,
5. Determine the effects of Covid-19, drought and inflation on the project, its activities and implementing organisation,
6. Identify risks and weaknesses and make recommendations for the successful completion of the project.
7. To determine the effectiveness of the implementation approaches used by the project team so as to inform the rest of the project life.
8. To determine sustainability measures put in place or planned by the project team to enable continuity of key project interventions on exit of project teams.
9. To share recommendations on needed project revision aspects.

Duties and Responsibilities

The Evaluation Consultant will work under the overall guidance of the Head of the International Assistance and Cooperation Department, in close cooperation with the responsible SoH Officer and the local implementing partner.

The duties and responsibilities of the Evaluation Consultant will include:

• Develop a work plan outlining the proposed research methodology, geographical coverage and schedule to conduct the study,
• Conduct a desk review of relevant documents,
• Carry out a project site visit to a project location to conduct research, collect data and establish contact with the local implementing partner, project beneficiaries and relevant project stakeholders,
• Review and evaluate available data and existing sources of information, including the project proposal, annual reports, conducted studies and other documents,
• Examine institutional, technical, staffing and financial capacities of the implementing partner as well as its relationship with the target group and other relevant stakeholders.

Expected Deliverables

The study will produce the following deliverables:

• an inception report, including the proposed research methodology and data collection tools, a table of content and timeline of research activities prior to the site visit to the project location,
• A comprehensive report of a maximum of 30 pages with practical recommendations and relevant annexes (including raw data and documented records).

A template will be provided to serve as a guide and may be used to structure the final report.

Study Quality and Ethical Standards

The study team will take all reasonable steps to ensure that the study is designed and conducted to respect and protect the rights and welfare of the people and communities involved. Furthermore, the study should be aligned to the following standards and applicable practices:

• Utility: the study must be useful and used.
• Feasibility: the study must be realistic, diplomatic and managed in a sensible, cost-effective manner.
• Ethics and Legality: the study must be conducted in an ethical and legal manner, with particular regard for the welfare of those involved in and affected by the Study.
• Impartiality and Independence: the study should be impartial, providing a comprehensive and unbiased assessment that takes into account the views of all stakeholders.
• Transparency: the study activities should reflect an attitude of openness and transparency.
• Accuracy: the study should be technically accurate and credible, providing sufficient information about the data collection, analysis, and interpretation methods so that its worth or merit can be determined.
• Participation: the Stakeholders should be consulted and meaningfully involved in the study process when feasible and appropriate.
• Collaboration: Collaboration between key operating partners in the study process improves the legitimacy and utility of the study.

The study must be in line with the SoH guiding principles and Code of Conduct.

Process/Timeframe

The total duration of the assignment is up to 22 working days within the period from 1st September 2022 to 30th September 2022.

Planning meeting with SoH (remotely), handover of relevant documents 1 day

Initial document review and inception report preparation 4 days

Sharing inception report with SoH and CMD 1 day

Finalization of inception report 1 day

Data collection site visit to a project location 7 days

Data analysis, draft report with annexes 5 days

Incorporating received feedback and report finalization 3 days

Qualifications and Experience

Essential:

• Minimum of 5 years of project evaluation and/or implementation experience in the result-based management framework
• Proven experience of conducting feasibility studies, evaluations and other research projects
• Technical and methodological knowledge to conduct research projects and formulate conclusions based on a solid methodology, assessing projects for relevance, coherence, effectiveness, efficiency, impact and sustainability of projects
• Experience working with non-governmental organisations (NGOs) and partnered projects
• Fluency in written and spoken English

Desirable:

• Experience in the relevant field/sector
• Professional familiarity with the project country/region
• Practical experience of working for and/or evaluating BMZ-funded projects
• Fluency in written and spoken Pokot, Kiswahili, English and/or Ngakarimojong

Academic Background

An advanced level university degree (Masters’ degree or equivalent) in social sciences, public administration, international development studies, community/public health and/or any other relevant qualification with experience in undertaking similar assignments.

A first-level university degree in combination with additional years of qualifying experience may be accepted.

The Evaluation Consultant is to be independent and impartial with no liabilities to any other organisation or government entity regarding this evaluation.