Christian Blind Mission
Terms of Reference to conduct Endline Evaluation For Foreseeing Inclusion Project: Eye Health and Disability Mainstreaming in Northern Uganda 2020– 2022.
BACKGROUND INFORMATION
Project name: FORESEEING INCLUSION PROJECT: Eye health and disability mainstreaming in northern Uganda
Project Number: AID 11907
Project duration: To contribute to the reduction in the prevalence of avoidable blindness by 2022 in Northern Uganda in line with the 4th Eye Health Action Plan 2016-2020.
Project partners: Saint Joseph Hospital – Kitgum and CUAMM-Arua Local Government – and it has been structured in collaboration with the Ministry of Health as well as CBM.
Project Area: Health facilities in the districts of Kitgum, Lamwo and Arua (Acholi and West Nile sub-regions, North Uganda)
INTRODUCTION
CBM is an international Christian development organization, committed to improving the quality of life of persons with disabilities in the poorest countries of the world. Our vision is “an inclusive world in which all persons with disabilities enjoy their human rights and achieve their full potential”.
Based on our Christian values and over 100 years of professional expertise, CBM addresses poverty as a cause, and a consequence, of disability, and works in partnership to create an inclusive society for all. CBM has been working with partners in Uganda for over 4 decades, working across the country to prevent avoidable blindness, improve health and help people with disabilities to go to school, earn a living, access health care/rehabilitation, and secure respect in their communities.
THE PROJECT DESCRIPTION
The project Title is FORESEEING INCLUSION PROJECT: Eye health and disability mainstreaming in Northern Uganda. Project code AID 11907 funded by Italian Agency for Development Cooperation-IADC.
Inclusive eye health (IEH) means ensuring eye care services are accessible and welcoming to all members of the community, including people with sensory, physical and intellectual impairments, and those with mental health conditions; it also means proactively ensuring that people with long term vision impairment access their right to wider opportunities in rehabilitation, health, education, livelihoods and social inclusion. IEH is essential for reaching the poorest people.
The implementing partners of the project are Saint Joseph Hospital – Kitgum and CUAMM-Arua Local Government in Uganda, while GNUCOOP organization and Italian Blind Union (UICI) and Arco have supported the two local partners remotely and with field consultancy missions– and it has been structured in collaboration with the Ministry of Health as well as CBM Italy.
In line with the strong evidence base being built, which shows the importance of inclusive practice, CBM wants to see all eye health programmes across the world strengthened to include and welcome not only people with disabilities, but also those from all marginalised groups. This is essential practice for poverty alleviation.
PROJECT PURPOSE, AIM, GOAL, AND OBJECTIVES
PURPOSE
The endline evaluation will cover all activities undertaken in the project from 2020 to end of 2022. The evaluation will assess the extent to which the planned outputs/outcomes, budget and activities of the project have been achieved and adequacy in scope of implementation. The purpose of the evaluation is to assess the performance of the project against expected achievements and to understand what specific lessons, insights and recommendations can be taken forward in future project design and implementation. The evaluation will build on the findings of the Mid-Term Evaluationeview (MTE), conducted between January and March 2022.
AIM: The project aim is improving access and provision of quality inclusive eye care services both within the communities and health facilities in the districts of Kitgum, Lamwo and Arua (Acholi and West Nile sub-regions, North Uganda). In particular, it focuses on the most vulnerable groups, such as persons with disabilities, women and children.
Project Goal: To contribute to the reduction in the prevalence of avoidable blindness by 2022 in Uganda in line with the 4th Eye Health Action Plan 2016-2020.
PROJECT OBJECTIVE
Specific Objective: To improve access of quality eye care services delivery and promote Disability Mainstreaming in Kitgum, Lamwo and Arua Districts in 3 years with particular attention to persons with disabilities, women and children.
Result 1: Eye care services at primary level are strengthened in communities and refugee camps in Kitgum, Lamwo and Arua Districts.
Result 2: Specialized Eye Care services at secondary level are enhanced inside Saint Joseph’s hospital Kitgum and in Arua Regional Referral Hospital (ARRH).
Result 3: Strengthened the governance in Eye Health Sector and Disability Mainstreaming in Northern Uganda.
THE CONSULTANCY ASSIGNMENT
PURPOSE OF THE ENDLINE EVALUATION.
The Foreseeing Inclusion Project: Eye health and disability mainstreaming in Northern Uganda by the end of 2022. The partner and the donor would like the endline evaluation to determine the extent to which the planned outputs/outcomes, budget and activities of the project have been achieved. The purpose of the endline evaluation is to assess the performance of the project and to understand what specific lessons, insights and recommendations can be taken forward in future project design and implementation.
The endline evaluation will apply an adapted set of DAC criteria to review the project in the areas of relevance, effectiveness, efficiency, impact, sustainability, scalability, and equity and inclusion. The evaluation questions developed under each of these criteria will incorporate a gender, equity and disability inclusion lens.
Generally, the purpose is to accomplish the following:
- To identify lessons learned, good practices, produce a set of clear recommendations, determining which are relevant at programme and organisational level, for potential improvements. This is with a view to proposing corrective measures if necessary, and providing recommendations to ensure the proper implementation of activities over the remaining time of the project.
- Establish to what extent the programme has achieved the results numbered 1-3 above so as to contribute to improvements in eye health systems and service delivery and in promoting equality of opportunity for disabled people in the targeted countries of intervention
- The evaluation will assess the overall programme performance using the following criteria; relevance, efficiency, effectiveness, coherence/coordination, impact and scalability and sustainability. As well as assessing achievements and results of the programme as described in the results framework.
- To report on the use of resources (human, material and financial) and analysis of the adequacy between the resources used and the level of results achieved.
- To identify the difficulties encountered in the implementation of the project.
- To develop projections for the achievement of the general and specific objective in the final year.
- To evaluate sustainability of the project.
EVALUATION CRITERIA AND QUESTIONS
The consultant(s) will develop specific evaluation questions to be answered under each of the criteria. The list below is not exhaustive.
**Relevance:**Is the intervention addrerssing the need?
The extent to which the intervention objectives and design respond to beneficiaries’, global, country, and partner/institution needs, policies, and priorities, and continue to do so if circumstances change. How did the project contribute to their realisation or complements them in important strategic issues that are identified as not sufficiently addressed?
**Effectiveness:**is the intervention achieving its objectives?
The extent to which the intervention achieved, or is expected to achieve, its objectives and its results, including any differential and positive unexpected results across groups.
**Efficiency:**The extent to which results have been delivered with the least costly resources possible.
To what extent did the programme convert its resources and inputs (such as funds, expertise and time) economically into results in order to achieve the maximum possible outputs, outcomes and impacts with the minimum inputs?
**Impact:**Long term change or effects resulting from the intervention.
The extent to which the intervention has generated or is expected to generate significant positive or negative, intended or unintended, higher-level effects.
**Sustainability:**Will the benefits last?
The extent to which the net benefits of the intervention continue or are likely to continue thanks also to the involvement of local and national authorities
Scalability/replication: How scalable is the intervention?
The extent to which any aspects of the intervention are suitable for replication or scaling-up.
**Coherence:**How well does the intervention fit?
The compatibility of the intervention with other interventions in a country, sector or institution, and the degree to which the project design and implementation is internally coherent.
Equity and inclusion: How inclusive has the intervention been?
The extent to which the human rights and needs of a diverse range of stakeholders have been addressed, and intersectionality considered. This includes people with disabilities, women and people from other marginalised communities.
Participation; Is communities’ trust towards partnering health facilities increased? Please describe the target group – quantitatively and qualitatively – and explain how they have been included in the different phases of project management. Collect their satisfaction with the project delivered, understanding which score they give to eye health now in their priority health services ranking.
SCOPE OF WORK
The scope of work for the consultant will include but not be limited to the following:
- Inception Report (Technical) outlining the preferred survey methodology and justification for selection of the methodology, schedules, data collection tools, names and particulars of the consulting team members
- A financial overview (budget) in UGX indicating the costs of conducting this exercise.
- Participatory Session involving the consortium to present the inception report;
- A draft report to CBM team for feedback and input into the final report.
- A comprehensive final endline evaluation report at the end of the contract including an executive summary, the methodology, the findings, conclusions and recommendations with relevant annexes to support the work.
- Desk study and document review: Review of relevant programme monitoring documents, evaluations, surveys, national plans and CBM publications for all the partners involved in the project.
- Interviews (KIIs and FGDs) with key stakeholders; civil society and government partners, relevant staff at head office, regional and country offices, other key donors and stakeholders in Uganda and Italy in the programme portfolio.
- Conduct field data collection in the two partner project areas from the selected key stakeholders, sampled communities and respondents in order to assess the achievement of each strategic objective, implemented at country level.
- Analyse data and generate summary reports to share with implementing partners and CBM.
- Data sets (Excel or Word files) for all collected data (quantitative and qualitative)
- PowerPoint slides summarising the key findings from the review.
QUALIFICATIONS AND EXPERIENCE OF CONSULTANT
The evaluation will be contracted to an external independent consultant or consultancy company through an open tender. The team or consultant should be suitably-qualified and experienced individual/s, who can provide the following competencies and experience:
- Must hold at least a Master’s Degree in one or more of the disciplines relevant to the following areas: Evaluation, Primary health care, Ophthalmology, and Research, or Social Sciences
- Extensive experience in monitoring and evaluation for project/programmes, with strong skills in both qualitative and quantitative approaches is essential.
- Having At least 10 years of recognized experience in conducting or managing/leading evaluations or review of development programmes, and experience as team leader of evaluation team and as main writer of evaluation reports;
- Prior eye health evaluation experience, as well as knowledge and expertise of inclusive health and/or disability inclusion.
- Having strong mixed-methods evaluation expertise and skills and having flexibility in using non- traditional and innovative evaluation methods;
- Thematic expertise in eye health, inclusive health and disability inclusion; comprehensive understanding of preferred practices/policy issues at global and national levels.
- Strong knowledge on participatory approaches or assessments and facilitating strategic planning processes
- Excellent knowledge and understanding of theories of change, logical/result frameworks, monitoring and evaluation systems and practice;
- Demonstrated high level of professionalism and ability to work independently under tight deadlines.
- Experience of carrying out data collection and evaluation and learning exercises of an appropriate scale.
- Ability to produce concise, readable and analytical reports
- Excellent analysis skills in writing evaluation reports with constructive and practical recommendations.
- Excellent communication, advocacy and people skills. Ability to communicate with various stakeholders and to express concisely and clearly ideas and concepts in written and oral form.
- Excellent knowledge in statistical packages like SPSS, STATA.
- The consultant/team must be independent of involvement in any CBM’s partner programmes so that they can assure impartiality and present no risk of a conflict of interests.
TIMELINE INDICATIVE TIMEFRAME
No: Task Details Estimated number of days Timeline
1.0 Phase 0-Ground work 0
1.1 Terms of Reference sent out to prospective consultants. 21st /10/2022
1.1 Deadlines for receiving responses to Terms of Reference by interested bidders. 28th /10/2022
1.3 Remote meetings with project teams for further details and clarifications about the project. 3rd and 4th /11/2022
1.4 Signing of Contract and commencement of assignment 9th /11/2022
2.0 Phase I – Desk study: Review of documentation and elaboration of field Study: 16th /11/2022
- Conduct a desk review and consultation with key stakeholders
- Project data review
- Develop and submit inception report including desk review, detailed evaluation methodology and tools, evaluation matrix, reconstructed underlying theory of change, work-plan, report outline in close consultation with CBM Team
- Revision of collection methods and tools based on inception report comments
- Inception report final version: This will include a specific outline of the evaluation, finalized learning questions; it will identify sampling, timing data collection, quality control measurements and methodology. The inception report will be reviewed and approved prior to any data collection.
2.1 Presentation of the Inception report to the consortium members 22nd /11/2022: Deliverables Inception Report of maximum 20-40 pages (in English) approved by CBM
3.0 Phase II: Field Data Collection: Conduct quantitative and qualitative data collection 24th November to – 1st December 2022
4.0 Phase III – Analysis and production of evaluation report:
- Debriefing (In-country)
- Data Processing, Analysis and Report writing – Prepare and submit 1st draft evaluation report for review and PowerPoint presentation (maximum 20 slides), summarising the methodology, challenges faced, key findings under each of the final evaluation criteria and main recommendations. 5th -12th Dec 2022
- CBM provides feedback to the report (CBM will provide feedback on the report within 10 working days of acknowledged receipt) 14th Dec 2022
- Revise and submit the revised draft evaluation report that takes into consideration of comments and feedbacks (with a matrix showing how the evaluation team has responded to the comments) 19th Dec 2022
Finalize and submit the evaluation report including abstract, executive summary, full report, summary report, PowerPoint presentation of key findings and recommendations, all annexes and data sets and Hard bound signed and stamped 3 copies-3rd January 2023
PAYMENT TERMS
The payment schedule will be as follows:
- 40% of fees After signing of contract, and to support in-country travel cost, and DSA upon the preparation and submission of the approved inception report including detailed evaluation methodology and tools, evaluation matrix, reconstructed theory of change, work-plan, report outline
- 30% of fees upon the submission of the 1st draft evaluation report, and presentation of Basic Findings
- 30% of fees upon the submission of the final revised and approved evaluation report, including abstract, executive summary, full report, summary report PowerPoint presentation of key findings and recommendations
How to apply
Interested Consultants should submit to CBM an Expression of Interest indicating their technical and financial proposals, Maximum 10 pages excluding CVs as annexes; at CBM offices located on Plot 4, Upper Kololo Terrace, opposite Protea Hotel new entrance or emailed to:
Procurement Committee,
CBM Christoffel Blinden Mission Christian Blind Mission e.V,
Plot 4 Upper Kololo Terrace
P.O Box 5280, Kampala, Uganda.
Or Email your application documents to:
Email: [email protected]
The deadline for submission of technical and financial proposals by 28th /10/2022
Code of Conduct
CBM Uganda Country Office’s work is deeply held on values and principles of child safe guarding and protection of adults at risk. Consultants, research Assistants and Interpreters must adhere to the CBM code of Conduct and will need to sign the code before being commissioned for the study.