CONSULTANCY FOR FINAL PRM PROJECT EVALUATION

TERMS OF REFERENCE

CONSULTANCY FOR FINAL PRM PROJECT EVALUATION

Improve access to and quality of comprehensive rehabilitation and Early Childhood Development (ECD) services for girls, boys, women, and men affected by the Syrian crisis in targeted areas of Amman, Irbid, Mafraq, and Zarqa governorate.

1st September 2021 to 31st August 2023

1. General information (1-page maximum)
2. 1. . About Humanity & Inclusion

HI is an independent and impartial aid and development organization with no religious or political affiliations operating in situations of poverty and exclusion, conflict, and disaster. We work alongside people with disabilities and vulnerable people to help meet their essential needs, improve their living conditions and promote respect for their dignity and fundamental rights. Since the organization was first founded in 1982, we have set up development programs in more than 50 countries and responded to many emergencies. Today we have a budget of around 185 million euros, with 3,500 employees worldwide. HI is engaged in an employment policy in favour of persons with disabilities. For further information about the organization, please visit www.hi.org

1.2 About Humanity & Inclusion in Jordan

HI has been operating in Jordan since 2006, implementing projects ranging from the provision of comprehensive rehabilitation services, directly, through service providers or a community-based approach; to inclusive local development, disability movement strengthening through capacity building of organizations of Persons with Disabilities, and multi-stakeholder dialogue, among others.

In 2021, HI started implementing the new phase of the PRM-funded project titled “Improve access to and quality of comprehensive rehabilitation and Early Childhood Development (ECD) services for girls, boys, women and men affected by the Syrian crisis in targeted areas of Amman, Irbid, Mafraq, and Zarqa governorate”. The project goal was to contribute to building more inclusive communities, allowing crisis-affected Syrians and the most vulnerable Jordanians to reach their potential. The project worked at different levels; the authorities, including the Ministry of Health (MoH) and Ministry of Social Development (MoSD), and the Service Providers level, including the governmental hospitals, Primary Health Centres (PHCs), community centres, and MoSD inclusive daily centres. Finally, at the community level, in which HI has a Community-Based Rehabilitation (CBR) volunteer network who do outreach activities, identification, referrals, follow-up visits, and conduct a home-based intervention.

1. Context of the evaluation (1-page ½ maximum)

2.1 Presentation of the project to be evaluated

Project title: Improve access to and quality of comprehensive rehabilitation and Early Childhood Development (ECD) services for girls, boys, women, and men affected by the Syrian crisis in targeted areas of Amman, Irbid, Mafraq, and Zarqa governorate.

Implementation dates: 1st September 2021 to 31st August 2023

Location/Areas of Intervention: Irbid, Mafraq, Zarqa, and Amman governorates.

Operating Partners: Princess Basma hospital, and Community development centre (Irbid); Zarqa Governmental hospital, and Community development centre (Zarqa); Mafraq Governmental Hospital; Community Development Center Wehdat and one Primary Health Clinic (both in Amman) and MoSD Inclusive daily care centres.

Target Groups: Syrians and most vulnerable Jordanians.

Project Budget: Total: 3,400,00 USD

The goal of the project: Contribute to building more inclusive communities, allowing crisis-affected Syrians and most vulnerable Jordanians to reach their potential

Objectives and Activities:

Objective 1: Enhance the capacity of Community-Based Rehabilitation (CBR) volunteers to identify, refer, follow up, and conduct home-based intervention programs, supporting vulnerable women, men, girls, and boys with disabilities to improve their functionality

Objective 1 Activities:

1.1: Conduct specialized training for CBR volunteers on identified specific conditions to better manage the rehabilitation process of adults and children with disabilities

1.2: CBR volunteers identify the most vulnerable adults and children with functional and growth limitations in targeted host communities, assess their needs and refer them to relevant service providers (Rehabilitation and EDEI)

1.3: Provide follow-up for adults and children with disabilities and their caregivers to ensure they receive appropriate services as referred and support their engagement in the home-based rehabilitation process during treatment to enhance discharge

1.4: CBR volunteers support the establishment and functioning of self-support groups for persons with disabilities and their families to support access to services, the provision of peer-to-peer support and better engagement in the rehabilitation process

1.5: Provision of basic psychosocial support to adults and children (1 day – 6 years) and their caregivers during rehabilitation and early intervention program by CBR volunteers (individual or collective)

1.6: Support CBR committees to implement and monitor community-based activities

Objective 2: Enhance the capacity and quality of primary and secondary healthcare providers to provide comprehensive, inclusive, and qualitative rehabilitation and Early Detection Early Intervention (EDEI) services to vulnerable women, men, girls, and boys with disabilities

Objective 2 Activities:

2.1: Support the national rehabilitation platform to play an active role in the development of a rehabilitation strategy led by the Ministry of Health in Jordan

2.2: Provide training and coaching on specialized services for rehabilitation, ED, and EI service providers staff

2.3: Provide specialized equipment and materials to rehabilitation, PHCs service providers, including EI

2.4: Provide education/intervention toolkit (toys, educational materials) for EI centre and portage staff

2.5: Provide support for the establishment (equipment and refurbishment) of child-friendly EI centres under the MoSD

2.6: Provide assistive Product Priority training to MoH health staff

2.7: Share lessons learned and best practices on the delivery of rehabilitation and EDEI services with national and international decision-makers and advocate for their strategic support to the rehabilitation sector for refugees and host communities

Objective 3: The functional abilities of vulnerable women, men, girls, and boys with disabilities are improved through the provision of home and centre-based rehabilitation/EI services

Objective 3 Activities:

3.1: Provide comprehensive quality rehabilitation services for persons with disabilities through partner local service providers, based on beneficiary individual rehabilitation action plans (Equity fund, Rehab and EDEI)

3.2: Provide EI quality services for children with disabilities/developmental delays through service providers (centre-based intervention) and volunteers (home-based intervention), based on children’s needs

3.3: Purchase and donate to service providers/beneficiaries’ relevant assistive devices and specific items needed for targeted beneficiaries (EDEI and Rehab)

3.4: Support the provision of prosthetics and orthotics (P&O) devices for persons (adults and children) with disabilities (EDEI and Rehab)

3.5: Distribution of IPC kit to the beneficiaries who benefited from HI services

3.6: Document HI intervention and its impact in the field

3.7: Conduct awareness-raising amongst caregivers of adults and children on rehabilitation and EI

Objective 4: Beneficiaries of comprehensive rehabilitation services define and accomplish personalized pathways to improve their participation in the socio-economic life of their communities, thanks to enhanced CBR networks and empowered local CBR committees.

Objective 4 Activities:

4.1: Training and continuous coaching of CBRW to support rehabilitation beneficiaries to define personalized action plans for inclusion in their communities

4.2: Train and continuous coaching to CBRW to support rehabilitation beneficiaries’ functional independence at home (including home adaptations) and in daily life activities outside home (shopping, going to mosque, and other individual dimension activities)

4.3: Support local CBR Committees to develop partnerships with CBOs, VTCs and employers to provide rehabilitation beneficiaries with opportunities/spaces to test functional abilities in relation different professional vocations

4.4: Share lessons learned and best practices on the delivery of community-based rehabilitation with national and international decision-makers and advocate for their strategic support to the rehabilitation sector for refugees and host communities

2.2 Justification of the Evaluation

The final evaluation of the two-year PRM-funded project serves several essential purposes, particularly in assessing its intervention impact and measuring the long-term effect (outcomes). The evaluation will capture critical lessons learned from the two years of implementation and produce recommendations that will be used to improve HI interventions in any future funded projects.

The evaluation will involve various stakeholders, including the beneficiaries, service providers, ministries, volunteers, the project team, and all relevant parties.

1. Objectives of the evaluation (3 pages maximum)
2. 1. Overall Objectives and Expectations of the Evaluation

The final evaluation aims to assess the Changes, Relevance, Effectiveness, Efficiency and Partnership of the project activities, outputs, outcomes, and impact. Furthermore, the evaluation aims to measure the impact on the beneficiaries and capture the lessons learned to be considered in any future interventions.

3.2 Specific objectives

• Assess the complementary/comprehensive services of different project components (rehabilitation, Early Childhood Development, Community-Based Volunteering, Testing Abilities, etc.) in terms of how the project considered the role of local partners in the sustainability and oriented approach toward the affected population of the intervention.
• Appraise how the Disability, Gender, and Age policy was integrated and mainstreamed into project cycle phases (initial assessment, design, inception, implementation, and completion).
• Measure the efficiency of the intervention and project in terms of technical expertise and skills utilized, resource optimization, and adapting the context changes to the successes of the intervention.
• Provide specific and meaningful recommendations and lessons learned in the project phases based on the achieved results of the intervention.

3.3 Evaluation Criteria and evaluative questions

5 main evaluation criteria will be considered in the evaluation as follows:

1. Changes (Effects, Continuity, Empowerment):

The project aims at positive short, medium, and/or long-term changes for the targeted populations

Evaluation questions:

• Did the project produce significant positive changes in the lives of the affected populations?
• Does the project contribute to empowering actors (Local Partners, Ministries), and target populations?
• What is the project’s intended and unintended impact on the targeted population and their communities? Are they positive and/or negative?

1. Relevance (Needs, Context, Lessons Learned):

The project meets the identified needs and is adapted to the context of the intervention

Evaluation questions:

• To what extent did the project meet the needs of the affected populations?
• Has the project sufficiently adapted its actions to the context of the country of intervention? What are the lessons that can be learned from these adaptations?

1. Effectiveness (Results, Adjustments, Technicality):

The objectives of the project are achieved.

Evaluation questions:

• Do the results obtained contribute to the achievement of the project objective? How? What are the roles and responsibilities of partners in achieving these objectives? What are the resources used by partners?
• Is the monitoring of results regular and has it allowed the necessary adjustments to the project to achieve the objectives?

1. Partnership (Collaboration, Involvement, Relationship):

Operational partners are involved in each phase of the project cycle?

Evaluation questions:

• To what extent were the roles and responsibilities of the partners clearly defined and understood by both parties?
• Does the project implementation allow the future transition of its activities to the partners?

1. Efficiency (Skills, Optimisation, Responsiveness):

Resources (human, financial, logistical, technical, etc.) are converted into results in an economical way.

Evaluation questions:

• To what extent have the resources (human, logistical, financial, technical) available enabled the project to achieve its objectives?
• To what extent did the team identify and implement mitigation measures for project risks?
• How the project resources (human, financial, logistical, technical, etc.) were allocated and used to achieve the project’s objectives at the lowest cost?

1. Evaluation methodology and organization of the mission (1 Page maximum)

4.1 Collection Methodology

Evaluation methods will be discussed with the HI steering committee and should be rigorous while remaining proportionate and appropriate to the context of the project intervention. The project will work across various governorates and sites in Jordan, site visits will be scheduled in accordance with the methods chosen.

The evaluation will be based on primary and secondary data, in particular documentation directly related to the project – proposal, narrative and financial reports, monitoring datasets, surveys, financial information, and other documents produced to analyze individual project components and inform decisions regarding the course of the activities. Finally, key stakeholders involved in the project at different stages will be mobilized for the evaluation – in addition to the whole current project team, former senior management and experts, main representatives of partners, and finally, volunteers and beneficiaries.

A mixed methodology approach will be expected from the evaluator ensuring qualitative and quantitative data collection methods, as well as triangulation with secondary and other reference data that could be used and helpful for this evaluation.

4.2 Actors Involved in the Evaluation

• The Regional MEAL Manager, is the authorized person, who oversees the overall evaluation process and ensures the adherence to guidelines and procedures.
• ECD project manager, is the responsible person to ensure the evaluation process implementation.
• The steering committee of the evaluation which includes:

1. Operations Manager
2. Regional Rehabilitation Specialist
3. CBR Manager
4. Jordan MEAL Officer
5. Log Manager

4.3 Organization of the Mission

• The Evaluation Steering Committee will be responsible for validating the proposed evaluation methodology after the closure of the selection process. In addition, the steering committee must approve the inception report and evaluation methodology prior to the commencement of any fieldwork or any other substantive work.
• The steering committee will be part of the kick-off meeting, presentation of results meeting, and closure of the evaluation.
• The final report shall be reviewed and validated by the steering committee before finalization and publishing

1. Principles and values

5.1. Protection and Anti-Corruption Policy

Please either maintain this table or attach these URL links as appendices.

Code of Conduct:

https://hi.org/sn_uploads/document/ID_CodeOfConduct.pdf

Protection of beneficiaries from sexual exploitation, abuse and harassment: https://hi.org/sn_uploads/document/PI03_HI_Protection-Beneficiaries_EN.pdf

Child Protection Policy:

https://hi.org/sn_uploads/document/PI02_HI-Child-Protection_EN_1.pdf

Anti-fraud and anti-corruption policy:

https://hi.org/sn_uploads/document/PI04_IP_antiFraud-bribery-corruption-policy_1.pdf

5.2. Ethical measures*

As part of each evaluation, HI is committed to upholding certain ethical measures. It is imperative that these measures are considered in the technical offer:

• Guarantee the safety of participants, partners and teams: the technical offer must specify the risk mitigation measures.
• Ensuring a person/community-centred approach: the technical offer must propose methods adapted to the needs of the target population (e.g. tools adapted for illiterate audiences / sign language / child-friendly materials, etc.).
• Obtain the free and informed consent of the participants: the technical proposal must explain how the evaluator will obtain the free and informed consent and/or assent of the participants.
• Ensure the security of personal and sensitive data throughout the activity: the technical offer must propose measures for the protection of personal data.

*These measures may be adapted during the completion of the inception report.

5.3. Participation of stakeholders and beneficiaries

Several stakeholders will be involved in the evaluation as follows:

1. Direct beneficiaries: Women, Men, Boys, and Girls with disabilities who were identified and receive rehabilitation, ECD and testing abilities services.
2. Families of persons with Disabilities (indirect beneficiaries): Family members of the direct Project beneficiaries.
3. Local partners: (management and technical team)
4. Community-Based Rehabilitation (CBR) Volunteers: Volunteers who are involved in the project through implementing the project’s activities at the community level.
5. Ministries/Ministry of Health (MoH) and Ministry of Social Development (MoSD)
6. CDC management team/ Higher CBR committee
7. WHO and National Rehabilitation and Assistive Technology (AT) committee members

5.4. Others

It is essential that the process of data collection, as well as storage of data, be supported by careful ethical practice, including informed consent, anonymity, confidentiality, do no harm, and protection of data and data storage. Informed consent needs to include awareness of the evaluation data collection process and that the evaluation report may be published and publicly disseminated. Extra precaution must be taken in involving project beneficiaries considering the sensitivity of the thematic issues tackled by this project. To protect the anonymity of communities, partners and stakeholders’ names or identifying features of evaluation participants (such as community position or role) will not be made public.

The evaluator should engage in respecting the following ethical principles:

• Child protection principles;
• Integrity (respect for gender sensitivity issues, especially when performing interviews/focus groups, religion, and beliefs);
• Anonymity and confidentiality;
• Independence and objectivity;
• Veracity of information;
• Coordination spirit;
• Intellectual property of information generated during and by the evaluation (including report and annexes) will be transferred to the evaluation commissioner;
• Quality of reporting;
• Respect for timelines, in case of late submission of the report, HI reserves the right to terminate the contract.
• Project Quality Policy and Project Quality Framework.

1. Expected deliverables and proposed schedule

6.1. Deliverables

• An inception report refining/specifying the proposed methodology for answering the evaluation questions and an action plan. This inception report will have to be validated by the Steering Committee.
• A presentation document presenting the first results, conclusions, and recommendations, to be presented to the Steering Committee.
• A final report of maximum of 25 pages in English (using HI final report template) including:
• Table of contents.
• Abbreviations list
• Executive summary (that can be used as a stand-alone document).
• Brief on General Jordanian context at the design and implementation phase.
• Introduction that includes evaluation objectives, methodologies, used techniques, and limitations of the evaluation where relevant.
• Presentation of the evaluation analysis and findings, covering the five focus areas (Efficiency, Change, Effectiveness, Relevance, and Partnership).
• Conclusion and recommendations with a clear relationship between them.
• Report annexes include The Final Evaluation Term of Reference; The Data collection tools; list of the people interviewed; list of documents and bibliography as well as the composition evaluation form.
• PowerPoint presentation presenting the key findings and conclusion of the evaluation in English.
• A summary of 4 pages in English that can be used externally.

6.2. End-of-Evaluation Questionnaire

An end-of-evaluation questionnaire will be given to the evaluator and must be completed by him/her, a member of the Steering Committee, and the person in charge of the evaluation.

6.3. Evaluation dates and schedule

Total mission duration*: 30 working days (approximately 50 calendar days)***

It is expected that the evaluation process will take around 2 months for the period 1st of August to the 20th of September. A detailed action plan will be submitted as part of the inception report. The draft final report shall be shared from the evaluator by the 7th of September and will be reviewed from HI steering committee by the 14th of September 2023, and the final validated report shall be finalized by the 20th of September 2023.

1. Means
2. 1. Expertise sought from the consultant(s)

The evaluation expert (or team of experts) who will undertake this assignment should have the following skills, experience, and knowledge:

• Academic background in public health, Disability, Social Sciences, and/or developmental studies with a minimum of a Master’s Degree in the relevant field.
• Solid experience in project evaluation and related methodologies
• Demonstrated Experience in conducting participatory (qualitative and quantitative) evaluation techniques.
• A broad experience in all aspects of project cycle management.
• Experience working with persons with disabilities and other vulnerable populations, in general, is an asset.
• Practical knowledge of rights-based approaches and Inclusion.
• Strong analytical and report-writing skills.
• Excellent speaking and writing skills in English
• Speaking skills in Arabic within the evaluation team
• Experience in project evaluation and related methodologies with PRM-funded projects is a plus

Qualified persons with disabilities are encouraged to apply!

1. 1. Budget allocated to the evaluation

The overall cost of the evaluation including transport costs (international and local), logistics costs, accommodation, and translation costs; with proposals for payment modalities shall be submitted by the evaluator with a detailed budget.

Caution: Please note that the last payment is conditional on the validation of the final report and not on the sending of the final report. By validation, we mean validation of the quality and under no circumstances of the appreciation of the project evaluated

7.3. Available resources made available to the evaluation team

Document and resource of information:

• Project proposal and logical framework
• Monitoring Box, (PM Box) which includes all project activities within the timeframe. In addition, human recourse involved
• Memorandums of understanding and letters of Agreement.
• Quarterly and final Donor Reports
• MEAL Plan (including MEAL matrix, calendar, and narrative plan).
• HI Operational and monitoring tools, including; Technical Assessments, training reports, pictures, attendance sheets, lessons learned reports, and outcome monitoring reports.
• Supported partners’ operational and monitoring tools.
• Evaluation Pack

1. Submission of applications

Bids from interested individual consultants or firms should include:

– A detailed technical offer that includes the methodology and evaluation plan.

– A detailed financial offer that covers all anticipated costs (withholding tax, travel, accommodation, transportation, insurance, translation, venue, etc.) in USD.

– A Resume (list of Resumes) detailing relevant skills and experience of the consultant and her/his team of no more than 3 pages each, including contactable referees. In case of a team of experts, the Team Leader must be clarified.

– A minimum of one sample of a relevant previous evaluation, preferably for an international donor-funded project in a similar area or context.

Note: Humanity & Inclusion reserves the right to accept or reject any proposal without giving reasons and is not bound to accept the lowest or the highest bidder.

Bids must be sent by email to this address: [email protected]. Please put “Consultancy for final PRM project evaluation – [name of consultant]” in the subject.

Deadline for submission of applications: Sunday, July 9th, 2023 @ 17:00 PM (Amman Local Time)

Applications submitted after the deadline (day or hour) will not be considered. Selected consultants will be invited for an interview. Also, candidates who only submit resumes without technical and financial offers will not be considered.

Humanity & Inclusion is committed to protecting the rights of children and opposes all forms of child exploitation and child abuse. HI, contractors must commit to protecting children against exploitation and abuse.

Persons with disabilities are particularly encouraged to apply.

1. Appendices

• HI’s Quality Framework, on which all evaluators must base their evaluation.

https://hinside.hi.org/intranet/upload/docs/application/pdf/2022-12/posterqualityframeworkhi_pqp_en.pdf

• The Disability – Gender – Age Policy, which must guide the approach and the construction of evaluation tools in the technical offer.

https://hi.org/sn_uploads/document/IP_DisabilityGenreAge_1.pdf

How to apply

Bids must be sent by email to this address: [email protected]. Please put “Consultancy for final PRM project evaluation – [name of consultant]” in the subject.

Deadline for submission of applications: Sunday, July 9th, 2023 @ 17:00 PM (Amman Local Time)

Applications submitted after the deadline (day or hour) will not be considered. Selected consultants will be invited for an interview. Also, candidates who only submit resumes without technical and financial offers will not be considered.

Humanity & Inclusion is committed to protecting the rights of children and opposes all forms of child exploitation and child abuse. HI, contractors must commit to protecting children against exploitation and abuse.

Persons with disabilities are particularly encouraged to apply.