RFP-IRQ-CO-2022-008-End of Project External Evaluation

Terms of References for External Evaluation –Economic Recovery Program

Promoting Self-Reliance & Improving Access to Livelihoods Opportunities for Displacement-Affected Iraqi & Syrian Households in Salah al-Din, Diyala, Erbil, & Dohuk Governorates, Iraq

These TORs are open for qualified national and international individual consultants or independent firms.

Project title

Promoting self-reliance and improving access to livelihoods opportunities for displacement-affected Iraqi and Syrian households in Salah al-Din, Diyala, Erbil, and Dohuk Governorates, Iraq

Donor

US State Department Bureau of Population, Refugees, and Migration

Project location

Iraq—Salah Al-Din, Diyala, Erbil and Dohuk

Project duration

30 September 2020 To 29 September 2022

Evaluation to be conducted in

Evaluation owner

DRC Iraq

Evaluation Manager

Country MEAL Manager as Evaluation Manager and Country Economic Recovery Coordinator

Evaluation Team

TBD by selected company

Type of evaluation

End of Project External Evaluation

Evaluation Trigger

DRC Evaluation Policy, performance and lessons learned about the project implemented by DRC, contractual obligation

Implementing Partners

Not Applicable

1. Context

As Iraq enters 2022, the humanitarian context is paradoxical and evolving. Many gains and positive developments continue, slowly bringing millions previously affected by the Islamic State of Iraq and the Levant (ISIL) and related counter-military operations back towards parity with other Iraqis. Yet, simultaneously, humanitarian needs and displacement remain stubbornly persistent for a relatively small but deeply vulnerable portion of the population. It has been eight years since the first emergence of ISIL. The intervening years have been filled with horrific suffering, widespread destruction, the fraying of a diverse social tapestry, and the internal displacement of some 6 million Iraqis. More recently, these years have given way to a new – albeit tenuous – hope for the future, as the country progresses towards recovery. Of the 6.1 million people displaced during the ISIL crisis between 2014 and 2017, 4.9 million people have returned while 1.2 million remain displaced, the vast majority of whom (1 million people) are displaced outside of formal camps. Based on the revised approach to assessing humanitarian needs, 2.5 million IDPs and returnees remain highly vulnerable and in humanitarian need. This includes all IDPs who live in camps (180,000), just over half of out-of-camp IDPs (549,000), and one third of all returnees (1.7 million)[1]. Of these, about 961,000 people face acute humanitarian needs, reaching extreme or catastrophic levels. In crisis-affected governorates such as Salah al-Din and Diyala, conflict and displacement affected market systems and pre-crisis livelihoods patterns. This is further exacerbated by limited availability of services, infrastructure damage, and outdated administrative and regulatory systems. Access to livelihoods opportunities is one of the major factors determining severity of needs among returnees.

For Syrian Refugees, as of 31 March 2022, 257,974 (79,185 households) Syrian refugees reside in Iraq. Although returns to Syria were recorded in 2020, including during the intermittent border openings during the pandemic, large-scale returns of Syrian refugees living in Iraq are unlikely in the near future, based upon return intention preliminary Multi-Sector Needs Assessment (MSNA) findings. Despite the challenging political climate in Iraq, the current economic downturn and the COVID-19 situation, the protection environment in the KR-I, where the vast majority of refugees in Iraq resides, remains favourable, despite some challenges as a result of COVID-19 related movement restrictions, particularly the closure of the border with Syria. However, the absence of an effective legal framework for refugee protection in Iraq continues to preclude longerterm residency rights and other legal benefits for Syrian refugees. The difficult economic situation has negatively affected the livelihood opportunities of Iraqis and Syrian refugees alike and stretches the existing public services. Lack of access to sustainable employment and livelihood opportunities remains the main vulnerability reported by Syrian refugees and the root cause of protection issues, such as child labour and child marriage. It also led to refugees seeking relocation to camps and not being able to cover costs related to multiple needs, such as renting adequate accommodation, purchasing food for the household, ensuring children’s school attendance, and accessing adequate healthcare services. Research in Iraq by the Durable Solutions Platform found that livelihoods opportunities are Syrian refugees’ biggest need—and greatest obstacle—to achieving meaningful local integration.[2] Today, 38% of Syrians in KRI live below the poverty line.[3] Displacement-affected Iraqis face similar challenges.

1. Project Summary[4]

The project aims to promote self-reliance and livelihoods opportunities for displacement-affected IDPs, returnees, Syrian refugees, and vulnerable host communities in Erbil, Dohuk, Salah al-Din and Diyala governorates. It is designed to serve as a bridge between humanitarian assistance and longer-term recovery and development strategies by identifying entry-points to assistance for households at different vulnerability stages: addressing basic needs and reducing reliance on negative coping strategies for extremely vulnerable households, and job creation and income generation for vulnerable households. This will result in participants having improved capacity to start their own business and generate sustainable income and/or improved work skills and access to the labor market through wage employment. The continuum of support allows the extremely vulnerable to graduate to job-creation and income generation assistance, thus strengthening the overall resilience and the self-reliance of crisis-affected communities.

The project includes:

Objective 1: Vulnerable displacement-affected refugees and IDPs/returnees have improved capacity to start their own business and generate sustainable income

• Provision of business development support (BDS) training to micro, small and medium enterprises (MSMEs)
• Provision of business development grants to micro, small and medium enterprises (MSMEs)
• Provision of business advisory support and coaching
• Information provision and legal support to enterprises

Objective 2: Vulnerable individuals have improved work skills and access to the labor market through wage employment

• Provision of Soft Skills Training and Complementary Skills for employment
• Facilitation of Job placements with private sector
• Information provision and legal support to employers and job seekers

Objective 3 ((Graduation approach): Extremely Vulnerable households have reduced reliance on negative coping strategies Provision of financial health encouragement

• Provision of multi-round emergency cash
• Enrolment of beneficiaries into business support or wage employment activities

1. Targeted Group

The intervention provides comprehensive livelihoods assistance to 1,670 displacement-affected Iraqi and Syrian refugee households, benefitting 10,020 individuals. Reflecting the current context—where returnees now exceed IDPs, DRC targets IDPs and returnees (approximately 60% of total beneficiaries) and Syrian refugees in the KRI (30%). DRC includes approximately 10% vulnerable host households, an important measure for ensuring social cohesion and avoiding harm. Considering the demographic composition of the four target governorates, DRC works with vulnerable conflict-affected Iraqi households in Diyala and Salah al-Din. In Dohuk and Erbil (KR-I), DRC’s intervention solely target vulnerable Syrian refugees referred by UNHCR.

1. Scope of Evaluation

DRC Iraq is seeking to conduct an external evaluation with an overall objective of generating evidence to inform DRC’s Economic Recovery programming to ensure that the programme interventions are relevant to the context, needs and overall project performance is satisfactory and have made a contribution to its objective. During the evaluation, apart from evaluating the performance of project, DRC will be capturing lessons learned and best practices as a continuous part of learning process to refine//re-design its strategy to sustainable livelihoods and durable solutions. Through this evaluation, DRC expects to revisit its programming modalities for economic recovery program in relation based on evidence generated throughout the current programming and external evaluation conducted for the previous action, thus is it is expected that this evaluation will be instrumental to validate the economic recovery programme strategy. The scope for evaluation is determined using OECD-DAC criteria, i.e., Relevance, Effectiveness, Impact, Efficiency, Sustainability and Coherence. Details of each criterion are given in the section H.

1. Specific inquiry areas on program modalities

It is expected to evaluate each modality of the economic recovery project separately with application of OECD-DAC criteria and also making comparative analysis of each in relation to the effectiveness, impact, sustainability, longevity, durability and appropriateness to target population, needs and context. DRC Iraq expect from consultant to propose a methodology which provides recommendation for future strategic direction based on the lesson learned and best practice from project implementation. Some primary focus areas of interest and inquiry questions includes, but not limited to; (These questions serve as guidance to develop evaluation methodology and needs to be expanded in evaluation tools)

1. Graduation approach (Consumption assistance with livelihoods support): How appropriate was consumption support under graduation approach in terms of its transfer value, frequency of transfer, time-period, vulnerabilities, capacities of the target beneficiaries? What has been the impact and sustainability of the intervention for different categories of the target population according to gender, age, status and disability. Evaluation should provide recommendations of existing model and what revisions and improvement should be brought to all these elements.
2. Business Grants: How successful was the business development support for micro, small and medium scale businesses? Specific questions of interest under this evaluation includes, the business grant transfer value appropriateness, market relevance of supported businesses, market saturation effects due to new businesses, and suitability of target beneficiaries to business grant support. Also, the evaluation should investigate the relevance and impact of business and financial management trainings, coaching and advisory support. What has been the impact and sustainability of the intervention for different categories of the target population according to gender, age, status and disability. Recommendations should provide practical and realistic refinements to existing approaches.
3. Job placement: To what extend the employability trainings, linkages with private sector for job placement, terms of negotiation, and salary’s subsidies were appropriate. What is the scalability, sustainability of the approach and to what extent the approach has gained acceptance at beneficiary and employer’s level? What has been the impact and sustainability of the intervention for different categories of the target population according to gender, age, status and disability
4. Specific objectives

The following are the specific objectives of the evaluation:

1. To assess the performance of the project against key evaluation criteria for all the project activities implemented by DRC;
2. Evaluate the relevance and appropriateness of existing programming modalities to diverse population needs (Based on Age, Gender, displacement status, disability status – AGD), priorities and capacities of target population in terms of sustainability, participation, and achieving self-reliance.
3. Evaluate assistance modalities implemented under this project, i.e., business grants, job placement, graduation approach, and provide recommendations for expansion, continuity or scale-down of specific modalities with AGD inclusion lens.
4. Assess the project implementation in relation to participation of project beneficiaries, communities, market actors in decision making through relevant mechanisms established by DRC
5. Identify lessons learned and best practices in programming implemented by DRC and partners;
6. Provide recommendations based on findings for DRC, and other relevant stakeholders.
7. Identify and assess key internal and external factors that have contributed to, affected, or impeded the achievements of the project, and how DRC have managed these factors.
8. Timeframe of the project

External evaluation will be looking at the project implementation period from 30th September 2020 to 30th April 2022 across the project locations.

1. Intended Users of Evaluation Findings and Recommendations

This external evaluation will be shared with DRC Iraq internally, with donors and other livelihood actors in Iraq. The intended users of the evaluation are DRC Senior Management Team, Economic Recovery Coordinator, Economic Recovery Program Managers, Area Managers, MEAL Department.

1. Evaluation criteria and key questions to be addressed in the evaluation

DRC will conduct the evaluation considering the following six criteria: Relevance, Effectiveness, Impact, Efficiency, Sustainability and Coherence.

Relevance/Appropriateness

Is the intervention doing the right thing?

• To what extent were the project design, objectives and interventions valid or in line with the needs of people and context specific? How needs-based, context-adapted, and capacity-conscious was the design of the programme?
• Are the activities and outputs of the programmes consistent with the overall goal and the attainment of its objectives? How appropriate was DRC’s programme design and implementation structure?
• How relevant were the livelihoods assistance modalities to the identified needs of diverse population groups in terms of vulnerability status, capacities, market situation and the context?
• How relevant and appropriate were project activities to the needs of different targeted groups, e.g., male, female, persons with disabilities in targeted communities (please distinguish between gender, age, persons with dyabilities, displacement status (IDPs, Syrian Refugees, returnees, and host communities) given their socio-economic circumstances and priorities?
• To what extent have the key contextual changes, threats and opportunities that arose during implementation influenced and informed project implementation?
• How appropriate were DRC’s beneficiaries’ participation and complaints and feedback mechanisms to the context?
• How and to what extent were monitoring and research findings used to inform decision-making and the improvement of project implementation by DRC and partners?

Coherence

How well does the intervention fit?

• To what extent does the project complement existing interventions in the country as well as government policies and strategies? To what extent was the project coordinated with other relevant actors?
• To what extent were government stakeholders consulted in the design of the project, and how was it coordinated with them to improve complementarity and coverage?

Effectiveness

Is the intervention achieving its objectives?

• To what extent were the objectives achieved / are likely to be achieved? What were the major factors influencing the achievement or non-achievement of the objectives?
• How effective was DRC’s response within economic recovery program with reference to intervention modalities (Employability and business development trainings, Business grants, job placement, graduation approach, private sector engagement, legal awareness, livelihoods counselling, coaching and mentoring) and intended results?
• Was the economic recovery’s staff structure, including overall management structure, appropriate to deliver effective implementation? What are the recommendations in terms of structure for similar programs?
• How were beneficiaries selected and were they informed of the selection criteria or participation in the programme/projects? How effective were the selection criteria in reaching the most vulnerable populations for different activities?
• Were there any risks inherent to the duration of the project, either in the course of or towards the end of the intervention?

Impact

What difference does the intervention make?

• Analyse the contribution of the project to any observed impact (intended, unintended, positive, negative) and analyse what other actors and factors contributed to the impact. What real difference has the intervention made to the beneficiaries?
• Determine the scale, longevity, and durability of the impact on economic situation of the beneficiaries assisted under this project through various modalities and distinguishing according to age, gender, displacement and disability status.
• Make a comparative analysis of different modalities (Business grants, job placement, graduation approach) to determine the impact of individual approaches on people socio-economic conditions with recommendation of modalities for future scale-up/down, continuity and improvements.
• What were the intended and unintended effects of the programme, and how do they relate to the principal objective? Did all intended beneficiaries benefit equally from interventions as per their needs?

Sustainability

Will the benefits last?

• To what extent are the benefits of the project likely to continue after donor funding ceases? Did the project plan and implement an adequate transition and exit strategy that ensures longer-term positive effects and reduces risk of dependency?
• What were the major factors which influenced the achievement or non-achievement of sustainability of the project?
• Are the assisted population groups more resilient (in line with the project results) than before (applying AGD lens to indicate differences for men, women, youth, adult, persons with disabilities, persons of different displacement status)?

Efficiency

How well are resources being used?

• Were the interventions cost-efficient? Were the objectives achieved on time? Was the programme or project implemented in the most efficient way compared to alternatives?
• How efficient were the management structures and the implementation modalities in terms of timeliness of delivery and cost-effectiveness of the interventions?
• Was the project implemented based on the best use of existing resources/capacity, e.g. the capacity internal capacity and expertise of DRC? What key limitations existed on this front? What could DRC’s future projects do to increasingly develop and invest in existing resources?
• What cost-effective alternatives could have been used?

1. Methodology

DRC is committed to conduct evaluation in line with the principles of ethics in evaluation, i.e. Integrity, Accountability, Respect and Beneficence. DRC consider engaging the beneficiaries and stakeholders in line with the OECD DAC Quality Standards for Development Evaluation. DRC will use quantitative and qualitative methods using both primary and secondary data collection techniques. The evaluation firm/individual consultant is expected to develop a detailed and robust methodology upon their selection (to be approved by DRC Iraq) to generate representative sampling size and credible findings. The evaluation methodology should also make use of existing monitoring and research studies data already generated by DRC Iraq programme. It is expected that individual firms will use desk review and in-depth analysis of existing reports and monitoring data to minimize the challenge of primary data collection because of in place travel restrictions and social distancing. It is also anticipated that this evaluation will be a participatory review and learning exercise.

Thus, it requires the consultant(s)/firms to be experienced in participatory approaches to learning and inquiry, and especially in seeking the views and perceptions of key stakeholders that include:

1. Targeted beneficiaries
2. Actors directly involved in the project at different levels:
   • The service providers, i.e., training institutes
   • Community leaders (if applicable) and representative of people of concerns
   • Local authorities
   • Private sector partners
   • External livelihoods actors
   • donor staff and representatives, if available
3. DRC staff involved in the implementation of the project (e.g., area managers, program managers, coordinators, and other field teams)

In addition, the following should be taken into consideration:

• That the method(s) and approach chosen are relevant to the objective of the evaluation
• That the individuals to be consulted during the evaluation are relevant to the focus of the evaluation
• That evaluation samples are representative of men, women, persons of different age groups (youth, adults), displacement and disability status to allow for comparative analysis
• That the method(s) and approach chosen allows for source and method triangulation of findings
• That the beneficiaries are consulted only if relevant to the evaluation questions
• That collection of data that is not used and not relevant to the evaluation is avoided
• That the method and approach chosen are ethically sound and culturally sensible
• That the data privacy and security is sole responsibility of the contractor.

Note: Individual consultants or firms who are operational and aware of the local context in Iraq will be given priority

1. Timeframe of evaluation

The evaluation will be carried out between for period of 45 calendar days starting on mid of Aug 2022 to 29th September 2022 tentatively, with the final report submitted to DRC as per agreed timeline within the contractual obligation. The exact dates will be negotiated with final selected firm or consultants. Deadlines agreed with the selected consultants/firms will be non-negotiable.

1. Reporting

Selected consultant or firm will report directly to MEAL Manager and Economic Recovery Coordinator and will work closely with Area Managers, and Economic Recovery Programme Managers in targeted locations throughout the evaluation process.

1. Evaluator’s qualifications and expression of interest

The evaluation consultant team or firm should have the following expertise and skills:

• Extensive expertise in evaluations of complex programmes in humanitarian context and minimum three or more than three years of experience in conducting complex evaluation studies that include economic recovery programming consisting of livelihoods graduation programming, small business development and trainings, job placement, and private sector engagement.
• Proven experience of conducting evaluation studies with international humanitarian organisations and knowledge of economic recovery sector;
• Proven experience in the use of quantitative and participatory qualitative methods for data collection and analysis including remote data collection and remote management of evaluation.
• Knowledge of ICT tools for mobile data collection.
• Excellent writing and communication skills in English.
• Master’s degree in social sciences, development studies, economics or another relevant academic discipline for the team leader and at least a first degree for the other team member(s);
• Understanding of data collection ethics including GDPR (Global Data Protection Regulations)

The following are desirable:

• Familiarity with the humanitarian response to the conflict and with Iraq context
• Proficiency of field staff in Arabic and Kurdish language
• Familiarity with DRC programs and operations.

1. Expected outputs /Evaluation deliverables

The following are the expected deliverables of the evaluation.

1. Inception Report: Inception report will be submitted to DRC in 15 days after signing the contract with a clear evaluation methodology, timeline, and data collection tools. Inception report will need to be endorsed by DRC before data collection starts.
2. First Draft of Evaluation Report: Consultant/Firm will prepare the first draft evaluation report in English and will share with DRC (between 35 to 50 pages excluding annexes, including executive summary not exceeding 2 to 3 pages). Feedback from DRC will be provided within one (1) week after the submission of the draft report. Minimum guidelines on the evaluation report:
   1. The report should systematically answer the key questions posed;
   2. It should fairly and clearly represent the views of the different actors/stakeholders;
   3. It should give the conclusions of the evaluator in a way that is clear and substantiated by the collected evidence.
3. Evaluation Management Response Plan: Evaluation team will include all key findings in the management response plan for the team to prepare a management response plan to be presented in the debrief meeting by DRC team.DRC will share the management response plan template.
4. Evaluation Debrief Meeting: A remote or in person debrief meeting/workshop will be conducted by the selected firm or consultant to present the draft findings of the evaluation, and to give feedback to extended SMT.
5. Final Draft Evaluation Report: A final draft of the evaluation report will be shared within 7 days after the debrief meeting with DRC and partner staff. It will include changes/modifications, agreed between DRC and the consultant/firm.
6. Lesson Learned Note and Quality of Evidence Checklist: Two separate annexes will be prepared along with the final evaluation report, i.e. DRC lesson learned note and and checklist for assessing the quality of evidence. DRC will share the templates for both annexes.

• Codes of Behaviour

The evaluation process will be directed by DRC’s policy for ethical conduct of evaluation guiding the evaluation team through careful considerations of the key ethical implications at every stage of evaluation. DRC is also a member of ALNAP (The Active Learning Network for Accountability and Performance in Humanitarian Action) and as such ALNAP’s Evaluation of Humanitarian Action Guide is a core reference when conducting evaluations. Selected consultant or firm will be asked to sign and adhere with the DRC’s Code of Conduct.

1. Disclosure

Under the terms of reference, the consultant is not authorized to make any commitments on behalf of DRC. All data collected as part of this consultancy belongs to DRC and public dissemination of the data and evaluation products can only be done with the written consent of DRC.

[1] Iraq HRP 2022

[2] Durable Solutions Platform, Far from Home: Future Prospects for Syrian Refugees in Iraq, January 2019.

[3] Regional Refugee and Resilience Plan 2020-21 to Syria Crisis.

[4] Currently project is ongoing. DRC will share the proposal and progress updates with final selected consultant or firm.

How to apply

Interested bidder/s to reach out to [email protected] to get full package.

Email submission

Bids can be submitted by email to the following dedicated, controlled, & secure email address:

[email protected]

When Bids are emailed the following conditions shall be complied with:

• The RFP number shall be inserted in the Subject Heading of the email
• Separate emails shall be used for the ‘Financial Bid’ and ‘Technical Bid’, and the Subject Heading of the email

shall indicate which type the email contains

• • The financial proposal shall only contain the financial proposal,
    – The technical proposal shall contain all other documents required by the tender, but excluding all pricing information
• Bid documents required, shall be included as an attachment to the email in PDF, JPEG, TIF format, or the same type of files provided as a ZIP file. Documents in MS Word or excel formats, will result in the bid being disqualified.

Email attachments shall not exceed 4MB; otherwise the bidder shall send his bid in multiple emails