International Organization for Migration
Vacancy Notice Number: CON#/2023/015
Position Title: Consultant (External Evaluator)
Classification: Consultancy Contract
Duty Station: Gaziantep, Türkiye
Deadline of Applications: 25 December 2023
Number of People to be hired: 1
Eligibility: Internal & External Candidates
General Functions:
Established in 1951, the International Organization for Migration (IOM) – the UN Migration Agency, is the leading inter-governmental organization in the field of migration and works closely with governmental, intergovernmental, and non-governmental partners. With 174 Member States, eight states holding observer status and offices in over 100 countries, IOM is dedicated to promoting humane and orderly migration for the benefit of all.
IOM Türkiye addresses the full scope of migration issues, supporting and developing government capacity to manage migration. IOM first opened its offices in Türkiye in 1991, and partnership with the Republic of Türkiye was formalized in November 2004 when Türkiye was granted member status to IOM. With over 25 years of operational experience in Türkiye, the Mission is now one of the largest globally and has over 1200 staff working across the country, with sub-offices in Istanbul, Gaziantep, Hatay, Şanlıurfa and Izmir and head office in Ankara.
The IOM Development Fund-funded project “Türkiye: Resilience Innovation Facility” aimed to empower refugee, migrant and host community youth in Gaziantep through services and networks provided by the Resilience Innovation Centre (RIF). The RIF, which was established inside the premises of Gaziantep University (GU), is jointly managed by GU and IOM with the support of Gaziantep Metropolitan Municipality. While the facility adopted an open-door policy to make its various digital and computer-assisted equipment accessible to the target groups, it also delivered a series of targeted training and mentorship programmes to selected youth beneficiaries to support the development of innovative project and business ideas. Linkages have also been established with other organisations, in both the humanitarian and private sectors, to promote knowledge sharing and to explore possibilities for responding to humanitarian and commercials needs; an avenue that may contribute to the sustainability of the initiative.
Specifically, the objective of the project is to contribute to a multi-stakeholder approach in empowering refugee, migrant and host community youth in Gaziantep through services and networks provided by the Resilience Innovation Centre (RIF) for invention, innovation, learning and livelihood creation. This objective was to be achieved through three outcomes:
1. The University of Gaziantep establishes and sustains the Resilience Innovation Facility (RIF) for invention, innovation, learning and livelihood creation for refugee, migrant and host community youth.
2. Refugee, migrant and host community youth trained at the Resilience Innovation Facility (RIF) use their acquired skills and knowledge to develop innovative projects and businesses.
3. The Resilience Innovation Facility (RIF) responds to the demands of various sectors including humanitarian and private sectors and paves its way forward.
Evaluation purpose and objective
This evaluation is being conducted in accordance with the evaluation guidelines of the donor, the IOM Development Fund (the Fund), which calls for an ex-post evaluation of the project to be carried out 12 months after the end of the project.
Through the lens of the OECD-DAC evaluation criteria (relevance, coherence, efficiency, effectiveness, impact, and sustainability), the purpose of this external ex-post evaluation is to assess the impact of the project, including positive and negative, direct and indirect, intended and unintended effects. In considering the impact, the evaluation will also assess how efficiently results were achieved, how effectively activities were planned and implemented and how any operational or coordination challenges that emerged were addressed.
The evaluation is expected to generate insights and guidance for further development of the project concept and overall objective, and the evaluation report should include recommendations on the project coordination structure and related monitoring systems.
The evaluation is being commissioned in accordance with the Evaluation Guidelines of the IOM Development Fund. The Guidelines require all funded projects to include an evaluation after 12 months of completion, with a view to assessing the relevance of project design, the coherence of the intervention vis a vis other interventions, the project’s effectiveness and performance, the efficiency of project management and implementation, and the impact and sustainability of the project.
The results of the evaluation will be used by the IOM management in the Mission for consideration in ongoing and future projects, in coordination with the project partners, and the Fund.
Evaluation scope
The evaluation will cover the full timeframe of the project period from 01 February 2021 to 31 January 2023, with a focus on the Gaziantep province of Türkiye, where the project was implemented. The evaluator will use inclusive and participatory approaches to cover relevant stakeholders, which will include IOM staff in the country office, governmental focal points in Türkiye, and implementing partners and beneficiaries from different activities.
Evaluation criteria
The ex-post project evaluation will use the six OECD-DAC evaluation criteria: relevance, coherence, efficiency, effectiveness, impact, and sustainability. The evaluation will also consider the cross-cutting issues of environment, gender and human rights.
Evaluation questions
The following key questions will guide the evaluation, subject to discussion and confirmation with the selected evaluator, considering feasibility within the timeframe available.
Evaluation Criteria:
Relevance: assessing to what extent the project’s objective and intended results remain valid and pertinent either as originally planned or as subsequently modified.
Evaluation Questions:
- To what extent was the action, its objective and targets relevant to the national context, including the Government of Türkiye’s strategies and priorities?
- Did the project respond to the needs of the target groups?
- Did the project correspond to IOM global, regional, and national strategies and priorities?
- Were the project activities and outputs consistent with the intended outcomes and objectives?
- Was the project relevant for the identified need?
Evaluation Criteria:
Coherence: the compatibility of the intervention with other interventions in the country, sector or institution.
Evaluation Questions:
- To what extent was this project coherent with other IOM interventions in this area?
- How does this project align with and complement other related initiatives implemented by the government, or other national and international actors?
- What other synergies and linkages with authorities, partners and other stakeholders could be made in future interventions?
Evaluation Criteria:
Effectiveness: assessing the extent to which the project achieves its intended results.
Evaluation Questions:
- Was the project effective in achieving planned results?
- Do the results respond to the needs of all stakeholders, men, women and other key groups, including persons with disabilities, as identified at the design stage?
- Are the target beneficiaries satisfied with the services provided?
- What were the major factors influencing the achievement of the project’s expected outcomes?
- To what extent did the project adapt to changing external conditions to ensure project outcomes?
Evaluation Criteria:
Efficiency: assessing how well human, physical, and financial resources are used to undertake activities and how well these resources are converted into outputs.
Evaluation Questions:
- To what extent were resources adequate to implement the activities and achieve the outputs?
- Did the project have the necessary coordination mechanisms and communication flow to ensure that the allocated resources were efficiently converted into the expected outputs?
Evaluation Criteria:
Impact: assessing the positive and negative, primary, and secondary long-term effects produced by a project, directly or indirectly, intentionally, or unintentionally.
Evaluation Questions:
- Which positive/negative and intended/ unintended effects could be observed in the project? To what extent did the project contribute to those changes, considering also other contributing factors?
- Did the project take timely measures for mitigating any unplanned negative impacts?
Evaluation Criteria:
Sustainability: assessing to what extent the project’s results will be maintained for a certain period of time after the current project is phased out.
Evaluation Questions:
- Were structures, resources, and processes in place to ensure that benefits generated by the project continue once external support ceases?
- How far was the project embedded in local/national institutional structures that are likely to survive beyond the life of the project?
- Do the project partners have the financial capacity and commitment to maintain the benefits of the project in the long run?
- Did the project strengthen national and/or local capacities (governmental and non-governmental) to generate livelihood opportunities through innovation?
Evaluation Criteria:
Cross-cutting issues
Evaluation Questions:
- To what extent have environment, gender and human rights considerations been integrated into the design, planning and implementation of the project?
Evaluation methodology
An inception report will be prepared by the Evaluator and shared with the IOM team within two weeks after the start of the assignment. The report should include an evaluation matrix, evaluation methodology, work plan, interview guide, other data collection instruments to be used for the evaluation, and a timeline. IOM can provide templates for an Inception Report and for an Evaluation Matrix for reference. The Evaluation Matrix will demonstrate the Evaluators’ understanding of the ToR and outline data collection and analysis plans, to be completed and reviewed with the Evaluation Manager prior to the field work. The Evaluator may use their own format, but it should include all the elements of the IOM templates.
Following data collection, the Evaluator will prepare a short PowerPoint presentation of the initial findings, conclusions, and recommendations. This will be used to debrief the IOM team to identify and address any misinterpretations or gaps.
A draft report will be shared with the IOM team, building on the debrief and initial feedback. The IOM team will review and provide feedback on the report. The feedback will be provided on technical aspects and not on the findings, conclusions, or recommendations. The Evaluator will make factual corrections to the report.
A final report will be prepared and shared with the IOM team. IOM can provide a template for an evaluation report. The Evaluator may use their own format, but should include all of the elements of the IOM template: an executive summary, list of acronyms, introduction, evaluation context and purpose, evaluation framework and methodology, findings, conclusions, and recommendations. Annexes should include the TOR, inception report, list of documents reviewed, list of persons interviewed or consulted, and data collection instruments.
A two-page evaluation brief will be prepared by the external Evaluator to share the key findings, conclusions, and recommendations. IOM’s template will be provided to prepare the brief.
A presentation of findings should be conducted by the evaluator upon finalisation of the report in order to communicate the key findings and recommendations with relevant stakeholders.
Finally, the Evaluator will prepare a draft management follow up response matrix (template to be provided by IOM) by inserting the recommendations as well as an indicative timeframe or deadline for implementation.This will later be finalized by the IOM team.
All deliverables are to be written in English. The final report should meet the standards laid out in the UNEG Quality Checklist for Evaluation Reports.
Specifications of roles
The roles of each party are as follows:
- External Evaluator
- Implement the data collection, analysis, and reporting activities of the final evaluation.
- Flag any challenges or emerging issues to the project team.
- Prepare and deliver the inception report, debrief session, final report, two-page evaluation brief and the visual presentation of the evaluation of the findings and recommendations.
- Evaluation Manager (Programme Coordinator (Recovery and Stabilisation)
- Oversee the general process of the final evaluation.
- Act as the primary point of contact with the evaluator, including facilitating communication as needed between the evaluator and the program team.
- Coordinate communication with and feedback from the MEAL Unit and other relevant internal units.
- MEAL Unit
- Contribute to overseeing the evaluation process.
- Help address any challenges or emerging issues flagged by the evaluator.
- Provide feedback on the deliverables submitted by the external evaluator.
Time Schedule
The final evaluation is expected to take 35 working days for the consultant, including preparation, data collection, analysis, and reporting. The Evaluator should be able to undertake some of the tasks concurrently to fit within the planned timeframe without compromising the quality expected. The assignment is expected to be conducted between 12/02/2024 – 29/03/2024.
Activity: Kick-off meeting, exchange of relevant project documents. Review of documents and preparation of a detailed inception report, including the evaluation matrix and the data collection tools.
Days: 5
Responsible: Evaluator
Location: Home-based
Weeks: 1
Activity: Finalize the inception report and the field visit agenda
Days: 5
Responsible: Evaluator, in coordination with the IOM Team
Location: Home-based
Weeks: 2
Activity: Planning and facilitation of the data collection activities, including pre-testing, logistical arrangements, and schedule.
Days: 7
Responsible: Evaluator, in coordination with the IOM Team
Location: Gaziantep
Weeks: 3-4
Activity: Preliminary data analysis, preparation of the presentation, and deliver the presentation to the IOM team
Days: 3
Responsible: Evaluator
Location: Gaziantep
Weeks: 4
Activity: A draft evaluation report
Days: 8
Responsible: Evaluator
Location: Home-based
Weeks: 5
Activity: Submission of the Final evaluation report
Days: 5
Responsible: Evaluator
Location: Home-based
Weeks: 6
Activity: Development and finalization of the evaluation brief, both in English, and the draft management response matrix. Delivery of final presentation.
Days: 2
Responsible: Evaluator
Location: Home-based
Weeks: 7
Evaluation budget
Payment of fees will be made according to the following schedule.
Deliverables: Inception Report
Amount to be paid: 15%
Deliverables: Draft Final Report
Amount to be paid: 35%
Deliverables: Final Report
Amount to be paid: 50%
Required Qualifications:
IOM Türkiye is seeking an independent, multidisciplinary external evaluator.
Education:
- At least a bachelor’s degree in International Relations, Public Administration, Social Policy, Psychology, Sociology and other related fields.
Experience:
- Experience in conducting at least three evaluations of large-scale projects comparable to the one to be evaluated.
- Strong background and expertise in conducting quantitative and qualitative data analysis.
- Demonstrated sound understanding of migrant’s thematic topics, e.g., migration governance, labour migration, trafficking in persons, crisis management, border management, etc.
- Experience working with IOM is an advantage.
- Excellent analytical, oral, and written communication skills in English.
- Experience with collecting data in difficult circumstances.
- Ability to create graphic visuals on key findings.
- Experience in technical and analytical report writing.
- Experience in leading an international evaluation project.
- Experience in working in complex institutional environments.
- Displays cultural, gender, religion, race, nationality and age sensitivity and adaptability.
- Ability to work with minimal supervision and to meet deadlines.
Languages:
- Fluency in English is required.
- Working knowledge of Turkish is advantageous.
Required Competencies
The incumbent is expected to demonstrate the following values and competencies:
Values
- Inclusion and respect for diversity: respects and promotes individual and cultural differences; encourages diversity and inclusion wherever possible.
- Integrity and transparency: maintains high ethical standards and acts in a manner consistent with organizational principles/rules and standards of conduct.
- Professionalism: demonstrates ability to work in a composed, competent and committed manner and exercises careful judgment in meeting day-to-day challenges.
Core Competencies – behavioural indicators level 2
- Teamwork: develops and promotes effective collaboration within and across units to achieve shared goals and optimize results.
- Delivering results: produces and delivers quality results in a service-oriented and timely manner; is action oriented and committed to achieving agreed outcomes.
- Managing and sharing knowledge: continuously seeks to learn, share knowledge and innovate.
- Accountability: takes ownership for achieving the Organization’s priorities and assumes responsibility for own action and delegated work.
- Communication: encourages and contributes to clear and open communication; explains complex matters in an informative, inspiring and motivational way.
Other:
The consultant must adhere to the International Organization for Migration (IOM) Data Protection Principles (IN/138) and maintain confidentiality.
The consultant will be responsible to follow IOM writing guidelines and latest glossaries in all given assignments for accurate translation.
Any offer made to the candidate in relation to this vacancy notice is subject to funding confirmation. Appointment will be subject to certification that the candidate is medically fit for appointment, accreditation, any residency or visa requirements, and security clearances.
How to apply
Interested candidates are requested to submit their application including the most recent CV with a cover letter in English with contact details (name, position, phone and e-mail details) of three references by indicating name of the position applied with its VN number in the subject line of the e-mail to [email protected] or to IOM Birlik Mahallesi Sehit Kurbani Akboga Sok. No:24 06610, Çankaya, Ankara Türkiye by the end of 25 December 2023.
Please note that only shortlisted candidates will be contacted.