The Organisation

Plan International is an independent child rights and humanitarian organisation committed to ensuring children live a life free of poverty, violence and injustice. We actively unite children, communities and other people who share our mission to make positive lasting changes in children’s and young people’s lives. We support children in gaining the skills, knowledge and confidence they need to claim their rights to a fulfilling life, today and in the future. We place a specific focus on girls and women, who are most often left behind. We have been building powerful partnerships for children for more than 80 years and are now active in more than 70 countries.

The Commissiong office

Plan International Jordan was established in 2016 and has programmes throughout the country on education, youth empowerment, and protection (CP, GBV, SRHR) in various governorates across Jordan. Plan’s Global Gender Equality and Inclusion policy states that the core objectives of Plan International’s work are to achieve gender equality, promote gender justice, realize girls’ rights and foster an inclusive society. This commitment is reflected in our five-year country strategy, our Values and Behaviours Framework, and our Theory of Change.

We aim to:

• confront and challenge discrimination and human rights violations based on gender. This includes gender-based violence and other forms of exclusion.
• challenge stereotypes and unequal power relations between women, men, boys, and girls to promote gender equality, girls’ rights, and inclusion.
• foster an organisational culture that embraces and exemplifies our commitment to gender equality, girls’ rights and inclusion, while supporting staff to adopt good practices, positive attitudes and the principles of gender equality and inclusion.

Background AND RATIONALe

Jordan faces far-reaching economic and development challenges, mainly due to high youth and female unemployment, demographics, resource scarcity and high numbers of refugees. Policymakers, donors and civil society actors agree that social entrepreneurship offers a compelling and sustainable solution to some of the development problems. However, the right environment must be created for it to flourish. This includes, in particular, appropriate legal frameworks, legalisation, decentralisation and strengthening of support structures, as well as access to finance, education and awareness raising. Both entrepreneurs and support organizations lack the capacity to successfully start and scale SE. Within the education sector and knowledge institutes, entrepreneurship education is not prioritized or highly valued. However, ministries give high priority to job creation initiatives and want to strengthen entrepreneurship and the role of the social economy.

With funding from BMZ and Plan International Germany (GNO), the implementation of a 33-month project, named “Ibtikar”, in partnership with Royal Society for the Conservation of Nature (RSCN), JoWomenomics (JoWo), and Durrat AlManal (DMDT).

Project time period

Three years: 01.12.2021 – 30.08.2024

Project goal

The overall objective of the project is to contribute to poverty reduction and social inclusion of marginalised groups, especially girls and young women in Jordan (In Amman, Irbid, Karak and Ajloun);

Project Objectives

Expected Outcome: The social enterprise ecosystem is strengthened and contributes to economic integration and social inclusion of marginalized groups, in particular girls and young women in Amman, Irbid, Karak and Ajloun.

To reach this objective, the project delivers the following 9 results/ specific objectives:

1. SO1: 100 youth report that they have an employment contract with a duration of at least 3 months.
2. SO2: 100 youth have founded an SE and started business activities.
3. SO3: 12 cooperatives between Syrians and Jordanians have been established.
4. SO4: 400 adolescents have been referred to vocational training opportunities.
5. SO5: 5 existing curricula have been enriched with additional entrepreneurial skills.
6. SO6: The offered education measures of the project centres correspond to a high degree to the job market needs
7. SO7. 4 strengthened support centres (one in each of the project regions) are functioning as SE-support centres and offer qualitative support for SEs
8. Representatives from MoDEE, MIT, MoSD, private sector, SEs and NGOs prepared and adopted a strategy and agreed on a roadmap for SEs in Jordan.
9. The level of engagement of local authorities is classified as high.

Project Locations

East Amman, Irbid, Kerak, Ajloun

Project Target Groups

• Adolescents (16 – 18) and Youth (18 – 35)
• Parents and caregivers
• Community members
• Partner Organisations Staff
• Members of the advisory forum
• Volunteers

Purpose, Objectives, and Use of the study

As part of the monitoring and evaluation framework for the project, the consultant(s) or consulting firm will conduct an endline evaluation and study involving the current participants identified within Plan International Jordan’s project. This endline evaluation and study will fulfil the requirements set by the project donor, BMZ, to assess both the results and implementation processes at the midpoint of the intervention.

The primary objectives of the endline study and final evaluation are to:

• Ensure Accountability: Provide evidence of achievements relative to the project’s planned results, demonstrating accountability to BMZ, project participants, communities, and other stakeholders.
• Update Data: Repeat the baseline and midline studies to gather updated quantitative information on project indicators.
• Document Lessons Learned: Capture and document insights from the implementation experience to inform future work.
• Provide Recommendations: Identify suggestions for enhancing the design, implementation, and processes of similar future interventions.

The endline study and final evaluation study will cover the implementation period of the SOYEE project from December 2021 to August 2024. It should cover all indicators assessed at baseline and midline, plus additional outcome level indicators that were not assessed at baseline and endline, and the overall process should address all project activities in all the regions where it was implemented. The scope of the exercise may be further detailed in the inception report.

The primary objective of the Endline Study are:

• To provide quantitative values for outcome level project indicators at endline, using the same tools developed for the baseline and midline data collection. The list of indicators to be assessed are attached to this ToR.
• Assess the quality of the intervention by responding to specific key evaluation questions (listed below) under the following OECD-DAC evaluation criteria: effectiveness, efficiency, coherence, sustainability and relevance.
• To assess the extent to which the intervention’s approach has been sensitive to issues of gender, power, and inclusion and is geared to respecting the rights of children and young adults and to advancing the rights of children and gender equality.
• To identify recommendations for follow-up phases, scale up and similar projects

Key users of the endline study and final evaluation report

The endline and evaluation study findings will be shared with the following stakeholders:

• Plan International Jordan, Project management staff, project teams, country office leadership;
• Project M&E and Knowledge Management staff;
• Project participants, key local government offices, and relevant line ministries;
• Plan International Germany; and
• The donor: BMZ.

The above stakeholders will use the endline study and final evaluation report to:

• Compare midline indicator values with baseline values and identify achievements and variances against targets;
• Demonstrate accountability to project participants, donors, and other stakeholders;
• Communicate learnings and achievements to project stakeholders, donors, and other stakeholders; and
• To inform the decision-making around course corrections.

Ownership

All documents, data and research related to the project and other information shall remain the property of the Project and shall be treated as confidential by the consultant(s) at all times. They shall not be made available to any third party whatsoever, in any form, without the prior written approval of a properly authorised employee of Plan International. The utilisation of all proposals, plans and reports and other information provided by the consultant(s) to Plan International is the property of Plan International and the use thereof is solely at the discretion of Plan International. All documents and other papers, whether in soft or hard copy and whether containing data or other information, provided by Plan International shall be returned complete to Plan International upon completion of the assignment. All documentation and reports written during and/or as a result of this study, or otherwise related to it in any way, shall remain the property of Plan International and no part shall be reproduced or quoted, or otherwise used in any way except with the prior, express and specific written permission of authorised employee of Plan International.

Key evaluation questions

1. Evaluation Criteria and Research Questions

The research questions addressing the evaluation criteria are as follows:

Evaluation Criteria

Research Questions

Relevance[1]

• To what extent did the project’s objectives respond to the needs of different adolescent groups in the different project locations?
• To which degree is the project designed in line with Plan International Jordan’s Country Strategy
• What are the lessons we can learn from the design of the project in terms of the project relevance?
• To what extent did the project tackle relevant developmental challenges of the target groups?
• Have any changes been achieved in relation to policy / practice / attitudes of decision makers / policy makers etc. in the countries where the project is working?
• Are the project outputs still relevant to the desired outcomes and impacts for the target population?
• Are the project goals and objectives still relevant to the current challenges and opportunities in the project area?

Effectiveness[2]

• To what extent has the project achieved its objectives in an equitable manner for different groups (e.g. girls, boys, women, men, etc)?
• Were there any unintended outcomes, either positive or negative, that have been experienced by project participants in the different project locations*.*
• To what extent is the project being delivered in a safe, accessible, accountable, and participatory manner?
• What were the helping and hindering factors for the implementation? (Systemic factors, individual factors, at community or official levels, etc.) And how did that affect achieving the project’s objective?

Efficiency[3]

• To what extent has the intervention delivered its results in the most economical (time, financial, human,) manner compared to other feasible options?

Impact

To what extent was the overall project objective achieved?

What was the impact of the action?

Sustainability

The extent to which the benefits of a project are likely to continue after support (monetary and non-monetary) has been withdrawn.

Coherence

How does this intervention complement and integrate with other existing programs and initiatives?

IMPORTANT:

• ALL DELIVERABLES ARE TO BE TREATED SEPARATELY AND MAY BE SUBJECT TO CHANGE. QUANTITY OF ITEMS MAY ALSO BE SUBJECT TO CHANGE.
• FULL PRICE BREAKDOWN FOR EACH ITEM MUST BE PROVIDED (AS DETAILED AS POSSIBLE)
• PER EXPERIENCE AND AS PER SIMILAR WORK, KINDLY ADVISE OR PROVIDE ANY ADDITIONAL SAMPLE THAT MAY BE BENEFICIAL OR NECESSARY WITH ITEMIZED PRICING BREAKDOWN ETC. AS AN OPTIONAL ADDITIVE.

APPROACH

Key considerations in report writing:

• Cover page, Plan will provide sample cover sheet for reference.
• Table of contents, list of acronyms, abbreviations and list of tables and charts.
• Executive summary of key findings and recommendations.
• Background information and context analysis presented per key criteria with a brief description.
• End line methodology with clear explanation of sampling and limitations, KIIs/FGDs, participants’ selection and data analysis approach.
• Evaluation findings, analysis, with associated data presented, where appropriate in clear graphs or charts. The findings can include subsections for each research criteria.
• Conclusion and Recommendations.
• The recommendations should be framed according to each section of project.
• Appendices should include raw and clean collected data in Excel format, detailed description of the methodology with evaluation instruments, list of interviewees and signed consent forms, tools, list of key documents.

The report should be submitted electronically in a MS – Word document. The consultant is responsible for English editing and proofreading of the final report, which should be well formatted. The report will be credited to the evaluator and potentially placed in the public domain at the decision of Plan International.

All handwritten and electronic transcripts of interviews and KIIs, hard copies of survey questionnaires, photographs taken during the assessment and any equipment received from Plan for the purpose of the study should be submitted to Plan. Furthermore, all information generated during the evaluation will be the sole property of Plan and is subject to submission to Plan, along with the final report, prior to the end of the contract.

METHODOLOGY

1. Project evaluation methods for data collection and analysis
   1. Data collection methods

Prospective consultant(s) should describe their proposed methodological approaches, aligned with the endline and evaluation study objectives, and provide an overview of data collection, data management, data quality assurance, data protection and data analysis plans, including sampling strategies, validation and reporting approaches. To allow for triangulation of findings, quantitative methodologies should be complemented by qualitative methodologies. Any limitations to the methodologies proposed should be noted, and proposed mitigation measures identified.

For the indicators assessed at baseline and midline the same methodological approach should be used for the endline study. The baseline and midline methodology and tools developed for the baseline and midline study will be shared with the selected consultant(s) upon contract signing.

Sources of data should be properly documented, and data disaggregated by sex, disability, age group, and any other context specific relevant criteria during collection and analysis.

The data collection as well as the analysis should meet the highest level of sensitivity and privacy protection and have a very high standard of data protection put in place.

All suggested tools will be discussed with the project team before finalization and should be shared with the project teams as part of the deliverables. The project team will share all relevant project documents with the consultants. Additional secondary data sources might be used in the document review.

The consultants should further develop their proposed methodology in the inception report.

• Desk Review: The existing project related documents, but not limited to, project proposal, project result framework, project baseline report, mid-evaluation report, project progress reports, project monitoring reports, etc will be reviewed by the consultant team to get data/information around the project implementation approaches, the project relevance, effectiveness, cost-efficiency, best practices, strengths and weaknesses, and key challenges happened during the project implementation.
• Surveys: the survey will be conducted with different groups from both gender and nationality to cover all project locations, the survey is to collect data/ information about the change in knowledge and practices on business plans marketing and so on.
• Focus Group Discussion (FGD): FGDs together will be conducted with groups of projects participants from different locations to gather data/information more detail about the benefits they received from the project, the challenges they are facing with the project; their points of view; and their feedback for future project implementation.
• Key Informant Interview (KII): The KII will be conducted with partner’s staff and project stakeholders, to collect data/information about the project relevance, effectiveness, efficiency, and sustainability, the project implementation approaches, good practices, strengths and weaknesses, key challenges, and lessons learnt.
  1. Sample Size and Recruitment Methods
     1. Evaluation

The consultant(s) is expected to develop and suggest sampling strategies for all proposed methods of data collection, quantitative and qualitative. Sample sizes for quantitative data collection need to be representative of the respective beneficiary population. For any proposed quantitative methodologies, a 95%+ confidence interval level with a 5% margin of error is required for sample size calculations with a minimum disaggregation by gender and age.

b. Endline

For the indicators that were assessed at baseline, the same sampling strategies that were used for the baseline and midline study should be repeated for the endline study. For the indicators that were not assessed at baseline or midline, the consultant(s) is expected to develop and suggest sampling strategies for all proposed methods of data collection, quantitative and qualitative. Sample sizes for quantitative data collection need to be representative of the respective participants. For quantitative methodologies, a 95%+ confidence interval level with a 5% margin of error is required for sample size calculations with a minimum disaggregation by gender and age.

The primary respondents to be involved in the project Final-evaluation should be:

• Youth aged (18-35) years, 100 participants to be included in surveys

• adolescents aged (16-18) years, 235 participants to be included in surveys

• Partners staff, KIIs with two staff from each partner

• KIIs with government representatives

• Four FGDs (one in each location)

  Validation and reporting

It is critical that findings are validated by a representation of all stakeholder groups who participated in the research. For this reason, after data analysis and first drafting of the midline & evaluation study report (also incorporating the desk review), the consultant will conduct a validation workshop for the results. The consultant will consider the validation activity in his/her proposal and financial offer. Plan Egypt and the consultant will agree on the exact scope, level and time of this validation process while refining the detailed implementation plan. The feedback from the validation will be reflected in the draft report submitted to Plan for further feedback and comments to be considered in the final midline & evaluation study report.

Sampling

Table of project population:

CAY Children, adolescents, and young adults

Parents, caregivers, and family members of the above participants

Community members

Volunteers

PNGO staff

Partner Organisation Staff

Advisory Committee members

Dissemination of findings

Finalization of the consultancy, the consultant will share the main findings with the project’s stakeholders and research participants in an audience-appropriate way. The consultant may be asked to present the main findings of the study to stakeholders in different meetings.

Presentation slides with infographic with the evaluation key findings, major data points, actionable recommendations and policy implication

1. Data Entry and Analysis

The consultant team will propose to Plan International Jordan the data entry method for this project evaluation.

In analysing the data, Plan International Jordan expects the data is analysed with disaggregation by gender, nationality, age groups and locations.

Key relationships

The project evaluation report and its annexes will be used by the following organizations and institutions for various purposes:

• Plan International: As the concrete evidence that will inform Plan International Germany and Plan International Jordan’s program management and the project team about good practices, strengths and weaknesses, and lessons learnt that Plan International Jordan can adapt for the rest of project, and future project design and implementation.
• Donor (BMZ): For the concrete evidence to inform them the accomplishments that have been made by the project so far, the changes contributed by the project, the good practices, strengths and weaknesses, and lessons learnt during the project implementation, what to improve in the future design and implementation and how effectiveness and efficiency of the project implementation made.
• Project stakeholders (Partners and relevant ministries)

The evaluation report has to follow the structure given by the donor. In addition, the report will also focus on reflecting on different aspects which were not captured or sufficiently covered by project indicators and reports, such as; the gender power dynamics, child’s rights, and disability inclusion aspects, as per Plan International’s standards. please see Annex

key deliverables and Timeline

Inception report

The inception report

Does not exceed 10 pages excluding annexes and draft tools

One week

after the initial meeting and desk review have taken place.

The report should include:

• An updated timeline;
• detailed methodology, including draft sampling methodology and size;
• draft data collection tools; (e.g. Proposed guiding questions for semi-structured interviews, focus group discussion or other approaches, retrospective tools, and proposing the draft data collection questionnaires)
• ethical considerations;
• consent forms for any primary data collection;
• (draft) methods for data analysis;
• brief justification of the methods and techniques used (including relevant underlying values and assumptions/ theories) with a justification of the selections made (e.g. of persons interviewed).
• Clear matrix of roles and responsibilities indicating the persons involved in the midline & evaluation study and their roles
• The key internal and external stakeholders to be involved
• Summary of the preliminary findings and any preliminary hypotheses resulting from the desk review and explain the process for obtaining the participants’ consent.
• Research midline & evaluation study matrix stating the tools and questions per each tool to answer each indicator, research question for the midline & evaluation study, and the calculation method.

Data collection tools and related materials

Word and excel, Arabic and English

To be submitted along with the inception report

The final FGD questions, interview questions, questionnaires, other tools that will be used with target groups will be shared by the consultant in English for review then to be translated for Arabic after the ethical review and prior to the data collection process after the tools have been tested and possible modifications to them based on the tests have been made.

Given that the project has a sensitive topic “Sexual and Reproductive Health” and sensitive age group “starting from 13 YO”, PIE will conduct an initial meeting with the data collectors to discuss their backgrounds and capacities. PIE has the right to ask for replacement or dismissal of any of the data collectors from the consultant.

Draft midline and evaluation study report

The draft report should be delivered in a soft copy in English. References should be fully cited after all important facts and figures.

A full report with main text of maximum 50 pages excluding cover page, basic document information page, table of contents, abbreviations, executive summary and annexes.

Two weeks maximum after the end of data collection

The report should as a minimum include the following elements:

• Front page with the title of the midline & evaluation study, date and authors of the report
• A table of basic document information on page 2
• Executive summary (3-4 pages) that presents the key points of the different sections
• Objectives and the intended use of the midline & evaluation study
• Methodology and limitations
• Description of the project
• Findings, including a table presenting the midline & evaluation data and suggested targets for each of the indicators in the project’s logical framework
• Conclusions and recommendations
• Relevant annexes, which as a minimum must include:
• List of people interviewed or consulted
• Bibliography of the documents reviewed
• Terms of Reference for the midline & evaluation study

PIE staff will provide a detailed template for the final report to be followed by the consultant.

Final midline and evaluation study report

In a soft copy in English and Arabic.

Maximum 50 pages

One week after the draft report

The midline & evaluation study report will be considered final only after incorporating the feedback from stakeholders, Plan Egypt, Plan Germany and partners (including the same components of the draft report)

Power point presentation

Power point in both Arabic and English languages

Power point presentation with the main findings of the study and presenting the results to project’s staff and partners.

1. Timeline

Activity Start Date Days of Work Responsible Individuals Involved

*Tendering 13th Aug 10 days

*Background Checks 23th Aug 7 days

and contracting.

*Inception Call/

Inception Workshop

*Submission of Inception 4th Sep 14 days Evaluator PM,MERL Focal point reviews and Report approves inception report

Preparations for Data Collection

1. Develop tools 18th Sep 6 days Evaluator Technical team
2. Field piloting 24th Sep 3 days Evaluator MERL Team
3. Enumerator training 27th Sep 3 days Evaluator MERL Team

Data Collection 30th Sep 10 days Evaluator MERL Team

Data Cleaning 10th Oct 7 days Evaluator MERL Team

Data Analysis 17th Oct 8 days Evaluator MERL Team

Submission of Draft Report 25th Oct 15 days Evaluator PM, Technical Team

Validation of findings with key stakeholders and respondents & feedback incorporation

10th Oct 15 days Evaluator, PM, Technical Team

plan international

Submission of Final Report 25th October- 10th November 15days Evaluator PM, Technical Team

Management Response and Action Plan

Level of contact with children

Plan International is committed to ensuring that the rights of those participating in data collection or analysis are respected and protected, in accordance with the Framework for Ethical MERL and our Global Policy on Safeguarding Children and Young People. All applicants should include details in their proposal on how they will ensure ethics and child safeguarding in the data collection process. Specifically, the consultant or firm shall explain how appropriate, safe, non-discriminatory participation of all stakeholders will be ensured and how special attention will be paid to the needs of children and other vulnerable groups. The consultant or firm shall also explain how confidentiality and anonymity of participants will be guaranteed while providing the participants with the consent forms. Safeguarding policy, safe identification and referral and Non-Staff Code of Conduct.

PLAN INTERNATIONAL’S ETHICAL & ENVIRONMENTAL STATEMENT

The supplier should establish environmental standards and good practices that follow the principles of ISO 14001 Environmental Management Systems, and in particular to ensure compliance with environmental legislation

Plan International is committed to ensuring that the rights of those participating in data collection or analysis are respected and protected, in accordance with Ethical MERL Framework and our Child and Youth Safeguarding Policy. All applicants should include details in their proposal on how they will ensure ethics and child protection in the data collection process. Specifically, the consultant(s) shall explain how appropriate, safe, non-discriminatory participation of all stakeholders will be ensured and how special attention will be paid to the needs of children and other vulnerable groups. The consultant(s) shall also explain how confidentiality and anonymity of participants will be guaranteed. And ensure getting the ethical approvals by using PIE consent forms template for adult and children. It should be noted that consultants who fail to detail ethics and the safeguarding process will not be considered.

Technical expertise, skills and knowledge

The Consultant/Consulting firm (preferred to be a firm or a team of consultants) should have the following competencies and qualifications:

• Minimum Master’s Degree in social studies, International Development or any other related field such as Statistics, Social Science, Monitoring, Evaluation and Research, PhD is desirable
• Minimum 10 years’ experiences in undertaking baseline and endline surveys studies and evaluations in contexts similar to Jordan.
• Relevant experiences in the response to humanitarian crisis, preferably in the areas of education, protection, and livelihoods.
• Experience working in Jordan or Lebanon, proven experience in both countries is plus
• Demonstrated experience of facilitating research with participatory methods and tools, particularly with young people
• Competency in managing, organizing and interpreting quantitative and qualitative data and information
• Report writing skills.
• Excellent written and verbal communication skills in Arabic and English.
• Have excellent knowledge in data analysis for quantitative and qualitative data
• Ability to communicate effectively to a range of different stakeholders
• Significant experience in conducting research using participatory approaches
• Ability to produce well-written reports, in plain and approachable language, demonstrating excellent analytical and communication skills. (Sample must be provided)

Note that the consultant / consulting firm is required to identify, recruit, contract and train enumerators and data collectors in both countries. No support can be provided on this matter by Plan.

Evaluation criteria

Technical 65%

15% Company/consultant bio, 20% details on the proposed work plan, development ,30% sample of work, and post -evaluation feedback

Gender responsive procurement 5%

Supplier meet any of the criteria below:

•If headed up by a woman

•If supplier is a women-owned business: A legal entity in any field that is more than 51% owned, managed, and controlled by one or more women.

•If the % of women in management positions is over 35%

•If % of women workers is 55% or above

•If robust gender equality initiatives are in place and active. E.g. WEPs (Women Empowerment Principles) signed, gender equality procurement policy, any additional gender-sensitive program implemented.

Financial 30%

• An itemized and detailed budget, indicating the unit costs for producing the deliverables.
• All costs must be expressed in Jordanian Dinars

Budget

First payment 25%

After submitting the inception report, with a Brief proposal for the assessment, including a draft format for the report and a list of survey questions**

2 weeks from signing the contract

Second payment 75%

Final report including executive summary

Milestone Detail Amount to be Paid (%) Expected Timeframe

August Inception Report 3750 August 2024

November Final Report 11250 November 2024

APPLICATION METHOD AND DEADLINE

Plan International Jordan has appointed an overall focal point for the study that will keep primary contact with the consultant. Throughout the research process the consultant will work jointly with relevant Plan Egypt programme staff (Programme Quality and Delivery Manager, Programme Unit Manager, Project Coordinator/Manager, the M&E team at country office and programme area level).

References and contact information:

a) Names, addresses and telephone numbers of representatives of two organizations that will act as professional referees; these must be persons of managerial responsibility at the level where such reviews as these can be authorized.

b) Company/ Consultant Portfolio and 2 specific examples of relevant work.

TERMS OF PAYMENTS

PLAN Jordan shall release the payment at the end of each month of the assignment contingent the acceptance and approval of the service delivery. 100 % to be paid after completion and approval of Payment

After reviewing the project documents an exact sampling framework covering the 4 locations (Amman, Irbid, Ajloun Karak) should be proposed by the consultant.