People in Need
Country Office: Bosnia and Herzegovina
Project Name: “My work – Economic opportunities for people with disabilities”
Implementing lead organisation: People in Need
Partner organisations: ProReha, Nešto Više, Sumero
Location: Eight municipalities in Bosnia and Herzegovina (Banja Luka, Bihać, Brčko, Mostar, Sarajevo, Trebinje, Vitez, Zenica)
Donor: Czech Development Agency
Project length: 1.7.2020 – 31.12.2022
Project Budget: 2020: 3 513 225,00- CZK/ 139 887.36 EUR 2021: 6 000 000,00-CZK/ 238 904.19 EUR 2022: 3 000 000,00- CZK/ 119 452.09 EUR
Duration of final evaluation: 25 days
Estimated start date: November 2022
1. Background
People in Need (PIN) is a non-governmental, non-profit organisation founded on the ideals of humanism, freedom, equality and solidarity. We consider human dignity and freedom to be fundamental values. We believe that people anywhere in the world should have the right to make decisions about their lives and share the rights expressed in the Universal Declaration of Human Rights.
For more information, please visit https://www.clovekvtisni.cz/en/
Recently PIN in BiH primarily focuses on three main areas: 1. Social inclusion; 2. Good governance; and 3. Emergency preparedness and response.
Project Background
People in Need is currently leading a project entitled “My Work – Economic Opportunities for People with Disabilities” with a focus on eight municipalities (Banja Luka, Bihać, Brčko, Mostar, Sarajevo, Trebinje, Vitez, Zenica) in Bosnia and Herzegovina. Implementing partner organisations are Nešto Više, ProReha and Sumero. The project is funded by Czech Development Agency.
The project is initiated for thirty months, with the end in December 2022. It draws upon previous interventions of PIN in BiH that focused on the inclusion of persons with intellectual and psychosocial disabilities and their deinstitutionalisation. The current project differs from the previous interventions in its approach to inclusion of People with Intellectual Disabilities (PwID) as it stresses economic empowerment of PwID and economic aspects of their inclusion in society.
The overall objective of the project is to enhance the status of PwID to exercise their rights in Bosnian and Herzegovinian society. The specific objective aims to enhance the economic opportunities for PwID in eight target municipalities.
The achievement of the above-mentioned objective is supported by the following results:
Result 1. Enhanced provision of supported employment service to PwID
Result 2. Enhanced entrepreneurship and income generation schemes benefiting PwID
Result 3. Strengthened advocacy efforts on the inclusion of PwID in employment and society
The major activities to support the achievement of results are described in the project proposal attached to this ToR.
Project status
Most of the main project activities have been completed. In line with the objectives of the project: link between the project and the field-trained labour counselors has been established; labour counselors trained in Supported Employment methodology and Transition program “From school to Work”; eight-week internships introduced and applied; advocacy network expanded; trainings of self-advocates about rights of PwD conducted; Facebook and Instagram pages “Zelim biti dio drustva” set up and content regularly updated; working groups defined priorities that need to be adopted in the current legislation in order to improve status of PwD in the employment process; the transition program “From school to work” engaged two schools to start piloting methodology; accelerator program conducted and grants awarded to the employers with good ideas that envisaged employment of PwDs. The project underwent an internal mid-term evaluation in November-December 2021 and identified its strengths and weaknesses and provided recommendation for the remaining implementation period. The project end date is end of December. The selected Evaluator will be provided with the mid-term evaluation, all official donor reports and other key documents to inform the successful completion of this assignment.
2. Objectives and Scope of the Evaluation
The main purpose of the Final evaluation is to assess the overall progress of the project and the quality of implementation towards project objectives, as well as its long-term impact and sustainability. The Final evaluation will also provide recommendations for potential future initiatives to capitalize on lessons learned and avoid similar omissions and mistakes.
Objectives:
- Evaluate the progress of outputs / outcomes of the project;
- Analyze the impact on or changes occurring within beneficiary groups;
- Analyze the impact of advocacy activities aiming for systemic changes in the area of PWD rights and employment in the open market
- Identify problems and constraints that have been encountered;
- Assess the financial management of the project;
- Identify important lessons learnt, good and bad practices and make recommendations for future similar initiatives as well as for potential extension/continuation of the project. Which activities/aspects of the project can be evaluated as suitable for replication/expansion/deepening, including the aspect of legislation and systemic changes.
- What are opportunities of further engagement and cooperation with municipal authorities to inform future programming phases.
Scope:
Content and areas requiring more in-depth analysis: The employment of PwID on the open labour market proved to be a difficult task, and the recommendations on how to better achieve set indicators and outputs would be beneficial for further project implementation.
Geographical scope: The evaluation should focus on all 8 municipalities involved in the project (Banja Luka, Bihać, Brčko, Mostar, Sarajevo, Trebinje, Vitez, Zenica).
Period: The evaluation should contain the period from 1.7.2020 to 31.12.2022 of the project implementation.
Evaluation stakeholders:
- PwD (open market, income generation, internship) and their families
- Labor counselors
- Employers in the open labour market
- The accelerator program participants
- Transition program school representatives
- Transition program students and parents
- Partners organizations’ representatives
- Participating faculties’ coordinators
- Self-advocates
- Students
- Representatives of ministries, platform/working group members for systemic changes
- Donor representatives
- PIN staff
3. Key Evaluation Questions
The evaluation will aim to provide assessment of achievement of project objectives, make judgement on how intended or unintended, positive or negative changes came about. The Development Assistance Criteria (DAC) of Relevance, Effectiveness, Efficiency, Impact and Sustainability will be used.
Relevance: To what extent are the project objectives in line with problems, real needs, capacities and priorities of target groups / beneficiaries (PwD)? Was a needs analysis carried out at the beginning of the project reflecting the various needs of different stakeholders? To what extent the project contributed to definition of priority changes in the legislation and how? How were the available resources and stakeholders coordinated within the project? Were any synergies established? Have the initial assumptions strengthened or weakened the project design? How?
Effectiveness: Have the activities delivered created an effective foundation for the meaningful changes in the area of employment of PwD in the open market and for improvement of the status of PwD in general? Were there differential results for different people? If so, how and why? Were different approaches necessary to reach people of different levels of disability? Was there sufficient monitoring and analysis of differential effects? Was the intervention adjusted to address any concerns and maximise effectiveness? Did the project achieve planned objectives? What, if any, alternative strategies would have been more effective in achieving the project’s objectives?
Efficiency: To what extent have the delays in implementation affected the overall project progress and has this been addressed efficiently? Have resources (funds, human resources, time, expertise, etc.) been allocated strategically to achieve outcomes? Have risks been considered and managed in a proactive, timely and effective manner?
Impact: Did the project make a significant contribution to broader and long-term development impact? Were there any unintended impact and/or side effects of the project activities (positive or negative)?
Sustainability: To what extent are the benefits generated by the project likely to sustain once the project ends? What were major factors helping or hindering implementation? Are they likely to continue?
PIN will require specific and data-supported answers to each of the agreed evaluation questions or strong justification for why the data could not be obtained. Justification of data unavailability must be communicated by the evaluator without any delay as soon as it becomes apparent and approved by PIN. Failure to do so can result in decreasing the consultant’s remuneration.
4. Methodology
The evaluation is expected to apply qualitative methods of research – semi structured interviews, focus group discussions, desk research of related data including project documentation.
Document review
- Project documentation: project proposal, logical framework, table of outputs and activities, annual report, MEAL documentation, procurement documents, labour counselors’ reports, trainers’ reports, research reports, mid-term evaluation report, etc.
Field research
- Interviews with project team and project partners (Nešto Više, Sumero, ProReha)
- Interviews/surveys/focus groups with target groups (PwD, labor counselors, students, families of PwD, internship providers/employers, representatives of institutions and other stakeholders)
- Field visits (to PwD supported through income generation, PwD employed during the project, internship providers, labour counselors)
Specific Tasks to be Performed by the Evaluation Consultant
- Review of project documents
- Review of project logic and targets
- Meetings with project staff and relevant stakeholders
- Provision of recommendations for the upcoming activities of the project
- Preparation of final evaluation documents (inception report, draft report, final report)
Expected Deliverables and Indicative Timeline
The evaluator is expected to allocate about 20% of the time for a desk review of project documents, 60% to field work (field visit to eight cities) and 20% to preparing the final report. The fieldwork is planned to be completed by 10.12. 2022.
The expected deliverables with indicative timeline are:
- Inception report (November)
- Field work – field visits in eight cities (by December 10, 2022)
- Draft report submitted to PIN BiH for review and comments prior to finalizing and submitting the final document (by December 15)
- Presentation of findings to the project team and partners (mid- December)
- Final report with incorporated feedback (by December 23)
- Presentation of findings to representatives of Czech Development Agency and Czech Embassy in Sarajevo (mid-January 2023)
Evaluation Report
Desired structure of the evaluation report:
- Executive summary;
- Brief description of the context and the project;
- Description of evaluation goals and objectives;
- Description of evaluation methodology and data collection methods;
- Presentation of main finding and conclusions of the assessment;
- Discussion of lessons learned;
- Recommendations
- Annexes
The evaluation report Executive summary should not exceed the limit of 3 pages, and the remaining parts of the report should not exceed 25 pages (excluding annexes).
5. Assignment Terms
Management Arrangement
The Evaluator will report to and liaise with the PIN Focal Person on all matters and decisions relating to this assignment. PIN can assist in arranging meetings with relevant stakeholders if/when needed. To enable this the Evaluator must provide a list and schedule of meetings in good time to ensure all meetings can be arranged in a respectful and timely way. If required, PIN can support the Evaluator with logistics arrangements, but the Evaluator will be responsible for making the respective payments.
Payment Modality
% — Milestones
- 40% — Following the signing of the Contract on Evaluation Services
- 60% — After the final version of the final evaluation report has been submitted and approved by PIN
- PIN reserves the right to deduct up to 0.5 % of the total contract price for each day’s delay in meeting the deliverables specified. This deduction shall be applied to the last payment of 60 % of the contract price.
Duration
The evaluator/evaluation team should perform all of the tasks under this Terms of Reference during the Assignment Period. The expected workload should not exceed 25 working days, including desk research/project documentation review, field work and report writing.
The deadline for submission of the final evaluation report is 23.12.2022.
How to apply
Evaluator Experience
Essential
- At least 6 years of professional experience in conducting development project evaluations;
- Proven experience and knowledge of conducting quantitative and qualitative research;
- Excellent analytical skills;
- Significant practical experience in report writing and formulation of recommendations;
- Excellent spoken and written English.
Preferred
- Experience evaluating CzDA funded projects;
- Understanding of project management principles;
- Previous experience with results‐based monitoring and evaluation methodologies.
Please note that most targeted beneficiaries and stakeholders do not speak English, so relevant translation services into Bosnian/Croatian/Serbian need to be considered in the proposed price of the work and organised by the Evaluator in case of foreign evaluators or organizations.
Proposal Submission and review of the applications
Interested candidates/organizations whose profile matches the qualification requirements stated above are invited to send their:
- Curriculum vitae or organizational profile highlighting relevant experience (max.4 pages);
- Cover letter stating how your experience and competencies can best deliver the assignment (max.1 page);
- 2 samples of previous similar work;
- Clear and concise proposal outlining the methodology and sub-questions to be asked (max. 4 pages)
- Assignment Budget (in EUR) broken down by: Personnel Service fees; Direct evaluation activity costs; Anticipated logistics, travel and subsistence costs.
All interested candidates/organizations who meet the above requirements and are confident that their background and experience qualify them to implement Final Evaluation, should e-mail their complete application packs in English language to: [email protected] mentioning “Final Evaluation: My work – Economic opportunities for people with disabilities” in the subject line of the e-mail.
Review and selection criteria:
The selection committee will be formed and will be evaluating the applications against the following criteria:
- Suggested budget/ cost efficiency to complete the evaluation (criteria weight is 20%);
- Quality of the submitted technical offer (criteria weight is 40 %);
- Relevant experience, qualification and quality of sample report submitted (criteria weight is 40%).
Incomplete applications will not be reviewed. Only short-listed candidates will be contacted. The final decision will be made after the interviews.