Handicap International - Humanity & Inclusion
General information
-
1 About Humanity & Inclusion
Handicap International/ Humanity & Inclusion (HI) is an international organization specialized in the field of disability. Non-governmental, non-religious, non-political and non-profit-making, it works alongside persons with disabilities, whatever the context, in response to humanitarian crises and the effects of extreme poverty. Humanity & Inclusion implements programs of assistance to persons and local organizations inclusion programs and programs focusing on the fight against the main causes of disability. It runs projects in almost 60 countries, with the support of a network of 8 national associations (Germany, Belgium, Canada, United-States, Luxembourg, United Kingdom and Switzerland). The organization employs almost 3300 people worldwide, 330 of whom work in France and in its European and North American sections.
1.2 About Humanity & Inclusion in the country/region
HI has been present in Afghanistan since 1996, supporting the most vulnerable communities across the country. With over 400 staff in Kandahar, Nimroz, Herat, Kunduz and Kabul HI has been delivering humanitarian and longer- term recovery programs ensuring access to basic services for displaced populations, host communities and returnees. The key areas of HI intervention include physical rehabilitation, training of professional physiotherapists, psychosocial support, and socio-economic inclusion through inclusive livelihood activities, mine risk education and advocacy. These activities have not only focused on the provision of services but also on mainstreaming a right-based approach and ensuring that disability does not remain a separate and standalone work stream, especially in emergency situations. .
- Context of the evaluation
2.1 Presentation of the project to be evaluated
In the form of one or more tables, containing at least the following information:
Project title
Towards Improved Access to Quality Physical Rehabilitation in Afghanistan II (TIQRA II)
Implementation dates
09.07.2019- 26.11.2022
Location/Areas of intervention
Herat, Kandahar, Kapisa, Paktya and Balkh
Operating Partners
Consortium led by Handicap International /Humanity and Inclusion (HI)
Partners : Swedish Committee for Afghanistan and Norwegian Afghanistan Committee
Target Groups
Physiotherapy graduates and indirectlly Afghan population in need to PT services
Project Budget 3,000,000 EUR
Objectives of the project
Overall objective:The delivery of physical rehabilitation services to the Afghan population in underserved areas of the country with focus on the most vulnerable groups is improved.
Specific objective: Improved quality and contribution to expansion of physical rehabilitation services in underserved areas of Afghanistan.
Expected results and indicators
Output 1: TIQRA I newly graduated PTs deployed and facilitated in delivering quality physical rehabilitation services within health facilities.
1.1 # of TIQRA I graduates (men and women including those with disabilities) employed to fill the vacant positions by the end of the project.
1.2 # of newly graduated students from TIQRA project who receive mentoring/coaching according to their needs in order to deliver quality physical rehabilitation services
1.3 % of mentees / graduate PTs who are able to use clinical tools (patient assessment form, treatment planning forms and cross referral with other departments) and procedures at the end of mentoring period
1.4 The PT units where the graduates are employed, are equipped for effective service delivery
Output 2: Newly graduated rehabilitation professionals from the P&O are employed by existing and newly established PRCs and obtain needed on-the-job mentoring / coaching to deliver quality physical rehabilitation services.
2.1 # of newly graduated male and female students from P&O project employed to fill the vacant positions by the end of the project.
2.2 # of newly graduated students receive on the-job mentoring / coaching in order to deliver quality physical rehabilitation services.
2.3 % of mentees / P&0 graduates who are able to work independently and with minimal supervision at the end of the mentoring period.
Output 3: PTs with increased level of education and skills are available for provision of quality physical rehabilitation services.
3.1 # of Physiotherapists who graduate with 3-year Diploma accredited by GIHS PTPOEAB
3.2 # holders of PT 2 yr Diploma upgraded for 3-year Diplomas through PTIPTPOEAB
Output 4 : Accreditation Board (PTPOEAB) is increased to sustain Physiotherapy trainings according to needed human resources for physiotherapy services in the public health system
4.3 # of PT trainers from NGOs, AAPT and private sector who are member of PTPOEAB attended assessors’ training, curriculum revision and PT standards revision workshops.
4.4 # of academic sessions, ToTs and workshops are conducted.
4.5 PT Assessors knowledge and skill on how to evaluate the centre are enhanced.
4.6 PTPOEAB capacity and role is strengthened to cover private training institutes
Main activities implemented under Output 1
1.1 Follow-up the graduated students from TIQRA to employment according to pre-employment plans
1.1.1 Rehab Advocacy working group meetings
1.1.2 Follow-up and meetings with BPHS/EPHS implementers to fulfil the pre-employment plan done during the TIQRA I student recruitment
1.2 Training of selected mentors for providing mentorship support to newly employed physiotherapists.
1.2.1 Selection/recruitment of mentors
1.2.2 Development of mentoring program and plan, including the on-the-job training templates
1.2.3 Conducting specialized mentorship trainings for mentors
1.3 Systematic follow-up of graduated students of TIQRA projects into their workplaces and careers
1.3.1 Implementation of mentoring plan
1.4 Providing appropriate equipment for selected PT units upon establishment and recruitment of new graduates from TIQRA I.
1.4.1 Assess the equipment needs in each PT unit where the graduated students will work
1.4.2 Supply the necessary equipment for PT units as needed, according to the means available, ensuring the PT unit can function well
2.1 Advocate for employment of P&O graduates from the project “Strengthening of Prosthetics and Orthotics Services in Underserved Areas of Afghanistan.
2.1.1 Rehab Advocacy working group meetings
2.1.2 Advocacy for P&O and PT graduates on central level targeting GCMU and SEHATMANDI donors
2.2 Training of selected mentors for providing mentorship support to newly employed P&O graduates
2.2.1 Support the selection/recruitment of mentors and their training.
2.2.2 Development of mentoring program and plan, including the on-the-job training templates
2.3 Systematic follow-up of graduated students of TIQRA P&O employed within the public health system
2.3.1 Implementation of mentoring plan
2.4Provide the means for DRP/MoPH to monitor services
2.4.1 Develop ToR for liaison officer for DRP
2.4.2 Monitor the work of the Liaison Officer
3.1 To support PT trainings in 5 regions (Kandahar, Herat, Balkh, Kapisa and Paktia) in corresponding GIHS/IHS training centres.
3.1.1 To develop and sign the MoU with the Ministry of Public Health and regional entities (PPHDs, IHSs, hospitals etc.).
3.1.2 Conduct awareness and sensitization sessions in targeted underserved areas.
3.1.3 To support the selection of students coming from underserved areas
3.2 Supporting the recruitment of PT teachers/trainers and organise Effective Teaching Skills (ETS) and Clinical Teaching Skills (CTS) courses for them
3.3 Development of Teachers’ Guides according to the curriculum and needs of teachers based on their experiences from TIQRA I.
3.3.1 Collect all training materials which were developed in TIQRA I and file them in one clearly labelled database
3.3.2 Recruit a consultant to support the analysis of the filed training materials and frame the minimum teaching content for each module topic
3.3.3 Facilitate Physiotherapy Teacher Working Group (PTWG) to develop the teaching guides
3.3.4. Provision of basic Physiotherapy Kit for graduated students
3.4 Support the Physio Therapy Institute (PTI) to upgrade the remaining 25 PTs’ 2 yr Diplomas into 3 yr Diplomas
3.4.1 Signing of MoU with PTI for modular upgrading course
3.4.1. Monitor the classes regularly
3.5 Support the PTPOEAB for monitoring the quality and accrediting the PT training courses for GIHS approved Diplomas
3.5.1 Organising refresher course for assessors to be recognised as national assessors
Activities and Sub-activities under Output 4
4.1 Support GIHS and HR department of MoPH to analyse the needs for training PTs in the country
4.1.1 Update of Physical Rehabilitation Mapping to show the needed human resources for rehabilitation sector
2.2 Justification of the evaluation
The Purpose of this final evaluation is to indicate to all project stakeholders the extent to which the project has achieved its aims and objectives and to determine the relevance, coherence effectiveness,efficiency, impact and sustainability of project outcomes. The knowledge generated by the evaluation will also feed in the design of relevant future intervention and contribute to documenting management and delivery approaches.
- Objectives of the evaluation (3 pages maximum)
3.1 Overall objectives and expectations of the evaluation
Describe the general objective that is linked to the dominant motivation for the evaluation (see 2.2).
The overall aim is to assess the level of achievement of the project and the extent to which the project has brought positive changes and added value to beneficiaries, relevant stakeholders. This summative evaluation will also assess the quality of project approaches, strategies, and interventions as stated in HI Project Quality Framework. Further, this evaluation will take into account the constraints and challenges, as well as adaptations during project implementation, in the context of the COVID-19, and the events of the summer 2021 which led to the change of power in the country and also to analyze the impact of project implementation to see kind of activities that has work well and/ or need to improve in the future as part of lessons learn of the project.
Specifically, the evaluation aims to:
- Analyze the extent to which the project has contributed in bringing about medium and long-term positive effects in the physiotherapy sector
- To examine and analyze the achievements of project expected result
- Analyze how the project resources are mobilized and adapted following the changes of governement in August 2021.
Finally, the final evaluation will provide the Consortim and the donor INTPA (EU Delegation) with sufficient information to:
– assess and analyze the project results, efficiency and relevance of the implementation strategy
– review, analyze, provide evidence and document the impact of the intervention through its progress, challenges, barriers and lessons learned with recommendations for a logical and potential next phase.
3.2 Specific objectives
Scope of evaluation (geographic, temporal, regulatory)?
Specify the objectives of this evaluation and the evaluation criteria, which will be specified in the section below.
The consultants will articulate their analysis around a set of evaluation questions related to Changes, Efficiency, Relevance, and Effectiveness. Some questions are listed below. These questions are not exhaustive and will be reviewed by the consultants at the beginning of the inception report stage and planning. The following criteria should be looked into, though other criteria can be suggested by the evaluator:
Relevance: appropriateness of project objectives to the problems it was supposed to address, including assessment of the quality of the project preparation and design. Specifically:
– Does the project meet the needs of the target population?
– Is the project design appropriate to the specific context?
– Are the mechanism and approaches developed in coherence with existing plans and policies of HI?
Effectiveness of the project, including specific assessment of the benefits accruing to target groups:
– To what extent does the project achieve the expected results?
– Did the project contribute to improved employment of physiotherapists ?
– How does the team adjust the project and its methodologies to the constraints faced during the implementation phase to achieve the expected results?
– Do the project’s activities designed and implemented address the needs of both men and women on an equal basis ?
– Did the project’s implementation have any unexpected consequences which should be considered in the design of future projects with a similar program logic
Efficiency, including comparing alternative approaches to achieving the same results, to see whether the most efficient process has been adopted:
– Are the methodologies and tools appropriate to meet the project’s objective?
– Is the project team profile and the three organizations efficient for implementing the project in the area covered?
– Are there any barriers to the efficient implementation of the key activities?
– Do the strategy and approaching method enable the achievement of the results in a cost-effectivemanner?
Change
– To what extent can it be said that the effects/impacts are attributable to project interventions? Are there other external factors which have played a role in the effects/impacts during the project period?
– For those effects/ impacts which are attributed to the project, what have been the processes, component or qualities of the project intervention which have led to the change?
– What modification/reorientation should be made in areas of intervention and activities to better achieve the expected the effects/ impacts? The evaluator should consider both the short term and the longer-term directions for future strategy.
– Does the project have any negative impact or is likely to have in future?
– What is the impact of the project on its wider environment (social level impact, policy level impact, economic level impact, technical level impact)?
Sustainability to assess the likelihood of benefits produced by the project to continue to flow after external funding has ended, and with particular reference to:
- Financial sustainability
- Institutional sustainability
- Policy level sustainability
-
- Evaluation criteria and evaluative questions
- Sustaninablity
- Change
- Efficiency
- Effectiveness
- Relevance
- Evaluation methodology and organization of the mission
4.1 Collection methodology
Possible methods for data collection would include:
• Internal documents review: Intern-Service Project reviews report, ROM evaluation, interim
reports, monitoring tools.
• External document review such phyisiotherapy curriculum
• Interview with the co-applicants.
• Interview with stakeholders and final beneficiaries
• Field visits
• Data analyse tools
Participatory approach during data collection is expected by not only considering stakeholders including the co-applicants as providers of data only but also involving them in initial analysis;
4.2 Actors involved in the evaluation
– Operations Manager
– Physical Rehabilitation Technical Officer
– Consortium Coordinator
– Project Managers
– beneficiaries
-PTOEAB
A team coordinator will be clearly appointed. The team coordinator will be ultimately responsible for the whole work and all deliveries; s/he will also act as the contact person with
- Principles and values
4.1. Protection and Anti-Corruption Policy
Protection of beneficiaries from sexual exploitation, abuse and harassment
Anti-fraud and anti-corruption policy
4.2. Ethical measures*
As part of each evaluation, HI is committed to upholding certain ethical measures. It is imperative that these measures are taken into account in the technical offer:
- Guarantee the safety of participants, partners and teams: the technical offer must specify the risk mitigation measures.
- Ensuring a person/community-centred approach: the technical offer must propose methods adapted to the needs of the target population (e.g. tools adapted for illiterate audiences / sign language / child-friendly materials, etc.).
- Obtain the free and informed consent of the participants: the technical proposal must explain how the evaluator will obtain the free and informed consent and/or assent of the participants.
- Ensure the security of personal and sensitive data throughout the activity: the technical offer must propose measures for the protection of personal data.
*These measures may be adapted during the completion of the inception report.
- Expected deliverables and proposed schedule
6.1. Deliverables
- An inception report refining / specifying the proposed methodology for answering the evaluation questions and an action plan. This inception report will have to be validated by the Steering Committee.
- A presentation document presenting the first results, conclusions and recommendations, to be presented to the Steering Committee.
- A final report of approximately 20-30 pages maximum and the following annexes:
- Initial and final terms of reference of the evaluation
- o List of persons interviewed
- o List of documents reviewed
- o Final timetable of evaluation
- o Tools used for data collection
- o Preliminary results presentation and report of the meeting
- o Detailed analysis if relevant
- o Financial Report
Limit the number of pages of each deliverable (recommendation: for the final report about 25 pages are sufficient)
The final report should be integrated into the following template:
The quality of the final report will be reviewed by the Steering Committee of the evaluation using this checklist:
6.2. End-of-Evaluation Questionnaire
An end-of-evaluation questionnaire will be given to the evaluator and must be completed by him/her, a member of the Steering Committee and the person in charge of the evaluation.
6.3. Evaluation dates and schedule
Total mission duration
The work plan below is estimated by the team as a basis and should be revised and precised by the consultant according to the technical offer made.
The proposed steps for the evaluation are:
• Inception phase desk-based review (in Kabul) and initial gathering of information
• Core data collection, done in Kabul and centrally with the co-applicants and key
stakeholders, based on a previously designed and agreed methodology
• Analysis and presentation of first findings
• Reporting
5.Means
5.1Expertise sought from the consultant(s)
5.2 Budget allocated to the evaluation
The maximum available budget is 14,000 Euros.
Payment will be made in three instalments: 50% at the finalization of the field work, and 50% once the final evaluation report has been validated, provided the schedule and deadlines defined together and the quality criteria referred to in the contract have been met.
The budget should be detailed – including calculations – and include:
• Fees and per diem
• Medical and Repatriation insurance (proven at contract signature)
• Third party liability Insurance (if/when required)
• Travel expenses to Afghanistan – including visa expenses
• Accommodation withinAfghanistan– both in Freetown and in the provinces
(estimated)
• Communication costs (internet connection outside HI office, mobile credit)
• Workshop or meeting organization and logistics (estimated)
• All Taxes (if/when applicable)
• Any other relevant cost related to and required for the proper conducting of the
evaluation as per all the objectives and requirements detailed in the present ToRs.
7.3. Available resources made available to the evaluation team
(Data, documents, housing, software …)
- Submission of applications
Proposals from interested consultant(s) should include:
– Proposed evaluation design and methodology based on project needs outlined by this ToR;
– Financial plan for the evaluation. All costs related to the evaluation without exceptions should be figured into the financial plan of the consultant, including consultancy fees, domestic and international travel, visa, accommodation, and per diem;
– Proposed activities and timetable (considering that contextual limitations will later be communicated by project team);
– Curriculum vitae detailing the evaluator’s preparedness, experience & expertise in project evaluation and disability work;
– Registration certificate (copy);
– The applicant must integrate all expenses related to the study which should include flights, logistics, organization of workshops etc. These should be integrated within the financial application. Evaluation of the expression of interest will be made through a selection committee only if complete application is received. Criteria to select the best application will be based on quality of the methodology, human resources dedicated to the study, realistic work plan, previous experiences, demonstrated expertise of the applicant, and competitive financial proposition.
How to apply
Please submit your proposal to [email protected] The deadline for submission of proposal is 24 November by the end of business hours (16:30 hrs.), Afghanistan time.
The document must include
– Letter of interest
– Technical proposal, including methodology, timeline, strategy of evaluation and geographical location of project sites
– Curriculum vitae of lead evaluator and assistant(s) or organizational profile with CV of lead consultant and assistant(s), and list of previous similar experiences
– Budget proposition, inclusive of tax.