Consultant, Evaluation for the project “Grassroots Organizational Development-Working Towards Humanity (GROWTH)” in SEA

Organisation Description:

Organisation Description: Johanniter-Unfall-Hilfe e.V. is a German non-governmental organisation, dedicated to excellence in the field of first aid, ambulance service, social service programmes and other projects in the medical and social field. The Federal Headquarters (HQ) are based in Berlin, Germany.

Johanniter International Assistance is the operational unit for humanitarian aid, development co-operation and emergency relief, implementing and supporting projects in Health and Livelihoods with a specific focus on climate change and gender equality worldwide. (www.thejohanniter.org).

Background:

Johanniter-Unfall-Hilfe e.V. (Johanniter International Assistance) has been working in South East Asia since 2008, implementing projects in the field of health, nutrition, WASH, Livelihood, and disaster preparedness.

Key purpose of the evaluation:

• Learning from the first phase of the project to adapt and improve the implementation of a second phase and build on best practices and lessons learned across project countries and participants.
• The evaluation report includes a Feasibility analysis in regards to the implementation of a second phase.

Objectives of the evaluation:

• Explore the final progress and achievements against the project logical framework and analyse results against the OECD DAC evaluation criteria and answers the corresponding questions as well as compared to the baseline findings conducted at the beginning of the project.
• Assess the GROWTH capacity building approach on localization/empowerment and organizational development focusing on:
• To what extent the approach was effective?
• Has Covid- 19 outbreak and other external factors affected this approach? If yes, to what extent? Challenges/opportunities.
• To what extent is partners absorbing learnings and practices of the GROWTH capacity building approach into their organizations?
• Assess the potential of the project for regional collaboration, learning, and synergies among partners and Johanniter and partners. (Challenges/opportunities)
• Can our current partners really connect on the regional level and would it be beneficial for them, or did the attempts rather cause confusion?
• What are the results of partner’s interaction promoted by the project?

Scope of the evaluation and approach and methods

The consultant is specifically requested to examine the contextual analysis and impact of internal and external factors in project implementation and challenges posed by the COVID-19 pandemic, a military coup in Myanmar, natural disasters, and regional and global trends. The consultant is also expected to produce a separate brief summary of key findings and recommendations from the final evaluation to inform the donors and key stakeholders. The report will also include cross-cutting development issues related to this project and contribute to the organizational goals of the grantee (if applicable).

The evaluation employed the OECD standardized criteria, including Effectiveness, Efficiency, Relevance, Sustainability and Impact (see http://www.oecd.org/dac/evaluation/49756382.pdf). The key questions of each criterion were mainstreamed into the evaluation tools.

The consultant is also expected to carry out a feasibility analysis for an anticipated GROWTH phase 2. The findings can be illustrated in a separate section in the report interlinking experiences from GROWTH phase 1 with GROWTH phase 2. The analysis will focus on the mitigation of (possible) problems that the evaluation might show in regards to the implementation of GROWTH phase 2 and specifically include the possible influence of external factors on the implementation of the 2nd phase.

Approach and Methodology:

The evaluation will follow a gender-sensitive, inclusive of all the stakeholders, culturally –sensitive, and participatory approach.

Once the consultant is on-board, the methodology will be finalized in consultation with the Johanniter and implementing partners. However, to ease the selection process, consultants are requested to propose their own methodology and should contain the following methodological topics as a minimum:

• The evaluator’s understanding of the evaluation questions
• Description of the phases related to the evaluation approach proposed.
• Sources of information for primary data collection (include a field visit plan in Cambodia and the Philippines and remote data collection for Myanmar)
• Sampling strategies, including the area and population group, are represented in the sample, sampling procedures, and sample size.
• Instruments to be used for data collection.
• Different types of data analysis will be carried out.
• Reference indicators and benchmarks for each evaluation question (if relevant).

Delivered by the consultant

The consultant shall deliver, within the time schedule presented, the following products:

Product #1: A detailed work plan

Product #2: Methodological proposal for the collection, processing, and analysis of information.

Product #3: A first draft of the final evaluation report, including feasibility analysis report, including annexes.

Product #4: A final evaluation, including annexes, validated by Johanniter, with the following structure and quality as provided in ToR. (The final report should be presented in English version with a professional English editor).

Time Schedule

The completion of this work is expected to take approximately 55 days following the signing of the contract, spread over 6 weeks, from 30 June to 25 August 2022. The final report must be finalized and submitted by 25 August 2022.

Management

The consultant will be commissioned by the commissioning manager Project Coordinator – GROWTH and led by the evaluation manager Regional PMEAL Coordinator – South East Asia. The evaluation manager will be responsible for day-to-day coordination and will also be the primary focal point of contact from Johanniter. Implementing partners from respective countries will facilitate the mission of a consultant team during the evaluation process.

Intellectual property and data protection

All intellectual property generated by the consultancy will be owned by Johanniter and implementing partners, who will retain the rights to disseminate and publish the final report. The agency will follow the data protection policy of Johanniter while collecting, processing, and storing the program related data.

Requirements:

• Experienced in conducting similar studies in the past- experience with research, analysis, statistics, etc.
• Relevant academic background- statistics, community development, or related field. Consultants should have the requisite technical, methodological and practical expert knowledge and are well familiar with the methodology.
• Experience with local NGOs and community level programming
• High-quality communication skills, notably report writing.
• Strong qualitative and quantitative analytical skills.
• Experience writing high-quality reports, incorporating written feedback, and addressing comments from multiple stakeholders
• Excellent written and oral English.
• Strong relationship management skills
• Ability to manage the available time and resources and to work to tight deadlines
• The independent consultant/consultancy firm/team of experts must demonstrate the following skills and experience: Capacity Development of small national organisations, Organisational Development, Participatory Approaches, Livelihood, Community Participation and Project Cycle Management/ Monitoring (including Do no harm). They should have experience and an excellent understanding of Localisation Agenda and the issues related to each country’s context, experience and underdoing of the Charter for Change movement, including issues of shrinking CSO space in the context of SEA. Besides the sectoral expertise, contextual knowledge of Myanmar, Cambodia and the Philippines is required.