Evaluation of the Profiling Exercise in the Philippines

Background

In the last decade, the Philippines are facing both disaster and conflict-induced displacements. The Bangsamoro Autonomous Region in Muslim Mindanao (BARMM) and specifically the island provinces of Basilan, Sulu and Tawi-Tawi (BASULTA) are among the regions registering the highest numbers of internally displaced persons (IDPs).

The local Protection Cluster team, led by UNHCR Philippines, and the local government have been monitoring IDP movements in the region since 2012, but it has proven challenging to collect data on the displacement situation in the BASULTA island province.

Thus, UNHCR Philippines, together with the Ministry of the Interior and Local Government (MILG), the Department of Social Welfare and Development (DSWD), and the Ministry of Social Services and Development (MSSD), have decided in August 2019 to jointly conduct a profiling exercise, and requested JIPS for technical support to implement the process.

Given the ongoing political transition in BARMM, the profiling exercise was implemented in a critical time as it offered an opportunity to the Bangsamoro Transition Authority (BTA) to develop critical knowledge and capacities to better respond to internal displacement in the region.

UNHCR and JIPS implemented the profiling exercise between 2019 and 2021. The exercise was endorsed and supported by the above-mentioned ministries, its local government units on municipal and barangay level in the Basulta provinces, the provincial and municipal and social service offices and the Provincial Disaster Risk Reduction Management Offices (PDRRMO) of Basilan, Sulu and Tawi-Tawi.

Objectives

The evaluation will focus on examining performance. The evaluation of the profiling exercise in Basilan, Sulu and Tawi-Tawi will aim to assess the relevance, effectiveness and efficiency of the profiling process and collaborative structures and will further explore the impact the project has had in creating unique spaces for collaboration between actors to inform solutions to displacement.

The evaluation will aim to provide insights to JIPS as well as all partners participating in the collaborative platform, on the ways in which the profiling exercise was able to contribute to transformative change. The evaluation results will further yield recommendations to enhance the process and outcomes of collaborative data collection exercises.

Therefore, the evaluation will put an emphasis on:

1/ The relevance, efficiency, and effectiveness of the process from receiving the initial request for support to the global launch of the profiling report including, but not limited to:

• JIPS’ internal ways of working and use of financial, human and other resources;
• Identification and inclusion of various stakeholders throughout the profiling;
• Establishing and sustaining collaboration and coordination among stakeholders throughout the profiling cycle;
• Knowledge sharing and capacity building throughout the profiling
• Provision of technical support and capacity building to profiling partners through remotely using JIPS’ Remote Facilitation Toolbox in response to the challenges posed by the Covid-19 global pandemic

2/ The positive, negative, expected, and unexpected changes generated throughout the process related to:

• Enabling and sustaining collaboration between humanitarian, development partners as well as government actors to inform solutions to displacement
• Informing policies and programs of local and national public authorities aimed at enhancing resilience of displacement affected communities and communities at risk of statelessness on the Islands of Basilan, Sulu, and Tawi Tawi (Philippines)
• The protection environment of displaced communities and those at risk of statelessness;
• Data literacy of Technical Working Group members and other stakeholders.

and the external elements (enablers and blockers) influencing these changes.

3/ Based on the performance evaluation, recommendations will be formulated seeking to enhance the relevance of a profiling exercise by improving the process, as well as highlighting the pathways that have led to the identified outcomes.

Methodology

Key questions:

How relevant, effective, and efficient was the profiling process in creating unique spaces to inform solutions to displacement through a collaborative process?

Throughout collaborative data processes, JIPS aims to enhance government ownership to implement change that will positively affect the enjoyment of human rights by displacement affected communities. This change can be visible in policies and programs, but also through a strengthened coordination and collaboration with international and national actors that support resilient communities. A positive change that contributes to enhanced safety, security and protection of displacement affected communities can also be understood and amplified by enhanced accountability, good governance, and inclusion of said communities in government planning.

Which target groups and beneficiaries were reached through the profiling exercise, how effective was the targeting approach and did the collaborative platform and generated tools, as well as products, enable an effective and appropriate response to their identified needs?

Did the originally planned human resources and budget allow for a successful implementation and how were problems and challenges – such as remote support due to the COVID-19 pandemic – managed?

The performance evaluation will be split into 3 components: 1/ Review of the processes designed to carry out the profiling exercise, 2/ Evaluation of the changes generated through the profiling process, and 3/ recommendations that can enhance the impact of the exercise.

1/ The evaluation of the process will include an examination of all relevant technical tools and documents that guided the different phases of the profiling process, complemented by qualitative data collection with key stakeholders in the country, such as members of the Technical Working Group, relevant government officials and displacement affected communities among others.

2/ The evaluation of the achieved changes in creating unique spaces to inform solutions to displacement through a collaborative data process. It will analyze the outcomes that the project generated through Key Informant Interviews (KII) and Focus Group Discussions (FGD) with key stakeholders in the country such as members of the Technical Working Group, the Resident Coordinator’s Office, international and national organizations, relevant government officials and displacement affected communities among others.

3/ Analyzing observations from the performance evaluation, the recommendations will highlight opportunities in the processes used that can reduce negative outcomes and amplify positive outcomes.

The evaluation will apply a variety of methods that will allow to connect people, processes and technology in a coherent analysis aimed at enhancing the outcomes of collaboration:

• Desk review of key documents and tools used during the project exercise including – among others – tools from the JIPS Profiling Toolbox, ToRs, communication materials, request for support, documentation prepared for the phases of methodology design, analysis, and dissemination, with particular focus on joint analysis.
• Qualitative data collection through FGDs and KIIs with key stakeholders such as members of the Technical Working Group, UNHCR Philippines, JIPS, displacement affected communities and communities at risk of statelessness, local and national government officials, and civil society among others.
• Preparation for a multi-stakeholder evaluation workshop to share back and validate the findings from the evaluation, and to offer a forum to discuss and agree on the key recommendations. The organization and hosting of the event will be catered by the Technical Working Group.

Whereas the desk review can take place remotely, the FGDs and the majority of the KIIs are to be organized in the Philippines. The multi-stakeholder evaluation workshop is also to be organized in person in the Philippines with support from UNHCR and profiling partners.

Structure & Reporting lines

JIPS and UNHCR Philippines will identify a suitable consultant or consultancy firm as per the criteria set in the section “Profile”. JIPS will be the main focal point for the consultant, whereas UNHCR Philippines will provide support and guidance on identifying and setting up the relevant FGD and KII.

Within JIPS, the focal points for the consultant will be JIPS’ Head of Field Support & Capacity Building as well as the Information Management Officer who was JIPS’ focal point during the Philippines evaluation. From UNHCR Philippines side, the focal points shall be the protection associates involved as focal points from UNHCR during the profiling exercise in the Philippines.

Timeline

Activity

September

October

November

December

January

Deliverables

W1

W2

W3

W4

W1

W2

W3

W4

W1

W2

W3

W4

W1

W2

W3

W4

W1

W2

W3

W4

Recruitment of consultant

Onboarding of consultant + inception of evaluation needs & objectives

Methodology design, including tools for KII and FGD, finalization of workplan, recruitment of enumerators

Inception report

Organization of KII & FGD

Training of enumerators (FGD)

Data collection, data cleaning, first analysis

KII & FGD reports

Evaluation and report writing

Draft evaluation report

Validation workshop

Workshop report

Revision of first draft report

Presentation of final results at province level

Final report

Final report

Presentation of Final results to multi-stakeholder forum at BARMM level

Policy brief, summarizing and highlighting key take-aways from the evaluation and validation process

Policy brief (final version)

Outputs

1. An inception report outlining a clear understanding of the objectives of the consultancy as well as the proposed methodologies and tools, as well as a proposed structure of the final report
2. Data collection, including the recruitment and training of enumerators
3. A draft final report providing an in-depth analysis of the identified impact of the profiling exercise.
4. A workshop report based on the provincial validation workshops organized. These workshops will have as aim to get a general consensus on the content of the process and impact evaluation and will also serve to inform the writing of the final report.
5. A final report – for internal use – outlining the impact and how the processes used and applied during the profiling exercise have contributed to the impact of the exercise, as well as highlighting external elements that contribute positively and negatively to the process and its impact.
6. A policy brief, summarizing the findings of the final report and which will be used for global dissemination.
7. Contribution to a dissemination event at the BARMM level, bringing attention to the profiling exercise and the impact generated through the activity.

Profile

JIPS and UNHCR Philippines will recruit an independent consultant or consultancy firm based in the Philippines to conduct an independent evaluation. The consultant shall have the following qualifications;

• At least 6 years of prior experience conducting evaluations in the humanitarian or development field;
• At least 3 years of prior experience in evaluating activities and programs linked to forced displacement;
• Previous experience working with, and including communities in evaluations;
• Previous experience working with, and including government officials and decision makers in evaluations;
• Previous experience working on or with large scale data collection exercises;
• Previous experience with impact and/or process evaluations;
• Good written and spoken English skills;
• At least have a bachelor’s degree in political science, social science, statistics or any other related subject;

Additionally, the consultant should ideally also have;

• Native knowledge of the Philippines context and culture;
• Native knowledge about local languages;
• Experience in organizing and facilitating workshops;

Required documents

To a minimum, the applicant should provide;

• CV
• Motivation letter
• At least 2 examples of previous work highlighting English capacities
• Filled RFQ

How to apply

Please send an email to [email protected]

More documents may be required

Consultants must be registered as individual or companies in their home country