Final Evaluation Study – Promoting Women’s Inclusion in Peacebuilding

Search and UNW seek to compensate for the lack of equal representation of women in the national political process by including key bodies established to facilitate the country’s transition toward peace.

1. Context

• The Project

Search is implementing a 12-months project commissioned by The United Nations Entity for Gender Equality and the Empowerment of Women (UNW) with the objective of “increasing trust and cooperation across diverse communities, to create opportunities for strategic alliances between women’s rights actors and leaders to influence the country’s future”. Search and UNW seek to compensate for the lack of equal representation of women in the national political process by including key bodies established to facilitate the country’s transition towards peace.

The project focused on engaging women’s rights actors, women leaders and women’s organizations through capacity building; building bridges between women and established women’s groups that are already engaged in national Track I and II *(Track I: Top Leadership; military/political/religious leaders with high visibility; Track II: Middle Range Leadership; unofficial, non-governmental, analytical, policy-oriented, problem-solving, experienced and informed actors who interact with community members and aim to develop strategies, to influence public opinion, organize human and material resources in ways that might help resolve their conflict. Track II has access to high level decision makers and negotiation/advocacy processes and efforts.)*of the political process; and contributing to transforming norms around gender roles. The project also engaged men in order to build alliances and support for women’s engagement with their male peers in the target areas. This holistic approach ensured the meaningful participation of a diversity of women in addressing common issues and/or issues related to gender equality and women’s rights linked to the political process, and the amplification of their voices into the national political process.

Search conducted an initial mapping to identify grassroot local leaders to be trained as Insider Mediators (IMs) and Track I and II actors through specific selection criteria. The results of this intervention realized a successful implementation of capacity building workshops, conflict scans, community dialogue processes and community-led initiatives in each target area, which provided the Insider Mediators with a key opportunity to apply skills gained and contribute to achieving the project’s objectives. The project increased the ability of IMs to: 1) identify conflicts and tensions within local communities; 2) sensitively and constructively address these conflicts and inequalities by leveraging local resources, conducting sensitization workshops and inclusive dialogues, and noting conflict- and gender-sensitive principles; and 3) effectively identifying and building networks of women leaders. The project also increased local IMs knowledge of local conflict dynamics, particularly as these relate to issues surrounding gender equality and women’s rights linked to the political process, and led to the compilation of priority community conflict drivers.

The local IMs participated in Track III (Track III: Grassroot Leadership; trusted local personalities, such as civic, social, religious, or political leaders, who are themselves an intrinsic part of the conflict context. As such, they can engage rapidly and directly with disputing parties from across social divides. Track III has access to civil society, local decision makers, and can represent the community and speak on its behalf since they have insider knowledge.) activities at the cross-governorate level to discuss learnings and approaches to promoting gender equality, women’s rights, and women’s participation in political and peace processes, as well as entry points into the national political process, and key local grievances impacting women and girls that need to inform the political process. Local women IMs have exchanged visits with women already engaged in Track II to foster an opportunity to learn about issues raised by IMs at the local level. The project also contributed to the implementation of a buddy program pairing up members of each target group with another member in order to promote sustainable linkages between local women and Track II women’s groups and to ensure an ongoing exchange from both sides.

Target groups

The primary target groups of the project are 45 IMs and 20 Women Track II actors. The secondary target groups are the wider members of target communities; specifically vulnerable women groups such as internally displaced persons (IDPs), minorities, and poor households.

2. Goal and Objectives of Study

• Search is seeking a consultancy team/firm that can conduct a summative Endline Evaluation study to understand the extent to which the project has contributed in increasing trust and cooperation across diverse communities to create opportunities for strategic alliances between women’s rights actors and leaders across diverse communities to influence the country’s future. This study will also aim to assess the project’s progress towards its specific objectives.

SO.1: Increase tolerance, collaboration and alliances on key gender equality issues across women’s rights actors, women’s leaders and women’s organisations at the community level

SO.2: Increase participation of diverse women and inclusion of gender perspectives in the political process

The Final Evaluation Study should enable Search to inform future programme design and will assess the overall success and effectiveness of the implemented project. In specific terms, The Final Evaluation has the following objectives:

• Assess the overall impact of the project based on evidence-based outcomes whether intended (according to the project’s logical framework) or unintended outcomes (positive or negative) and determine Search’s contribution to identified changes.
• Update the project’s logframe and indicators with endline values.
• Assess whether the project had produced the effects as envisioned in the Theory of Change in addition to assessing the project’s Relevance, Efficiency, Effectiveness and Impact, and Sustainability as per the Organisation for Economic Co-operation and Development – Development Assistance Committee (OECD-DAC) evaluation criteria in addition to the overall project’s adaptability; and
• Capture good practices, compile lessons learned throughout the lifespan of the project and draw actionable recommendations to inform future programme design in a similar context.

This study is expected to give specific focus to assessing the progress, effectiveness and relevance of the activities towards achieving the objectives and outcomes of the project. The activities conducted are 1) capacity-building training program including facilitation and dialogue, non-violent conflict resolution, leadership, gender-sensitive approaches to peacebuilding, and project and financial management, 2) local conflict dynamics and gender needs scanning, 3) facilitation of IM-led community dialogue processes, 4) community initiatives intended to strengthen women’s interventions and leadership in contributing to peacebuilding, 5) Engaging Track II and Track III women in conflict management, and 6) conducting buddy program for different young women actors.

3. Key Questions of the Study

• End-line Questions

The analysis will be focused on the following evaluation questions organised by criteria. The study is expected to prioritise collecting feedback from direct and indirect participants including IMs, Track II women actors, Women’s CSOs, and community members.

• Relevance:
• To what extent did the intervention’s objectives and design respond to women’s needs (specifically on gender equality and women’s rights) related to creating opportunities for strategic alliances between women’s rights actors and leaders across diverse communities to influence the country’s future?
• To what extent has ‘do no harm’, conflict sensitivity and barriers been taken into consideration in the design and implementation of community-led initiatives and what are the effects of these interventions and how are they contributing to peacebuilding?
• To what extent did the intervention’s objectives and design align with and contribute to Search’s Levant Strategy?
• Effectiveness and Impact:
• To what extent has the intervention been effective in meeting the essence of the Theory of Change and achieving its results and planned outcomes by addressing common issues and/or issues related to gender equality and women’s rights linked to the political process, and the amplification of their voices into the national political process and by assessing:
• The level of change in knowledge and capacities of Insider Mediators;
• The level of change in personal agency among Insider Mediators towards the ability of making positive difference in the community around gender equality and women’s rights issues;
• The change in women’s actors perception of having tangible opportunities to access political and peace processes at different level;
• The level of engagement and exchange between Track III and Track II women actors and other stakeholders to support the effective achievement of the intervention’s objectives
• by addressing common issues and/or issues related to gender equality and women’s rights linked to the political process, and the amplification of their voices into the national political process.
• What unintended outcomes (positive and negative) emerged from project implementation?
• What factors (positive and negative) have had the greatest influence on the achievement of results?
• To what extent the intervention could contribute to longer-term effects (impact)?

Efficiency and Value for Money:

• To what extent have resources been allocated and utilised in an efficient manner to achieve value-for-money?
• How efficient was the delivery of the intervention in terms of expenditure and implementation of activities?

Sustainability:

• To what extent are the benefits of the program (specifically on gender equality and women’s rights) likely to sustain in the long term? What are the main factors behind this?
• What are efforts required to improve and strengthen sustainability?
• To what extent did the women’s actors show efficiency and ownership towards the project?

Lessons Learned:

• What lessons can be learned or good practices can be identified from the implementation of the project?

4. Geographic Locations

• The Endline Evaluation study will provide quantitative and qualitative information, gender, age, ethnicity, religious background, and residency status (host community member, IDP and refugee) disaggregated data and analysis in a strategic county in the MENA region.

5. Methodology and Data Collection Tools

• The Endline Evaluation Study will utilise a mixed method approach consisting of both qualitative and quantitative primary and secondary data collections. The study should triangulate data from multiple sources and stakeholders in order to infer reliable findings.

Desk review: the consultant(s) will review key project documents including the proposal, the baseline and mapping report, MEL framework, logframe and set meetings with key personnel to better understand the project, its goal and activities. The consultancy firm is expected to review the above background documentation as part of the desk review phase of the study, in addition to the literature review about the Gender context. Also, the consultant will utilise primary available M&E data that was formerly collated by project staff including activity surveys and assessments, baseline data, project quarterly reports, etc.

Data collection tools and approach: The consultant(s) will develop quantitative and qualitative data collection tools and collect data in the form of surveys, interviews, focus group discussions (FGDs), and possibly case studies using a solid sampling approach. To ensure a better understanding of the key issues that will be addressed in the project, the data will be disaggregated by age, sex, gender, age, ethnicity, religious background, and residency status (host community member, IDP and refugee), persons with disabilities as well as by geographical location.

Sampling strategy and approach: The consultant(s) shall determine the appropriate sample size and approach in consultation with Search MEAL Manager and referring to the M&E plan. The sampling strategy will take into consideration the activities carried out, target population and the project areas (95% Confidence Level and 5% Margin of error). The consultant(s) will meet with the project participants, partners, Search staff and relevant stakeholders.

Evaluation matrix: The consultant(s) is also required to develop a detailed evaluation matrix with judgement criteria that captures the study’s objectives and evaluation questions of which will guide the evaluation process into reliable judgments and outcomes.

Search’s MEAL Manager will validate and approve the final methodology and tools before data collection begins, as well as provide feedback on the report.

Data collection, analysis and the results should represent Inclusiveness—the methodology should include a wide range of viewpoints, specifically gender and age-sensitivity when applicable.

6.Deliverables

• Search expects the following deliverables from the external consultant(s) as they correspond to the timeline and budget:
• An inception report detailing the methodology, data collection tools, analytical framework, approach and timeline;
• All original datasets should be submitted to Search (Excel format for the quantitative data and all transcripts for the qualitative data); In addition to any necessary training of data collectors or set-up of systems for data collection
• A draft endline report in English for review by Search staff; and
• A final report in English (40 pages max in length, excluding appendices) consistent with Search branding and standards for evaluation. The report will:
• Uses the Search reporting template;
• Provides a clear connection between the conflict or context assessment and the intended results, articulate the project’s ToC, and include other relevant project specifics;
• Fully explains the objectives and research questions of the study, limitations and methods chosen for analysis;
• Findings respect Search’s evaluation standards, are structured around the main objectives of the study, and are presented in relation to the intended target groups. The findings should speak to the link between the project, its Theory of Change and its contribution to our strategy. It should explain adaptations that occurred during the project and their impact on results;
• Recommendations should have a clear audience and be specific, accessible, and actionable;
• Indicator table showing all indicators;
• Appendices should include detailed research instruments, list of interviewees, terms of references and evaluator(s) brief biography.
• A two-pager summary highlighting key lessons learnt in this project that will inform Search programming in the future;
• A PowerPoint presentation that will be used by the consultancy team to present the findings to Search and the donor after the final report is approved.

7. Logistical Support

• Regardless of the modality chosen, the firm/consultant(s) should be fully responsible for the data collection, including working with data collectors to be recruited and trained by them in case needed. In case of in-person data collection, the firm/consultant(s) will be responsible for organising their own logistics for data collection (vehicles, fuel, and drivers). All of this must be budgeted into the financial proposal.

In addition, Search and partners will share the following elements with the external consultant(s): background materials including the project proposal and logframe, etc.

8. Ethical Considerations

• The consultancy should take into consideration the rights of participants in line with the ethical codes and guidelines of research. The participants should be asked to provide their consent and made aware that their identities would not be revealed. Cultural rights will be respected. The consultant shall remain alert and responsive to any child safeguarding risks, acquire relevant knowledge and skills which will enable promoting strong safeguarding practices, understanding the child safeguarding policy and procedures.

The firm/consultants are required to respect the following ethical principles:

• Comprehensive and systematic inquiry: Consultant should make the most of the existing information and full range of stakeholders available at the time of the review. Consultant should conduct systematic, data-based inquiries. He or she should communicate his or her methods and approaches accurately and in sufficient detail to allow others to understand, interpret and critique his or her work. He or she should make clear the limitations of the review and its results.
• Competence: Consultant should possess the abilities and skills and experience appropriate to undertake the tasks proposed and should practice within the limits of his or her professional training and competence.
• –Honesty and integrity: Consultant should be transparent with the contractor/constituent about: any conflict of interest, any change made in the negotiated project plan and the reasons why those changes were made, any risk that certain procedures or activities produce misleading review information.
• Respect for people: Consultant should respect the security, dignity and self-worth of the respondents, program participants. Consultant has the responsibility to be sensitive to and respect differences amongst participants in culture, religion, gender, disability, age and ethnicity.

Applicants are kindly required to integrate a detailed multiple scenario strategy in their proposed methodologies and work plans that would ensure efficacy in the delivery of the assignment and allow for flexibility to switch between different modalities (i.e., to virtual data collection and vice-versa) whenever there is a need to do so.

9. Data Quality Assurance and Management

• All deliverables will be reviewed and approved by the country office and global Institutional Learning Team prior to acceptance of the final product. The consultant(s) are also required to develop a clear and rigorous quality control plan during the inception phase of which will be implemented and deployed throughout all phases of the evaluation process to ensure reliability and validity of findings.

To ensure effective data management, all the qualitative collected data (through FGDs, KIIs) will be transcribed with the respect to the data collection ethics. All the quantitative surveys will be cleaned and stored in a secured database. Access to the data will be allowed to the staff members who work on the final evaluation and will be limited to those who have the password.

10. Timeline

• The evaluation timeline is expected to be kicked off in December 2022 and concluded by the end of February 2023 by submitting the final deliverables requested above.

11. Budget

• The total budget available for this study is 15,000 USD. A detailed budget should be provided, including daily rates for personnel, and costs related to data collection (per total number of people sampled, sites for collection, etc.), analysis, and production of deliverables. The selection committee will give preference to the applicant(s) with a relatively lower budget and higher quality technical proposal.

12. Requirements of Consultant

Education:

• Lead consultants must have at least a Master’s degree (PhD preferable) in research methods and/or evaluations, development, conflict or peacebuilding, M&E or any related social sciences.

Skills and experience:

The following skills and experience are expected by Search for our evaluator for this project:

• Excellent proficiency in English and Arabic – written (including professional English reporting) and spoken;
• More than five years of experience in programme/project evaluation, including collecting data in interviews, surveys and focus groups and analysis;
• Experience in carrying our studies, evaluations, and baseline on Women Peace and Security (WPS) in the Greater Levant region;
• Experience applying remote data collection modalities in conflict areas in the Greater Levant region;
• Understanding of the UNSCR 1325 and its localisation in the Greater Levant context;
• Experience in conflict analysis and working with justice, civil society sectors and gender related topics;
• Experience in doing evaluations for peacebuilding and democracy, human rights and governance programmes in MENA region;
• Experience working with international organisations;
• Experience conducting quantitative surveys and analysis;
• Monitoring and Evaluation methods and data collection skills; and
• Familiarity and experience with contextual challenges in the geographic location(s) where the study will take place.

13. Selection Criteria

• Consultant proposals will be selected for:
• Relevance of proposed methodology to the goal, objectives, and research questions for the project.
• Quality of proposed methods, conflict sensitivity approaches, and quality control measures.
• Qualifications of the candidate(s).
• Proposed budget in relation to proposed methodology, deliverables and team.
• Timeline for proposed activities.