RFQ FY22 114 Champions of Change- Synthesis of Evaluations

1. Background Information on Plan International

Plan International is an independent development and humanitarian organisation that advances children’s rights and equality for girls.

We believe in the power and potential of every child. But this is often suppressed by poverty, violence, exclusion and discrimination. And it’s girls who are most affected. Working together with children, young people, our supporters and partners, we strive for a just world, tackling the root causes of the challenges facing girls and all vulnerable children.

We support children’s rights from birth until they reach adulthood. And we enable children to prepare for – and respond to – crises and adversity. We drive changes in practice and policy at local, national and global levels using our reach, experience and knowledge.

We have been building powerful partnerships for children for over 75 years, and are now active in more than 70 countries.

Read more about Plan International’s Global Strategy: 100 Million Reasons at https://plan-international.org/strategy

2. Background/Context

Champions of Change (CoC) is Plan International’s community-wide strategy for promoting gender equality and social norm change through youth organization, engagement and peer-to-peer mobilization. It aims to advance gender equality by engaging girls in a process of empowerment and by working with boys to challenge dominant masculinities and to support girls’ empowerment.

Champions of Change was initially implemented from 2012-2015 in five countries in Latin America. The programme encouraged and supported young men between the ages of 14 and 18 to redefine masculinity and become change agents and peer educators for gender equality and girls´ rights. In the subsequent years, the model began to scale up and roll out to other Latin American countries, as well as to other regions in the world. After 3 years of its implementation, in 2015, an evaluation was conducted and recommended that a follow-up phase for CoC should include girls as well.

Champions of Change developed the Monitoring, Evaluation and Learning (MEL) Package on CoC, including Results Framework (incl. indicators), MEL activities to guide the sampling and data analysis, Data collection tools, etc. To date, CoC has been implemented across the PI federation in over 116 projects or programmes in more than 46 countries. Most of these have integrated the CoC component into a broader project, whilst only a few are CoC stand-alone projects.

A wide range of evaluations of CoC projects have been conducted, especially in the Latin American and Eastern / Southern Africa regions. From the light touch Synthesis of Evaluations, which is a brief analysis of the existing materials was done in February 2022, 40 evaluations were done so far, with a majority of them being final evaluations and around 1/4 being midterm evaluations. Also, 4 interventions using CoC are currently in the process of concluding their evaluation reports and, once approved, these reports will be added to the list of evaluations considered for the purpose of this Synthesis of Evaluations.

In addition, a current consultancy is underway to revise the boy’s modules. This process has included important evaluative data and work that should be included in this review. It includes a Survey to CoC facilitators (FCoCs) including their opinion on each of the fifty-six (56) activities from the five (05) modules. Furthermore, it includes focus group discussions with participants, a proposal for a simplified M&E framework, information from “master trainers of CoC Facilitators”. In addition to this, data, from the Gender Transformative Programme and Influencing Practices Mapping conducted in the West and Central Africa (WACA) Region should also be considered.

There is therefore a need to conduct a Synthesis of Evaluations to bring together evidence from all different regions of the PI federation to compare patterns, trends and issues that are emerging from the different regions of the federation. This global analysis will also help identify results, good practices that could be scaled-up further and potential gaps and challenges in implementing CoC. It is against this background that we are seeking for a consultant/s to carry out this assignment as a first step of building the evidence of the programme

Description & Objectives

Purpose

The objective of the consultancy is to conduct a Synthesis of Evaluations of the Champions of Change programme by collecting all the learnings from existing final and midterm evaluations, analysing existing M&E data from past and current CoC projects and giving recommendations to improve the quality of the existing evaluations.

3. Evaluation Questions

3.1 Questions on results and lesson learned about CoC programming across countries

In this component of their mission, the consultant(s) will be looking at what the evaluation reports tell of the achievements of the interventions’ intended results. Their findings will help Plan International understand the results of the CoC programming as well as improve the development and implementation of CoC interventions.

Overall questions to be analysed through the Synthesis of Evaluations (Kindly note that the list is not exhaustive and may be enhanced by the consultant in the proposal):

• What is the effectiveness of CoC programming? i.e. to what extent is CoC achieving its intended results, including:

o Shifts in social norms

o Improvements in gender relations

o Strengthening youth collective action

o Changes in the policy and legislative environment

• What are the indicators for which evaluations often record a significant progress and the indicators for which evaluations often do not? What are the reasons (i.e. enablers and barriers) for this?

• What are the indicators for which evaluations often record a significant gap between boys/girls, men/women, age groups, etc.? What are the reasons (i.e. enablers and barriers) for this?

• What are the key lessons learnt (both successes and challenges) regarding CoC programming implementation, considering, for example:

o different contexts?

o standalone vs. integrated models?

o different modules of CoC?

o innovations to respond to the context of Covid-19?

• Do the CoC initiatives engage with key stakeholders for policy and social change at all levels – local to global? Has it been able to connect and amplify young people’s voices on gender issues?

• What is the evidence of the programme’s impact and sustainability (at project and country level)?

• What are the opportunities and challenges, in relation to scale up and hand over the programme to local authorities or other stakeholders? (if planned)

• What are key recommendations that are consistent or recurring, with regards to CoC programming?

3.2 Questions on the quality and completeness of Champions of Change evaluations

The consultant together with a reference group will elaborate a Quality assessment “raster” to be applied for the review of each evaluation or research reports.

In evaluating the quality of the evaluation products and processes, the consultant should consider the following indicative questions (the list is not exhaustive and may be enhanced by the consultant in the proposal

• Are the evaluations complete in terms of data collection, data analysis and elaboration of recommendations? If so, do they fulfil a required quality standard that allows further analysis?

• Do the evaluations themselves consider gender as a cross cutting principle (from data disaggregation to assessment of impact)?

• Does the evaluation design allow robust assessment of the contribution, limitations and gaps of the CoC approach?

• Do the evaluations develop actionable recommendations for the design of future CoC projects?

4. Users of the Synthesis of Evaluations.

The audiences for the study include:

• programme staff and managers from Plan and its partners implementing CoC.

• funders and other external stakeholders working with CoC or similar model

5. Methodology

The methodology should be explained in detail in the inception report by the consultant and will be discussed with the PI multi-disciplinary reference group in charge of the supervision of this Synthesis of Evaluations. However, indicatively, the methods envisaged include:

5.1 Desk review of evaluations and other CoC reports

The methodology should be explained in detail in the inception report, but it is expected that the consultants will do preliminary desk research on Plan’s gender transformative programme approach and other project documentation at the start of the assessment (provided by Plan).

The consultants will also do a content analysis of the completed country evaluation reports (midterm and/or final), supplementary monitoring and evaluation data for all CoC projects across the federation (including evaluations in planning stage); as well as other CoC relevant materials.

As a first step, it will be necessary to define the minimum standards for a project to be defined as a so called “CoC project”, in consultation with the coordinator and reference group. Also, quality standards will need to be defined for evaluations to be considered for Synthesis of Evaluations. These definitions will guide the sampling of existing and ongoing evaluations to be considered for the Synthesis of Evaluations.

As part of the Inception Report, the consultant is expected to propose an approach for sample selection of evaluations, the structure of data extraction in relation to the key evaluation questions (analysis matrix) and the criteria for the evaluation quality assessment.

5.2 Key Informant Interview

Key Informant interviews should be conducted with the following:

• Members of the Reference Group for the CoC M+E (o*utlined below)*

• project-based Gender Specialists and the CoC specialists (including trainers of CoC facilitators); Plan CO staff working in civil society support to youth organisations; the technical advisors, program managers, M&E specialists, program directors (to be determined)

• Possibly external actors i.e. academics involved in similar Synthesis of Evaluations processes, evaluations of CoC or similar approaches

6. Roles and responsibilities

A multi-disciplinary reference group consisting of Plan International staff will be formed to guide this Synthesis of Evaluations process. It will consist of:

1. Global Champions of Change Coordinator, Plan International (GH).
2. Global Safer Cities Coordinator, Plan International (GH).
3. Regional Gender and Inclusion Specialist, Region of the Americas.
4. Global Gender Equality Specialist (GH).
5. Monitoring and Evaluation staff from National Offices and COS who are currently working in the CoC MEL working group.
6. Selected CO CoC staff and facilitators from across the Federation.
7. Global Monitoring and Evaluation Specialist from the Global Monitoring, Evaluation Research and Learning (MERL) Hub.

The global CoC coordinator will ensure coherence with the other three groups (including reference groups) that are currently providing direction and feedback to CoC global process including consultancies.

7. Timeline

This work is expected to start in May 2022 and completed by June 2022 for a total number of approximately 40 working days with possible no cost extension, in the first quarter of FY23. (Plan’s new FY23 starts on 1^st July 2022).

1. Inception Call/ Workshop and writing the inception report

Duration/ Date due: Within the first two weeks after signing the contract

Days of Work: 5 days

2. Revision of Evaluations and other key material, key informant interviews

Duration/ Date due: One month after submitting the Inception report

Days of Work: 13 days

3. Analysis and report writing

Duration/ Date due: Analysis, report writing and submission of the report after revision of evaluation report

Days of Work: 12 days

4. Feedback and validation of findings with key stakeholders and respondents

Duration/ Date due: Two weeks to receive feedback and to validate the findings

Days of Work: 7 days

5. Presentation of the Synthesis of Evaluations findings and Submission of Final Report

Duration/ Date due: After the finalization of the report

Days of Work: 3 days

Total No of Days: 40 days

8. Deliverables and Timeline

Key Deliverables

• Inception Report

• Key informant interviews

• Final Report

• Presentation of Findings

9. Budget

Payment to the selected Consultant (s) will be in instalments and subject to the completion of and approval of Deliverables by Plan International as follows:

• First payment (following approval of the inception report) 20% of total budget

• Second payment (following approval of first draft of the report) 50% of total budget

• 30% of the total budget will be retained until the final version of the report and the presentation have been approved by Plan International

10. Expected qualifications

A successful applicant should meet most of the following requirements:

• University degree from an appropriate field (e.g. social development or gender studies)

• Strong understanding of gender equality, gender transformative programming and human rights

• Minimum of 5 years work experience with gender programming, research and / or evaluations

• Proven experience in carrying out qualitative and quantitative evaluation and/ or research initiatives

• Proven experience with qualitative and/or quantitative data analysis, including proficiency in statistics

• Proven track record of conducting independent research/ evaluations, including on meta level, of development programs from a gender perspective

• Ability to work independently with minimal supervision, adhere to deadlines and deliverables

• Extremely strong analytical and writing skills
• Fluency in English, working knowledge of Spanish and /or French is desirable

11. Contact

Any questions or comments related to this consultancy should be directed to Alejandra Agredo at [email protected]. Please include the RFQ reference number RFQ FY22 114 Champions of Change- Synthesis of Evaluations in all correspondence

12. List of documents to be submitted with the RFQ

Applicants interested in conducting the study, are asked to include the following documents/information in their proposal:

1. A cover letter outlining how they meet the expected criteria outlined in this Terms of Reference, including relevant experience with similar organisations

2. A short methodology and timeline outlining how they plan to undertake the study, explaining how work will be completed according to the Terms of Reference ensuring successful completion of assignment; as well as explaining the ethics and child safeguarding approaches, including any identified risks and associated mitigation strategies.

3. Two samples of previous primary research or evaluation work including quantitative, qualitative, and participatory elements.

4. CVs of the consultant(s) who will carry out the work.

5. A detailed proposed budget required to conduct the study, including daily fee rates in EURO or GBP, expenses, VAT etc. The respondent is strongly encouraged to provide its best price in its response as no guarantee is made that there will be any opportunity to negotiate pricing at any point during the selection process Please submit your proposal in PDF or Word format. No Links will be accepted except for examples of previous work.

13. Submission of proposals

Please send your application to [email protected] *by 26^th April 2022 23:59 (BST) referencing “RFQ* FY22 114 Champions of Change- Synthesis of Evaluations” in the subject line and including support documents as outlined.

Interviews with shortlisted consultants are likely to take place between 3- 5^th May 2022.

14. Evaluation of offers

Shortlisted suppliers may be invited to discuss their proposals in more detail at Plan’s discretion.

Plan International, at its sole discretion, will select the successful RFQ.

Plan international shall be free to:

· Accept the whole, or part only, of any submission

· Accept none of the proposals

· Republish this Request for Quotations

Plan International reserves the right to keep confidential the circumstances that have been considered for the selection of the offers.

Part of the evaluation process may include a presentation from the supplier.

Women-owned businesses and companies actively engaged or advancing gender equality and women empowerment in the workplace are especially encouraged to apply

Value for money is very important to Plan International, as every additional £ saved is money that we can use on our humanitarian and development work throughout the world.

Plan International may award multiple contracts and all contracts will be non-exclusive. **

15. Contract & Payment terms

Please note that, if successful, Plan International’s standard terms of payment are 30 days after the end of the month of receipt of invoice, or after acceptance of the Goods/Services/Works, if later.

16. IR35 Requirements – Only applicable for UK based or connections to the UK Consultants

As of April 2021, all Global Hub UK-based contractors (Consultant/personal service company/agency/intermediary) employing “people” in their chain to deliver serves to Plan International must follow a strict process of IR35 determination.

Plan Limited will conduct a CES tool on all relevant shortlisted proposers as outlined above to determine whether they fall inside or outside IR35.

17. Plan International’s Ethical & Environmental Statement

The supplier should establish environmental standards and good practices that follow the principles of ISO 14001 Environmental Management Systems, and in particular to ensure compliance with environmental legislation (as applicable)

18. Clarifications

The onus is on the invited individual/companies to ensure that its offer is complete and meets Plan International’s requirements. Failure to comply may lead to the offer being rejected. Please therefore ensure that you read this document carefully and answer fully all questions asked.

If you have any queries in relation to your submission, or to any requirements of this RFQ, please email: [email protected]

Thank you for your proposal