The Evaluation of Somalia Information and Resilience Building Action Programme (SIRA).

Title: The Evaluation of Somalia Information and Resilience Building Action Programme (SIRA).

Organization: Swiss Agency for Development and Cooperation (SDC), Embassy of Switzerland in Kenya.

Duration: Between July and September 2022.

Number of days: 30 days maximum.

Contract Type: Consultancy.

Closing date: 26 June 2022.

1. Purpose

This Terms of Reference (ToRs) provides the framework for the external evaluation of the Somalia Information and Resilience Building Action Programme (SIRA). SIRA aims to contribute to the improved resilience for agro-pastoral households through increased income from improved fodder value chains.

In 2018, Switzerland developed a 9-year entry proposal with FAO – Somalia Information and Resilience Building Action (SIRA) – with a 10-months opening phase to concretely identify interventions that contribute towards a longer term resilience building of the Somalia communities and to provision of reliable data for decision making. In the current three-year phase, Switzerland contributes USD 6 Million to the Somalia Joint Resilience Action (JRA). JRA Framework was launched by WFP, UNICEF and FAO to contribute to resilience building in two regions in Somaliland (Awdal and Togdheer).

The purpose of the evaluation is to assess specific aspects of the relevance, efficiency, effectiveness, sustainability and lessons learnt of SIRA programme in achieving its objectives. The evaluation will include transversal themes such as gender, good governance and conflict sensitivity programme management (CSPM) in the programme delivery and is expected to generate learning and recommendations for SDC and the relevant stakeholders. The evaluation is expected to also inform the planned next phase of the programme, and areas for enhanced synergies with other programmes in food security domain of the Swiss Regional Cooperation Programme for the Horn of Africa.

2. Context

Frequent natural disasters and conflicts have left Somali populations chronically food insecure. Recurrent droughts have severe impacts on the livestock sector that supports over 60% of the population in Somalia. The sector provides food, employment and incomes and contributes 40% of the GDP. Gender disparities in regards to income, access to resources and decision making power remain however important. Fodder is a key resource for Somali communities and their livestock, both in regards to income and prevention of drought-related emergencies.

Despite the potential of the Somalia livestock sector, there are huge structural weaknesses that hamper the harnessing of its full potential. The availability of year-round affordable good quality feed and fodder is a key to improve animal quality, to mitigate lack of pasture and browse during droughts[1] that lead to a large number of animal losses and resource based conflicts. In order to appropriately respond to disasters and shocks, a rigorous food security, nutrition and natural resources management information system is needed to provide timely, credible and locally owned analysis.

3. The Somalia Information and Resilience Building Action (SIRA)

SIRA aims at improving agro-pastoral livelihoods by focusing on fodder value-chain improvement, specifically support communities to enhance and sustain efficient fodder market systems. It will contribute to increased resilience in Somaliland through, enabling agro-pastoral communities to enhance and sustain efficient fodder production and fodder market system to absorb and adapt to shocks and stresses. It is aligned with the visions of the Somalia National Development Plan, 2017-2019 (NDP), the 2017-2020 United Nations in Somalia Strategic Framework (UNSF), and targets of the Sustainable Development Goals (SDGs) related to implementation areas. As a contribution to the JRA, the project will support communities to enhance their livelihoods, engage with market systems and sustainably manage natural resources for livelihoods. In doing so, SIRA contributes to the JRA outcome 1; improved consumption of adequate nutritious food within vulnerable households through increased and diversified agricultural production and income sources.

The first component of SIRA aims at improving agro-pastoral livelihoods by focusing on fodder value-chain improvement, specifically support communities to enhance and sustain efficient fodder market systems. The second component, contributes to FSNAU and SWALIM that provide timely information and analysis on the food, nutrition, livelihood security and natural resources situation in Somalia. Early warning and early action information mainly benefits the Government institutions, the civil society, development partners and the larger public, who can better plan and regulate drought emergencies and inform community resilience building.

In doing so, the Action contributes to the following key outcomes:

1. Outcome 1: Household incomes in target communities in Awdal region are enhanced from the sale of fodder.
2. Outcome 2: Risks to peoples’ lives and livelihoods are reduced through provision of information for action (FSNAU & SWALIM).

4. Objectives and scope of the evaluation

As indicated above, the evaluation will assess relevance, effectiveness, efficiency, sustainability, and identify and document lessons learned, best practices, gaps and recommendations. In view of consolidating the Swiss food security portfolio, a focus will also be put on synergies with planned Regional Livestock Programme (RLP).

5. Guiding questions

The following non-exhaustive key tasks/questions should be addressed:

Relevance

1. Was the design of SIRA appropriate to the context? How well are the two strategic objectives of the program aligned to the Theory of Change?
2. How relevant are the programme’s objectives to improve household resilience and incomes through the sale of fodder, livestock based livelihoods and sustainable socio-economic development for women and men in Awdal region of Somaliland? Has the program considered supply and demand dynamics of feed and fodder products for the target communities and markets?
3. To what extent is the programme aligned with the Somalia (especially on outcome 2) and Somaliland national development plans, livestock development and drought resilience strategies for socio-economic development, donors and other relevant stakeholders’ priorities?
4. What is the (potential) relevance of the project to the larger Somalia/regional context and the contribution to the UN agencies Joint Resilience Action (JRA)?
5. How relevant is information on climate, livelihoods, food security and nutrition to the reduction of the risks to people’s lives and livelihoods?

Effectiveness:

Evaluate the extent to which the programme is delivering on the outcomes expected to achieve the objectives;

1. To what extent did the program contribute to enhanced households’ resilience to droughts and increase their incomes in the target communities of Awdal region through increased production and the sale of fodder?
2. To what extent is the support for the technical and organizational capacity of Somali institutions to conduct food, nutrition and livelihood security assessment and analysis supported and effective for policy and programme decision-making?
3. How effective is information on climate, livelihoods, food security and nutrition processed and made available to the target community for early warning and early action? Is the application of the information reduced risk to lives and livelihoods, especially in Awdal region?

Efficiency:

1. Based on the risks identified during the planning and implementation period, how did the programme mitigate these risks to achieve the programme objectives?
2. How efficient were the resources utilized based on the project results/outputs? How efficient is the project in terms of costs versus the benefits to the communities and possible opportunities for sustainable development?
3. In how far did the SIRA programme use synergies and complementarities with other interventions from the Government or those supported by Switzerland[2] and other donors? In how far did engagement in coordination with other initiatives avoid duplication of efforts?
4. How efficient was the project in terms of promotion of local innovation through enhancing access to knowledge and piloting?

Sustainability;

1. Is the SIRA model of fodder production, supply and marketing a sustainable economic activity for communities in Awdal region?
2. To what extent has the project established local institutional capacities and ownership – both at the local cooperatives and associations’ level, research institutions (universities) and at the national relevant line ministries, more specifically with the Somaliland Ministry of Livestock and Fisheries Development and the Somalia National Bureau of Statistics (SNBS)?
3. How is the transfer of responsibility of the management of FSNAU/SWALIM to the national mandated institutions supported by the programme for the quality and timely production of information and data for early warning and early action, line with the longer vision of the project.
4. Has the facilitation and the engagement of the relevant Government agencies, improved delivery of services and adoption of best practices? In how far did the approach to strengthen and work through the country governance system increase or decrease efficiency?
5. To what extent is the knowledge, information and experiences documented and shared during the programme implementation, influence the future of livestock development?

Gender, good governance, diversity and conflict sensitivity

1. To what extent was the programme implemented in a conflict-sensitive manner and has it contributed to a reduction of conflicts, mainly natural resource based communal conflicts?
2. How has the program contributed to women participation and empowerment (leadership, decision-making, livelihood support and access to resources and investments) and transformation of gender relations? To what extent did the approach to promote women roles e.g. in user committees, fodder associations and cooperatives? In how far did these consolidate gender disparities?
3. How has the program contributed to enhanced social accountability, participation, transparency, non-discrimination, governance effectiveness and efficiency, and rule of law?
4. Has the programme promoted the do-no-harm principles and inclusion of minority groups?

Lessons Learned and Recommendations

1. What lessons can be learned from the programme thus far in regard to its relevance, coherence, effectiveness, impact, efficiency and sustainability, gender equity, transversal good governance and conflict sensitivity and ways of bringing about positive change at the normative, institutional and operational levels in a systemic way?
2. What are the recommendations for future engagements/subsequent phases looking at the programme focus, design and partnerships?
3. In what ways can the approaches applied by the project be expanded to the arid and semi-arid lands of the Horn of Africa region?
4. What aspects of the programme could be replicated and/or integrated, either as best practise or for consolidation with other ongoing programmes of the Swiss food security portfolio?

6. Suggested Methodology

The evaluation to be conducted in close collaboration with relevant stakeholders (Swiss Cooperation Office in Nairobi, FAO in Somalia, relevant line Ministries and other government agencies). SDC will directly manage and oversee the evaluation process.

The evaluation methodology will be guided by the objectives and the scope of the evaluation while exhaustively addressing the key evaluation questions. The evaluation is expected to provide quantitative and qualitative data through:

• Desk study/review of all relevant project documentation including e.g. programme documents, work-plans, programme reports (including progress, annual, baseline reports, gender assessment), minutes of programme steering and grant committees, among others.

• In depth interviews[3] to gather primary data from key stakeholders using a structured methodology.

• Focu Group discussions with programme stakeholders including pastoralist women and men.

• Observations (field visits using checklist to be developed by the consultants in collaboration with SDC).

A detailed method of evaluation should be outlined in the evaluation inception report before any field missions are carried out.

7. Deliverables

The following products are expected from the evaluation:

1. An adjusted evaluation approach paper and a work plan (inception report) to be developed by the evaluation team, approved by SDC and a briefing session held before the start of the evaluation mission. The inception report should describe key stages of the review process, provide timeline and establish clear roles and responsibilities in the review process.
2. An evaluation report (max. 25 pages, excl. the executive summary and annexes) with an analytical review and recommendation part. The report should take the guiding questions and respond to the evaluation guidelines.
3. Presentation of the outcome of the evaluation before the final reports are produced.
4. Presentation to programme key partners (to be agreed upon).

8. Review Team

The review team should include an expert with international experience. The rational and the strength of the composition of the evaluation team should be clarified in the application proposal. The lead consultant is expected to have robust skills in evaluation methodologies and professional experience in conducting project and process evaluations, including in complex settings with a multitude of stakeholders and in fragile contexts. Additionally, the lead expert needs theoretical and practical knowledge of food security, livestock sector development, livelihoods and resilience, good governance, gender and conflict sensitivity thematic topics. He/ she should have expertise in systemic development approaches. Proven experience in fragile, conflict-affected drylands contexts in the Horn of Africa region is an advantage. Strong analytical capacity combined with ability to synthesize/communicate findings and recommendations and report-writing skills are required.

9. Time Frame, Budget and Logistics

The maximum time frame for this evaluation by the consultant(s) is 30 working days. The allocation of working days to inception, desk review, field visits, etc. will be agreed on the basis of the inception report.

The study is scheduled to take place between July and September 2022 along the following deliverables:

Timeframe (2022)

Deliverables

15 – 26th June, 2022

• Announcement (with the deadline submission 26th June 2022)

Until 8th July 2022

• Recruitment of consultants and Contractual processes.

Until 22th July 2022

• Conduct desk review.
• Submit inception report (in English) with detailed work-plan with timeframe outlining the activities/steps to be undertaken during the consultancy.
• Develop the evaluation methodology and tools for field work, including key informant interviews, focus group discussion etc. and identify people to be interviewed.
• Exchange and briefing session with SDC

Until 19th August 2022

• Carry out programme evaluation at the field level (including exchange with partners and relevant stakeholders)

Until 2nd September 2022

• Elaboration and delivery of draft evaluation report in English to SDC for review and feedback.

Until 16th September 2022

• Presentation/workshop to share the results of the evaluation and discuss on how the assessment can be translated to concrete actions/next steps.
• SDC to provide feedback on the draft report

23rd September 2022

• Consultant to deliver the final evaluation report to SDC Integrating all comments and feedbacks.

10. Award criteria

Of the valid offers submitted, the contract will be awarded to the most highly rated bid. Offers will be assessed according to the following award criteria and weighting:

Award criteria

Weighting

• Academic qualification – a minimum of Master’s Degree in the relevant field with 10 years of experience. Proven knowledge and experience in food security, livestock sector development, livelihoods and resilience thematic topics (40%), Proven knowledge and experience in good governance, conflict sensitivity and gender approaches (40%), Proven knowledge and experience in systemic development (20%)- 30%
• Experience in developing and implementing quantitative and qualitative research protocols, including research methods, sampling, data analysis, and experience with reviews and assessments, particularly in Horn of Africa context-40%
• Financial offer/Cost of consultancy service offered-20%
• Proven knowledge of the social and political context of the Horn of Africa, sensitivity for political economy-10%

How to apply

11. Application

Consultants invited to apply will provide a full application pack, and send it to the following e-mail address: [email protected] and specifically headed “SDC SIRA Programme Evaluation”:

The technical proposal in English (10 to 15 pages maximum) should include:

• Understanding of the Terms of Reference
• Technical approach developed and detailed methodology with approach and workplan.
• Composition of the evaluation team with clear division of responsibilities between its members, CVs submitted with indication of the availability of consultants.
• Provisional timetable for the evaluation.
• A detailed budget proposal/financial offer.
• References from two similar previous assignments.
• A sworn statement as to the absence of any conflict of interest.

The financial proposal should include:

• Total budget including all taxes (WHT, VAT) and incorporating a budget break-down to;
• Include daily fees rate per consultant,
• Living expenses,
• Travel, etc.
• The winning bidder shall be required to submit the following administrative information to be verified and validated before the contract is awarded;

Corporate person/company

– Certificate of registration/Incorporation of the company.

– Latest Tax Compliance Certificate of the company.

– Copies of academic certificates of proposed consultant(s).

For natural persons/individual/freelancers

– Latest Tax Compliance Certificate.

– Copies of academic certificates of the consultant(s).

Compliance with local law on taxation;

1. Withholding tax (WHT)

Taxes, charges and social security contributions will be applicable in conformity with local legislation. The Embassy is obligated to deduct and submit Withholding Tax (WHT) to the Kenyan Revenue Authority (KRA). WHT is a percentage of the earnings and will vary depending on the country of origin of the consultant.

1. For non-residents, the Embassy will respect existing “double taxation agreements (DTA)”. The maximum WHT rate of 20% (subject to change depending on legislation) for non-resident, will be deducted.
2. For residents the maximum WHT is 5% for this type of consultancy.

More information on the applicable tax rates can be found here: https://www.kra.go.ke/en/helping-tax-payers/faqs/more-about-withholding-tax.

1. Value Added Tax (VAT)

The Embassy is exempt from VAT. The service if subject to VAT according to the local law, the resident corporate person will within 30 days reimburse the VAT amount to the Embassy as soon as the exemption certificate is availed by the Embassy.

Legal status of the consultant in the country of engagement*:* The consultant must have valid a work permit or equivalent authorizations before travelling, that allows such a person to live and work in the respective country.

Final date for submission of applications: Sunday, 26th June 2022, 17.00 hrs local time, Nairobi.

[1] Somalia Livestock Sector Development Strategy (2019 – 2021).

[2] Switzerland supported in Kenya: Kenya-RAPID ( in five of the 10 FCDC Counties) and IGAD-FAO; in Ethiopia: SDR-SNR, NRM-Borena, and projects implemented by the SDC Global Programme Foods security; in Somalia: Somalia Resilience Programme (SomRep), and Somalia Information and Resilience Building Action (SIRA)

[3] The field visits and face-to-face interviews will be dependent on how the Covid-19 pandemic situation evolves.