Consultancy for Integrated Capacity for Recovery and Early Action in Emergencies for Drought Affected Communities in ASAL Counties (I-CREATE)

Terms of Reference

1. Background and context

Integrated Capacity for Recovery and Early Action in Emergencies for Drought Affected Communities in ASAL Counties (I-CREATE) is a 24 months project funded by the USAID’s Bureau for Humanitarian Assistance (BHA) that runs between 1st July, 2020 and 30th June 2022 split into two phases of 12 months each in Marsabit, Turkana, Baringo, Samburu and West Pokot Counties. The project main goal was to improve capacities and systems of communities and institutions to cope with and respond to the effects of recurrent shocks in the five target ASAL Counties in Kenya by reduced coping capacities and increased vulnerabilities of the target population in the five Counties through an integrated humanitarian, recovery and disaster risk reduction interventions.

To achieve this, the implementing partners propose multi-sectoral interventions in four of the USAID’s Bureau for Humanitarian Assistance (BHA) sectors and eight sub sectors with each of the five target Counties covered by at least five of these sub-sectors depending on their context specific needs. The interventions were categorized into lifesaving, drought recovery and disaster risk reduction delivered over a 24 months period split in two phases of 12 months to realize the intended results.

The interventions were delivered through close collaboration and partnership with County government structures and processes to foster sustainability beyond the project period. This was achieved through undertaking annual joint work plan development with the relevant County government departments of health, agriculture, livestock, water and natural resource management. The implementing partners also worked closely with communities through transformative organized community structures including community conversations, community managed disaster risk reduction, community health strategy and producer groups to deliver community level interventions.

The proposed interventions with county government institutions included strengthening both public and private sector animal health service delivery, technical extension service provision for crop and livestock production, management of acute malnutrition through increased health and nutrition service delivery, water supply services both for human and livestock consumption, and strengthened institutional preparedness through county integrated needs analysis tracking and contingency planning. At community level, the implementing partners facilitated communities to participate and influence county government budgeting and planning processes, undertake disaster risk reduction planning and financing at community level as well as increase access to basic service provision.

Programme Goal: To improve capacities and systems of communities and institutions to cope and respond to the effects of recurrent shocks in the five target ASAL Counties in Kenya

Programme Results

Sector 1: Agriculture and food security

Sub-Sector 1.1: Livestock:

Indicator 1: Number of people benefitting from livestock activities

Data Collection Method: Secondary data sources from Program reports
Data Collection Source: Sub-county PDS Reports, Treatment and Vaccination Reports, Extension Service Reports, E-Voucher beneficiary Reports

Indicator 2: Number of animals benefiting from livestock activities

Data Collection Method: Secondary data sources from Program reports
Data Collection Source: PDS Reports, Treatment and Vaccination Reports, E-Voucher beneficiary Reports

Indicators 3: Number of animals owned per individual.

Data Collection Method: Baseline and end line survey data
Data Collection Source: Baseline and end line survey reports

Indicator 4: Number of people trained in livestock

Data Collection Method: Training reports and participants list
Data Collection Source: PE/PDS, BDS, Extension Services training reports and training participants list

Indicator 5: Percentage of households with adequate food consumption score

Data Collection Method: Baseline and end line cross sectional household survey
Data Collection Source: Household survey

Sub-Sector 1.2: Improving Agricultural Production/Food Security:

Indicator 1: Number of months of household food self-sufficiency as a result of improved agricultural production programming

Data Collection Method: Baseline and end line cross sectional household survey
Data Collection Source: Household Survey

Indicator 2: Number of people directly benefiting from improving agricultural production and/or food security activities

Data Collection Method: Nutrition sensitive agriculture beneficiary lists
Data Collection Source: Beneficiary lists, voucher distribution lists

Indicator 3: Number of hectares under improved agricultural methods

Data Collection Method: Estimates from extension officer reports, estimates from baseline and end line survey
Data Collection Source: Extension officer’s reports, baseline and end line survey reports

Indicator 4: Total USD value of vouchers redeemed by beneficiaries

Data Collection Method: Voucher disbursement financial statements
Data Collection Source: Quarterly financial reports

Indicator 5: Percentage of targeted households with access to sufficient seed to plant

Data Collection Method: Nutrition sensitive agriculture beneficiary lists
Data Collection Source: Beneficiary lists, voucher distribution lists

Sector 2: Nutrition

Sub-Sector 2.1: Infant and Young Child Feeding in Emergencies:

I**ndicator 1**: Proportion of infants 0-5 months of age who are fed exclusively with breast milk.

Data Collection Method: KAP survey administered to a representative sample of the population served by the program
Data Collection source: KAP Survey
Survey data of mothers and caregivers of infants less than 6 months of age at the time of the intervention

Indicator 2: Proportion of children 6-23 months of age who receive foods from 4 or more food groups

Data Collection Method: KAP survey administered to a representative sample of the population served by the program
Data Collection Source: KAP survey data of mothers and caregivers of children 6-23 months

Indicator 3: Number of people receiving behavior change interventions to improve infant and young child feeding practices

Data Collection Method: Routine monitoring. Tally participation from sign in sheets from trainings, meetings and events.
Data Collection Source: Activity logs and records, meeting, training and activity sign-in sheets

Indicator 4: Number of people receiving micronutrient supplementation (Vitamin A)

Data Collection Method: Compile data from supported health facilities and nutrition centers.
Data Collection Source: DHIS,
Patient Registers

Indicator 5 : Number of CBRAs trained to promote exclusive breast feeding

Data Collection Method: Compile data from training reports
Data Collection Source: Training reports

Indicator 6: Proportion of households in North Horr Sub County receiving at least 1 household visit per month from CHV supported by USAID/BHA funding
Data Collection Method: Compile data from supported health facilities through the CHAs report
Data Collection Source: DHIS and CHAs Reports

Indicator 7: Proportion of children under-5 in targeted communities screened for malnutrition on monthly basis

Data Collection Method: Compile data from supported health facilities through the CHAs report
Data Collection Source: DHIS and CHAs reports

Sub-Sector 2.2: Management of Acute Malnutrition:

Indicator 1: Number of health care staff trained in the prevention and management of acute malnutrition

Data Collection Method: Compile data from training rosters and records.
Data Collection Source: Training reports, attendance lists

Indicator 2: Number of supported sites managing acute malnutrition

Data Collection Method: Registration books, internal record keeping and reporting
Data Collection Source: DHIS
Work plans; Partner records

Indicator 3: Number of people admitted, rates of recovery, default, death, relapse, and average length of stay for people admitted to Management of Acute Malnutrition sites

Data Collection Method: Compile data from supported health facilities and nutrition centers
Data Collection Source: DHIS, CMAM Register

Indicator 4: Number of people screened for malnutrition by community outreach workers

Data Collection Method: Screening database linked to health facilities and outreaches, MUAC tally sheet
Data Collection Source: County Outreaches report
MUAC Tally Sheets

Sector 3: Risk Management Policy and Practice

Sub-sector 3.1: Capacity Building and Training

Indicator 1: Number of people trained in disaster preparedness, risk reduction and management

Data Collection Method PDRA training reports, DRR action plans:
Data Collection Source: Training reports, attendance lists, DRR action plans

Indicator 2: Percentage of people trained who retain skills and knowledge after two months

Data Collection Method: Panel assessment report
Data Collection Source: Panel assessment data two months after PDRA trainings

Indicator 3: Number of county governments contingency and response plans informed by ward level DRR plans

Data Collection Method: Review with county governments departments and NDMA
Data Collection Source: Contingency and response plans

Sub-Sector 3.2: Policy and Planning

Indicator 1: Number of hazard risk reduction plans, strategies, policies, disaster preparedness, and contingency plans developed and in place

Data Collection Method: Review with county governments departments and NDMA
Data Collection Source: Contingency and response plans

Indicator 2: Number of people participating in discussions regarding national risk reduction strategies as a result of the program

Data Collection Method: County seasonal contingency planning attendance records, County contingency plans
Data Collection Source: Attendance Records, Contingency plans

Indicator 3: National and local risk assessment, hazards data and vulnerability information is available within targeted areas (Y/N)

Data Collection Method: Review with county governments departments and NDMA
Data Collection Source: Contingency and response plans

Sector 4: Water, Sanitation, and Hygiene

Sub-Sector 4.1: Hygiene Promotion:

Indicator 1: Number of people receiving direct hygiene promotion (excluding mass media campaigns and without double-counting)

Data Collection Method: Activity reports: county public health officer’s community hygiene promotion sensitization reports, CHV home visit reports
Data Collection Source: Activity reports, attendance lists

Indicator 2: Percent of people targeted by the hygiene promotion program who know at least three (3) of the five (5) critical times to wash hands

Data Collection Method: Barrier analysis, baseline and end line survey, SMART Survey
Data Collection Source: Barrier analysis, baseline and end line reports, SMART survey report

Indicator 3: Percent of households targeted by the hygiene promotion program who store their drinking water safely in clean containers

Data Collection Method: Barrier analysis, baseline and end line survey, SMART Survey
Data Collection Source: Barrier analysis, baseline and end line reports, SMART survey report

Indicator 4: Percent of people targeted by the hygiene promotion program who wash hands in at least three (3) of the five (5) critical times with soap/sand/ash

Data Collection Method: Barrier analysis, baseline and end line survey, SMART Survey
Data Collection Source: Barrier analysis, baseline and end line reports, SMART survey report

Sub Sector 4.2: Water Supply:

Indicator 1: Number of people directly utilizing improved water services provided with BHA funding

Data Collection Method: Pre and post rehabilitation assessment, rapid response team rehabilitation
Data Collection Source: Pre and post rehabilitation assessment reports, rapid response team rehabilitation reports

Indicator 2: Average liters/person/day collected from all sources for drinking, cooking, and hygiene

Data Collection Method: Household Survey
Data Collection Source: Household survey

Indicator 3: Percent of households targeted by WASH program that are collecting all water for drinking, cooking, and hygiene from improved water sources

Data Collection Method: Household survey
Data Collection Source: Baseline and end line report

Indicator 4: Percent of water points developed, repaired, or rehabilitated that are clean and protected from contamination

Data Collection Method: Water quality testing
Data Collection Source: Water quality testing reports

2. Purpose of the evaluation

The purpose of this evaluation is to provide an independent assessment of the projects in order to identify and understand extent to which the projects implemented by Concern Worldwide and ACTED together with the county governments achieved the expected results .It is intended to the program’s relevance and fulfilment of objectives, developmental efficiency, effectiveness, impact and sustainability.

1. Objectives of the Evaluation
2. To determine the extent of achievement of specific objective and sector results
3. To determine how effective the systems (logistics, partnerships and linkages within actions) worked in the implementation of actions
4. To determine how effective were the strategies for implementing the programme
5. To identify relevant lessons learned related to the project operational contexts to inform design and implementation of future programming.
6. Evaluation approach and methodology

The evaluation will use a mixed methods approach integrating both quantitative and qualitative data. The DAC criteria will be used to determine the effectiveness, efficiency, Impact and sustainability of the project. The evaluation team will determine the evaluation criteria, evaluation questions and draw up a detailed evaluation Plan with timelines which will be discussed and agreed with the Concern team leading the process. To measure results the evaluation will conduct and end line survey using the same methodology used in baseline data collection at the start of the project.

The process will need to adopt a methodology that combines both qualitative and quantitative research techniques. The evaluator in liaison with the Concern team will identify and adopt an appropriate methodology for data collection. The adopted evaluation methodology can include:

a) Documents Review
b) Cross-sectional survey design/household interviews with beneficiaries
c) Key Informant Interviews (KII)
d) Field Observations
e) Focus group discussions (FGD)
f) Meetings

The evaluation will engage all relevant stakeholders, including the Departments for Environment, Water and Natural Resources, Department for Agriculture Fisheries and Livestock Development and Department of Health.

3. Evaluation Questions:

The evaluation questions will include the following;

i. Effectiveness: To which degree did the activities meet the objectives and results set out in the Program (as outlined in the logical framework)?
ii. Matching needs: Did the Program /activities meet relevant needs of the beneficiaries?
iii. Relevance: Was the Program designed in a way that is relevant to reach its goals?
iv. Efficiency: Was the Program run in an efficient way?
v. Sustainability: Are the results achieved so far sustainable?
vi. Internal coherence: Were the result indicators and their means of verification adequate?
vii. Gender mainstreaming: To which extent did the Program succeed in including a gender perspective?
viii. Impact and spill over: Were there any unforeseen positive/negative effects of the activities?
ix. Lessons learned and provide recommendations.

4. Key Tasks of the Evaluation:

• For the objectives of the consultancy to be achieved, as a minimum, the following key tasks are to be performed by the consultant:
• Undertake desk review of the relevant program documents including the Program Proposal, Project detailed Implementation Plans, Project Reports, Concern strategy documents and any other relevant documents and should take into consideration USAID/BHA evaluation guidelines and standards.
• Develop an inception report detailing the process and methodologies to be employed to achieve the objective of this consultancy as stated above. It should include the detailed data collection and sampling design, analysis and output framework and timetable. Present to Concern for review and further inputs before proceeding with the development of data collection instruments.
• Design, develop, critique (with Concern team) and refine data collection tools including translation to the local languages, where appropriate.
• Prepare training materials in consultation with Concern team, and conduct the survey training covering all details in the survey tool.
• Conduct a comprehensive field based program evaluation [using both quantitative and qualitative data collection methods] and collect data, based on the criteria and objectives of the evaluation.
• Carry out data analysis of the quantitative and qualitative data, and write up the final assessment report.
• Present the draft report to Concern team for review before producing a second draft.
• Submit a final end of program evaluation report to Concern as stated in these Terms of Reference.

5. Outputs and Deliverables

• An inception report detailing how the evaluation criteria questions, the evaluation methodology, work plan/schedule, budget and draft data collection tools.
• Validation Workshop of evaluation findings with Concern Worldwide after generating the draft evaluation report.
• The evaluator shall share a short presentation of outcome findings, insights into contribution pathways and feasible recommendations with the project team at least 3 days before the validation workshop.
• Final Evaluation report of no more than 20 pages (excluding executive summary, references & annexes).
• Most Significant Change Stories: At minimum of 3 – one-page Most Significant Change stories must be part of the annexes.
• Other documents/materials such as raw data files, quantitative data files, transcripts of FGDs, photographs taken, outcomes matrix, at least one change story per ward.

6. Timeline
The consultancy is expected to commence in May 2022 and the activity is projected to take a maximum of 30 days. This duration is inclusive of the time required for all work including document review, field visits, debriefing, and final submission of the evaluation report.

7. Remuneration

• Concern will pay the consultant on a daily rate
• NB: – The payment is subject to withholding tax and other requirements under the Laws of Kenya or applicable tax obligations as per the Consultant researcher’s country of residence.
• Provide your rate per day, clearly indicating if VAT is applicable or not
• Provide a detailed work plan**8. Working Conditions**

The Senior Manager MEAL and Survey and Surveillance Manager in collaboration with the Livelihood Senior Program Manager will manage the end line evaluation consultancy. The consultant will also work closely with the MEL officer(s), Manager Livelihoods, Senior Manager Health and Nutrition and County Program Manager. In addition, the consultant will work closely with Departments for Environment, Water and Natural Resources, Department for Agriculture Fisheries and Livestock Development and Department of Health of Marsabit, Turkana, Baringo, Samburu and West Pokot Counties. The M&E officers will provide full support and coordinate in the data collection, stakeholder engagement in the field

9. Qualifications

The consultant(s) applying for the end term evaluation must meet the following minimum qualification criteria:

• Minimum experience of 5 years conducting evaluations along BHA/USAID OECD evaluation criteria, ideally leading an evaluation team and experience of designing evaluation methodology / tools, data analysis;
• At least 5 years’ experience using Value-for-Money tools and methodologies;
• At least 10 years’ experience of working in development contexts in Arid and Semi-Arid (ASAL) areas in Kenya;
• In-depth knowledge and at least 10 years’ experience of using quantitative and qualitative research methods;
• Individuals or firms with a background and at least 10 years’ experience in research methods, Livelihoods/ social work or development studies;

10. Supporting documentation required

a. Certificate of Incorporation (firms) or National ID card (individual)
b. Valid Tax Compliance Certificate
c. PIN Certificate
d. Company / Consultant’s Profile
e. CVs of key staff
f. Certificate/reference information of previous undertakings of similar contracts with NGOs/UN agencies
g. Safeguarding Policy, Code of Conduct etc. or what are the necessary provisions have you put in place to keep everyone safe in the course of your engagement.
h. Attach copy of Certificate of Good Conduct or proof that you have applied for the same
i. Confirm the gender ratio for the team that you will be engaging in this exercise
j. A detailed work plan with milestones

Safeguarding at Concern: Code of Conduct and its Associated Policies

Concern has an organisational Code of Conduct (CCoC) with three Associated Policies; the Programme Participant Protection Policy (P4), the Child Safeguarding Policy and the Anti-Trafficking in Persons Policy. These have been developed to ensure the maximum protection of programme participants from exploitation, and to clarify the responsibilities of Concern staff, consultants, visitors to the programme and partner organisation, and the standards of behaviour expected of them. In this context, staff have a responsibility to the organisation to strive for, and maintain, the highest standards in the day-to-day conduct in their workplace in accordance with Concern’s core values and mission. Any candidate offered a consultancy opportunity with Concern Worldwide will be expected to sign the Concern Code of Conduct and Associated Policies as an appendix to their consultancy contract. By signing the Concern Code of Conduct, candidates acknowledge that they have understood the content of both the Concern Code of Conduct and the Associated Policies and agree to conduct themselves in accordance with the provisions of these policies. Additionally, Concern is committed to the safeguarding and protection of vulnerable adults and children in our work. We will do everything possible to ensure that only those who are suitable to do consultancy work or volunteer with vulnerable adults and children are recruited by us for such roles. Subsequently, being hired as a consultant with Concern is subject to a range of vetting checks, including criminal background checking.

Concern’ is the trading name of ‘Concern Worldwide’, a company limited by guarantee, registered number 39647; registered charity number CHY 5745, registered in Ireland, registered address is 52-55 Lower Camden Street, Dublin 2, Ireland. Follow Concern online: www.concern.net