BSI Evaluation Framework Consultant

Terms of Reference

Development of an evaluation framework for demonstrating the outputs, outcomes and impact of the Building Social Impact Initiative on children and workers in construction camps

Organization Background

Established in 2002, BDF is a not-for-profit, non-governmental organization with the mission to provide access to essential education, health, and child protection services to disadvantaged children and families living in construction site camps. Through field projects and advocacy activities, BDF aims to improve access to services for the estimated 60,000 children connected to the construction sector in Thailand. BDF’s activities reach over 1,600 children and 10,000 workers in the construction industry per year.

Project Background

Migrant workers connected to the construction sector in Thailand move around from project to

project regularly with their children and live in construction site camps with slum-like conditions. Due to constant migration, a lack of Thai language skills, and other barriers, their access to essential public services is heavily affected. As a result, many of these children live in unsuitable conditions, are often out of school, and lack access to social protection and healthcare, and social services. There are an estimated 60,000 children currently living in Thai construction site camps.

Intervention: Through its Systemic Impact strategy, Baan Dek Foundation (BDF) advocates for systemic change in the Thai construction sector, encouraging the sector to provide better living conditions for construction workers and their children in camps, and to facilitate their access to public education, health, and social services.

To do this, BDF develops key partnerships with major real estate developers and construction companies and supports them to implement changes in camps with training and a toolkit containing Guidelines and a Self-Assessment Tool. This strategy and the toolkit are based on the BSI Framework for Action, 12 recommendations for companies to implement improvements and access to services in construction site camps, which was developed by BDF and UNICEF Thailand in collaboration with partner companies. These recommendations focus on the four key areas of infrastructure, welfare and services, healthcare and education..

BDF aims to scale the Systemic Impact strategy over the next four years, by 1) ensuring the overall development of the strategy and accessibility of the approach at a national level (marketing, web development, BSI tool development, research), 2) providing workshops and on-the-job training on the BSI Framework and its related tools with construction companies, and 3) coalition building with the construction sector and its investors, government agencies, multilateral organizations, and other duty bearers, specifically to contribute to the development of policy instruments and incentives that support construction sector investment in improved social performance.

Objective of the Consultancy

To scale up the BSI Initiative and offer it as a credible, relevant and effective solution both for private and public sector uptake, BDF is seeking to contract a consultant or consultancy firm to develop two sets of evaluation frameworks

1. An impact evaluation framework which can be used to assess the impacts produced by the BSI Initiative, both positive and negative, intended and unintended. The evaluation framework is envisioned to be a summative impact evaluation to generate evidence of the BSI Initiative in relation to the impact statement as described in the matrix below.
2. A simplified M&E framework for the BSI Initiative throughout programme implementation using a small set of standard indicators to monitor progress on the programme’s outputs and outcome as shown in the matrix below, adn report to donors and external partners. The M&E framework and plan should have 1-2 SMART indicators per outcome and outputs.
3. Development of key indicators and source of verification to confidently measure and report on the total number of direct and indirect beneficiaries reached. This information would be published in the annual report of the Foundation.

Both frameworks shall be based on the standard OECD-DAC criteria of Relevance, Effectiveness, Efficiency, Impact, and Sustainability.

BSI Initiative Impact Matrix

Impact for people

Migrant workers and their children living in construction camps enjoy decent living conditions and effective and equitable access to key public services

Impact for business

Construction companies are better able to procure and retain migrant labor and reduce reputational risk

Outcome

Private and public stakeholder fulfill their mandates towards construction migrant workers and their children according to the the UN Guiding Principles on Business and Human Rights

Output 1

Construction companies apply the BSI Framework and its toolkit in their construction camps

Output 2

Relevant Thai ministries and agencies create an enabling environment for the integration of the UNGPs in the construction sector and its value chain

Output 3

Relevant service providers and construction companies collaborate for the facilitation of access to services for migrant workers and their children

Output 4

Migrant workers and their children’s voices are incorporated into the BSI Initiative

Deliverables

Inception workshop 1 Working Day, Deadline on 03/10/2022

1. Inception report. After reviewing BSI’s core programme documents, the consultant will participate in an inception workshop with relevant BDF staff to review the current BSI Initiative impact matrix and agree on the impact statements, outcome and outputs. Following the workshop the consultant would submit an inception report (5 to 10 pages max.) resuming their understanding of the project and the methodology, steps and way forward to conclude the assignment. – 3 Working Days, Deadline on 09/10/2022
2. Develop an initial draft of the impact evaluation framework of no more than 10 pages – 5 Working Days, Deadline on 23/10/2022
3. Produce a final draft of the of the impact evaluation framework after no more than two rounds of feedback from BDF – 3 Working Days, Deadline on 02/11/2022
4. Develop an initial draft of an M&E framework for general programme monitoring – 2 Working Days, Deadline on 18/10/2022
5. Produce a final draft of the M&E framework after no more than two rounds of feedback from BDF – 2 Working Days, Deadline on 26/10/2022
6. Develop a two-pager detailing criteria and a method for accurately calculating the number of direct and indirect beneficiaries of the BSI Initiative – 1 Working Day, Deadline on 26/10/2022

Total: 17 Working Days

Impact Evaluation Framework – Proposed Structure

• Background of the BSI Initiative (0.5 page)
• Rationale and purpose of the evaluation (.5 page)
• BSI Initiative Impact Matrix and a short description (1 page)
• A set of high-level Key Evaluation Questions (KEQs) to address the quality and relevance of the BSI Framework as a model of intervention
  • Within the proposed KEQs, detailed meso and micro-level questions to answer the KEQs (2 page)
• An overall evaluation rubric to determine the quality of outcomes, evaluation criteria and identification of evidence (2 pages)
• A recommended set of data collection tools including: (4 pages)
  • Type of data collection tool (e.g survey, focus group discussion, in-depth interview, key informant interview, workshop etc)
  • Guidance on developing data collection tools in line with micro-level questions identified for the KEQs
  • Target group (workers, children, camp management staff, company’s senior management, government representatives etc)
  • A timeline for when baseline and endline data should be collected
  • Recommended sampling sizes for each target group for data collection

M&E Framework – Proposed Structure

• Background of the BSI Initiative (1 page)
• BSI Initiative Impact Matrix including indicators and assumptions (1 page)
• Detailed M&E plan including indicators (1-2 per output and outcome), description of indicators, means of verification and target group, data collection tool,frequency of collection, target values , frequency of collection , unit of measurement, responsibility (1 page1)
• A recommended set of data collection tools (2 pages)
  • Type of data collection tool (e.g survey, focus group discussion, in-depth interview, key informant interview, workshop etc)
  • Target group (workers, children, camp management staff, company’s senior management, government representatives etc)
  • A timeline for when baseline and endline data should be collected
  • Recommended sampling sizes for each target group for data collection

Qualifications and Competencies

• University degree in a relevant field such as international development, sociology, political studies, public health etc; postgraduate degree preferred
• Ability to write and speak fluently in English; ability to write and speak in Thai considered a plus
• At least 7 years experience in a monitoring and evaluation role, designing impact evaluation studies and/or designing field research projects
• Significant experience in leading evaluation and/or research projects
• Knowledge and experience relating to international development and or business and human rights is considered an advantage
• Excellent interpersonal skills and ability to work in a diverse and multicultural team
• Experience in managin or evaluating private sector engagement projects is an asset.
• Proactive and creative
• Flexibility and ability to meet tight deadlines

Evaluation Criteria

The prospective consultant’s proposal will be evaluated on the quality of the technical proposal, the consultant’s experience on the subject matter. The financial offer shall not exceed 240,000 THB – all taxes included.

Submission of Proposal:

● CV of the consultant(s)

● List of similar assignment conducted by the consultant, and at least 2 examples submitted along with the application

● A technical proposal of 2-3 pages including the methodology and a work plan (all deliverables need to be submitted before November 14th 2022).

● A financial proposal with a detailed budget breakdown in Thai Baht.