Call for Proposal: Evaluation of the HIV/TB Schools program, Eshowe

The Stockholm Evaluation Unit (SEU), based in Sweden, is one of three MSF units tasked to manage and guide evaluations of MSF’s operational projects. For more information see: evaluation.msf.org.

Name of evaluation: Evaluation of the HIV/TB Schools program, Eshowe

Starting date: asap

Terms of reference: https://evaluation.msf.org/call-proposal-evaluation-hivtb-schools-program-eshowe-south-africa

Duration: Final report to be submitted by latest September 2022

Requirements: Interested applicants should submit:

1. A proposal describing how to carry out this evaluation (including budget in a separate file),
2. a CV, and
3. a written sample from previous work

BACKGROUND: MSF, in partnership with the KwaZulu-Natal Department of Health (DoH) in South Africa, supports an HIV/TB project – Bending the Curves – in the Mbongolwane and Eshowe areas (King Cetshwayo District). The project was introduced in 2011 and the overall objectives of the HIV project are to reduce the HIV and TB incidence, reduce HIV and TB-related morbidity and mortality, and to help the DoH achieve the WHO 90-90-90 targets in the project areas of the rural setting Mbongolwane and the urban setting Eshowe. One component of the HIV/TB project is a school program targeting high school learners, which is the focus of the evaluand. MSF-OCB and the DoH in partnership with the Department of Education (DoE) collaborated together on the school program which was implemented between 2012 and 2021. The school program aimed to empower high school learners to make informed decisions when it comes to sexual reproductive health, and to reduce new HIV and TB infections. The school program component’s main objective has been adapted over the years, transitioning from a focus on HIV/TB to TB. The main objective of the schools’ program component was to raise awareness and improve case identification of HIV and TB/TB through implementation of HIV and TB/TB educational sessions in high schools. The activities of this component include health education sessions, HIV counselling and testing, TB screening, STI screening, pregnancy testing, education sessions on male circumcision, youth health dialogues, a youth health camp, and trainings for Life Educators and Learner Supporter Agents.

PURPOSE AND INTENDED USE PURPOSE The purpose of the evaluation is to assess the efficiency, effectiveness, relevance, appropriateness, impact and connectedness of the now closed schools’ program. INTENDED USE The primary intended use of the evaluation is to generate knowledge that can be used to inform discussions between MSF and key external stakeholders, notably the Ministry of Health and Department of Education, in order to reflect on the potential replicability and/or continuity of the program in the future by a non-MSF party. A further intended use is for the evaluation to generate organizational learning through the lessons learned from this component of the HIV/TB project in Eshowe.

EVALUATION CRITERIA For this evaluation, we are looking for evaluator(s) who can deliver with a focus on the DAC criteria. We encourage combining DAC criteria with other criteria specific to educational programming, where deemed suitable, to adapt, improve and complement the below evaluation questions.

EVALUATION QUESTIONS The following questions have been formulated using DAC criteria and are to be used as an indicative reference point only.

EQ1. How was the school program component of the HIV project relevant in meeting the needs of the population, organization and expectations of various stakeholders? EQ2. How was the school program component of the HIV project appropriate and tailored to the context? EQ3. How effective was the school program component of the HIV project in meeting the project objectives, results and outcomes looking at a wide range of stakeholders, including the students and their communities? EQ4. What is the impact (intended and unintended) of the HIV and TB school programs on the students’ behaviour and attitudes? EQ5. How efficiently were resources (human and financial) utilized in the project planning, implementation and follow-up of the HIV and TB school programs? EQ6. How did the schools program ensure interconnectedness with key stakeholders during design, implementation and closure of the schools program for the future continuation/alternatively replicability of all or parts of the schools program by other key stakeholders? What are key lessons learned for all parties involved?

EXPECTED DELIVERABLES

1. Inception Report As per SEU standards, after conducting initial document review and preliminary interviews. It will include a detailed evaluation proposal, including methodology.
2. Draft Evaluation Report As per SEU standards. It will answer to the evaluation questions and will include conclusions, lessons learned and recommendations.
3. Working Session With the attendance of commissioner and consultation group members. As part of the report writing process, the evaluator will present the findings, collect attendances´ feedbacks and will facilitate discussion on lessons learned.
4. Final Evaluation Report After addressing feedbacks received during the working session and written inputs.
5. Other dissemination deliverables to be defined in a separate dissemination plan.

TOOLS AND METHODOLOGY PROPOSED In addition to the initial evaluation proposal submitted as a part of the application (see requirement chapter), a detailed evaluation protocol should be prepared by the evaluators during the inception phase. It will include a logic model developed by the evaluation team, a detailed explanation of proposed methods and its’ justification based on validated theory/ies. It will be reviewed and validated as a part of the inception phase in coordination with the SEU.

RECOMMENDED DOCUMENTATION ▪ Project documents (project proposals, logistical frameworks, situational reports, annual reports, field visit reports) ▪ Analysis of routinely collected monitoring data (including baseline and endline data) ▪ Documentation regarding the ongoing operational research initiatives in the project ▪ National and regional documentation ▪ External literature and documentation of similar experiences

PRACTICAL IMPLEMENTATION OF THE EVALUATION

Number of evaluators: 1 +

Timing of the evaluation: July to October 2022

PROFILE/REQUIREMENTS FOR EVALUATOR(S) ▪ Requirements: o Proven competencies in carrying out evaluations within the thematic areas of learning and education. o Excellent language skills in English and Isizulu. ▪ Assets: o Experience in HIV/TB medical programming and specifically capacity-building and training in this thematic area a strong asset. o Experience in South Africa, preferably in HIV/TB education a strong asset. o MSF experience and/or understanding.