Evaluator (Consultant)

ABA ROLI seeks an Evaluator (Consultant) for its Europe and Eurasia Internet Advocacy Support Program.

I. Background

The Europe and Eurasia Internet Advocacy Support Program (from here on forward referred to as “the Program”) is a 24-month program implemented by the American Bar Association Rule of Law Initiative (ABA ROLI). The Program started in 2020 and will end in September 2022.

The Program’s goal is to build the capacity of local CSOs, expand networks, and support local initiatives in the region to combat laws that restrict Internet Freedom.

II. Evaluation Objectives and Use

The evaluation is commissioned by ABA ROLI’s Europe and Eurasia Division to comply with the commitment set under the Program. The evaluation will provide evidence-based assessments of the Program’s achievements, lessons learned, best practices, and key takeaways for future programming.

Specifically, the evaluator will determine whether there is suggestive evidence that the Program contributed, in whole or in part, to any outcomes that helped achieve the Program’s goal (listed above). Specifically:

The evaluation will respond to the following questions:

a. To what extent has the Program achieved its objectives, specifically,

i. In increasing Internet Freedom advocacy capacity in the four Program Countries among local stakeholders, including in priority areas identified under the Program;

ii. In empowering civil society activists in the four targeted Program Countries to effectively use advocacy tools and network and collaborate across the digital rights defense community?

b. What positive results or benefits could be observed from the accomplishment of objectives and targets set out under the program? Of these changes, what would stakeholders identify as the most significant to their country?

c. What implications would these have to future efforts to support Internet advocacy, or of projects in the same context and conditions?

The Evaluation will utilize performance evaluation to assess the effects of process and substantive aspects of the Program interventions.

The evaluation shall be guided by the American Evaluation Association’s principles for evaluators.

III. Uses and Users of this Evaluation:

This evaluation will be used by ABA ROLI and the donor to better understand program’s achievements, lessons learned and key takeaways for future programming to better inform managers on future program design efforts.

IV. Scope

The evaluation covers activities, outputs and outcomes from 2020-2022 and all outputs and outcomes that were reported on or within the said period.

The evaluation will conduct a Performance Evaluation using document reviews, surveys, and interviews. Documents to be reviewed will cover program progress reports, partner reports, report on IF policy priorities, and local partner outputs completed under the Program. Post-tests and other surveys completed following training activities will as well be sorted and reviewed.

V. Deliverables

1. An Inception report, detailing the data collection methods and tools to be used for the evaluation.

o Depending on the contract start date, the Inception Report is to be submitted to ABA ROLI no later than 1-2 weeks after the start date;

o the Inception Report must include a work plan prepared in consultation with ABA ROLI’s project team. The inception report should include the data collection and analysis methods and the draft tools (which may include, but is not restricted to survey questionnaires, interview and FGD scripts, data collection tables, or policy analysis sheets) to be used for the evaluation.

2. An Evaluation Report in English of not more than 35 pages, including an Executive Summary.

o a draft report to be submitted no later than August 10, 2022

o a Final Evaluation Report in English to be delivered to ABA ROLI no later than August 31, 2022 (in Microsoft Word, Times New Roman font size 12, single-spaced).

o A report/addendum or notes for internal ABA ROLI review to be delivered as part of the Final Evaluation Report to be delivered to ABA ROLI no later than August 31, 2022.

VI. What We Are Looking For:

The consultant should be proficient in conducting mixed research and analysis, with relevant experience in conducting advocacy and policy evaluation. He/she must have:

● At least 7 years of experience undertaking outcome evaluations using mixed research methods, and in applying policy analysis in evaluations

● Required proficiency in speaking, reading, and writing in English. (Not required but preferred proficiency in speaking, reading, and writing in one or more of the following: Russian and Romanian).

● Experience researching and evaluating human rights, civil society strengthening, advocacy workshops/trainings, and Internet Freedom advocacy.

● Proven ability to organize and coordinate evaluations or studies in the field, and with a group of program implementers in various locations

● Experience working on evaluations of programming in Eastern European countries

● Proficiency in the use of Zoom and other secure online meeting platforms to conduct and transcribe Evaluation key informant interviews (no travel to the field foreseen under this engagement)

● Proficiency in the use of MS Office and other applications for online surveys and data analysis; and

● Demonstrate abilities and experience in managing and mobilizing quantitative and qualitative data collection and analysis.